2026-03-29 08:35:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-29 08:35:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-29 08:35:06 [auto1.be] INFO: Batch mode enabled: batch 2/2
2026-03-29 08:35:06 [auto1.be] INFO: Starting spider auto1.be
2026-03-29 08:35:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-29 08:35:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-29 08:35:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-29 08:35:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-29 08:35:06 [scrapy.extensions.telnet] INFO: Telnet Password: fd944e9bae11d40a
2026-03-29 08:35:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-29 08:35:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.be/task_26_2026-03-29T08_35_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-29 08:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 08:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 08:35:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-29 08:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-29 08:35:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-29 08:35:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-29 08:35:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-29 08:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-29 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-29 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-29 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-29 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-29 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-29 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-29 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-29 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-29 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-29 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-29 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-29 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-29 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-29 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-29 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-29 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-29 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-29 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-29 08:35:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-29 08:35:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-29 08:35:06 [scrapy.core.engine] INFO: Spider opened
2026-03-29 08:35:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-29 08:35:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2026-03-29 08:35:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-29 08:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-29 08:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-29 08:35:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-29 08:35:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-29 08:35:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-29 08:35:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-29 08:35:16 [auto1.be] INFO: Channel: 24h | Page: 0 | totalHits: 1252 | hits on page: 40
2026-03-29 08:35:16 [auto1.be] INFO: Found listing with ID: SW43031
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW43031%27 HTTP/1.1" 200 None
2026-03-29 08:35:16 [auto1.be] INFO: Scrape type for SW43031: 1
2026-03-29 08:35:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:16 [auto1.be] INFO: Found listing with ID: KH45960
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH45960%27 HTTP/1.1" 200 None
2026-03-29 08:35:16 [auto1.be] INFO: Scrape type for KH45960: 1
2026-03-29 08:35:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:16 [auto1.be] INFO: Found listing with ID: VR58028
2026-03-29 08:35:16 [auto1.be] INFO: Found listing with ID: EX99169
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX99169%27 HTTP/1.1" 200 None
2026-03-29 08:35:16 [auto1.be] INFO: Scrape type for EX99169: 2
2026-03-29 08:35:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2592f4f8-0ed4-52ca-a19a-b8c0e18f9364 with identifier: EX99169
2026-03-29 08:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2592f4f8-0ed4-52ca-a19a-b8c0e18f9364 with scrape type 2
2026-03-29 08:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2592f4f8-0ed4-52ca-a19a-b8c0e18f9364 with scrape type 2
2026-03-29 08:35:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2592f4f8-0ed4-52ca-a19a-b8c0e18f9364, identifier: EX99169
2026-03-29 08:35:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2592f4f8-0ed4-52ca-a19a-b8c0e18f9364 with identifier: EX99169
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-29 08:35:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-29 08:35:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 08:35:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2592f4f8-0ed4-52ca-a19a-b8c0e18f9364 with identifier: EX99169
2026-03-29 08:35:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2592f4f8-0ed4-52ca-a19a-b8c0e18f9364 with identifier: EX99169 to the API
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:44:17Z',
'fuel_type': 'petrol',
'id': '2592f4f8-0ed4-52ca-a19a-b8c0e18f9364',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX99169',
'listing': 'auction',
'make': 'Citroen',
'model': 'Xsara Picasso',
'odometer': 142863,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-05-11',
'seller_name': None,
'title': 'Citroen Xsara Picasso 1.6 Family',
'transmission': 'manual',
'trim': 'Family',
'year': 2003}
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX99169%27 HTTP/1.1" 200 None
2026-03-29 08:35:17 [auto1.be] INFO: Saving data for EX99169: {'auction_closing_time': 1774885457.0, 'created_time': 1774557497.827252, 'last_price_update_time': 1774773317.391877}
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EX99169') HTTP/1.1" 204 0
2026-03-29 08:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:17 [auto1.be] INFO: Found listing with ID: ES45973
2026-03-29 08:35:17 [auto1.be] INFO: Found listing with ID: DL06250
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL06250%27 HTTP/1.1" 200 None
2026-03-29 08:35:17 [auto1.be] INFO: Scrape type for DL06250: 2
2026-03-29 08:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a11059d8-ebbd-53d2-a7cf-8fd4728842c3 with identifier: DL06250
2026-03-29 08:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a11059d8-ebbd-53d2-a7cf-8fd4728842c3 with scrape type 2
2026-03-29 08:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a11059d8-ebbd-53d2-a7cf-8fd4728842c3 with scrape type 2
2026-03-29 08:35:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a11059d8-ebbd-53d2-a7cf-8fd4728842c3, identifier: DL06250
2026-03-29 08:35:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a11059d8-ebbd-53d2-a7cf-8fd4728842c3 with identifier: DL06250
2026-03-29 08:35:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a11059d8-ebbd-53d2-a7cf-8fd4728842c3 with identifier: DL06250
2026-03-29 08:35:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a11059d8-ebbd-53d2-a7cf-8fd4728842c3 with identifier: DL06250 to the API
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 113,
'expiration_date': '2026-03-30T15:08:41Z',
'fuel_type': 'petrol',
'id': 'a11059d8-ebbd-53d2-a7cf-8fd4728842c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL06250',
'listing': 'auction',
'make': 'Renault',
'model': 'Scenic',
'odometer': 176956,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-04-21',
'seller_name': None,
'title': 'Renault Scenic 1.6 Privilege Luxe',
'transmission': 'manual',
'trim': 'Privilege Luxe',
'year': 2005}
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL06250%27 HTTP/1.1" 200 None
2026-03-29 08:35:17 [auto1.be] INFO: Saving data for DL06250: {'auction_closing_time': 1774883321.0, 'created_time': 1773301742.016102, 'last_price_update_time': 1774773317.878696}
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DL06250') HTTP/1.1" 204 0
2026-03-29 08:35:17 [auto1.be] INFO: Found listing with ID: AM39981
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM39981%27 HTTP/1.1" 200 None
2026-03-29 08:35:17 [auto1.be] INFO: Scrape type for AM39981: 1
2026-03-29 08:35:17 [auto1.be] INFO: Found listing with ID: NJ87931
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ87931%27 HTTP/1.1" 200 None
2026-03-29 08:35:17 [auto1.be] INFO: Scrape type for NJ87931: 2
2026-03-29 08:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 097ae4a4-9f02-51f3-b32c-47cda2e42db9 with identifier: NJ87931
2026-03-29 08:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 097ae4a4-9f02-51f3-b32c-47cda2e42db9 with scrape type 2
2026-03-29 08:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 097ae4a4-9f02-51f3-b32c-47cda2e42db9 with scrape type 2
2026-03-29 08:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 097ae4a4-9f02-51f3-b32c-47cda2e42db9, identifier: NJ87931
2026-03-29 08:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 097ae4a4-9f02-51f3-b32c-47cda2e42db9 with identifier: NJ87931
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-29 08:35:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-29 08:35:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 08:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 097ae4a4-9f02-51f3-b32c-47cda2e42db9 with identifier: NJ87931
2026-03-29 08:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 097ae4a4-9f02-51f3-b32c-47cda2e42db9 with identifier: NJ87931 to the API
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:50:22Z',
'fuel_type': 'diesel',
'id': '097ae4a4-9f02-51f3-b32c-47cda2e42db9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ87931',
'listing': 'auction',
'make': 'Citroen',
'model': 'C5',
'odometer': 223350,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-02',
'seller_name': None,
'title': 'Citroen C5 2.0 HDi Business Class',
'transmission': 'manual',
'trim': 'Business Class',
'year': 2012}
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ87931%27 HTTP/1.1" 200 None
2026-03-29 08:35:18 [auto1.be] INFO: Saving data for NJ87931: {'auction_closing_time': 1774885822.0, 'created_time': 1774557471.14209, 'last_price_update_time': 1774773318.517467}
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NJ87931') HTTP/1.1" 204 0
2026-03-29 08:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:18 [auto1.be] INFO: Found listing with ID: RS13546
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS13546%27 HTTP/1.1" 200 None
2026-03-29 08:35:18 [auto1.be] INFO: Scrape type for RS13546: 2
2026-03-29 08:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f00bd44-25e5-558e-8f6a-dee957f3a308 with identifier: RS13546
2026-03-29 08:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f00bd44-25e5-558e-8f6a-dee957f3a308 with scrape type 2
2026-03-29 08:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f00bd44-25e5-558e-8f6a-dee957f3a308 with scrape type 2
2026-03-29 08:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8f00bd44-25e5-558e-8f6a-dee957f3a308, identifier: RS13546
2026-03-29 08:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8f00bd44-25e5-558e-8f6a-dee957f3a308 with identifier: RS13546
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-29 08:35:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 08:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8f00bd44-25e5-558e-8f6a-dee957f3a308 with identifier: RS13546
2026-03-29 08:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8f00bd44-25e5-558e-8f6a-dee957f3a308 with identifier: RS13546 to the API
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:08:24Z',
'fuel_type': 'diesel',
'id': '8f00bd44-25e5-558e-8f6a-dee957f3a308',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS13546',
'listing': 'auction',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 211924,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-11-07',
'seller_name': None,
'title': 'Citroen Berlingo 1.9 Diesel 600 Kasten',
'transmission': 'manual',
'trim': '600 Kasten',
'year': 2001}
2026-03-29 08:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS13546%27 HTTP/1.1" 200 None
2026-03-29 08:35:19 [auto1.be] INFO: Saving data for RS13546: {'auction_closing_time': 1774883304.0, 'created_time': 1774557509.506569, 'last_price_update_time': 1774773319.052655}
2026-03-29 08:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RS13546') HTTP/1.1" 204 0
2026-03-29 08:35:19 [auto1.be] INFO: Found listing with ID: MB50362
2026-03-29 08:35:19 [auto1.be] INFO: Found listing with ID: BR08123
2026-03-29 08:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR08123%27 HTTP/1.1" 200 None
2026-03-29 08:35:19 [auto1.be] INFO: Scrape type for BR08123: 2
2026-03-29 08:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4092a559-8164-57d5-a03e-9567c0410e0c with identifier: BR08123
2026-03-29 08:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4092a559-8164-57d5-a03e-9567c0410e0c with scrape type 2
2026-03-29 08:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4092a559-8164-57d5-a03e-9567c0410e0c with scrape type 2
2026-03-29 08:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4092a559-8164-57d5-a03e-9567c0410e0c, identifier: BR08123
2026-03-29 08:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4092a559-8164-57d5-a03e-9567c0410e0c with identifier: BR08123
2026-03-29 08:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4092a559-8164-57d5-a03e-9567c0410e0c with identifier: BR08123
2026-03-29 08:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4092a559-8164-57d5-a03e-9567c0410e0c with identifier: BR08123 to the API
2026-03-29 08:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:11:25Z',
'fuel_type': 'diesel',
'id': '4092a559-8164-57d5-a03e-9567c0410e0c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR08123',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 148687,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-22',
'seller_name': None,
'title': 'Volkswagen Passat 1.6 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2017}
2026-03-29 08:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR08123%27 HTTP/1.1" 200 None
2026-03-29 08:35:19 [auto1.be] INFO: Saving data for BR08123: {'auction_closing_time': 1774883485.0, 'created_time': 1774471139.3196, 'last_price_update_time': 1774773319.527401}
2026-03-29 08:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BR08123') HTTP/1.1" 204 0
2026-03-29 08:35:19 [auto1.be] INFO: Found listing with ID: MR13936
2026-03-29 08:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR13936%27 HTTP/1.1" 200 None
2026-03-29 08:35:19 [auto1.be] INFO: Scrape type for MR13936: 2
2026-03-29 08:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 554c6eda-25b8-5f5c-b237-5fd019014ed8 with identifier: MR13936
2026-03-29 08:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 554c6eda-25b8-5f5c-b237-5fd019014ed8 with scrape type 2
2026-03-29 08:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 554c6eda-25b8-5f5c-b237-5fd019014ed8 with scrape type 2
2026-03-29 08:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 554c6eda-25b8-5f5c-b237-5fd019014ed8, identifier: MR13936
2026-03-29 08:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 554c6eda-25b8-5f5c-b237-5fd019014ed8 with identifier: MR13936
2026-03-29 08:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 08:35:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-29 08:35:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 08:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 08:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 554c6eda-25b8-5f5c-b237-5fd019014ed8 with identifier: MR13936
2026-03-29 08:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 554c6eda-25b8-5f5c-b237-5fd019014ed8 with identifier: MR13936 to the API
2026-03-29 08:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:57:55Z',
'fuel_type': 'diesel',
'id': '554c6eda-25b8-5f5c-b237-5fd019014ed8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR13936',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 166842,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-04-22',
'seller_name': None,
'title': 'Ford Mondeo 1.8 Turbodiesel CLX',
'transmission': 'manual',
'trim': 'CLX',
'year': 2001}
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR13936%27 HTTP/1.1" 200 None
2026-03-29 08:35:20 [auto1.be] INFO: Saving data for MR13936: {'auction_closing_time': 1774886275.0, 'created_time': 1773693907.204172, 'last_price_update_time': 1774773320.234029}
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MR13936') HTTP/1.1" 204 0
2026-03-29 08:35:20 [auto1.be] INFO: Found listing with ID: VB51630
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB51630%27 HTTP/1.1" 200 None
2026-03-29 08:35:20 [auto1.be] INFO: Scrape type for VB51630: 2
2026-03-29 08:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a778dadb-4594-5ba8-adfe-51f7584663f1 with identifier: VB51630
2026-03-29 08:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a778dadb-4594-5ba8-adfe-51f7584663f1 with scrape type 2
2026-03-29 08:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a778dadb-4594-5ba8-adfe-51f7584663f1 with scrape type 2
2026-03-29 08:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a778dadb-4594-5ba8-adfe-51f7584663f1, identifier: VB51630
2026-03-29 08:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a778dadb-4594-5ba8-adfe-51f7584663f1 with identifier: VB51630
2026-03-29 08:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a778dadb-4594-5ba8-adfe-51f7584663f1 with identifier: VB51630
2026-03-29 08:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a778dadb-4594-5ba8-adfe-51f7584663f1 with identifier: VB51630 to the API
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:56:14Z',
'fuel_type': 'diesel',
'id': 'a778dadb-4594-5ba8-adfe-51f7584663f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB51630',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 324983,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-31',
'seller_name': None,
'title': 'Ford Focus 1.6 TDCi Style+',
'transmission': 'manual',
'trim': 'Style+',
'year': 2010}
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB51630%27 HTTP/1.1" 200 None
2026-03-29 08:35:20 [auto1.be] INFO: Saving data for VB51630: {'auction_closing_time': 1774886174.0, 'created_time': 1774125497.948713, 'last_price_update_time': 1774773320.664718}
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VB51630') HTTP/1.1" 204 0
2026-03-29 08:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:20 [auto1.be] INFO: Found listing with ID: AD75254
2026-03-29 08:35:20 [auto1.be] INFO: Found listing with ID: KM93600
2026-03-29 08:35:20 [auto1.be] INFO: Found listing with ID: JZ74663
2026-03-29 08:35:20 [auto1.be] INFO: Found listing with ID: JW28444
2026-03-29 08:35:20 [auto1.be] INFO: Found listing with ID: ST41989
2026-03-29 08:35:20 [auto1.be] INFO: Found listing with ID: SB58546
2026-03-29 08:35:20 [auto1.be] INFO: Found listing with ID: ZN33988
2026-03-29 08:35:20 [auto1.be] INFO: Found listing with ID: WV98137
2026-03-29 08:35:20 [auto1.be] INFO: Found listing with ID: WM98444
2026-03-29 08:35:20 [auto1.be] INFO: Found listing with ID: YL67549
2026-03-29 08:35:20 [auto1.be] INFO: Found listing with ID: RJ01486
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ01486%27 HTTP/1.1" 200 None
2026-03-29 08:35:20 [auto1.be] INFO: Scrape type for RJ01486: 0
2026-03-29 08:35:20 [auto1.be] INFO: Found listing with ID: WP77155
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP77155%27 HTTP/1.1" 200 None
2026-03-29 08:35:20 [auto1.be] INFO: Scrape type for WP77155: 1
2026-03-29 08:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SW43031/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KH45960/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:20 [auto1.be] INFO: Found listing with ID: CY85383
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY85383%27 HTTP/1.1" 200 None
2026-03-29 08:35:20 [auto1.be] INFO: Scrape type for CY85383: 1
2026-03-29 08:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:20 [auto1.be] INFO: Found listing with ID: MK20841
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK20841%27 HTTP/1.1" 200 None
2026-03-29 08:35:20 [auto1.be] INFO: Scrape type for MK20841: 2
2026-03-29 08:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f00419ab-005d-52a3-a1fe-e32ee02d70cd with identifier: MK20841
2026-03-29 08:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f00419ab-005d-52a3-a1fe-e32ee02d70cd with scrape type 2
2026-03-29 08:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f00419ab-005d-52a3-a1fe-e32ee02d70cd with scrape type 2
2026-03-29 08:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f00419ab-005d-52a3-a1fe-e32ee02d70cd, identifier: MK20841
2026-03-29 08:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f00419ab-005d-52a3-a1fe-e32ee02d70cd with identifier: MK20841
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-29 08:35:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 08:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f00419ab-005d-52a3-a1fe-e32ee02d70cd with identifier: MK20841
2026-03-29 08:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f00419ab-005d-52a3-a1fe-e32ee02d70cd with identifier: MK20841 to the API
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 252,
'expiration_date': '2026-03-30T15:34:55Z',
'fuel_type': 'hybrid',
'id': 'f00419ab-005d-52a3-a1fe-e32ee02d70cd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK20841',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 120199,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-08',
'seller_name': None,
'title': 'BMW 3er 330e Luxury Line',
'transmission': 'automatic',
'trim': 'Luxury Line',
'year': 2021}
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK20841%27 HTTP/1.1" 200 None
2026-03-29 08:35:21 [auto1.be] INFO: Saving data for MK20841: {'auction_closing_time': 1774884895.0, 'created_time': 1773693544.683782, 'last_price_update_time': 1774773321.268299}
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MK20841') HTTP/1.1" 204 0
2026-03-29 08:35:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:21 [auto1.be] INFO: Found listing with ID: NE45749
2026-03-29 08:35:21 [auto1.be] INFO: Found listing with ID: VP73114
2026-03-29 08:35:21 [auto1.be] INFO: Found listing with ID: GB22067
2026-03-29 08:35:21 [auto1.be] INFO: Found listing with ID: XS85102
2026-03-29 08:35:21 [auto1.be] INFO: Found listing with ID: RX06086
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX06086%27 HTTP/1.1" 200 None
2026-03-29 08:35:21 [auto1.be] INFO: Scrape type for RX06086: 1
2026-03-29 08:35:21 [auto1.be] INFO: Channel: 24h | Page: 1 | totalHits: 1252 | hits on page: 40
2026-03-29 08:35:21 [auto1.be] INFO: Found listing with ID: BJ49980
2026-03-29 08:35:21 [auto1.be] INFO: Found listing with ID: PE70540
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE70540%27 HTTP/1.1" 200 None
2026-03-29 08:35:21 [auto1.be] INFO: Scrape type for PE70540: 0
2026-03-29 08:35:21 [auto1.be] INFO: Found listing with ID: ZZ18378
2026-03-29 08:35:21 [auto1.be] INFO: Found listing with ID: GN69495
2026-03-29 08:35:21 [auto1.be] INFO: Found listing with ID: XD29708
2026-03-29 08:35:21 [auto1.be] INFO: Found listing with ID: SK35491
2026-03-29 08:35:21 [auto1.be] INFO: Found listing with ID: KT58942
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT58942%27 HTTP/1.1" 200 None
2026-03-29 08:35:21 [auto1.be] INFO: Scrape type for KT58942: 2
2026-03-29 08:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa136741-a903-582a-8e45-c5ce6c6ac8cf with identifier: KT58942
2026-03-29 08:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa136741-a903-582a-8e45-c5ce6c6ac8cf with scrape type 2
2026-03-29 08:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa136741-a903-582a-8e45-c5ce6c6ac8cf with scrape type 2
2026-03-29 08:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: aa136741-a903-582a-8e45-c5ce6c6ac8cf, identifier: KT58942
2026-03-29 08:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: aa136741-a903-582a-8e45-c5ce6c6ac8cf with identifier: KT58942
2026-03-29 08:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: aa136741-a903-582a-8e45-c5ce6c6ac8cf with identifier: KT58942
2026-03-29 08:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: aa136741-a903-582a-8e45-c5ce6c6ac8cf with identifier: KT58942 to the API
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 340,
'expiration_date': '2026-03-30T15:46:35Z',
'fuel_type': 'petrol',
'id': 'aa136741-a903-582a-8e45-c5ce6c6ac8cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT58942',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 92227,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-26',
'seller_name': None,
'title': 'Audi A6 55 TFSI Mild-Hybrid quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2018}
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT58942%27 HTTP/1.1" 200 None
2026-03-29 08:35:21 [auto1.be] INFO: Saving data for KT58942: {'auction_closing_time': 1774885595.0, 'created_time': 1773693602.362588, 'last_price_update_time': 1774773321.926004}
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KT58942') HTTP/1.1" 204 0
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: SW43031
2026-03-29 08:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: UY87343
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY87343%27 HTTP/1.1" 200 None
2026-03-29 08:35:22 [auto1.be] INFO: Scrape type for UY87343: 1
2026-03-29 08:35:22 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/SW43031/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: KH45960
2026-03-29 08:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AM39981/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: VR58028
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: EX99169
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX99169%27 HTTP/1.1" 200 None
2026-03-29 08:35:22 [auto1.be] INFO: Scrape type for EX99169: 0
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: ES45973
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: DL06250
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL06250%27 HTTP/1.1" 200 None
2026-03-29 08:35:22 [auto1.be] INFO: Scrape type for DL06250: 0
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: AM39981
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: NJ87931
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ87931%27 HTTP/1.1" 200 None
2026-03-29 08:35:22 [auto1.be] INFO: Scrape type for NJ87931: 0
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: RS13546
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS13546%27 HTTP/1.1" 200 None
2026-03-29 08:35:22 [auto1.be] INFO: Scrape type for RS13546: 0
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: MB50362
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: BR08123
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR08123%27 HTTP/1.1" 200 None
2026-03-29 08:35:22 [auto1.be] INFO: Scrape type for BR08123: 0
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: MR13936
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR13936%27 HTTP/1.1" 200 None
2026-03-29 08:35:22 [auto1.be] INFO: Scrape type for MR13936: 0
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: VB51630
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB51630%27 HTTP/1.1" 200 None
2026-03-29 08:35:22 [auto1.be] INFO: Scrape type for VB51630: 0
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: AD75254
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: KM93600
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: JZ74663
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: JW28444
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: ST41989
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: SB58546
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: ZN33988
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: WV98137
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: WM98444
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: YL67549
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: RJ01486
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ01486%27 HTTP/1.1" 200 None
2026-03-29 08:35:22 [auto1.be] INFO: Scrape type for RJ01486: 0
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: WP77155
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: CY85383
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: MK20841
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK20841%27 HTTP/1.1" 200 None
2026-03-29 08:35:22 [auto1.be] INFO: Scrape type for MK20841: 0
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: NE45749
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: VP73114
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: GB22067
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: XS85102
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: RX06086
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: BJ49980
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: PE70540
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE70540%27 HTTP/1.1" 200 None
2026-03-29 08:35:22 [auto1.be] INFO: Scrape type for PE70540: 0
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: ZZ18378
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: GN69495
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: XD29708
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: SK35491
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: KT58942
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT58942%27 HTTP/1.1" 200 None
2026-03-29 08:35:22 [auto1.be] INFO: Scrape type for KT58942: 0
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: UY87343
2026-03-29 08:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WP77155/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CY85383/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UY87343/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KH45960> (referer: https://www.auto1.com/v1/car-details-view/KH45960/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ddc8b27-ee61-5001-ac67-ec82372107e7 with identifier: KH45960
2026-03-29 08:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ddc8b27-ee61-5001-ac67-ec82372107e7 with scrape type 1
2026-03-29 08:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5ddc8b27-ee61-5001-ac67-ec82372107e7
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fbc%252Fdcbc81a4902356b2934ef120a8cd77ca%252Fpa%252FKH45960_884891b6ff9a97aa27ca59bc8470c019.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/bc/dcbc81a4902356b2934ef120a8cd77ca/pa/KH45960_884891b6ff9a97aa27ca59bc8470c019.jpg already downloaded
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fbc%252Fdcbc81a4902356b2934ef120a8cd77ca%252Fpa%252FKH45960_90789387481564fad6240a38e1b0f9e1.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/bc/dcbc81a4902356b2934ef120a8cd77ca/pa/KH45960_90789387481564fad6240a38e1b0f9e1.jpg already downloaded
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fbc%252Fdcbc81a4902356b2934ef120a8cd77ca%252Fpa%252FKH45960_708f096aae59f05be7c2ac0a61225817.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/bc/dcbc81a4902356b2934ef120a8cd77ca/pa/KH45960_708f096aae59f05be7c2ac0a61225817.jpg already downloaded
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fbc%252Fdcbc81a4902356b2934ef120a8cd77ca%252Fpa%252FKH45960_a31efd2533d29f02733a41d2cb19e8d5.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/bc/dcbc81a4902356b2934ef120a8cd77ca/pa/KH45960_a31efd2533d29f02733a41d2cb19e8d5.jpg already downloaded
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fbc%252Fdcbc81a4902356b2934ef120a8cd77ca%252Fpa%252FKH45960_9eed0d485a33cb26b5aa0a814b4b4694.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/bc/dcbc81a4902356b2934ef120a8cd77ca/pa/KH45960_9eed0d485a33cb26b5aa0a814b4b4694.jpg already downloaded
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fbc%252Fdcbc81a4902356b2934ef120a8cd77ca%252Fpa%252FKH45960_930a93b06de9982202911fc2266c9ead.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/bc/dcbc81a4902356b2934ef120a8cd77ca/pa/KH45960_930a93b06de9982202911fc2266c9ead.jpg already downloaded
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fbc%252Fdcbc81a4902356b2934ef120a8cd77ca%252Fpa%252FKH45960_5415ca3fce695ac81a24a99c8f26c77a.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/bc/dcbc81a4902356b2934ef120a8cd77ca/pa/KH45960_5415ca3fce695ac81a24a99c8f26c77a.jpg already downloaded
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fbc%252Fdcbc81a4902356b2934ef120a8cd77ca%252Fpa%252FKH45960_f0f1e3f7f19780654cf672ea8295343d.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/bc/dcbc81a4902356b2934ef120a8cd77ca/pa/KH45960_f0f1e3f7f19780654cf672ea8295343d.jpg already downloaded
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fbc%252Fdcbc81a4902356b2934ef120a8cd77ca%252Fpa%252FKH45960_d3a020062aa008dc5220f0ca07edd3d9.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/bc/dcbc81a4902356b2934ef120a8cd77ca/pa/KH45960_d3a020062aa008dc5220f0ca07edd3d9.jpg already downloaded
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fbc%252Fdcbc81a4902356b2934ef120a8cd77ca%252Fpa%252FKH45960_39973cdfdc2e8e1cfde206c136d66161.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/bc/dcbc81a4902356b2934ef120a8cd77ca/pa/KH45960_39973cdfdc2e8e1cfde206c136d66161.jpg already downloaded
2026-03-29 08:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5ddc8b27-ee61-5001-ac67-ec82372107e7, identifier: KH45960
2026-03-29 08:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5ddc8b27-ee61-5001-ac67-ec82372107e7 with identifier: KH45960
2026-03-29 08:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5ddc8b27-ee61-5001-ac67-ec82372107e7 with identifier: KH45960
2026-03-29 08:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5ddc8b27-ee61-5001-ac67-ec82372107e7 with identifier: KH45960 to the API
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KH45960>
{'auction_title': '',
'c_o_2_emission_value': 164,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:02:53Z',
'fuel_type': 'petrol',
'id': '5ddc8b27-ee61-5001-ac67-ec82372107e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH45960',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Volvo',
'model': 'XC40',
'odometer': 71833,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgdc/bc/dcbc81a4902356b2934ef120a8cd77ca/pa/KH45960_884891b6ff9a97aa27ca59bc8470c019.jpg',
'https://img-pa.auto1.com/imgdc/bc/dcbc81a4902356b2934ef120a8cd77ca/pa/KH45960_90789387481564fad6240a38e1b0f9e1.jpg',
'https://img-pa.auto1.com/imgdc/bc/dcbc81a4902356b2934ef120a8cd77ca/pa/KH45960_708f096aae59f05be7c2ac0a61225817.jpg',
'https://img-pa.auto1.com/imgdc/bc/dcbc81a4902356b2934ef120a8cd77ca/pa/KH45960_a31efd2533d29f02733a41d2cb19e8d5.jpg',
'https://img-pa.auto1.com/imgdc/bc/dcbc81a4902356b2934ef120a8cd77ca/pa/KH45960_9eed0d485a33cb26b5aa0a814b4b4694.jpg',
'https://img-pa.auto1.com/imgdc/bc/dcbc81a4902356b2934ef120a8cd77ca/pa/KH45960_930a93b06de9982202911fc2266c9ead.jpg',
'https://img-pa.auto1.com/imgdc/bc/dcbc81a4902356b2934ef120a8cd77ca/pa/KH45960_5415ca3fce695ac81a24a99c8f26c77a.jpg',
'https://img-pa.auto1.com/imgdc/bc/dcbc81a4902356b2934ef120a8cd77ca/pa/KH45960_f0f1e3f7f19780654cf672ea8295343d.jpg',
'https://img-pa.auto1.com/imgdc/bc/dcbc81a4902356b2934ef120a8cd77ca/pa/KH45960_d3a020062aa008dc5220f0ca07edd3d9.jpg',
'https://img-pa.auto1.com/imgdc/bc/dcbc81a4902356b2934ef120a8cd77ca/pa/KH45960_39973cdfdc2e8e1cfde206c136d66161.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ddc8b27-ee61-5001-ac67-ec82372107e7/5ddc8b27-ee61-5001-ac67-ec82372107e7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 129313,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/bc/dcbc81a4902356b2934ef120a8cd77ca/pa/KH45960_884891b6ff9a97aa27ca59bc8470c019.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ddc8b27-ee61-5001-ac67-ec82372107e7/5ddc8b27-ee61-5001-ac67-ec82372107e7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 134262,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/bc/dcbc81a4902356b2934ef120a8cd77ca/pa/KH45960_90789387481564fad6240a38e1b0f9e1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ddc8b27-ee61-5001-ac67-ec82372107e7/5ddc8b27-ee61-5001-ac67-ec82372107e7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121970,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/bc/dcbc81a4902356b2934ef120a8cd77ca/pa/KH45960_708f096aae59f05be7c2ac0a61225817.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ddc8b27-ee61-5001-ac67-ec82372107e7/5ddc8b27-ee61-5001-ac67-ec82372107e7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90706,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/bc/dcbc81a4902356b2934ef120a8cd77ca/pa/KH45960_a31efd2533d29f02733a41d2cb19e8d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ddc8b27-ee61-5001-ac67-ec82372107e7/5ddc8b27-ee61-5001-ac67-ec82372107e7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114986,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/bc/dcbc81a4902356b2934ef120a8cd77ca/pa/KH45960_9eed0d485a33cb26b5aa0a814b4b4694.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ddc8b27-ee61-5001-ac67-ec82372107e7/5ddc8b27-ee61-5001-ac67-ec82372107e7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 132567,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/bc/dcbc81a4902356b2934ef120a8cd77ca/pa/KH45960_930a93b06de9982202911fc2266c9ead.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ddc8b27-ee61-5001-ac67-ec82372107e7/5ddc8b27-ee61-5001-ac67-ec82372107e7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102559,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/bc/dcbc81a4902356b2934ef120a8cd77ca/pa/KH45960_5415ca3fce695ac81a24a99c8f26c77a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ddc8b27-ee61-5001-ac67-ec82372107e7/5ddc8b27-ee61-5001-ac67-ec82372107e7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122321,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/bc/dcbc81a4902356b2934ef120a8cd77ca/pa/KH45960_f0f1e3f7f19780654cf672ea8295343d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ddc8b27-ee61-5001-ac67-ec82372107e7/5ddc8b27-ee61-5001-ac67-ec82372107e7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119214,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/bc/dcbc81a4902356b2934ef120a8cd77ca/pa/KH45960_d3a020062aa008dc5220f0ca07edd3d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ddc8b27-ee61-5001-ac67-ec82372107e7/5ddc8b27-ee61-5001-ac67-ec82372107e7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116727,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/bc/dcbc81a4902356b2934ef120a8cd77ca/pa/KH45960_39973cdfdc2e8e1cfde206c136d66161.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-02-15',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC40 1.5 T3 Momentum Core 2WD',
'transmission': 'automatic',
'trim': 'Momentum Core 2WD',
'year': 2022}
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH45960%27 HTTP/1.1" 200 None
2026-03-29 08:35:23 [auto1.be] INFO: Saving data for KH45960: {'created_time': 1774773323.800614, 'last_price_update_time': 1774773323.800625, 'auction_closing_time': 1774882973.0}
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KH45960') HTTP/1.1" 204 0
2026-03-29 08:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RX06086/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SW43031> (referer: https://www.auto1.com/v1/car-details-view/SW43031/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AM39981> (referer: https://www.auto1.com/v1/car-details-view/AM39981/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:24 [auto1.be] INFO: Channel: 24h | Page: 2 | totalHits: 1252 | hits on page: 40
2026-03-29 08:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2231bb70-71ba-582f-8672-6424b8dc86f1 with identifier: SW43031
2026-03-29 08:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2231bb70-71ba-582f-8672-6424b8dc86f1 with scrape type 1
2026-03-29 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2231bb70-71ba-582f-8672-6424b8dc86f1
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F15%252Fbb15e563600c8a7e242d42be8cc58107%252Fpa%252FSW43031_d12652331f28389bd938fcf33a57a9b0.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/15/bb15e563600c8a7e242d42be8cc58107/pa/SW43031_d12652331f28389bd938fcf33a57a9b0.jpg already downloaded
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F15%252Fbb15e563600c8a7e242d42be8cc58107%252Fpa%252FSW43031_3fdebc7140cc1234af0125e774e534ae.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/15/bb15e563600c8a7e242d42be8cc58107/pa/SW43031_3fdebc7140cc1234af0125e774e534ae.jpg already downloaded
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F15%252Fbb15e563600c8a7e242d42be8cc58107%252Fpa%252FSW43031_6d12691186a25bd864951ff8e7a9cd54.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/15/bb15e563600c8a7e242d42be8cc58107/pa/SW43031_6d12691186a25bd864951ff8e7a9cd54.jpg already downloaded
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F15%252Fbb15e563600c8a7e242d42be8cc58107%252Fpa%252FSW43031_f556bcb6aafc719040d26a48cd19c097.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/15/bb15e563600c8a7e242d42be8cc58107/pa/SW43031_f556bcb6aafc719040d26a48cd19c097.jpg already downloaded
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F15%252Fbb15e563600c8a7e242d42be8cc58107%252Fpa%252FSW43031_ac0658b298be95423ecb7d489156a064.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/15/bb15e563600c8a7e242d42be8cc58107/pa/SW43031_ac0658b298be95423ecb7d489156a064.jpg already downloaded
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F15%252Fbb15e563600c8a7e242d42be8cc58107%252Fpa%252FSW43031_496f8f44c566793287ebccbf38f3ea04.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/15/bb15e563600c8a7e242d42be8cc58107/pa/SW43031_496f8f44c566793287ebccbf38f3ea04.jpg already downloaded
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F15%252Fbb15e563600c8a7e242d42be8cc58107%252Fpa%252FSW43031_ba17dfb815c443ddb90d11a8da2644a7.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/15/bb15e563600c8a7e242d42be8cc58107/pa/SW43031_ba17dfb815c443ddb90d11a8da2644a7.jpg already downloaded
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F15%252Fbb15e563600c8a7e242d42be8cc58107%252Fpa%252FSW43031_5b003530617430e21039b9163b2fbae6.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/15/bb15e563600c8a7e242d42be8cc58107/pa/SW43031_5b003530617430e21039b9163b2fbae6.jpg already downloaded
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F15%252Fbb15e563600c8a7e242d42be8cc58107%252Fpa%252FSW43031_506d5c6d2619b028b9a5d18289fb7c10.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/15/bb15e563600c8a7e242d42be8cc58107/pa/SW43031_506d5c6d2619b028b9a5d18289fb7c10.jpg already downloaded
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F15%252Fbb15e563600c8a7e242d42be8cc58107%252Fpa%252FSW43031_c4c0e71b2d5685a77cc0a752ba008243.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/15/bb15e563600c8a7e242d42be8cc58107/pa/SW43031_c4c0e71b2d5685a77cc0a752ba008243.jpg already downloaded
2026-03-29 08:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2231bb70-71ba-582f-8672-6424b8dc86f1, identifier: SW43031
2026-03-29 08:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2231bb70-71ba-582f-8672-6424b8dc86f1 with identifier: SW43031
2026-03-29 08:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2231bb70-71ba-582f-8672-6424b8dc86f1 with identifier: SW43031
2026-03-29 08:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2231bb70-71ba-582f-8672-6424b8dc86f1 with identifier: SW43031 to the API
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SW43031>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:32:53Z',
'fuel_type': 'diesel',
'id': '2231bb70-71ba-582f-8672-6424b8dc86f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW43031',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Renault',
'model': 'Kangoo',
'odometer': 37871,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgbb/15/bb15e563600c8a7e242d42be8cc58107/pa/SW43031_d12652331f28389bd938fcf33a57a9b0.jpg',
'https://img-pa.auto1.com/imgbb/15/bb15e563600c8a7e242d42be8cc58107/pa/SW43031_3fdebc7140cc1234af0125e774e534ae.jpg',
'https://img-pa.auto1.com/imgbb/15/bb15e563600c8a7e242d42be8cc58107/pa/SW43031_6d12691186a25bd864951ff8e7a9cd54.jpg',
'https://img-pa.auto1.com/imgbb/15/bb15e563600c8a7e242d42be8cc58107/pa/SW43031_f556bcb6aafc719040d26a48cd19c097.jpg',
'https://img-pa.auto1.com/imgbb/15/bb15e563600c8a7e242d42be8cc58107/pa/SW43031_ac0658b298be95423ecb7d489156a064.jpg',
'https://img-pa.auto1.com/imgbb/15/bb15e563600c8a7e242d42be8cc58107/pa/SW43031_496f8f44c566793287ebccbf38f3ea04.jpg',
'https://img-pa.auto1.com/imgbb/15/bb15e563600c8a7e242d42be8cc58107/pa/SW43031_ba17dfb815c443ddb90d11a8da2644a7.jpg',
'https://img-pa.auto1.com/imgbb/15/bb15e563600c8a7e242d42be8cc58107/pa/SW43031_5b003530617430e21039b9163b2fbae6.jpg',
'https://img-pa.auto1.com/imgbb/15/bb15e563600c8a7e242d42be8cc58107/pa/SW43031_506d5c6d2619b028b9a5d18289fb7c10.jpg',
'https://img-pa.auto1.com/imgbb/15/bb15e563600c8a7e242d42be8cc58107/pa/SW43031_c4c0e71b2d5685a77cc0a752ba008243.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2231bb70-71ba-582f-8672-6424b8dc86f1/2231bb70-71ba-582f-8672-6424b8dc86f1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66383,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/15/bb15e563600c8a7e242d42be8cc58107/pa/SW43031_d12652331f28389bd938fcf33a57a9b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2231bb70-71ba-582f-8672-6424b8dc86f1/2231bb70-71ba-582f-8672-6424b8dc86f1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63471,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/15/bb15e563600c8a7e242d42be8cc58107/pa/SW43031_3fdebc7140cc1234af0125e774e534ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2231bb70-71ba-582f-8672-6424b8dc86f1/2231bb70-71ba-582f-8672-6424b8dc86f1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60560,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/15/bb15e563600c8a7e242d42be8cc58107/pa/SW43031_6d12691186a25bd864951ff8e7a9cd54.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2231bb70-71ba-582f-8672-6424b8dc86f1/2231bb70-71ba-582f-8672-6424b8dc86f1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55634,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/15/bb15e563600c8a7e242d42be8cc58107/pa/SW43031_f556bcb6aafc719040d26a48cd19c097.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2231bb70-71ba-582f-8672-6424b8dc86f1/2231bb70-71ba-582f-8672-6424b8dc86f1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53508,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/15/bb15e563600c8a7e242d42be8cc58107/pa/SW43031_ac0658b298be95423ecb7d489156a064.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2231bb70-71ba-582f-8672-6424b8dc86f1/2231bb70-71ba-582f-8672-6424b8dc86f1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66117,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/15/bb15e563600c8a7e242d42be8cc58107/pa/SW43031_496f8f44c566793287ebccbf38f3ea04.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2231bb70-71ba-582f-8672-6424b8dc86f1/2231bb70-71ba-582f-8672-6424b8dc86f1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58425,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/15/bb15e563600c8a7e242d42be8cc58107/pa/SW43031_ba17dfb815c443ddb90d11a8da2644a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2231bb70-71ba-582f-8672-6424b8dc86f1/2231bb70-71ba-582f-8672-6424b8dc86f1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70410,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/15/bb15e563600c8a7e242d42be8cc58107/pa/SW43031_5b003530617430e21039b9163b2fbae6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2231bb70-71ba-582f-8672-6424b8dc86f1/2231bb70-71ba-582f-8672-6424b8dc86f1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60719,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/15/bb15e563600c8a7e242d42be8cc58107/pa/SW43031_506d5c6d2619b028b9a5d18289fb7c10.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2231bb70-71ba-582f-8672-6424b8dc86f1/2231bb70-71ba-582f-8672-6424b8dc86f1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52775,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/15/bb15e563600c8a7e242d42be8cc58107/pa/SW43031_c4c0e71b2d5685a77cc0a752ba008243.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-11-08',
'seats_number': 2,
'seller_name': None,
'title': 'Renault Kangoo 1.5 BLUE dCi Rapid Maxi Extra',
'transmission': 'manual',
'trim': 'Rapid Maxi Extra',
'year': 2021}
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW43031%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [auto1.be] INFO: Saving data for SW43031: {'created_time': 1774773324.697819, 'last_price_update_time': 1774773324.697828, 'auction_closing_time': 1774884773.0}
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SW43031') HTTP/1.1" 204 0
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: MH83966
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MH83966%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [auto1.be] INFO: Scrape type for MH83966: 1
2026-03-29 08:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5f97f61-cf56-594a-bb29-aaccb3fe128d with identifier: AM39981
2026-03-29 08:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5f97f61-cf56-594a-bb29-aaccb3fe128d with scrape type 1
2026-03-29 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c5f97f61-cf56-594a-bb29-aaccb3fe128d
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F39%252F573910e9efa0c3716b1c190fec0adb17%252Fpa%252FAM39981_71dc108cb0f324e745f4ce3e723022e9.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/39/573910e9efa0c3716b1c190fec0adb17/pa/AM39981_71dc108cb0f324e745f4ce3e723022e9.jpg already downloaded
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F39%252F573910e9efa0c3716b1c190fec0adb17%252Fpa%252FAM39981_6130163ef11d6916ddbce596133305be.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/39/573910e9efa0c3716b1c190fec0adb17/pa/AM39981_6130163ef11d6916ddbce596133305be.jpg already downloaded
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F39%252F573910e9efa0c3716b1c190fec0adb17%252Fpa%252FAM39981_ac5b360fa8bb5f25402a976329ed2367.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/39/573910e9efa0c3716b1c190fec0adb17/pa/AM39981_ac5b360fa8bb5f25402a976329ed2367.jpg already downloaded
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F39%252F573910e9efa0c3716b1c190fec0adb17%252Fpa%252FAM39981_d65384898f3fb30154cda3399bf80cbb.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/39/573910e9efa0c3716b1c190fec0adb17/pa/AM39981_d65384898f3fb30154cda3399bf80cbb.jpg already downloaded
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F39%252F573910e9efa0c3716b1c190fec0adb17%252Fpa%252FAM39981_d1f44cdc5d119dfcfdceb03eed75e62f.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/39/573910e9efa0c3716b1c190fec0adb17/pa/AM39981_d1f44cdc5d119dfcfdceb03eed75e62f.jpg already downloaded
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F39%252F573910e9efa0c3716b1c190fec0adb17%252Fpa%252FAM39981_9ad52fa3fb2f8a38e1a039df8b7d30c9.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/39/573910e9efa0c3716b1c190fec0adb17/pa/AM39981_9ad52fa3fb2f8a38e1a039df8b7d30c9.jpg already downloaded
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F39%252F573910e9efa0c3716b1c190fec0adb17%252Fpa%252FAM39981_d063386ab15e76d65f354af36abb5618.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/39/573910e9efa0c3716b1c190fec0adb17/pa/AM39981_d063386ab15e76d65f354af36abb5618.jpg already downloaded
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F39%252F573910e9efa0c3716b1c190fec0adb17%252Fpa%252FAM39981_1f5ddf6c0813366def5004a484451a94.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/39/573910e9efa0c3716b1c190fec0adb17/pa/AM39981_1f5ddf6c0813366def5004a484451a94.jpg already downloaded
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F39%252F573910e9efa0c3716b1c190fec0adb17%252Fpa%252FAM39981_ade44a437ca6477b27ba785b694cd64c.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/39/573910e9efa0c3716b1c190fec0adb17/pa/AM39981_ade44a437ca6477b27ba785b694cd64c.jpg already downloaded
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F39%252F573910e9efa0c3716b1c190fec0adb17%252Fpa%252FAM39981_f56cb0b81567c4fca02071472233889a.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/39/573910e9efa0c3716b1c190fec0adb17/pa/AM39981_f56cb0b81567c4fca02071472233889a.jpg already downloaded
2026-03-29 08:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c5f97f61-cf56-594a-bb29-aaccb3fe128d, identifier: AM39981
2026-03-29 08:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c5f97f61-cf56-594a-bb29-aaccb3fe128d with identifier: AM39981
2026-03-29 08:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c5f97f61-cf56-594a-bb29-aaccb3fe128d with identifier: AM39981
2026-03-29 08:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c5f97f61-cf56-594a-bb29-aaccb3fe128d with identifier: AM39981 to the API
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AM39981>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:56:22Z',
'fuel_type': 'hybrid',
'id': 'c5f97f61-cf56-594a-bb29-aaccb3fe128d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM39981',
'listing': 'auction',
'location': 'BE, Pelt',
'make': 'Kia',
'model': 'Optima',
'odometer': 106202,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img57/39/573910e9efa0c3716b1c190fec0adb17/pa/AM39981_71dc108cb0f324e745f4ce3e723022e9.jpg',
'https://img-pa.auto1.com/img57/39/573910e9efa0c3716b1c190fec0adb17/pa/AM39981_6130163ef11d6916ddbce596133305be.jpg',
'https://img-pa.auto1.com/img57/39/573910e9efa0c3716b1c190fec0adb17/pa/AM39981_ac5b360fa8bb5f25402a976329ed2367.jpg',
'https://img-pa.auto1.com/img57/39/573910e9efa0c3716b1c190fec0adb17/pa/AM39981_d65384898f3fb30154cda3399bf80cbb.jpg',
'https://img-pa.auto1.com/img57/39/573910e9efa0c3716b1c190fec0adb17/pa/AM39981_d1f44cdc5d119dfcfdceb03eed75e62f.jpg',
'https://img-pa.auto1.com/img57/39/573910e9efa0c3716b1c190fec0adb17/pa/AM39981_9ad52fa3fb2f8a38e1a039df8b7d30c9.jpg',
'https://img-pa.auto1.com/img57/39/573910e9efa0c3716b1c190fec0adb17/pa/AM39981_d063386ab15e76d65f354af36abb5618.jpg',
'https://img-pa.auto1.com/img57/39/573910e9efa0c3716b1c190fec0adb17/pa/AM39981_1f5ddf6c0813366def5004a484451a94.jpg',
'https://img-pa.auto1.com/img57/39/573910e9efa0c3716b1c190fec0adb17/pa/AM39981_ade44a437ca6477b27ba785b694cd64c.jpg',
'https://img-pa.auto1.com/img57/39/573910e9efa0c3716b1c190fec0adb17/pa/AM39981_f56cb0b81567c4fca02071472233889a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f97f61-cf56-594a-bb29-aaccb3fe128d/c5f97f61-cf56-594a-bb29-aaccb3fe128d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72786,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/39/573910e9efa0c3716b1c190fec0adb17/pa/AM39981_71dc108cb0f324e745f4ce3e723022e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f97f61-cf56-594a-bb29-aaccb3fe128d/c5f97f61-cf56-594a-bb29-aaccb3fe128d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59190,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/39/573910e9efa0c3716b1c190fec0adb17/pa/AM39981_6130163ef11d6916ddbce596133305be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f97f61-cf56-594a-bb29-aaccb3fe128d/c5f97f61-cf56-594a-bb29-aaccb3fe128d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73705,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/39/573910e9efa0c3716b1c190fec0adb17/pa/AM39981_ac5b360fa8bb5f25402a976329ed2367.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f97f61-cf56-594a-bb29-aaccb3fe128d/c5f97f61-cf56-594a-bb29-aaccb3fe128d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56383,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/39/573910e9efa0c3716b1c190fec0adb17/pa/AM39981_d65384898f3fb30154cda3399bf80cbb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f97f61-cf56-594a-bb29-aaccb3fe128d/c5f97f61-cf56-594a-bb29-aaccb3fe128d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70203,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/39/573910e9efa0c3716b1c190fec0adb17/pa/AM39981_d1f44cdc5d119dfcfdceb03eed75e62f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f97f61-cf56-594a-bb29-aaccb3fe128d/c5f97f61-cf56-594a-bb29-aaccb3fe128d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71132,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/39/573910e9efa0c3716b1c190fec0adb17/pa/AM39981_9ad52fa3fb2f8a38e1a039df8b7d30c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f97f61-cf56-594a-bb29-aaccb3fe128d/c5f97f61-cf56-594a-bb29-aaccb3fe128d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63120,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/39/573910e9efa0c3716b1c190fec0adb17/pa/AM39981_d063386ab15e76d65f354af36abb5618.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f97f61-cf56-594a-bb29-aaccb3fe128d/c5f97f61-cf56-594a-bb29-aaccb3fe128d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58485,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/39/573910e9efa0c3716b1c190fec0adb17/pa/AM39981_1f5ddf6c0813366def5004a484451a94.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f97f61-cf56-594a-bb29-aaccb3fe128d/c5f97f61-cf56-594a-bb29-aaccb3fe128d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64947,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/39/573910e9efa0c3716b1c190fec0adb17/pa/AM39981_ade44a437ca6477b27ba785b694cd64c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f97f61-cf56-594a-bb29-aaccb3fe128d/c5f97f61-cf56-594a-bb29-aaccb3fe128d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65890,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/39/573910e9efa0c3716b1c190fec0adb17/pa/AM39981_f56cb0b81567c4fca02071472233889a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-03-15',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Optima 2.0 Hybrid Spirit',
'transmission': 'automatic',
'trim': 'Spirit',
'year': 2017}
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM39981%27 HTTP/1.1" 200 None
2026-03-29 08:35:25 [auto1.be] INFO: Saving data for AM39981: {'created_time': 1774773325.352715, 'last_price_update_time': 1774773325.352724, 'auction_closing_time': 1774886182.0}
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AM39981') HTTP/1.1" 204 0
2026-03-29 08:35:25 [auto1.be] INFO: Found listing with ID: DE26055
2026-03-29 08:35:25 [auto1.be] INFO: Found listing with ID: AD76625
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD76625%27 HTTP/1.1" 200 None
2026-03-29 08:35:25 [auto1.be] INFO: Scrape type for AD76625: 1
2026-03-29 08:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:25 [auto1.be] INFO: Found listing with ID: ET26989
2026-03-29 08:35:25 [auto1.be] INFO: Found listing with ID: PF75414
2026-03-29 08:35:25 [auto1.be] INFO: Found listing with ID: WZ74297
2026-03-29 08:35:25 [auto1.be] INFO: Found listing with ID: KR32592
2026-03-29 08:35:25 [auto1.be] INFO: Found listing with ID: WU68692
2026-03-29 08:35:25 [auto1.be] INFO: Found listing with ID: HX23250
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX23250%27 HTTP/1.1" 200 None
2026-03-29 08:35:25 [auto1.be] INFO: Scrape type for HX23250: 2
2026-03-29 08:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6755ae0-a87b-5fa3-994f-3ce919988d38 with identifier: HX23250
2026-03-29 08:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6755ae0-a87b-5fa3-994f-3ce919988d38 with scrape type 2
2026-03-29 08:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6755ae0-a87b-5fa3-994f-3ce919988d38 with scrape type 2
2026-03-29 08:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c6755ae0-a87b-5fa3-994f-3ce919988d38, identifier: HX23250
2026-03-29 08:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c6755ae0-a87b-5fa3-994f-3ce919988d38 with identifier: HX23250
2026-03-29 08:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c6755ae0-a87b-5fa3-994f-3ce919988d38 with identifier: HX23250
2026-03-29 08:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c6755ae0-a87b-5fa3-994f-3ce919988d38 with identifier: HX23250 to the API
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:48:42Z',
'fuel_type': 'diesel',
'id': 'c6755ae0-a87b-5fa3-994f-3ce919988d38',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX23250',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 294042,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-24',
'seller_name': None,
'title': 'Skoda Fabia 1.2 TDI Greenline',
'transmission': 'manual',
'trim': 'Greenline',
'year': 2011}
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX23250%27 HTTP/1.1" 200 None
2026-03-29 08:35:25 [auto1.be] INFO: Saving data for HX23250: {'auction_closing_time': 1774885722.0, 'created_time': 1774557467.189421, 'last_price_update_time': 1774773325.797384}
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HX23250') HTTP/1.1" 204 0
2026-03-29 08:35:25 [auto1.be] INFO: Found listing with ID: DH89229
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH89229%27 HTTP/1.1" 200 None
2026-03-29 08:35:25 [auto1.be] INFO: Scrape type for DH89229: 2
2026-03-29 08:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3a826ff-a041-5c74-bd69-de6316afe70b with identifier: DH89229
2026-03-29 08:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3a826ff-a041-5c74-bd69-de6316afe70b with scrape type 2
2026-03-29 08:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3a826ff-a041-5c74-bd69-de6316afe70b with scrape type 2
2026-03-29 08:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e3a826ff-a041-5c74-bd69-de6316afe70b, identifier: DH89229
2026-03-29 08:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e3a826ff-a041-5c74-bd69-de6316afe70b with identifier: DH89229
2026-03-29 08:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e3a826ff-a041-5c74-bd69-de6316afe70b with identifier: DH89229
2026-03-29 08:35:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e3a826ff-a041-5c74-bd69-de6316afe70b with identifier: DH89229 to the API
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:05:46Z',
'fuel_type': 'petrol',
'id': 'e3a826ff-a041-5c74-bd69-de6316afe70b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH89229',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 83992,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2000-03-27',
'seller_name': None,
'title': 'Opel Astra 1.4',
'transmission': 'manual',
'trim': '',
'year': 2000}
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH89229%27 HTTP/1.1" 200 None
2026-03-29 08:35:26 [auto1.be] INFO: Saving data for DH89229: {'auction_closing_time': 1774883146.0, 'created_time': 1774557463.647659, 'last_price_update_time': 1774773326.21503}
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DH89229') HTTP/1.1" 204 0
2026-03-29 08:35:26 [auto1.be] INFO: Found listing with ID: UZ99297
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UZ99297%27 HTTP/1.1" 200 None
2026-03-29 08:35:26 [auto1.be] INFO: Scrape type for UZ99297: 1
2026-03-29 08:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UY87343> (referer: https://www.auto1.com/v1/car-details-view/UY87343/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CY85383> (referer: https://www.auto1.com/v1/car-details-view/CY85383/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WP77155> (referer: https://www.auto1.com/v1/car-details-view/WP77155/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:26 [auto1.be] INFO: Found listing with ID: DZ79289
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ79289%27 HTTP/1.1" 200 None
2026-03-29 08:35:26 [auto1.be] INFO: Scrape type for DZ79289: 1
2026-03-29 08:35:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:26 [auto1.be] INFO: Found listing with ID: DX83468
2026-03-29 08:35:26 [auto1.be] INFO: Found listing with ID: EP64027
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP64027%27 HTTP/1.1" 200 None
2026-03-29 08:35:26 [auto1.be] INFO: Scrape type for EP64027: 2
2026-03-29 08:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a5e666b-8a01-5a9c-87e1-49a05638397e with identifier: EP64027
2026-03-29 08:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a5e666b-8a01-5a9c-87e1-49a05638397e with scrape type 2
2026-03-29 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a5e666b-8a01-5a9c-87e1-49a05638397e with scrape type 2
2026-03-29 08:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0a5e666b-8a01-5a9c-87e1-49a05638397e, identifier: EP64027
2026-03-29 08:35:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0a5e666b-8a01-5a9c-87e1-49a05638397e with identifier: EP64027
2026-03-29 08:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0a5e666b-8a01-5a9c-87e1-49a05638397e with identifier: EP64027
2026-03-29 08:35:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0a5e666b-8a01-5a9c-87e1-49a05638397e with identifier: EP64027 to the API
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:52:41Z',
'fuel_type': 'petrol',
'id': '0a5e666b-8a01-5a9c-87e1-49a05638397e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP64027',
'listing': 'auction',
'make': 'Volvo',
'model': 'V40',
'odometer': 151370,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1998-03-31',
'seller_name': None,
'title': 'Volvo V40 1.8',
'transmission': 'manual',
'trim': '',
'year': 1998}
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP64027%27 HTTP/1.1" 200 None
2026-03-29 08:35:26 [auto1.be] INFO: Saving data for EP64027: {'auction_closing_time': 1774885961.0, 'created_time': 1774557466.9029, 'last_price_update_time': 1774773326.662823}
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EP64027') HTTP/1.1" 204 0
2026-03-29 08:35:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:26 [auto1.be] INFO: Found listing with ID: ZY04103
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY04103%27 HTTP/1.1" 200 None
2026-03-29 08:35:26 [auto1.be] INFO: Scrape type for ZY04103: 2
2026-03-29 08:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2266def0-435c-58c5-85f6-2de59ae5b344 with identifier: ZY04103
2026-03-29 08:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2266def0-435c-58c5-85f6-2de59ae5b344 with scrape type 2
2026-03-29 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2266def0-435c-58c5-85f6-2de59ae5b344 with scrape type 2
2026-03-29 08:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2266def0-435c-58c5-85f6-2de59ae5b344, identifier: ZY04103
2026-03-29 08:35:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2266def0-435c-58c5-85f6-2de59ae5b344 with identifier: ZY04103
2026-03-29 08:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2266def0-435c-58c5-85f6-2de59ae5b344 with identifier: ZY04103
2026-03-29 08:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2266def0-435c-58c5-85f6-2de59ae5b344 with identifier: ZY04103 to the API
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:49:24Z',
'fuel_type': 'diesel',
'id': '2266def0-435c-58c5-85f6-2de59ae5b344',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY04103',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 341241,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-11-30',
'seller_name': None,
'title': 'BMW 3er 318d Advantage',
'transmission': 'manual',
'trim': 'Advantage',
'year': 2008}
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY04103%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [auto1.be] INFO: Saving data for ZY04103: {'auction_closing_time': 1774885764.0, 'created_time': 1773301663.880859, 'last_price_update_time': 1774773327.22889}
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZY04103') HTTP/1.1" 204 0
2026-03-29 08:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6b02178-5ddd-5ae9-a577-76fb518f9234 with identifier: UY87343
2026-03-29 08:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6b02178-5ddd-5ae9-a577-76fb518f9234 with scrape type 1
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b6b02178-5ddd-5ae9-a577-76fb518f9234
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb3%252Fa4b3175ea50f75d015ae886481ffb239%252Fpa%252FUY87343_e05f86b2cbc240ff2683dca26b6ca1a7.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b3/a4b3175ea50f75d015ae886481ffb239/pa/UY87343_e05f86b2cbc240ff2683dca26b6ca1a7.jpg already downloaded
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb3%252Fa4b3175ea50f75d015ae886481ffb239%252Fpa%252FUY87343_a3c363cdbfd1e53ab0296ae8fba26af1.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b3/a4b3175ea50f75d015ae886481ffb239/pa/UY87343_a3c363cdbfd1e53ab0296ae8fba26af1.jpg already downloaded
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb3%252Fa4b3175ea50f75d015ae886481ffb239%252Fpa%252FUY87343_f3d5377f25675d4d3b526c02bdf2bca3.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b3/a4b3175ea50f75d015ae886481ffb239/pa/UY87343_f3d5377f25675d4d3b526c02bdf2bca3.jpg already downloaded
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb3%252Fa4b3175ea50f75d015ae886481ffb239%252Fpa%252FUY87343_1f8e6f82058144332ad54a5d2cd5d0e8.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b3/a4b3175ea50f75d015ae886481ffb239/pa/UY87343_1f8e6f82058144332ad54a5d2cd5d0e8.jpg already downloaded
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb3%252Fa4b3175ea50f75d015ae886481ffb239%252Fpa%252FUY87343_ba31a8aa4d08410fdce9b435983d117b.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b3/a4b3175ea50f75d015ae886481ffb239/pa/UY87343_ba31a8aa4d08410fdce9b435983d117b.jpg already downloaded
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb3%252Fa4b3175ea50f75d015ae886481ffb239%252Fpa%252FUY87343_7b7a67e189a1eed1d5de81ae249ca8ed.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b3/a4b3175ea50f75d015ae886481ffb239/pa/UY87343_7b7a67e189a1eed1d5de81ae249ca8ed.jpg already downloaded
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb3%252Fa4b3175ea50f75d015ae886481ffb239%252Fpa%252FUY87343_ca76f8099bdbc618d9cf6cb13850cc1f.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b3/a4b3175ea50f75d015ae886481ffb239/pa/UY87343_ca76f8099bdbc618d9cf6cb13850cc1f.jpg already downloaded
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb3%252Fa4b3175ea50f75d015ae886481ffb239%252Fpa%252FUY87343_2cfe1eda2277ad9cc2aa8c102ba533dc.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b3/a4b3175ea50f75d015ae886481ffb239/pa/UY87343_2cfe1eda2277ad9cc2aa8c102ba533dc.jpg already downloaded
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb3%252Fa4b3175ea50f75d015ae886481ffb239%252Fpa%252FUY87343_c8509c3bb91cb9461cfed74734a20f96.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b3/a4b3175ea50f75d015ae886481ffb239/pa/UY87343_c8509c3bb91cb9461cfed74734a20f96.jpg already downloaded
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga4%252Fb3%252Fa4b3175ea50f75d015ae886481ffb239%252Fpa%252FUY87343_a70b74b84eb6cc453dafeff1919bbd5a.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/b3/a4b3175ea50f75d015ae886481ffb239/pa/UY87343_a70b74b84eb6cc453dafeff1919bbd5a.jpg already downloaded
2026-03-29 08:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b6b02178-5ddd-5ae9-a577-76fb518f9234, identifier: UY87343
2026-03-29 08:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 826fa6ec-4704-5fa6-a7eb-b6e12f335807 with identifier: CY85383
2026-03-29 08:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 826fa6ec-4704-5fa6-a7eb-b6e12f335807 with scrape type 1
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 826fa6ec-4704-5fa6-a7eb-b6e12f335807
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F5c%252F055c64410cba517404496c1d954a8bb6%252Fpa%252FCY85383_29067610b1828669f2cee7220dd9147e.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/5c/055c64410cba517404496c1d954a8bb6/pa/CY85383_29067610b1828669f2cee7220dd9147e.jpg already downloaded
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F5c%252F055c64410cba517404496c1d954a8bb6%252Fpa%252FCY85383_9019a140a46dcf059e041a5dba0cb2cd.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/5c/055c64410cba517404496c1d954a8bb6/pa/CY85383_9019a140a46dcf059e041a5dba0cb2cd.jpg already downloaded
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F5c%252F055c64410cba517404496c1d954a8bb6%252Fpa%252FCY85383_0bdc42afbfe32194f05eade741a60a97.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/5c/055c64410cba517404496c1d954a8bb6/pa/CY85383_0bdc42afbfe32194f05eade741a60a97.jpg already downloaded
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F5c%252F055c64410cba517404496c1d954a8bb6%252Fpa%252FCY85383_e1253c650014519d6ff62a575e46f718.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/5c/055c64410cba517404496c1d954a8bb6/pa/CY85383_e1253c650014519d6ff62a575e46f718.jpg already downloaded
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F5c%252F055c64410cba517404496c1d954a8bb6%252Fpa%252FCY85383_134ad5a0e63424b35ede833d03c825b8.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/5c/055c64410cba517404496c1d954a8bb6/pa/CY85383_134ad5a0e63424b35ede833d03c825b8.jpg already downloaded
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F5c%252F055c64410cba517404496c1d954a8bb6%252Fpa%252FCY85383_5f0c90caba08244ecb0249913693b11d.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/5c/055c64410cba517404496c1d954a8bb6/pa/CY85383_5f0c90caba08244ecb0249913693b11d.jpg already downloaded
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F5c%252F055c64410cba517404496c1d954a8bb6%252Fpa%252FCY85383_b82b3aca20adc0e9ccb6d165fa483ed0.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/5c/055c64410cba517404496c1d954a8bb6/pa/CY85383_b82b3aca20adc0e9ccb6d165fa483ed0.jpg already downloaded
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F5c%252F055c64410cba517404496c1d954a8bb6%252Fpa%252FCY85383_316b725e4eb44d945259933939bf50f0.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/5c/055c64410cba517404496c1d954a8bb6/pa/CY85383_316b725e4eb44d945259933939bf50f0.jpg already downloaded
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F5c%252F055c64410cba517404496c1d954a8bb6%252Fpa%252FCY85383_d0e791c0285dbf5e7f7060e423fd2b7c.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/5c/055c64410cba517404496c1d954a8bb6/pa/CY85383_d0e791c0285dbf5e7f7060e423fd2b7c.jpg already downloaded
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252F5c%252F055c64410cba517404496c1d954a8bb6%252Fpa%252FCY85383_194510659cfd9b5e992c58a47d247b07.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/5c/055c64410cba517404496c1d954a8bb6/pa/CY85383_194510659cfd9b5e992c58a47d247b07.jpg already downloaded
2026-03-29 08:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 826fa6ec-4704-5fa6-a7eb-b6e12f335807, identifier: CY85383
2026-03-29 08:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0459d37-eaec-5e41-9eac-069885b807ab with identifier: WP77155
2026-03-29 08:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0459d37-eaec-5e41-9eac-069885b807ab with scrape type 1
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f0459d37-eaec-5e41-9eac-069885b807ab
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fe4%252F58e4b47516a5932bfb107b779aa21bbc%252Fpa%252FWP77155_600e02f65b03a76ddc1efa673bbfd53e.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/e4/58e4b47516a5932bfb107b779aa21bbc/pa/WP77155_600e02f65b03a76ddc1efa673bbfd53e.jpg already downloaded
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fe4%252F58e4b47516a5932bfb107b779aa21bbc%252Fpa%252FWP77155_8a6867f5ed840d169246cc04bb6d98ca.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/e4/58e4b47516a5932bfb107b779aa21bbc/pa/WP77155_8a6867f5ed840d169246cc04bb6d98ca.jpg already downloaded
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fe4%252F58e4b47516a5932bfb107b779aa21bbc%252Fpa%252FWP77155_edede4d1bdca0b9b829550ff53388c65.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/e4/58e4b47516a5932bfb107b779aa21bbc/pa/WP77155_edede4d1bdca0b9b829550ff53388c65.jpg already downloaded
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fe4%252F58e4b47516a5932bfb107b779aa21bbc%252Fpa%252FWP77155_ff5ca69031540f2694da955a6775cfd1.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/e4/58e4b47516a5932bfb107b779aa21bbc/pa/WP77155_ff5ca69031540f2694da955a6775cfd1.jpg already downloaded
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fe4%252F58e4b47516a5932bfb107b779aa21bbc%252Fpa%252FWP77155_d322bd17b7cf40254bc26aa0019c5c75.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/e4/58e4b47516a5932bfb107b779aa21bbc/pa/WP77155_d322bd17b7cf40254bc26aa0019c5c75.jpg already downloaded
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fe4%252F58e4b47516a5932bfb107b779aa21bbc%252Fpa%252FWP77155_86bade47599038244c038cf24d460163.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/e4/58e4b47516a5932bfb107b779aa21bbc/pa/WP77155_86bade47599038244c038cf24d460163.jpg already downloaded
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fe4%252F58e4b47516a5932bfb107b779aa21bbc%252Fpa%252FWP77155_524e803d82e01634465260ec6f308559.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/e4/58e4b47516a5932bfb107b779aa21bbc/pa/WP77155_524e803d82e01634465260ec6f308559.jpg already downloaded
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fe4%252F58e4b47516a5932bfb107b779aa21bbc%252Fpa%252FWP77155_fa40dbd5c471c90bd11dbbefac09dc33.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/e4/58e4b47516a5932bfb107b779aa21bbc/pa/WP77155_fa40dbd5c471c90bd11dbbefac09dc33.jpg already downloaded
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fe4%252F58e4b47516a5932bfb107b779aa21bbc%252Fpa%252FWP77155_41c794ee84c4b42ca4003eea4c6316d5.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/e4/58e4b47516a5932bfb107b779aa21bbc/pa/WP77155_41c794ee84c4b42ca4003eea4c6316d5.jpg already downloaded
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252Fe4%252F58e4b47516a5932bfb107b779aa21bbc%252Fpa%252FWP77155_3f282631438d872fc065a03adf5d3145.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/e4/58e4b47516a5932bfb107b779aa21bbc/pa/WP77155_3f282631438d872fc065a03adf5d3145.jpg already downloaded
2026-03-29 08:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f0459d37-eaec-5e41-9eac-069885b807ab, identifier: WP77155
2026-03-29 08:35:28 [auto1.be] INFO: Found listing with ID: UR96395
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR96395%27 HTTP/1.1" 200 None
2026-03-29 08:35:28 [auto1.be] INFO: Scrape type for UR96395: 2
2026-03-29 08:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc31ab03-abfe-5ea7-8fa8-df70e9489f69 with identifier: UR96395
2026-03-29 08:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc31ab03-abfe-5ea7-8fa8-df70e9489f69 with scrape type 2
2026-03-29 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc31ab03-abfe-5ea7-8fa8-df70e9489f69 with scrape type 2
2026-03-29 08:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bc31ab03-abfe-5ea7-8fa8-df70e9489f69, identifier: UR96395
2026-03-29 08:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RX06086> (referer: https://www.auto1.com/v1/car-details-view/RX06086/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b6b02178-5ddd-5ae9-a577-76fb518f9234 with identifier: UY87343
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-29 08:35:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 08:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b6b02178-5ddd-5ae9-a577-76fb518f9234 with identifier: UY87343
2026-03-29 08:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b6b02178-5ddd-5ae9-a577-76fb518f9234 with identifier: UY87343 to the API
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UY87343>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine': '',
'engine_horse_power': 204,
'expiration_date': '2026-03-30T15:14:55Z',
'fuel_type': 'electro',
'id': 'b6b02178-5ddd-5ae9-a577-76fb518f9234',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY87343',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'MG',
'model': '4',
'odometer': 23495,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imga4/b3/a4b3175ea50f75d015ae886481ffb239/pa/UY87343_e05f86b2cbc240ff2683dca26b6ca1a7.jpg',
'https://img-pa.auto1.com/imga4/b3/a4b3175ea50f75d015ae886481ffb239/pa/UY87343_a3c363cdbfd1e53ab0296ae8fba26af1.jpg',
'https://img-pa.auto1.com/imga4/b3/a4b3175ea50f75d015ae886481ffb239/pa/UY87343_f3d5377f25675d4d3b526c02bdf2bca3.jpg',
'https://img-pa.auto1.com/imga4/b3/a4b3175ea50f75d015ae886481ffb239/pa/UY87343_1f8e6f82058144332ad54a5d2cd5d0e8.jpg',
'https://img-pa.auto1.com/imga4/b3/a4b3175ea50f75d015ae886481ffb239/pa/UY87343_ba31a8aa4d08410fdce9b435983d117b.jpg',
'https://img-pa.auto1.com/imga4/b3/a4b3175ea50f75d015ae886481ffb239/pa/UY87343_7b7a67e189a1eed1d5de81ae249ca8ed.jpg',
'https://img-pa.auto1.com/imga4/b3/a4b3175ea50f75d015ae886481ffb239/pa/UY87343_ca76f8099bdbc618d9cf6cb13850cc1f.jpg',
'https://img-pa.auto1.com/imga4/b3/a4b3175ea50f75d015ae886481ffb239/pa/UY87343_2cfe1eda2277ad9cc2aa8c102ba533dc.jpg',
'https://img-pa.auto1.com/imga4/b3/a4b3175ea50f75d015ae886481ffb239/pa/UY87343_c8509c3bb91cb9461cfed74734a20f96.jpg',
'https://img-pa.auto1.com/imga4/b3/a4b3175ea50f75d015ae886481ffb239/pa/UY87343_a70b74b84eb6cc453dafeff1919bbd5a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6b02178-5ddd-5ae9-a577-76fb518f9234/b6b02178-5ddd-5ae9-a577-76fb518f9234_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85385,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/b3/a4b3175ea50f75d015ae886481ffb239/pa/UY87343_e05f86b2cbc240ff2683dca26b6ca1a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6b02178-5ddd-5ae9-a577-76fb518f9234/b6b02178-5ddd-5ae9-a577-76fb518f9234_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85385,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/b3/a4b3175ea50f75d015ae886481ffb239/pa/UY87343_a3c363cdbfd1e53ab0296ae8fba26af1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6b02178-5ddd-5ae9-a577-76fb518f9234/b6b02178-5ddd-5ae9-a577-76fb518f9234_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78054,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/b3/a4b3175ea50f75d015ae886481ffb239/pa/UY87343_f3d5377f25675d4d3b526c02bdf2bca3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6b02178-5ddd-5ae9-a577-76fb518f9234/b6b02178-5ddd-5ae9-a577-76fb518f9234_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 609232,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga4/b3/a4b3175ea50f75d015ae886481ffb239/pa/UY87343_1f8e6f82058144332ad54a5d2cd5d0e8.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6b02178-5ddd-5ae9-a577-76fb518f9234/b6b02178-5ddd-5ae9-a577-76fb518f9234_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74171,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/b3/a4b3175ea50f75d015ae886481ffb239/pa/UY87343_ba31a8aa4d08410fdce9b435983d117b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6b02178-5ddd-5ae9-a577-76fb518f9234/b6b02178-5ddd-5ae9-a577-76fb518f9234_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84202,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/b3/a4b3175ea50f75d015ae886481ffb239/pa/UY87343_7b7a67e189a1eed1d5de81ae249ca8ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6b02178-5ddd-5ae9-a577-76fb518f9234/b6b02178-5ddd-5ae9-a577-76fb518f9234_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75899,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/b3/a4b3175ea50f75d015ae886481ffb239/pa/UY87343_ca76f8099bdbc618d9cf6cb13850cc1f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6b02178-5ddd-5ae9-a577-76fb518f9234/b6b02178-5ddd-5ae9-a577-76fb518f9234_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 643384,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imga4/b3/a4b3175ea50f75d015ae886481ffb239/pa/UY87343_2cfe1eda2277ad9cc2aa8c102ba533dc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6b02178-5ddd-5ae9-a577-76fb518f9234/b6b02178-5ddd-5ae9-a577-76fb518f9234_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81276,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/b3/a4b3175ea50f75d015ae886481ffb239/pa/UY87343_c8509c3bb91cb9461cfed74734a20f96.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6b02178-5ddd-5ae9-a577-76fb518f9234/b6b02178-5ddd-5ae9-a577-76fb518f9234_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55101,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/b3/a4b3175ea50f75d015ae886481ffb239/pa/UY87343_a70b74b84eb6cc453dafeff1919bbd5a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-11-26',
'seats_number': 5,
'seller_name': None,
'title': 'MG 4 electric drive 150 kW Luxury',
'transmission': 'automatic',
'trim': 'Luxury',
'year': 2023}
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY87343%27 HTTP/1.1" 200 None
2026-03-29 08:35:28 [auto1.be] INFO: Saving data for UY87343: {'created_time': 1774773328.56874, 'last_price_update_time': 1774773328.568748, 'auction_closing_time': 1774883695.0}
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UY87343') HTTP/1.1" 204 0
2026-03-29 08:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 826fa6ec-4704-5fa6-a7eb-b6e12f335807 with identifier: CY85383
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-29 08:35:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 08:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 826fa6ec-4704-5fa6-a7eb-b6e12f335807 with identifier: CY85383
2026-03-29 08:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 826fa6ec-4704-5fa6-a7eb-b6e12f335807 with identifier: CY85383 to the API
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CY85383>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.5L',
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:45:59Z',
'fuel_type': 'petrol',
'id': '826fa6ec-4704-5fa6-a7eb-b6e12f335807',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY85383',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'BMW',
'model': 'X1',
'odometer': 126985,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img05/5c/055c64410cba517404496c1d954a8bb6/pa/CY85383_29067610b1828669f2cee7220dd9147e.jpg',
'https://img-pa.auto1.com/img05/5c/055c64410cba517404496c1d954a8bb6/pa/CY85383_9019a140a46dcf059e041a5dba0cb2cd.jpg',
'https://img-pa.auto1.com/img05/5c/055c64410cba517404496c1d954a8bb6/pa/CY85383_0bdc42afbfe32194f05eade741a60a97.jpg',
'https://img-pa.auto1.com/img05/5c/055c64410cba517404496c1d954a8bb6/pa/CY85383_e1253c650014519d6ff62a575e46f718.jpg',
'https://img-pa.auto1.com/img05/5c/055c64410cba517404496c1d954a8bb6/pa/CY85383_134ad5a0e63424b35ede833d03c825b8.jpg',
'https://img-pa.auto1.com/img05/5c/055c64410cba517404496c1d954a8bb6/pa/CY85383_5f0c90caba08244ecb0249913693b11d.jpg',
'https://img-pa.auto1.com/img05/5c/055c64410cba517404496c1d954a8bb6/pa/CY85383_b82b3aca20adc0e9ccb6d165fa483ed0.jpg',
'https://img-pa.auto1.com/img05/5c/055c64410cba517404496c1d954a8bb6/pa/CY85383_316b725e4eb44d945259933939bf50f0.jpg',
'https://img-pa.auto1.com/img05/5c/055c64410cba517404496c1d954a8bb6/pa/CY85383_d0e791c0285dbf5e7f7060e423fd2b7c.jpg',
'https://img-pa.auto1.com/img05/5c/055c64410cba517404496c1d954a8bb6/pa/CY85383_194510659cfd9b5e992c58a47d247b07.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_826fa6ec-4704-5fa6-a7eb-b6e12f335807/826fa6ec-4704-5fa6-a7eb-b6e12f335807_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70421,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/5c/055c64410cba517404496c1d954a8bb6/pa/CY85383_29067610b1828669f2cee7220dd9147e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_826fa6ec-4704-5fa6-a7eb-b6e12f335807/826fa6ec-4704-5fa6-a7eb-b6e12f335807_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72014,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/5c/055c64410cba517404496c1d954a8bb6/pa/CY85383_9019a140a46dcf059e041a5dba0cb2cd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_826fa6ec-4704-5fa6-a7eb-b6e12f335807/826fa6ec-4704-5fa6-a7eb-b6e12f335807_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63079,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/5c/055c64410cba517404496c1d954a8bb6/pa/CY85383_0bdc42afbfe32194f05eade741a60a97.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_826fa6ec-4704-5fa6-a7eb-b6e12f335807/826fa6ec-4704-5fa6-a7eb-b6e12f335807_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68816,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/5c/055c64410cba517404496c1d954a8bb6/pa/CY85383_e1253c650014519d6ff62a575e46f718.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_826fa6ec-4704-5fa6-a7eb-b6e12f335807/826fa6ec-4704-5fa6-a7eb-b6e12f335807_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57777,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/5c/055c64410cba517404496c1d954a8bb6/pa/CY85383_134ad5a0e63424b35ede833d03c825b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_826fa6ec-4704-5fa6-a7eb-b6e12f335807/826fa6ec-4704-5fa6-a7eb-b6e12f335807_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67469,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/5c/055c64410cba517404496c1d954a8bb6/pa/CY85383_5f0c90caba08244ecb0249913693b11d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_826fa6ec-4704-5fa6-a7eb-b6e12f335807/826fa6ec-4704-5fa6-a7eb-b6e12f335807_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62670,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/5c/055c64410cba517404496c1d954a8bb6/pa/CY85383_b82b3aca20adc0e9ccb6d165fa483ed0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_826fa6ec-4704-5fa6-a7eb-b6e12f335807/826fa6ec-4704-5fa6-a7eb-b6e12f335807_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71896,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/5c/055c64410cba517404496c1d954a8bb6/pa/CY85383_316b725e4eb44d945259933939bf50f0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_826fa6ec-4704-5fa6-a7eb-b6e12f335807/826fa6ec-4704-5fa6-a7eb-b6e12f335807_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64822,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/5c/055c64410cba517404496c1d954a8bb6/pa/CY85383_d0e791c0285dbf5e7f7060e423fd2b7c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_826fa6ec-4704-5fa6-a7eb-b6e12f335807/826fa6ec-4704-5fa6-a7eb-b6e12f335807_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52109,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/5c/055c64410cba517404496c1d954a8bb6/pa/CY85383_194510659cfd9b5e992c58a47d247b07.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-02-23',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 sDrive 18i xLine',
'transmission': 'manual',
'trim': 'xLine',
'year': 2017}
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY85383%27 HTTP/1.1" 200 None
2026-03-29 08:35:29 [auto1.be] INFO: Saving data for CY85383: {'created_time': 1774773329.012051, 'last_price_update_time': 1774773329.012062, 'auction_closing_time': 1774885559.0}
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CY85383') HTTP/1.1" 204 0
2026-03-29 08:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f0459d37-eaec-5e41-9eac-069885b807ab with identifier: WP77155
2026-03-29 08:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f0459d37-eaec-5e41-9eac-069885b807ab with identifier: WP77155
2026-03-29 08:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f0459d37-eaec-5e41-9eac-069885b807ab with identifier: WP77155 to the API
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WP77155>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.1L',
'engine_horse_power': 209,
'expiration_date': '2026-03-30T15:12:11Z',
'fuel_type': 'diesel',
'id': 'f0459d37-eaec-5e41-9eac-069885b807ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP77155',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Alfa Romeo',
'model': 'Stelvio',
'odometer': 126869,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img58/e4/58e4b47516a5932bfb107b779aa21bbc/pa/WP77155_600e02f65b03a76ddc1efa673bbfd53e.jpg',
'https://img-pa.auto1.com/img58/e4/58e4b47516a5932bfb107b779aa21bbc/pa/WP77155_8a6867f5ed840d169246cc04bb6d98ca.jpg',
'https://img-pa.auto1.com/img58/e4/58e4b47516a5932bfb107b779aa21bbc/pa/WP77155_edede4d1bdca0b9b829550ff53388c65.jpg',
'https://img-pa.auto1.com/img58/e4/58e4b47516a5932bfb107b779aa21bbc/pa/WP77155_ff5ca69031540f2694da955a6775cfd1.jpg',
'https://img-pa.auto1.com/img58/e4/58e4b47516a5932bfb107b779aa21bbc/pa/WP77155_d322bd17b7cf40254bc26aa0019c5c75.jpg',
'https://img-pa.auto1.com/img58/e4/58e4b47516a5932bfb107b779aa21bbc/pa/WP77155_86bade47599038244c038cf24d460163.jpg',
'https://img-pa.auto1.com/img58/e4/58e4b47516a5932bfb107b779aa21bbc/pa/WP77155_524e803d82e01634465260ec6f308559.jpg',
'https://img-pa.auto1.com/img58/e4/58e4b47516a5932bfb107b779aa21bbc/pa/WP77155_fa40dbd5c471c90bd11dbbefac09dc33.jpg',
'https://img-pa.auto1.com/img58/e4/58e4b47516a5932bfb107b779aa21bbc/pa/WP77155_41c794ee84c4b42ca4003eea4c6316d5.jpg',
'https://img-pa.auto1.com/img58/e4/58e4b47516a5932bfb107b779aa21bbc/pa/WP77155_3f282631438d872fc065a03adf5d3145.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0459d37-eaec-5e41-9eac-069885b807ab/f0459d37-eaec-5e41-9eac-069885b807ab_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74081,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/e4/58e4b47516a5932bfb107b779aa21bbc/pa/WP77155_600e02f65b03a76ddc1efa673bbfd53e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0459d37-eaec-5e41-9eac-069885b807ab/f0459d37-eaec-5e41-9eac-069885b807ab_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71437,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/e4/58e4b47516a5932bfb107b779aa21bbc/pa/WP77155_8a6867f5ed840d169246cc04bb6d98ca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0459d37-eaec-5e41-9eac-069885b807ab/f0459d37-eaec-5e41-9eac-069885b807ab_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71017,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/e4/58e4b47516a5932bfb107b779aa21bbc/pa/WP77155_edede4d1bdca0b9b829550ff53388c65.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0459d37-eaec-5e41-9eac-069885b807ab/f0459d37-eaec-5e41-9eac-069885b807ab_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74708,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/e4/58e4b47516a5932bfb107b779aa21bbc/pa/WP77155_ff5ca69031540f2694da955a6775cfd1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0459d37-eaec-5e41-9eac-069885b807ab/f0459d37-eaec-5e41-9eac-069885b807ab_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65965,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/e4/58e4b47516a5932bfb107b779aa21bbc/pa/WP77155_d322bd17b7cf40254bc26aa0019c5c75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0459d37-eaec-5e41-9eac-069885b807ab/f0459d37-eaec-5e41-9eac-069885b807ab_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71725,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/e4/58e4b47516a5932bfb107b779aa21bbc/pa/WP77155_86bade47599038244c038cf24d460163.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0459d37-eaec-5e41-9eac-069885b807ab/f0459d37-eaec-5e41-9eac-069885b807ab_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54501,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/e4/58e4b47516a5932bfb107b779aa21bbc/pa/WP77155_524e803d82e01634465260ec6f308559.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0459d37-eaec-5e41-9eac-069885b807ab/f0459d37-eaec-5e41-9eac-069885b807ab_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66832,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/e4/58e4b47516a5932bfb107b779aa21bbc/pa/WP77155_fa40dbd5c471c90bd11dbbefac09dc33.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0459d37-eaec-5e41-9eac-069885b807ab/f0459d37-eaec-5e41-9eac-069885b807ab_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65893,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/e4/58e4b47516a5932bfb107b779aa21bbc/pa/WP77155_41c794ee84c4b42ca4003eea4c6316d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0459d37-eaec-5e41-9eac-069885b807ab/f0459d37-eaec-5e41-9eac-069885b807ab_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59435,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/e4/58e4b47516a5932bfb107b779aa21bbc/pa/WP77155_3f282631438d872fc065a03adf5d3145.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-01-31',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Stelvio 2.2 JTDM Veloce Ti Q4',
'transmission': 'automatic',
'trim': 'Veloce Ti Q4',
'year': 2022}
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP77155%27 HTTP/1.1" 200 None
2026-03-29 08:35:29 [auto1.be] INFO: Saving data for WP77155: {'created_time': 1774773329.323245, 'last_price_update_time': 1774773329.323255, 'auction_closing_time': 1774883531.0}
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WP77155') HTTP/1.1" 204 0
2026-03-29 08:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bc31ab03-abfe-5ea7-8fa8-df70e9489f69 with identifier: UR96395
2026-03-29 08:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bc31ab03-abfe-5ea7-8fa8-df70e9489f69 with identifier: UR96395
2026-03-29 08:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bc31ab03-abfe-5ea7-8fa8-df70e9489f69 with identifier: UR96395 to the API
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:49:22Z',
'fuel_type': 'diesel',
'id': 'bc31ab03-abfe-5ea7-8fa8-df70e9489f69',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR96395',
'listing': 'auction',
'make': 'Opel',
'model': 'Meriva',
'odometer': 109669,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-04-25',
'seller_name': None,
'title': 'Opel Meriva 1.3 CDTI Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2010}
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR96395%27 HTTP/1.1" 200 None
2026-03-29 08:35:29 [auto1.be] INFO: Saving data for UR96395: {'auction_closing_time': 1774885762.0, 'created_time': 1774643857.348781, 'last_price_update_time': 1774773329.649016}
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UR96395') HTTP/1.1" 204 0
2026-03-29 08:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MH83966/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AD76625/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:29 [auto1.be] INFO: Found listing with ID: SD20873
2026-03-29 08:35:29 [auto1.be] INFO: Found listing with ID: EN78807
2026-03-29 08:35:29 [auto1.be] INFO: Found listing with ID: PZ32696
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PZ32696%27 HTTP/1.1" 200 None
2026-03-29 08:35:29 [auto1.be] INFO: Scrape type for PZ32696: 2
2026-03-29 08:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7ec2bb4-5047-539b-9439-cd251ebe0630 with identifier: PZ32696
2026-03-29 08:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7ec2bb4-5047-539b-9439-cd251ebe0630 with scrape type 2
2026-03-29 08:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7ec2bb4-5047-539b-9439-cd251ebe0630 with scrape type 2
2026-03-29 08:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a7ec2bb4-5047-539b-9439-cd251ebe0630, identifier: PZ32696
2026-03-29 08:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a7ec2bb4-5047-539b-9439-cd251ebe0630 with identifier: PZ32696
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-29 08:35:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 08:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a7ec2bb4-5047-539b-9439-cd251ebe0630 with identifier: PZ32696
2026-03-29 08:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a7ec2bb4-5047-539b-9439-cd251ebe0630 with identifier: PZ32696 to the API
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:30:04Z',
'fuel_type': 'petrol',
'id': 'a7ec2bb4-5047-539b-9439-cd251ebe0630',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ32696',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 159363,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-02-04',
'seller_name': None,
'title': 'Fiat Panda 1.2 Dynamic',
'transmission': 'manual',
'trim': 'Dynamic',
'year': 2004}
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PZ32696%27 HTTP/1.1" 200 None
2026-03-29 08:35:30 [auto1.be] INFO: Saving data for PZ32696: {'auction_closing_time': 1774884604.0, 'created_time': 1774557480.550812, 'last_price_update_time': 1774773330.189339}
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PZ32696') HTTP/1.1" 204 0
2026-03-29 08:35:30 [auto1.be] INFO: Found listing with ID: SD10160
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD10160%27 HTTP/1.1" 200 None
2026-03-29 08:35:30 [auto1.be] INFO: Scrape type for SD10160: 2
2026-03-29 08:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5601b94a-f4b9-5abb-8972-f50d02ba47de with identifier: SD10160
2026-03-29 08:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5601b94a-f4b9-5abb-8972-f50d02ba47de with scrape type 2
2026-03-29 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5601b94a-f4b9-5abb-8972-f50d02ba47de with scrape type 2
2026-03-29 08:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5601b94a-f4b9-5abb-8972-f50d02ba47de, identifier: SD10160
2026-03-29 08:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0055cfc8-0ea8-5ed6-92c3-6262c976ff2d with identifier: RX06086
2026-03-29 08:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0055cfc8-0ea8-5ed6-92c3-6262c976ff2d with scrape type 1
2026-03-29 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0055cfc8-0ea8-5ed6-92c3-6262c976ff2d
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F08%252Fad0809490365bed7585c6955d652302f%252Fpa%252FRX06086_3d38056431681543cd83c75702a7124b.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/08/ad0809490365bed7585c6955d652302f/pa/RX06086_3d38056431681543cd83c75702a7124b.jpg already downloaded
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F08%252Fad0809490365bed7585c6955d652302f%252Fpa%252FRX06086_a3bdd5f2b069071ff6400a72c0a27edd.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/08/ad0809490365bed7585c6955d652302f/pa/RX06086_a3bdd5f2b069071ff6400a72c0a27edd.jpg already downloaded
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F08%252Fad0809490365bed7585c6955d652302f%252Fpa%252FRX06086_8cb244dbaf010ae9f9cfbb1f9dd0dee7.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/08/ad0809490365bed7585c6955d652302f/pa/RX06086_8cb244dbaf010ae9f9cfbb1f9dd0dee7.jpg already downloaded
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F08%252Fad0809490365bed7585c6955d652302f%252Fpa%252FRX06086_b717d03fa37e4e33bfd516d7a554061e.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/08/ad0809490365bed7585c6955d652302f/pa/RX06086_b717d03fa37e4e33bfd516d7a554061e.jpg already downloaded
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F08%252Fad0809490365bed7585c6955d652302f%252Fpa%252FRX06086_3241578cf97737cf1a4054b65a04abaf.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/08/ad0809490365bed7585c6955d652302f/pa/RX06086_3241578cf97737cf1a4054b65a04abaf.jpg already downloaded
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F08%252Fad0809490365bed7585c6955d652302f%252Fpa%252FRX06086_c4a2588ac9ddf793c71b4f383e5b0ed7.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/08/ad0809490365bed7585c6955d652302f/pa/RX06086_c4a2588ac9ddf793c71b4f383e5b0ed7.jpg already downloaded
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F08%252Fad0809490365bed7585c6955d652302f%252Fpa%252FRX06086_0f1ffae6fa4c8006af8f03c2392fa019.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/08/ad0809490365bed7585c6955d652302f/pa/RX06086_0f1ffae6fa4c8006af8f03c2392fa019.jpg already downloaded
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F08%252Fad0809490365bed7585c6955d652302f%252Fpa%252FRX06086_97b8d39d57bc02649866a1a477335b5a.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/08/ad0809490365bed7585c6955d652302f/pa/RX06086_97b8d39d57bc02649866a1a477335b5a.jpg already downloaded
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F08%252Fad0809490365bed7585c6955d652302f%252Fpa%252FRX06086_98517d99c6fa75f6f3fe074539b8f504.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/08/ad0809490365bed7585c6955d652302f/pa/RX06086_98517d99c6fa75f6f3fe074539b8f504.jpg already downloaded
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F08%252Fad0809490365bed7585c6955d652302f%252Fpa%252FRX06086_a188716a00fa022541b7fd1e7e247c90.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/08/ad0809490365bed7585c6955d652302f/pa/RX06086_a188716a00fa022541b7fd1e7e247c90.jpg already downloaded
2026-03-29 08:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0055cfc8-0ea8-5ed6-92c3-6262c976ff2d, identifier: RX06086
2026-03-29 08:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5601b94a-f4b9-5abb-8972-f50d02ba47de with identifier: SD10160
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-29 08:35:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 08:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5601b94a-f4b9-5abb-8972-f50d02ba47de with identifier: SD10160
2026-03-29 08:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5601b94a-f4b9-5abb-8972-f50d02ba47de with identifier: SD10160 to the API
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:50:06Z',
'fuel_type': 'petrol',
'id': '5601b94a-f4b9-5abb-8972-f50d02ba47de',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD10160',
'listing': 'auction',
'make': 'Citroen',
'model': 'Xsara',
'odometer': 113937,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-02-01',
'seller_name': None,
'title': 'Citroen Xsara 1.4 VTR',
'transmission': 'manual',
'trim': 'VTR',
'year': 2001}
2026-03-29 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD10160%27 HTTP/1.1" 200 None
2026-03-29 08:35:31 [auto1.be] INFO: Saving data for SD10160: {'auction_closing_time': 1774885806.0, 'created_time': 1773520770.234096, 'last_price_update_time': 1774773331.016511}
2026-03-29 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SD10160') HTTP/1.1" 204 0
2026-03-29 08:35:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0055cfc8-0ea8-5ed6-92c3-6262c976ff2d with identifier: RX06086
2026-03-29 08:35:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0055cfc8-0ea8-5ed6-92c3-6262c976ff2d with identifier: RX06086
2026-03-29 08:35:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0055cfc8-0ea8-5ed6-92c3-6262c976ff2d with identifier: RX06086 to the API
2026-03-29 08:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RX06086>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:18:16Z',
'fuel_type': 'diesel',
'id': '0055cfc8-0ea8-5ed6-92c3-6262c976ff2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX06086',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'BMW',
'model': '3er',
'odometer': 51713,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgad/08/ad0809490365bed7585c6955d652302f/pa/RX06086_3d38056431681543cd83c75702a7124b.jpg',
'https://img-pa.auto1.com/imgad/08/ad0809490365bed7585c6955d652302f/pa/RX06086_a3bdd5f2b069071ff6400a72c0a27edd.jpg',
'https://img-pa.auto1.com/imgad/08/ad0809490365bed7585c6955d652302f/pa/RX06086_8cb244dbaf010ae9f9cfbb1f9dd0dee7.jpg',
'https://img-pa.auto1.com/imgad/08/ad0809490365bed7585c6955d652302f/pa/RX06086_b717d03fa37e4e33bfd516d7a554061e.jpg',
'https://img-pa.auto1.com/imgad/08/ad0809490365bed7585c6955d652302f/pa/RX06086_3241578cf97737cf1a4054b65a04abaf.jpg',
'https://img-pa.auto1.com/imgad/08/ad0809490365bed7585c6955d652302f/pa/RX06086_c4a2588ac9ddf793c71b4f383e5b0ed7.jpg',
'https://img-pa.auto1.com/imgad/08/ad0809490365bed7585c6955d652302f/pa/RX06086_0f1ffae6fa4c8006af8f03c2392fa019.jpg',
'https://img-pa.auto1.com/imgad/08/ad0809490365bed7585c6955d652302f/pa/RX06086_97b8d39d57bc02649866a1a477335b5a.jpg',
'https://img-pa.auto1.com/imgad/08/ad0809490365bed7585c6955d652302f/pa/RX06086_98517d99c6fa75f6f3fe074539b8f504.jpg',
'https://img-pa.auto1.com/imgad/08/ad0809490365bed7585c6955d652302f/pa/RX06086_a188716a00fa022541b7fd1e7e247c90.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0055cfc8-0ea8-5ed6-92c3-6262c976ff2d/0055cfc8-0ea8-5ed6-92c3-6262c976ff2d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95407,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/08/ad0809490365bed7585c6955d652302f/pa/RX06086_3d38056431681543cd83c75702a7124b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0055cfc8-0ea8-5ed6-92c3-6262c976ff2d/0055cfc8-0ea8-5ed6-92c3-6262c976ff2d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86709,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/08/ad0809490365bed7585c6955d652302f/pa/RX06086_a3bdd5f2b069071ff6400a72c0a27edd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0055cfc8-0ea8-5ed6-92c3-6262c976ff2d/0055cfc8-0ea8-5ed6-92c3-6262c976ff2d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77782,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/08/ad0809490365bed7585c6955d652302f/pa/RX06086_8cb244dbaf010ae9f9cfbb1f9dd0dee7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0055cfc8-0ea8-5ed6-92c3-6262c976ff2d/0055cfc8-0ea8-5ed6-92c3-6262c976ff2d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79636,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/08/ad0809490365bed7585c6955d652302f/pa/RX06086_b717d03fa37e4e33bfd516d7a554061e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0055cfc8-0ea8-5ed6-92c3-6262c976ff2d/0055cfc8-0ea8-5ed6-92c3-6262c976ff2d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79139,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/08/ad0809490365bed7585c6955d652302f/pa/RX06086_3241578cf97737cf1a4054b65a04abaf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0055cfc8-0ea8-5ed6-92c3-6262c976ff2d/0055cfc8-0ea8-5ed6-92c3-6262c976ff2d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82538,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/08/ad0809490365bed7585c6955d652302f/pa/RX06086_c4a2588ac9ddf793c71b4f383e5b0ed7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0055cfc8-0ea8-5ed6-92c3-6262c976ff2d/0055cfc8-0ea8-5ed6-92c3-6262c976ff2d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78659,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/08/ad0809490365bed7585c6955d652302f/pa/RX06086_0f1ffae6fa4c8006af8f03c2392fa019.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0055cfc8-0ea8-5ed6-92c3-6262c976ff2d/0055cfc8-0ea8-5ed6-92c3-6262c976ff2d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77792,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/08/ad0809490365bed7585c6955d652302f/pa/RX06086_97b8d39d57bc02649866a1a477335b5a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0055cfc8-0ea8-5ed6-92c3-6262c976ff2d/0055cfc8-0ea8-5ed6-92c3-6262c976ff2d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72715,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/08/ad0809490365bed7585c6955d652302f/pa/RX06086_98517d99c6fa75f6f3fe074539b8f504.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0055cfc8-0ea8-5ed6-92c3-6262c976ff2d/0055cfc8-0ea8-5ed6-92c3-6262c976ff2d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66896,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/08/ad0809490365bed7585c6955d652302f/pa/RX06086_a188716a00fa022541b7fd1e7e247c90.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-01-04',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 3er 318d Mild-Hybrid Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2022}
2026-03-29 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX06086%27 HTTP/1.1" 200 None
2026-03-29 08:35:31 [auto1.be] INFO: Saving data for RX06086: {'created_time': 1774773331.63355, 'last_price_update_time': 1774773331.633558, 'auction_closing_time': 1774883896.0}
2026-03-29 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RX06086') HTTP/1.1" 204 0
2026-03-29 08:35:31 [auto1.be] INFO: Found listing with ID: YA34487
2026-03-29 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA34487%27 HTTP/1.1" 200 None
2026-03-29 08:35:31 [auto1.be] INFO: Scrape type for YA34487: 1
2026-03-29 08:35:31 [auto1.be] INFO: Channel: 24h | Page: 3 | totalHits: 1252 | hits on page: 40
2026-03-29 08:35:31 [auto1.be] INFO: Found listing with ID: RC41327
2026-03-29 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC41327%27 HTTP/1.1" 200 None
2026-03-29 08:35:31 [auto1.be] INFO: Scrape type for RC41327: 1
2026-03-29 08:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UZ99297/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:31 [auto1.be] INFO: Found listing with ID: PH78267
2026-03-29 08:35:31 [auto1.be] INFO: Found listing with ID: GA47341
2026-03-29 08:35:31 [auto1.be] INFO: Found listing with ID: NL54460
2026-03-29 08:35:31 [auto1.be] INFO: Found listing with ID: RE30310
2026-03-29 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE30310%27 HTTP/1.1" 200 None
2026-03-29 08:35:31 [auto1.be] INFO: Scrape type for RE30310: 2
2026-03-29 08:35:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acfe35ad-0f16-5719-a748-009caf8a3395 with identifier: RE30310
2026-03-29 08:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acfe35ad-0f16-5719-a748-009caf8a3395 with scrape type 2
2026-03-29 08:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acfe35ad-0f16-5719-a748-009caf8a3395 with scrape type 2
2026-03-29 08:35:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: acfe35ad-0f16-5719-a748-009caf8a3395, identifier: RE30310
2026-03-29 08:35:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:31 [auto1.be] INFO: Found listing with ID: BL31735
2026-03-29 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BL31735%27 HTTP/1.1" 200 None
2026-03-29 08:35:31 [auto1.be] INFO: Scrape type for BL31735: 1
2026-03-29 08:35:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: acfe35ad-0f16-5719-a748-009caf8a3395 with identifier: RE30310
2026-03-29 08:35:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: acfe35ad-0f16-5719-a748-009caf8a3395 with identifier: RE30310
2026-03-29 08:35:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: acfe35ad-0f16-5719-a748-009caf8a3395 with identifier: RE30310 to the API
2026-03-29 08:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:28:52Z',
'fuel_type': 'petrol',
'id': 'acfe35ad-0f16-5719-a748-009caf8a3395',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE30310',
'listing': 'auction',
'make': 'BMW',
'model': '6er',
'odometer': 81117,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-12',
'seller_name': None,
'title': 'BMW 6er 630i GT M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2021}
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE30310%27 HTTP/1.1" 200 None
2026-03-29 08:35:32 [auto1.be] INFO: Saving data for RE30310: {'auction_closing_time': 1774884532.0, 'created_time': 1773132260.356116, 'last_price_update_time': 1774773332.132629}
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RE30310') HTTP/1.1" 204 0
2026-03-29 08:35:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:32 [auto1.be] INFO: Found listing with ID: MM05603
2026-03-29 08:35:32 [auto1.be] INFO: Found listing with ID: MT15926
2026-03-29 08:35:32 [auto1.be] INFO: Found listing with ID: RR05667
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR05667%27 HTTP/1.1" 200 None
2026-03-29 08:35:32 [auto1.be] INFO: Scrape type for RR05667: 2
2026-03-29 08:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf95bcee-79ec-58ca-95a9-5c510f677def with identifier: RR05667
2026-03-29 08:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf95bcee-79ec-58ca-95a9-5c510f677def with scrape type 2
2026-03-29 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf95bcee-79ec-58ca-95a9-5c510f677def with scrape type 2
2026-03-29 08:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cf95bcee-79ec-58ca-95a9-5c510f677def, identifier: RR05667
2026-03-29 08:35:32 [auto1.be] INFO: Found listing with ID: PJ34917
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ34917%27 HTTP/1.1" 200 None
2026-03-29 08:35:32 [auto1.be] INFO: Scrape type for PJ34917: 1
2026-03-29 08:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cf95bcee-79ec-58ca-95a9-5c510f677def with identifier: RR05667
2026-03-29 08:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cf95bcee-79ec-58ca-95a9-5c510f677def with identifier: RR05667
2026-03-29 08:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cf95bcee-79ec-58ca-95a9-5c510f677def with identifier: RR05667 to the API
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 230,
'expiration_date': '2026-03-30T15:11:54Z',
'fuel_type': 'petrol',
'id': 'cf95bcee-79ec-58ca-95a9-5c510f677def',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR05667',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 62351,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-11',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TSI GTI BlueMotion',
'transmission': 'manual',
'trim': 'GTI BlueMotion',
'year': 2018}
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR05667%27 HTTP/1.1" 200 None
2026-03-29 08:35:32 [auto1.be] INFO: Saving data for RR05667: {'auction_closing_time': 1774883514.0, 'created_time': 1774471142.833519, 'last_price_update_time': 1774773332.674993}
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RR05667') HTTP/1.1" 204 0
2026-03-29 08:35:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:32 [auto1.be] INFO: Found listing with ID: RA52713
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA52713%27 HTTP/1.1" 200 None
2026-03-29 08:35:32 [auto1.be] INFO: Scrape type for RA52713: 2
2026-03-29 08:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dff40a98-1a29-5a0c-bc27-394239566acc with identifier: RA52713
2026-03-29 08:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dff40a98-1a29-5a0c-bc27-394239566acc with scrape type 2
2026-03-29 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dff40a98-1a29-5a0c-bc27-394239566acc with scrape type 2
2026-03-29 08:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dff40a98-1a29-5a0c-bc27-394239566acc, identifier: RA52713
2026-03-29 08:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DZ79289/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:32 [auto1.be] INFO: Found listing with ID: TM16461
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM16461%27 HTTP/1.1" 200 None
2026-03-29 08:35:32 [auto1.be] INFO: Scrape type for TM16461: 1
2026-03-29 08:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dff40a98-1a29-5a0c-bc27-394239566acc with identifier: RA52713
2026-03-29 08:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dff40a98-1a29-5a0c-bc27-394239566acc with identifier: RA52713
2026-03-29 08:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dff40a98-1a29-5a0c-bc27-394239566acc with identifier: RA52713 to the API
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:43:37Z',
'fuel_type': 'diesel',
'id': 'dff40a98-1a29-5a0c-bc27-394239566acc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA52713',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 97098,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-03',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 d BlueTEC',
'transmission': 'automatic',
'trim': 'BlueTEC',
'year': 2015}
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA52713%27 HTTP/1.1" 200 None
2026-03-29 08:35:33 [auto1.be] INFO: Saving data for RA52713: {'auction_closing_time': 1774885417.0, 'created_time': 1773134356.130771, 'last_price_update_time': 1774773333.136359}
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RA52713') HTTP/1.1" 204 0
2026-03-29 08:35:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:33 [auto1.be] INFO: Found listing with ID: XY08671
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XY08671%27 HTTP/1.1" 200 None
2026-03-29 08:35:33 [auto1.be] INFO: Scrape type for XY08671: 2
2026-03-29 08:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d58fd6b-aa3c-50bf-abc0-31ac239c2679 with identifier: XY08671
2026-03-29 08:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d58fd6b-aa3c-50bf-abc0-31ac239c2679 with scrape type 2
2026-03-29 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d58fd6b-aa3c-50bf-abc0-31ac239c2679 with scrape type 2
2026-03-29 08:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2d58fd6b-aa3c-50bf-abc0-31ac239c2679, identifier: XY08671
2026-03-29 08:35:33 [auto1.be] INFO: Found listing with ID: PC06950
2026-03-29 08:35:33 [auto1.be] INFO: Found listing with ID: JN34238
2026-03-29 08:35:33 [auto1.be] INFO: Found listing with ID: KD33371
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD33371%27 HTTP/1.1" 200 None
2026-03-29 08:35:33 [auto1.be] INFO: Scrape type for KD33371: 1
2026-03-29 08:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2d58fd6b-aa3c-50bf-abc0-31ac239c2679 with identifier: XY08671
2026-03-29 08:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2d58fd6b-aa3c-50bf-abc0-31ac239c2679 with identifier: XY08671
2026-03-29 08:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2d58fd6b-aa3c-50bf-abc0-31ac239c2679 with identifier: XY08671 to the API
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:34:20Z',
'fuel_type': 'petrol',
'id': '2d58fd6b-aa3c-50bf-abc0-31ac239c2679',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY08671',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 48063,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-15',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2021}
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XY08671%27 HTTP/1.1" 200 None
2026-03-29 08:35:33 [auto1.be] INFO: Saving data for XY08671: {'auction_closing_time': 1774884860.0, 'created_time': 1773132016.89486, 'last_price_update_time': 1774773333.602498}
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XY08671') HTTP/1.1" 204 0
2026-03-29 08:35:33 [auto1.be] INFO: Found listing with ID: GB86339
2026-03-29 08:35:33 [auto1.be] INFO: Found listing with ID: PW41553
2026-03-29 08:35:33 [auto1.be] INFO: Found listing with ID: FF69776
2026-03-29 08:35:33 [auto1.be] INFO: Found listing with ID: BY20726
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY20726%27 HTTP/1.1" 200 None
2026-03-29 08:35:33 [auto1.be] INFO: Scrape type for BY20726: 1
2026-03-29 08:35:33 [auto1.be] INFO: Found listing with ID: ZM02853
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM02853%27 HTTP/1.1" 200 None
2026-03-29 08:35:33 [auto1.be] INFO: Scrape type for ZM02853: 1
2026-03-29 08:35:33 [auto1.be] INFO: Found listing with ID: YH64614
2026-03-29 08:35:33 [auto1.be] INFO: Found listing with ID: KF56069
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF56069%27 HTTP/1.1" 200 None
2026-03-29 08:35:33 [auto1.be] INFO: Scrape type for KF56069: 1
2026-03-29 08:35:33 [auto1.be] INFO: Found listing with ID: ZC87174
2026-03-29 08:35:33 [auto1.be] INFO: Found listing with ID: ZP04877
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP04877%27 HTTP/1.1" 200 None
2026-03-29 08:35:33 [auto1.be] INFO: Scrape type for ZP04877: 2
2026-03-29 08:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 045a87dd-84e7-543c-b5bf-0a061b950637 with identifier: ZP04877
2026-03-29 08:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 045a87dd-84e7-543c-b5bf-0a061b950637 with scrape type 2
2026-03-29 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 045a87dd-84e7-543c-b5bf-0a061b950637 with scrape type 2
2026-03-29 08:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 045a87dd-84e7-543c-b5bf-0a061b950637, identifier: ZP04877
2026-03-29 08:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 045a87dd-84e7-543c-b5bf-0a061b950637 with identifier: ZP04877
2026-03-29 08:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 045a87dd-84e7-543c-b5bf-0a061b950637 with identifier: ZP04877
2026-03-29 08:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 045a87dd-84e7-543c-b5bf-0a061b950637 with identifier: ZP04877 to the API
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:18:07Z',
'fuel_type': 'petrol',
'id': '045a87dd-84e7-543c-b5bf-0a061b950637',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP04877',
'listing': 'auction',
'make': 'Renault',
'model': 'Grand Scenic',
'odometer': 162816,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-31',
'seller_name': None,
'title': 'Renault Grand Scenic 2.0 Exception',
'transmission': 'manual',
'trim': 'Exception',
'year': 2006}
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP04877%27 HTTP/1.1" 200 None
2026-03-29 08:35:34 [auto1.be] INFO: Saving data for ZP04877: {'auction_closing_time': 1774883887.0, 'created_time': 1774125486.639898, 'last_price_update_time': 1774773334.141558}
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZP04877') HTTP/1.1" 204 0
2026-03-29 08:35:34 [auto1.be] INFO: Found listing with ID: BT87712
2026-03-29 08:35:34 [auto1.be] INFO: Found listing with ID: BV02466
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV02466%27 HTTP/1.1" 200 None
2026-03-29 08:35:34 [auto1.be] INFO: Scrape type for BV02466: 2
2026-03-29 08:35:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29117545-3de3-59e0-99ea-ad8357308098 with identifier: BV02466
2026-03-29 08:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29117545-3de3-59e0-99ea-ad8357308098 with scrape type 2
2026-03-29 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29117545-3de3-59e0-99ea-ad8357308098 with scrape type 2
2026-03-29 08:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 29117545-3de3-59e0-99ea-ad8357308098, identifier: BV02466
2026-03-29 08:35:34 [auto1.be] INFO: Found listing with ID: BY53413
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY53413%27 HTTP/1.1" 200 None
2026-03-29 08:35:34 [auto1.be] INFO: Scrape type for BY53413: 1
2026-03-29 08:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 29117545-3de3-59e0-99ea-ad8357308098 with identifier: BV02466
2026-03-29 08:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 29117545-3de3-59e0-99ea-ad8357308098 with identifier: BV02466
2026-03-29 08:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 29117545-3de3-59e0-99ea-ad8357308098 with identifier: BV02466 to the API
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:47:51Z',
'fuel_type': 'petrol',
'id': '29117545-3de3-59e0-99ea-ad8357308098',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV02466',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 40283,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-11',
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Feel Pack',
'transmission': 'manual',
'trim': 'Feel Pack',
'year': 2020}
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV02466%27 HTTP/1.1" 200 None
2026-03-29 08:35:34 [auto1.be] INFO: Saving data for BV02466: {'auction_closing_time': 1774885671.0, 'created_time': 1773225123.553245, 'last_price_update_time': 1774773334.705028}
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BV02466') HTTP/1.1" 204 0
2026-03-29 08:35:34 [auto1.be] INFO: Found listing with ID: SY52065
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY52065%27 HTTP/1.1" 200 None
2026-03-29 08:35:34 [auto1.be] INFO: Scrape type for SY52065: 2
2026-03-29 08:35:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2cba265-bd81-544e-b139-66cfe0127b20 with identifier: SY52065
2026-03-29 08:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2cba265-bd81-544e-b139-66cfe0127b20 with scrape type 2
2026-03-29 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2cba265-bd81-544e-b139-66cfe0127b20 with scrape type 2
2026-03-29 08:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a2cba265-bd81-544e-b139-66cfe0127b20, identifier: SY52065
2026-03-29 08:35:34 [auto1.be] INFO: Found listing with ID: GZ17047
2026-03-29 08:35:34 [auto1.be] INFO: Found listing with ID: TN87621
2026-03-29 08:35:34 [auto1.be] INFO: Found listing with ID: LY35485
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY35485%27 HTTP/1.1" 200 None
2026-03-29 08:35:34 [auto1.be] INFO: Scrape type for LY35485: 1
2026-03-29 08:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a2cba265-bd81-544e-b139-66cfe0127b20 with identifier: SY52065
2026-03-29 08:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a2cba265-bd81-544e-b139-66cfe0127b20 with identifier: SY52065
2026-03-29 08:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a2cba265-bd81-544e-b139-66cfe0127b20 with identifier: SY52065 to the API
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:55:17Z',
'fuel_type': 'petrol',
'id': 'a2cba265-bd81-544e-b139-66cfe0127b20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY52065',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20',
'odometer': 108090,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-02',
'seller_name': None,
'title': 'Hyundai i20 1.2 Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2013}
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY52065%27 HTTP/1.1" 200 None
2026-03-29 08:35:35 [auto1.be] INFO: Saving data for SY52065: {'auction_closing_time': 1774886117.0, 'created_time': 1773135978.353718, 'last_price_update_time': 1774773335.177166}
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SY52065') HTTP/1.1" 204 0
2026-03-29 08:35:35 [auto1.be] INFO: Found listing with ID: NG60197
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG60197%27 HTTP/1.1" 200 None
2026-03-29 08:35:35 [auto1.be] INFO: Scrape type for NG60197: 2
2026-03-29 08:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63ffb45e-3ba5-55d8-96c0-6a0838581d18 with identifier: NG60197
2026-03-29 08:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63ffb45e-3ba5-55d8-96c0-6a0838581d18 with scrape type 2
2026-03-29 08:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63ffb45e-3ba5-55d8-96c0-6a0838581d18 with scrape type 2
2026-03-29 08:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 63ffb45e-3ba5-55d8-96c0-6a0838581d18, identifier: NG60197
2026-03-29 08:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YA34487/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AD76625> (referer: https://www.auto1.com/v1/car-details-view/AD76625/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MH83966> (referer: https://www.auto1.com/v1/car-details-view/MH83966/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:35 [auto1.be] INFO: Found listing with ID: DP17314
2026-03-29 08:35:35 [auto1.be] INFO: Found listing with ID: KU68109
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU68109%27 HTTP/1.1" 200 None
2026-03-29 08:35:35 [auto1.be] INFO: Scrape type for KU68109: 1
2026-03-29 08:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 63ffb45e-3ba5-55d8-96c0-6a0838581d18 with identifier: NG60197
2026-03-29 08:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 63ffb45e-3ba5-55d8-96c0-6a0838581d18 with identifier: NG60197
2026-03-29 08:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 63ffb45e-3ba5-55d8-96c0-6a0838581d18 with identifier: NG60197 to the API
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:38:19Z',
'fuel_type': 'petrol',
'id': '63ffb45e-3ba5-55d8-96c0-6a0838581d18',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG60197',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 133609,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-10',
'seller_name': None,
'title': 'Kia Sportage 1.6 GDI Active 2WD',
'transmission': 'manual',
'trim': 'Active 2WD',
'year': 2015}
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG60197%27 HTTP/1.1" 200 None
2026-03-29 08:35:35 [auto1.be] INFO: Saving data for NG60197: {'auction_closing_time': 1774885099.0, 'created_time': 1773132744.258929, 'last_price_update_time': 1774773335.653261}
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NG60197') HTTP/1.1" 204 0
2026-03-29 08:35:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:35 [auto1.be] INFO: Found listing with ID: NC51382
2026-03-29 08:35:35 [auto1.be] INFO: Found listing with ID: JU27695
2026-03-29 08:35:35 [auto1.be] INFO: Found listing with ID: XU40393
2026-03-29 08:35:35 [auto1.be] INFO: Found listing with ID: YR77899
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YR77899%27 HTTP/1.1" 200 None
2026-03-29 08:35:35 [auto1.be] INFO: Scrape type for YR77899: 2
2026-03-29 08:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a41fd37-f35c-5167-bed6-afec25a1a293 with identifier: YR77899
2026-03-29 08:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a41fd37-f35c-5167-bed6-afec25a1a293 with scrape type 2
2026-03-29 08:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a41fd37-f35c-5167-bed6-afec25a1a293 with scrape type 2
2026-03-29 08:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5a41fd37-f35c-5167-bed6-afec25a1a293, identifier: YR77899
2026-03-29 08:35:35 [auto1.be] INFO: Found listing with ID: WT61211
2026-03-29 08:35:35 [auto1.be] INFO: Found listing with ID: RG41014
2026-03-29 08:35:35 [auto1.be] INFO: Found listing with ID: VL25326
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL25326%27 HTTP/1.1" 200 None
2026-03-29 08:35:35 [auto1.be] INFO: Scrape type for VL25326: 2
2026-03-29 08:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d98003c-f14a-5300-bd4a-0672a6e35e9a with identifier: VL25326
2026-03-29 08:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d98003c-f14a-5300-bd4a-0672a6e35e9a with scrape type 2
2026-03-29 08:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d98003c-f14a-5300-bd4a-0672a6e35e9a with scrape type 2
2026-03-29 08:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6d98003c-f14a-5300-bd4a-0672a6e35e9a, identifier: VL25326
2026-03-29 08:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5a41fd37-f35c-5167-bed6-afec25a1a293 with identifier: YR77899
2026-03-29 08:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5a41fd37-f35c-5167-bed6-afec25a1a293 with identifier: YR77899
2026-03-29 08:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5a41fd37-f35c-5167-bed6-afec25a1a293 with identifier: YR77899 to the API
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:03:03Z',
'fuel_type': 'diesel',
'id': '5a41fd37-f35c-5167-bed6-afec25a1a293',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR77899',
'listing': 'auction',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 131554,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-01-28',
'seller_name': None,
'title': 'Citroen Berlingo 1.9 Diesel 600 Kasten',
'transmission': 'manual',
'trim': '600 Kasten',
'year': 2004}
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YR77899%27 HTTP/1.1" 200 None
2026-03-29 08:35:36 [auto1.be] INFO: Saving data for YR77899: {'auction_closing_time': 1774882983.0, 'created_time': 1773240989.548451, 'last_price_update_time': 1774773336.231537}
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YR77899') HTTP/1.1" 204 0
2026-03-29 08:35:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6d98003c-f14a-5300-bd4a-0672a6e35e9a with identifier: VL25326
2026-03-29 08:35:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6d98003c-f14a-5300-bd4a-0672a6e35e9a with identifier: VL25326
2026-03-29 08:35:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6d98003c-f14a-5300-bd4a-0672a6e35e9a with identifier: VL25326 to the API
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:49:40Z',
'fuel_type': 'petrol',
'id': '6d98003c-f14a-5300-bd4a-0672a6e35e9a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL25326',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 292699,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-30',
'seller_name': None,
'title': 'Ford Fiesta 1.25 Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2012}
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL25326%27 HTTP/1.1" 200 None
2026-03-29 08:35:36 [auto1.be] INFO: Saving data for VL25326: {'auction_closing_time': 1774885780.0, 'created_time': 1773134432.039913, 'last_price_update_time': 1774773336.636653}
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VL25326') HTTP/1.1" 204 0
2026-03-29 08:35:36 [auto1.be] INFO: Found listing with ID: FH50113
2026-03-29 08:35:36 [auto1.be] INFO: Found listing with ID: YU69949
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU69949%27 HTTP/1.1" 200 None
2026-03-29 08:35:36 [auto1.be] INFO: Scrape type for YU69949: 2
2026-03-29 08:35:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb93a4ea-803b-569d-bc31-c83363dab30d with identifier: YU69949
2026-03-29 08:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb93a4ea-803b-569d-bc31-c83363dab30d with scrape type 2
2026-03-29 08:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb93a4ea-803b-569d-bc31-c83363dab30d with scrape type 2
2026-03-29 08:35:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fb93a4ea-803b-569d-bc31-c83363dab30d, identifier: YU69949
2026-03-29 08:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PJ34917/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RC41327/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fb93a4ea-803b-569d-bc31-c83363dab30d with identifier: YU69949
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-29 08:35:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 08:35:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fb93a4ea-803b-569d-bc31-c83363dab30d with identifier: YU69949
2026-03-29 08:35:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fb93a4ea-803b-569d-bc31-c83363dab30d with identifier: YU69949 to the API
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 249,
'expiration_date': '2026-03-30T15:09:09Z',
'fuel_type': 'diesel',
'id': 'fb93a4ea-803b-569d-bc31-c83363dab30d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU69949',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC90',
'odometer': 70496,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-12',
'seller_name': None,
'title': 'Volvo XC90 2.0 B5 Diesel Mild-Hybrid Inscription AWD',
'transmission': 'automatic',
'trim': 'Inscription AWD',
'year': 2021}
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU69949%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [auto1.be] INFO: Saving data for YU69949: {'auction_closing_time': 1774883349.0, 'created_time': 1774643857.676458, 'last_price_update_time': 1774773337.197084}
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YU69949') HTTP/1.1" 204 0
2026-03-29 08:35:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:37 [auto1.be] INFO: Channel: 24h | Page: 4 | totalHits: 1252 | hits on page: 40
2026-03-29 08:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75a91cdc-86c4-5050-8e38-0b274a59dfc5 with identifier: AD76625
2026-03-29 08:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75a91cdc-86c4-5050-8e38-0b274a59dfc5 with scrape type 1
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 75a91cdc-86c4-5050-8e38-0b274a59dfc5
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F80%252F1180ce6c945d7ecf996f0dcc7b00791a%252Fpa%252FAD76625_42787cf326d08646c06da4a9daf31650.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/80/1180ce6c945d7ecf996f0dcc7b00791a/pa/AD76625_42787cf326d08646c06da4a9daf31650.jpg already downloaded
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F80%252F1180ce6c945d7ecf996f0dcc7b00791a%252Fpa%252FAD76625_66f810ffd16932395668034dfcc05556.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/80/1180ce6c945d7ecf996f0dcc7b00791a/pa/AD76625_66f810ffd16932395668034dfcc05556.jpg already downloaded
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F80%252F1180ce6c945d7ecf996f0dcc7b00791a%252Fpa%252FAD76625_f6bd4b1149ba2ee0fdf50804848bc7cd.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/80/1180ce6c945d7ecf996f0dcc7b00791a/pa/AD76625_f6bd4b1149ba2ee0fdf50804848bc7cd.jpg already downloaded
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F80%252F1180ce6c945d7ecf996f0dcc7b00791a%252Fpa%252FAD76625_49f0a4e82e069d562565addfd5457520.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/80/1180ce6c945d7ecf996f0dcc7b00791a/pa/AD76625_49f0a4e82e069d562565addfd5457520.jpg already downloaded
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F80%252F1180ce6c945d7ecf996f0dcc7b00791a%252Fpa%252FAD76625_eccc00e895c53dad47b79865d8ed83ee.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/80/1180ce6c945d7ecf996f0dcc7b00791a/pa/AD76625_eccc00e895c53dad47b79865d8ed83ee.jpg already downloaded
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F80%252F1180ce6c945d7ecf996f0dcc7b00791a%252Fpa%252FAD76625_935c4a96db70b5f3ea6f81b7e4592dcf.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/80/1180ce6c945d7ecf996f0dcc7b00791a/pa/AD76625_935c4a96db70b5f3ea6f81b7e4592dcf.jpg already downloaded
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F80%252F1180ce6c945d7ecf996f0dcc7b00791a%252Fpa%252FAD76625_d7b4d048efa273feb442c3bd07b38e40.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/80/1180ce6c945d7ecf996f0dcc7b00791a/pa/AD76625_d7b4d048efa273feb442c3bd07b38e40.jpg already downloaded
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F80%252F1180ce6c945d7ecf996f0dcc7b00791a%252Fpa%252FAD76625_5768a97038b12637a73bb589dcbee23f.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/80/1180ce6c945d7ecf996f0dcc7b00791a/pa/AD76625_5768a97038b12637a73bb589dcbee23f.jpg already downloaded
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F80%252F1180ce6c945d7ecf996f0dcc7b00791a%252Fpa%252FAD76625_89912455622b65600c48ca20b96374bd.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/80/1180ce6c945d7ecf996f0dcc7b00791a/pa/AD76625_89912455622b65600c48ca20b96374bd.jpg already downloaded
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F80%252F1180ce6c945d7ecf996f0dcc7b00791a%252Fpa%252FAD76625_106db0007e093858ea9be664e49a059a.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/80/1180ce6c945d7ecf996f0dcc7b00791a/pa/AD76625_106db0007e093858ea9be664e49a059a.jpg already downloaded
2026-03-29 08:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 75a91cdc-86c4-5050-8e38-0b274a59dfc5, identifier: AD76625
2026-03-29 08:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd52cec8-ca5a-5686-8bc0-418f55f3a58c with identifier: MH83966
2026-03-29 08:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd52cec8-ca5a-5686-8bc0-418f55f3a58c with scrape type 1
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bd52cec8-ca5a-5686-8bc0-418f55f3a58c
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fda%252F86da990337cf80392eba62791eba32f9%252Fpa%252FMH83966_45484c9404fa43591c91b2976c814262.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/da/86da990337cf80392eba62791eba32f9/pa/MH83966_45484c9404fa43591c91b2976c814262.jpg already downloaded
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fda%252F86da990337cf80392eba62791eba32f9%252Fpa%252FMH83966_6b321edc62b13c646ab461668bf93482.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/da/86da990337cf80392eba62791eba32f9/pa/MH83966_6b321edc62b13c646ab461668bf93482.jpg already downloaded
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fda%252F86da990337cf80392eba62791eba32f9%252Fpa%252FMH83966_f0e399af05c5295ef4e8afb0374214d7.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/da/86da990337cf80392eba62791eba32f9/pa/MH83966_f0e399af05c5295ef4e8afb0374214d7.jpg already downloaded
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fda%252F86da990337cf80392eba62791eba32f9%252Fpa%252FMH83966_b43e3f7ee8cbf9edc8e51bc40e8edf44.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/da/86da990337cf80392eba62791eba32f9/pa/MH83966_b43e3f7ee8cbf9edc8e51bc40e8edf44.jpg already downloaded
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fda%252F86da990337cf80392eba62791eba32f9%252Fpa%252FMH83966_184b2d34c12786a774ec6b89b35ca1c6.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/da/86da990337cf80392eba62791eba32f9/pa/MH83966_184b2d34c12786a774ec6b89b35ca1c6.jpg already downloaded
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fda%252F86da990337cf80392eba62791eba32f9%252Fpa%252FMH83966_efd53ada776cd8a428e41f5b945b9412.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/da/86da990337cf80392eba62791eba32f9/pa/MH83966_efd53ada776cd8a428e41f5b945b9412.jpg already downloaded
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fda%252F86da990337cf80392eba62791eba32f9%252Fpa%252FMH83966_970bf69f078cb7188b8559892f7e97a6.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/da/86da990337cf80392eba62791eba32f9/pa/MH83966_970bf69f078cb7188b8559892f7e97a6.jpg already downloaded
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fda%252F86da990337cf80392eba62791eba32f9%252Fpa%252FMH83966_70e1dc427a57d25e50e92b1551037f40.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/da/86da990337cf80392eba62791eba32f9/pa/MH83966_70e1dc427a57d25e50e92b1551037f40.jpg already downloaded
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fda%252F86da990337cf80392eba62791eba32f9%252Fpa%252FMH83966_911a0a77c28d762206af7ff476c06f8d.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/da/86da990337cf80392eba62791eba32f9/pa/MH83966_911a0a77c28d762206af7ff476c06f8d.jpg already downloaded
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fda%252F86da990337cf80392eba62791eba32f9%252Fpa%252FMH83966_774e2e92a0eef8088f9b5e72f3626910.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/da/86da990337cf80392eba62791eba32f9/pa/MH83966_774e2e92a0eef8088f9b5e72f3626910.jpg already downloaded
2026-03-29 08:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bd52cec8-ca5a-5686-8bc0-418f55f3a58c, identifier: MH83966
2026-03-29 08:35:37 [auto1.be] INFO: Found listing with ID: VM31149
2026-03-29 08:35:37 [auto1.be] INFO: Found listing with ID: JC67757
2026-03-29 08:35:37 [auto1.be] INFO: Found listing with ID: UA36767
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA36767%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [auto1.be] INFO: Scrape type for UA36767: 2
2026-03-29 08:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea3a0f24-9c0d-50d2-a234-a7007900a850 with identifier: UA36767
2026-03-29 08:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea3a0f24-9c0d-50d2-a234-a7007900a850 with scrape type 2
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea3a0f24-9c0d-50d2-a234-a7007900a850 with scrape type 2
2026-03-29 08:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ea3a0f24-9c0d-50d2-a234-a7007900a850, identifier: UA36767
2026-03-29 08:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 75a91cdc-86c4-5050-8e38-0b274a59dfc5 with identifier: AD76625
2026-03-29 08:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 75a91cdc-86c4-5050-8e38-0b274a59dfc5 with identifier: AD76625
2026-03-29 08:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 75a91cdc-86c4-5050-8e38-0b274a59dfc5 with identifier: AD76625 to the API
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AD76625>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:23:09Z',
'fuel_type': 'petrol',
'id': '75a91cdc-86c4-5050-8e38-0b274a59dfc5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD76625',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'BMW',
'model': '4er',
'odometer': 215842,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img11/80/1180ce6c945d7ecf996f0dcc7b00791a/pa/AD76625_42787cf326d08646c06da4a9daf31650.jpg',
'https://img-pa.auto1.com/img11/80/1180ce6c945d7ecf996f0dcc7b00791a/pa/AD76625_66f810ffd16932395668034dfcc05556.jpg',
'https://img-pa.auto1.com/img11/80/1180ce6c945d7ecf996f0dcc7b00791a/pa/AD76625_f6bd4b1149ba2ee0fdf50804848bc7cd.jpg',
'https://img-pa.auto1.com/img11/80/1180ce6c945d7ecf996f0dcc7b00791a/pa/AD76625_49f0a4e82e069d562565addfd5457520.jpg',
'https://img-pa.auto1.com/img11/80/1180ce6c945d7ecf996f0dcc7b00791a/pa/AD76625_eccc00e895c53dad47b79865d8ed83ee.jpg',
'https://img-pa.auto1.com/img11/80/1180ce6c945d7ecf996f0dcc7b00791a/pa/AD76625_935c4a96db70b5f3ea6f81b7e4592dcf.jpg',
'https://img-pa.auto1.com/img11/80/1180ce6c945d7ecf996f0dcc7b00791a/pa/AD76625_d7b4d048efa273feb442c3bd07b38e40.jpg',
'https://img-pa.auto1.com/img11/80/1180ce6c945d7ecf996f0dcc7b00791a/pa/AD76625_5768a97038b12637a73bb589dcbee23f.jpg',
'https://img-pa.auto1.com/img11/80/1180ce6c945d7ecf996f0dcc7b00791a/pa/AD76625_89912455622b65600c48ca20b96374bd.jpg',
'https://img-pa.auto1.com/img11/80/1180ce6c945d7ecf996f0dcc7b00791a/pa/AD76625_106db0007e093858ea9be664e49a059a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75a91cdc-86c4-5050-8e38-0b274a59dfc5/75a91cdc-86c4-5050-8e38-0b274a59dfc5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83549,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/80/1180ce6c945d7ecf996f0dcc7b00791a/pa/AD76625_42787cf326d08646c06da4a9daf31650.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75a91cdc-86c4-5050-8e38-0b274a59dfc5/75a91cdc-86c4-5050-8e38-0b274a59dfc5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72573,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/80/1180ce6c945d7ecf996f0dcc7b00791a/pa/AD76625_66f810ffd16932395668034dfcc05556.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75a91cdc-86c4-5050-8e38-0b274a59dfc5/75a91cdc-86c4-5050-8e38-0b274a59dfc5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63722,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/80/1180ce6c945d7ecf996f0dcc7b00791a/pa/AD76625_f6bd4b1149ba2ee0fdf50804848bc7cd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75a91cdc-86c4-5050-8e38-0b274a59dfc5/75a91cdc-86c4-5050-8e38-0b274a59dfc5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70610,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/80/1180ce6c945d7ecf996f0dcc7b00791a/pa/AD76625_49f0a4e82e069d562565addfd5457520.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75a91cdc-86c4-5050-8e38-0b274a59dfc5/75a91cdc-86c4-5050-8e38-0b274a59dfc5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60494,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/80/1180ce6c945d7ecf996f0dcc7b00791a/pa/AD76625_eccc00e895c53dad47b79865d8ed83ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75a91cdc-86c4-5050-8e38-0b274a59dfc5/75a91cdc-86c4-5050-8e38-0b274a59dfc5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64537,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/80/1180ce6c945d7ecf996f0dcc7b00791a/pa/AD76625_935c4a96db70b5f3ea6f81b7e4592dcf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75a91cdc-86c4-5050-8e38-0b274a59dfc5/75a91cdc-86c4-5050-8e38-0b274a59dfc5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71255,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/80/1180ce6c945d7ecf996f0dcc7b00791a/pa/AD76625_d7b4d048efa273feb442c3bd07b38e40.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75a91cdc-86c4-5050-8e38-0b274a59dfc5/75a91cdc-86c4-5050-8e38-0b274a59dfc5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80251,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/80/1180ce6c945d7ecf996f0dcc7b00791a/pa/AD76625_5768a97038b12637a73bb589dcbee23f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75a91cdc-86c4-5050-8e38-0b274a59dfc5/75a91cdc-86c4-5050-8e38-0b274a59dfc5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91588,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/80/1180ce6c945d7ecf996f0dcc7b00791a/pa/AD76625_89912455622b65600c48ca20b96374bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75a91cdc-86c4-5050-8e38-0b274a59dfc5/75a91cdc-86c4-5050-8e38-0b274a59dfc5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64948,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/80/1180ce6c945d7ecf996f0dcc7b00791a/pa/AD76625_106db0007e093858ea9be664e49a059a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-04-23',
'seats_number': 4,
'seller_name': None,
'title': 'BMW 4er 420i',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD76625%27 HTTP/1.1" 200 None
2026-03-29 08:35:38 [auto1.be] INFO: Saving data for AD76625: {'created_time': 1774773338.177019, 'last_price_update_time': 1774773338.177029, 'auction_closing_time': 1774884189.0}
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AD76625') HTTP/1.1" 204 0
2026-03-29 08:35:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bd52cec8-ca5a-5686-8bc0-418f55f3a58c with identifier: MH83966
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-29 08:35:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 08:35:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bd52cec8-ca5a-5686-8bc0-418f55f3a58c with identifier: MH83966
2026-03-29 08:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bd52cec8-ca5a-5686-8bc0-418f55f3a58c with identifier: MH83966 to the API
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MH83966>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:58:51Z',
'fuel_type': 'petrol',
'id': 'bd52cec8-ca5a-5686-8bc0-418f55f3a58c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH83966',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'BMW',
'model': 'X1',
'odometer': 33577,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img86/da/86da990337cf80392eba62791eba32f9/pa/MH83966_45484c9404fa43591c91b2976c814262.jpg',
'https://img-pa.auto1.com/img86/da/86da990337cf80392eba62791eba32f9/pa/MH83966_6b321edc62b13c646ab461668bf93482.jpg',
'https://img-pa.auto1.com/img86/da/86da990337cf80392eba62791eba32f9/pa/MH83966_f0e399af05c5295ef4e8afb0374214d7.jpg',
'https://img-pa.auto1.com/img86/da/86da990337cf80392eba62791eba32f9/pa/MH83966_b43e3f7ee8cbf9edc8e51bc40e8edf44.jpg',
'https://img-pa.auto1.com/img86/da/86da990337cf80392eba62791eba32f9/pa/MH83966_184b2d34c12786a774ec6b89b35ca1c6.jpg',
'https://img-pa.auto1.com/img86/da/86da990337cf80392eba62791eba32f9/pa/MH83966_efd53ada776cd8a428e41f5b945b9412.jpg',
'https://img-pa.auto1.com/img86/da/86da990337cf80392eba62791eba32f9/pa/MH83966_970bf69f078cb7188b8559892f7e97a6.jpg',
'https://img-pa.auto1.com/img86/da/86da990337cf80392eba62791eba32f9/pa/MH83966_70e1dc427a57d25e50e92b1551037f40.jpg',
'https://img-pa.auto1.com/img86/da/86da990337cf80392eba62791eba32f9/pa/MH83966_911a0a77c28d762206af7ff476c06f8d.jpg',
'https://img-pa.auto1.com/img86/da/86da990337cf80392eba62791eba32f9/pa/MH83966_774e2e92a0eef8088f9b5e72f3626910.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd52cec8-ca5a-5686-8bc0-418f55f3a58c/bd52cec8-ca5a-5686-8bc0-418f55f3a58c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105882,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/da/86da990337cf80392eba62791eba32f9/pa/MH83966_45484c9404fa43591c91b2976c814262.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd52cec8-ca5a-5686-8bc0-418f55f3a58c/bd52cec8-ca5a-5686-8bc0-418f55f3a58c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105882,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/da/86da990337cf80392eba62791eba32f9/pa/MH83966_6b321edc62b13c646ab461668bf93482.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd52cec8-ca5a-5686-8bc0-418f55f3a58c/bd52cec8-ca5a-5686-8bc0-418f55f3a58c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87606,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/da/86da990337cf80392eba62791eba32f9/pa/MH83966_f0e399af05c5295ef4e8afb0374214d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd52cec8-ca5a-5686-8bc0-418f55f3a58c/bd52cec8-ca5a-5686-8bc0-418f55f3a58c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75591,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/da/86da990337cf80392eba62791eba32f9/pa/MH83966_b43e3f7ee8cbf9edc8e51bc40e8edf44.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd52cec8-ca5a-5686-8bc0-418f55f3a58c/bd52cec8-ca5a-5686-8bc0-418f55f3a58c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92869,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/da/86da990337cf80392eba62791eba32f9/pa/MH83966_184b2d34c12786a774ec6b89b35ca1c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd52cec8-ca5a-5686-8bc0-418f55f3a58c/bd52cec8-ca5a-5686-8bc0-418f55f3a58c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85294,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/da/86da990337cf80392eba62791eba32f9/pa/MH83966_efd53ada776cd8a428e41f5b945b9412.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd52cec8-ca5a-5686-8bc0-418f55f3a58c/bd52cec8-ca5a-5686-8bc0-418f55f3a58c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53793,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/da/86da990337cf80392eba62791eba32f9/pa/MH83966_970bf69f078cb7188b8559892f7e97a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd52cec8-ca5a-5686-8bc0-418f55f3a58c/bd52cec8-ca5a-5686-8bc0-418f55f3a58c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1819503,
'Height': 3024,
'OriginUrl': 'https://img-pa.auto1.com/img86/da/86da990337cf80392eba62791eba32f9/pa/MH83966_70e1dc427a57d25e50e92b1551037f40.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd52cec8-ca5a-5686-8bc0-418f55f3a58c/bd52cec8-ca5a-5686-8bc0-418f55f3a58c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100680,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/da/86da990337cf80392eba62791eba32f9/pa/MH83966_911a0a77c28d762206af7ff476c06f8d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd52cec8-ca5a-5686-8bc0-418f55f3a58c/bd52cec8-ca5a-5686-8bc0-418f55f3a58c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89428,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/da/86da990337cf80392eba62791eba32f9/pa/MH83966_774e2e92a0eef8088f9b5e72f3626910.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-03-23',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 sDrive 18i Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2021}
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MH83966%27 HTTP/1.1" 200 None
2026-03-29 08:35:38 [auto1.be] INFO: Saving data for MH83966: {'created_time': 1774773338.637832, 'last_price_update_time': 1774773338.637842, 'auction_closing_time': 1774886331.0}
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MH83966') HTTP/1.1" 204 0
2026-03-29 08:35:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ea3a0f24-9c0d-50d2-a234-a7007900a850 with identifier: UA36767
2026-03-29 08:35:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ea3a0f24-9c0d-50d2-a234-a7007900a850 with identifier: UA36767
2026-03-29 08:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ea3a0f24-9c0d-50d2-a234-a7007900a850 with identifier: UA36767 to the API
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:50:14Z',
'fuel_type': 'diesel',
'id': 'ea3a0f24-9c0d-50d2-a234-a7007900a850',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA36767',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 234001,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-10-02',
'seller_name': None,
'title': 'Hyundai Tucson 2.0 CRDi',
'transmission': 'manual',
'trim': '',
'year': 2008}
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA36767%27 HTTP/1.1" 200 None
2026-03-29 08:35:38 [auto1.be] INFO: Saving data for UA36767: {'auction_closing_time': 1774885814.0, 'created_time': 1773137435.944325, 'last_price_update_time': 1774773338.99318}
2026-03-29 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UA36767') HTTP/1.1" 204 0
2026-03-29 08:35:39 [auto1.be] INFO: Found listing with ID: TG30379
2026-03-29 08:35:39 [auto1.be] INFO: Found listing with ID: MX26890
2026-03-29 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX26890%27 HTTP/1.1" 200 None
2026-03-29 08:35:39 [auto1.be] INFO: Scrape type for MX26890: 2
2026-03-29 08:35:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dbb4816-4c7f-5b89-84c4-36c8814b7af5 with identifier: MX26890
2026-03-29 08:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dbb4816-4c7f-5b89-84c4-36c8814b7af5 with scrape type 2
2026-03-29 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9dbb4816-4c7f-5b89-84c4-36c8814b7af5 with scrape type 2
2026-03-29 08:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9dbb4816-4c7f-5b89-84c4-36c8814b7af5, identifier: MX26890
2026-03-29 08:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BL31735/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:39 [auto1.be] INFO: Found listing with ID: VE25219
2026-03-29 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE25219%27 HTTP/1.1" 200 None
2026-03-29 08:35:39 [auto1.be] INFO: Scrape type for VE25219: 2
2026-03-29 08:35:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cc247f5-8245-5670-8396-d87c43561ad5 with identifier: VE25219
2026-03-29 08:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cc247f5-8245-5670-8396-d87c43561ad5 with scrape type 2
2026-03-29 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cc247f5-8245-5670-8396-d87c43561ad5 with scrape type 2
2026-03-29 08:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3cc247f5-8245-5670-8396-d87c43561ad5, identifier: VE25219
2026-03-29 08:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9dbb4816-4c7f-5b89-84c4-36c8814b7af5 with identifier: MX26890
2026-03-29 08:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9dbb4816-4c7f-5b89-84c4-36c8814b7af5 with identifier: MX26890
2026-03-29 08:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9dbb4816-4c7f-5b89-84c4-36c8814b7af5 with identifier: MX26890 to the API
2026-03-29 08:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 231,
'expiration_date': '2026-03-30T15:36:57Z',
'fuel_type': 'petrol',
'id': '9dbb4816-4c7f-5b89-84c4-36c8814b7af5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX26890',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 90514,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-04',
'seller_name': None,
'title': 'MINI John Cooper Works',
'transmission': 'automatic',
'trim': '',
'year': 2021}
2026-03-29 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX26890%27 HTTP/1.1" 200 None
2026-03-29 08:35:39 [auto1.be] INFO: Saving data for MX26890: {'auction_closing_time': 1774885017.0, 'created_time': 1773137472.010623, 'last_price_update_time': 1774773339.512909}
2026-03-29 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MX26890') HTTP/1.1" 204 0
2026-03-29 08:35:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3cc247f5-8245-5670-8396-d87c43561ad5 with identifier: VE25219
2026-03-29 08:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3cc247f5-8245-5670-8396-d87c43561ad5 with identifier: VE25219
2026-03-29 08:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3cc247f5-8245-5670-8396-d87c43561ad5 with identifier: VE25219 to the API
2026-03-29 08:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:37:52Z',
'fuel_type': 'petrol',
'id': '3cc247f5-8245-5670-8396-d87c43561ad5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE25219',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan Allspace',
'odometer': 55598,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-31',
'seller_name': None,
'title': 'Volkswagen Tiguan Allspace 1.5 TSI ACT R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2022}
2026-03-29 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE25219%27 HTTP/1.1" 200 None
2026-03-29 08:35:39 [auto1.be] INFO: Saving data for VE25219: {'auction_closing_time': 1774885072.0, 'created_time': 1773239663.19014, 'last_price_update_time': 1774773339.882251}
2026-03-29 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VE25219') HTTP/1.1" 204 0
2026-03-29 08:35:39 [auto1.be] INFO: Found listing with ID: DB21184
2026-03-29 08:35:39 [auto1.be] INFO: Found listing with ID: ZX91910
2026-03-29 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX91910%27 HTTP/1.1" 200 None
2026-03-29 08:35:39 [auto1.be] INFO: Scrape type for ZX91910: 2
2026-03-29 08:35:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8339274d-c6a2-5f32-9851-1f9516d45de0 with identifier: ZX91910
2026-03-29 08:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8339274d-c6a2-5f32-9851-1f9516d45de0 with scrape type 2
2026-03-29 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8339274d-c6a2-5f32-9851-1f9516d45de0 with scrape type 2
2026-03-29 08:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8339274d-c6a2-5f32-9851-1f9516d45de0, identifier: ZX91910
2026-03-29 08:35:40 [auto1.be] INFO: Found listing with ID: WA86347
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA86347%27 HTTP/1.1" 200 None
2026-03-29 08:35:40 [auto1.be] INFO: Scrape type for WA86347: 2
2026-03-29 08:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 499739a2-91ec-56ba-9fc8-77d73743a9f1 with identifier: WA86347
2026-03-29 08:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 499739a2-91ec-56ba-9fc8-77d73743a9f1 with scrape type 2
2026-03-29 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 499739a2-91ec-56ba-9fc8-77d73743a9f1 with scrape type 2
2026-03-29 08:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 499739a2-91ec-56ba-9fc8-77d73743a9f1, identifier: WA86347
2026-03-29 08:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8339274d-c6a2-5f32-9851-1f9516d45de0 with identifier: ZX91910
2026-03-29 08:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8339274d-c6a2-5f32-9851-1f9516d45de0 with identifier: ZX91910
2026-03-29 08:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8339274d-c6a2-5f32-9851-1f9516d45de0 with identifier: ZX91910 to the API
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:34:34Z',
'fuel_type': 'diesel',
'id': '8339274d-c6a2-5f32-9851-1f9516d45de0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX91910',
'listing': 'auction',
'make': 'Renault',
'model': 'Trafic',
'odometer': 39745,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-19',
'seller_name': None,
'title': 'Renault Trafic 2.0 BLUE dCi L2H1 3,0t Komfort',
'transmission': 'automatic',
'trim': 'L2H1 3,0t Komfort',
'year': 2022}
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX91910%27 HTTP/1.1" 200 None
2026-03-29 08:35:40 [auto1.be] INFO: Saving data for ZX91910: {'auction_closing_time': 1774884874.0, 'created_time': 1773137643.772233, 'last_price_update_time': 1774773340.412364}
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZX91910') HTTP/1.1" 204 0
2026-03-29 08:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 499739a2-91ec-56ba-9fc8-77d73743a9f1 with identifier: WA86347
2026-03-29 08:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 499739a2-91ec-56ba-9fc8-77d73743a9f1 with identifier: WA86347
2026-03-29 08:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 499739a2-91ec-56ba-9fc8-77d73743a9f1 with identifier: WA86347 to the API
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:45:06Z',
'fuel_type': 'diesel',
'id': '499739a2-91ec-56ba-9fc8-77d73743a9f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA86347',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 192311,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-06-30',
'seller_name': None,
'title': 'Seat Ibiza 1.6 TDI Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2009}
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA86347%27 HTTP/1.1" 200 None
2026-03-29 08:35:40 [auto1.be] INFO: Saving data for WA86347: {'auction_closing_time': 1774885506.0, 'created_time': 1773132700.804933, 'last_price_update_time': 1774773340.871442}
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WA86347') HTTP/1.1" 204 0
2026-03-29 08:35:41 [auto1.be] INFO: Found listing with ID: LU53556
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU53556%27 HTTP/1.1" 200 None
2026-03-29 08:35:41 [auto1.be] INFO: Scrape type for LU53556: 2
2026-03-29 08:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7adbbda1-1630-5553-aed9-d33cff5a901f with identifier: LU53556
2026-03-29 08:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7adbbda1-1630-5553-aed9-d33cff5a901f with scrape type 2
2026-03-29 08:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7adbbda1-1630-5553-aed9-d33cff5a901f with scrape type 2
2026-03-29 08:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7adbbda1-1630-5553-aed9-d33cff5a901f, identifier: LU53556
2026-03-29 08:35:41 [auto1.be] INFO: Found listing with ID: PS31946
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS31946%27 HTTP/1.1" 200 None
2026-03-29 08:35:41 [auto1.be] INFO: Scrape type for PS31946: 2
2026-03-29 08:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0769dfb4-f815-5797-8b01-50a9da6de20a with identifier: PS31946
2026-03-29 08:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0769dfb4-f815-5797-8b01-50a9da6de20a with scrape type 2
2026-03-29 08:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0769dfb4-f815-5797-8b01-50a9da6de20a with scrape type 2
2026-03-29 08:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0769dfb4-f815-5797-8b01-50a9da6de20a, identifier: PS31946
2026-03-29 08:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7adbbda1-1630-5553-aed9-d33cff5a901f with identifier: LU53556
2026-03-29 08:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7adbbda1-1630-5553-aed9-d33cff5a901f with identifier: LU53556
2026-03-29 08:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7adbbda1-1630-5553-aed9-d33cff5a901f with identifier: LU53556 to the API
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 340,
'expiration_date': '2026-03-30T15:08:47Z',
'fuel_type': 'petrol',
'id': '7adbbda1-1630-5553-aed9-d33cff5a901f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU53556',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 68333,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-27',
'seller_name': None,
'title': 'BMW 1er M140i Special Edition',
'transmission': 'automatic',
'trim': 'Special Edition',
'year': 2019}
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU53556%27 HTTP/1.1" 200 None
2026-03-29 08:35:41 [auto1.be] INFO: Saving data for LU53556: {'auction_closing_time': 1774883327.0, 'created_time': 1773133730.700751, 'last_price_update_time': 1774773341.935154}
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LU53556') HTTP/1.1" 204 0
2026-03-29 08:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0769dfb4-f815-5797-8b01-50a9da6de20a with identifier: PS31946
2026-03-29 08:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0769dfb4-f815-5797-8b01-50a9da6de20a with identifier: PS31946
2026-03-29 08:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0769dfb4-f815-5797-8b01-50a9da6de20a with identifier: PS31946 to the API
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:09:04Z',
'fuel_type': 'petrol',
'id': '0769dfb4-f815-5797-8b01-50a9da6de20a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS31946',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 106584,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-11',
'seller_name': None,
'title': 'Skoda Octavia 1.4 TSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2014}
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS31946%27 HTTP/1.1" 200 None
2026-03-29 08:35:42 [auto1.be] INFO: Saving data for PS31946: {'auction_closing_time': 1774883344.0, 'created_time': 1773237985.450705, 'last_price_update_time': 1774773342.244463}
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PS31946') HTTP/1.1" 204 0
2026-03-29 08:35:42 [auto1.be] INFO: Found listing with ID: TT03576
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT03576%27 HTTP/1.1" 200 None
2026-03-29 08:35:42 [auto1.be] INFO: Scrape type for TT03576: 1
2026-03-29 08:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TM16461/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:42 [auto1.be] INFO: Found listing with ID: DY35896
2026-03-29 08:35:42 [auto1.be] INFO: Found listing with ID: KZ95632
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ95632%27 HTTP/1.1" 200 None
2026-03-29 08:35:42 [auto1.be] INFO: Scrape type for KZ95632: 2
2026-03-29 08:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa429584-98dd-52b8-ba87-dfdfb2bd2f40 with identifier: KZ95632
2026-03-29 08:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa429584-98dd-52b8-ba87-dfdfb2bd2f40 with scrape type 2
2026-03-29 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa429584-98dd-52b8-ba87-dfdfb2bd2f40 with scrape type 2
2026-03-29 08:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fa429584-98dd-52b8-ba87-dfdfb2bd2f40, identifier: KZ95632
2026-03-29 08:35:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BY20726/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KD33371/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DZ79289> (referer: https://www.auto1.com/v1/car-details-view/DZ79289/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fa429584-98dd-52b8-ba87-dfdfb2bd2f40 with identifier: KZ95632
2026-03-29 08:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fa429584-98dd-52b8-ba87-dfdfb2bd2f40 with identifier: KZ95632
2026-03-29 08:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fa429584-98dd-52b8-ba87-dfdfb2bd2f40 with identifier: KZ95632 to the API
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:33:17Z',
'fuel_type': 'petrol',
'id': 'fa429584-98dd-52b8-ba87-dfdfb2bd2f40',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ95632',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-3',
'odometer': 65099,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-05',
'seller_name': None,
'title': 'Mazda CX-3 2.0 Exclusive-Line',
'transmission': 'automatic',
'trim': 'Exclusive-Line',
'year': 2016}
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ95632%27 HTTP/1.1" 200 None
2026-03-29 08:35:42 [auto1.be] INFO: Saving data for KZ95632: {'auction_closing_time': 1774884797.0, 'created_time': 1774298271.500588, 'last_price_update_time': 1774773342.670644}
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KZ95632') HTTP/1.1" 204 0
2026-03-29 08:35:42 [auto1.be] INFO: Found listing with ID: BD95571
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD95571%27 HTTP/1.1" 200 None
2026-03-29 08:35:42 [auto1.be] INFO: Scrape type for BD95571: 2
2026-03-29 08:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efb9e4e0-3076-56c9-a209-f06e6b24a6d9 with identifier: BD95571
2026-03-29 08:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efb9e4e0-3076-56c9-a209-f06e6b24a6d9 with scrape type 2
2026-03-29 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efb9e4e0-3076-56c9-a209-f06e6b24a6d9 with scrape type 2
2026-03-29 08:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: efb9e4e0-3076-56c9-a209-f06e6b24a6d9, identifier: BD95571
2026-03-29 08:35:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:42 [auto1.be] INFO: Found listing with ID: VM01272
2026-03-29 08:35:42 [auto1.be] INFO: Found listing with ID: KL42374
2026-03-29 08:35:42 [auto1.be] INFO: Found listing with ID: UF75491
2026-03-29 08:35:42 [auto1.be] INFO: Found listing with ID: ZP25114
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP25114%27 HTTP/1.1" 200 None
2026-03-29 08:35:42 [auto1.be] INFO: Scrape type for ZP25114: 2
2026-03-29 08:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42940469-99fe-55df-bbf9-19e642712c9c with identifier: ZP25114
2026-03-29 08:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42940469-99fe-55df-bbf9-19e642712c9c with scrape type 2
2026-03-29 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42940469-99fe-55df-bbf9-19e642712c9c with scrape type 2
2026-03-29 08:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 42940469-99fe-55df-bbf9-19e642712c9c, identifier: ZP25114
2026-03-29 08:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: efb9e4e0-3076-56c9-a209-f06e6b24a6d9 with identifier: BD95571
2026-03-29 08:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: efb9e4e0-3076-56c9-a209-f06e6b24a6d9 with identifier: BD95571
2026-03-29 08:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: efb9e4e0-3076-56c9-a209-f06e6b24a6d9 with identifier: BD95571 to the API
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:13:22Z',
'fuel_type': 'petrol',
'id': 'efb9e4e0-3076-56c9-a209-f06e6b24a6d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD95571',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 35981,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-27',
'seller_name': None,
'title': 'Volkswagen Tiguan 1.5 TSI ACT R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2023}
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD95571%27 HTTP/1.1" 200 None
2026-03-29 08:35:43 [auto1.be] INFO: Saving data for BD95571: {'auction_closing_time': 1774883602.0, 'created_time': 1773136854.979983, 'last_price_update_time': 1774773343.271065}
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BD95571') HTTP/1.1" 204 0
2026-03-29 08:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 42940469-99fe-55df-bbf9-19e642712c9c with identifier: ZP25114
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-29 08:35:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 08:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 42940469-99fe-55df-bbf9-19e642712c9c with identifier: ZP25114
2026-03-29 08:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 42940469-99fe-55df-bbf9-19e642712c9c with identifier: ZP25114 to the API
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:12:22Z',
'fuel_type': 'diesel',
'id': '42940469-99fe-55df-bbf9-19e642712c9c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP25114',
'listing': 'auction',
'make': 'Ford',
'model': 'Grand Tourneo Connect',
'odometer': 188921,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-27',
'seller_name': None,
'title': 'Ford Grand Tourneo Connect 1.6 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2014}
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP25114%27 HTTP/1.1" 200 None
2026-03-29 08:35:43 [auto1.be] INFO: Saving data for ZP25114: {'auction_closing_time': 1774883542.0, 'created_time': 1773301904.259899, 'last_price_update_time': 1774773343.693945}
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZP25114') HTTP/1.1" 204 0
2026-03-29 08:35:43 [auto1.be] INFO: Found listing with ID: EA40127
2026-03-29 08:35:43 [auto1.be] INFO: Found listing with ID: TC19196
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC19196%27 HTTP/1.1" 200 None
2026-03-29 08:35:43 [auto1.be] INFO: Scrape type for TC19196: 2
2026-03-29 08:35:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77902958-9672-5cc1-9fff-811befb56fcc with identifier: TC19196
2026-03-29 08:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77902958-9672-5cc1-9fff-811befb56fcc with scrape type 2
2026-03-29 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77902958-9672-5cc1-9fff-811befb56fcc with scrape type 2
2026-03-29 08:35:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 77902958-9672-5cc1-9fff-811befb56fcc, identifier: TC19196
2026-03-29 08:35:43 [auto1.be] INFO: Found listing with ID: FP22064
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP22064%27 HTTP/1.1" 200 None
2026-03-29 08:35:43 [auto1.be] INFO: Scrape type for FP22064: 1
2026-03-29 08:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 77902958-9672-5cc1-9fff-811befb56fcc with identifier: TC19196
2026-03-29 08:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 77902958-9672-5cc1-9fff-811befb56fcc with identifier: TC19196
2026-03-29 08:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 77902958-9672-5cc1-9fff-811befb56fcc with identifier: TC19196 to the API
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 300,
'expiration_date': '2026-03-30T15:48:31Z',
'fuel_type': 'diesel',
'id': '77902958-9672-5cc1-9fff-811befb56fcc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC19196',
'listing': 'auction',
'make': 'Jaguar',
'model': 'XJ',
'odometer': 174112,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-10',
'seller_name': None,
'title': 'Jaguar XJ 3.0 D V6 Portfolio',
'transmission': 'automatic',
'trim': 'Portfolio',
'year': 2021}
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC19196%27 HTTP/1.1" 200 None
2026-03-29 08:35:44 [auto1.be] INFO: Saving data for TC19196: {'auction_closing_time': 1774885711.0, 'created_time': 1774643870.70738, 'last_price_update_time': 1774773344.111071}
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TC19196') HTTP/1.1" 204 0
2026-03-29 08:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZM02853/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KF56069/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: DF78239
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: CM14446
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM14446%27 HTTP/1.1" 200 None
2026-03-29 08:35:44 [auto1.be] INFO: Scrape type for CM14446: 1
2026-03-29 08:35:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ffbaf38-1261-55de-aa57-2a8a5e6cb02b with identifier: DZ79289
2026-03-29 08:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ffbaf38-1261-55de-aa57-2a8a5e6cb02b with scrape type 1
2026-03-29 08:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8ffbaf38-1261-55de-aa57-2a8a5e6cb02b
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F98%252F4b984c1c5646eb2ac56e2096ecd1e537%252Fpa%252FDZ79289_f8a4b5bf6eb91019e7b4defb74a90846.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/98/4b984c1c5646eb2ac56e2096ecd1e537/pa/DZ79289_f8a4b5bf6eb91019e7b4defb74a90846.jpg already downloaded
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F98%252F4b984c1c5646eb2ac56e2096ecd1e537%252Fpa%252FDZ79289_865cd850fbb9720eee64f0ab0817e2dc.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/98/4b984c1c5646eb2ac56e2096ecd1e537/pa/DZ79289_865cd850fbb9720eee64f0ab0817e2dc.jpg already downloaded
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F98%252F4b984c1c5646eb2ac56e2096ecd1e537%252Fpa%252FDZ79289_faf6461ada47e3909ae52ecf375ed499.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/98/4b984c1c5646eb2ac56e2096ecd1e537/pa/DZ79289_faf6461ada47e3909ae52ecf375ed499.jpg already downloaded
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F98%252F4b984c1c5646eb2ac56e2096ecd1e537%252Fpa%252FDZ79289_10adbeb5beb8762f46db2781dc6fbdfe.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/98/4b984c1c5646eb2ac56e2096ecd1e537/pa/DZ79289_10adbeb5beb8762f46db2781dc6fbdfe.jpg already downloaded
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F98%252F4b984c1c5646eb2ac56e2096ecd1e537%252Fpa%252FDZ79289_f429c6d9a3577a90a11545cc2c8819e3.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/98/4b984c1c5646eb2ac56e2096ecd1e537/pa/DZ79289_f429c6d9a3577a90a11545cc2c8819e3.jpg already downloaded
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F98%252F4b984c1c5646eb2ac56e2096ecd1e537%252Fpa%252FDZ79289_3db2e0835e2b335134d0429037ee8259.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/98/4b984c1c5646eb2ac56e2096ecd1e537/pa/DZ79289_3db2e0835e2b335134d0429037ee8259.jpg already downloaded
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F98%252F4b984c1c5646eb2ac56e2096ecd1e537%252Fpa%252FDZ79289_7da1b082df028df2c8aff3e742733d1c.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/98/4b984c1c5646eb2ac56e2096ecd1e537/pa/DZ79289_7da1b082df028df2c8aff3e742733d1c.jpg already downloaded
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F98%252F4b984c1c5646eb2ac56e2096ecd1e537%252Fpa%252FDZ79289_17143d94cb6d1ac0e1996c31a201576f.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/98/4b984c1c5646eb2ac56e2096ecd1e537/pa/DZ79289_17143d94cb6d1ac0e1996c31a201576f.jpg already downloaded
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F98%252F4b984c1c5646eb2ac56e2096ecd1e537%252Fpa%252FDZ79289_6089e201561ba17783642fee68ea55eb.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/98/4b984c1c5646eb2ac56e2096ecd1e537/pa/DZ79289_6089e201561ba17783642fee68ea55eb.jpg already downloaded
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F98%252F4b984c1c5646eb2ac56e2096ecd1e537%252Fpa%252FDZ79289_57e2f8caf18361cd6b3edc026c2369d6.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/98/4b984c1c5646eb2ac56e2096ecd1e537/pa/DZ79289_57e2f8caf18361cd6b3edc026c2369d6.jpg already downloaded
2026-03-29 08:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8ffbaf38-1261-55de-aa57-2a8a5e6cb02b, identifier: DZ79289
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: EL71552
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: SK78967
2026-03-29 08:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UZ99297> (referer: https://www.auto1.com/v1/car-details-view/UZ99297/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8ffbaf38-1261-55de-aa57-2a8a5e6cb02b with identifier: DZ79289
2026-03-29 08:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8ffbaf38-1261-55de-aa57-2a8a5e6cb02b with identifier: DZ79289
2026-03-29 08:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8ffbaf38-1261-55de-aa57-2a8a5e6cb02b with identifier: DZ79289 to the API
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DZ79289>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6B',
'engine': '1.4L',
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:25:39Z',
'fuel_type': 'hybrid',
'id': '8ffbaf38-1261-55de-aa57-2a8a5e6cb02b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ79289',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 166165,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img4b/98/4b984c1c5646eb2ac56e2096ecd1e537/pa/DZ79289_f8a4b5bf6eb91019e7b4defb74a90846.jpg',
'https://img-pa.auto1.com/img4b/98/4b984c1c5646eb2ac56e2096ecd1e537/pa/DZ79289_865cd850fbb9720eee64f0ab0817e2dc.jpg',
'https://img-pa.auto1.com/img4b/98/4b984c1c5646eb2ac56e2096ecd1e537/pa/DZ79289_faf6461ada47e3909ae52ecf375ed499.jpg',
'https://img-pa.auto1.com/img4b/98/4b984c1c5646eb2ac56e2096ecd1e537/pa/DZ79289_10adbeb5beb8762f46db2781dc6fbdfe.jpg',
'https://img-pa.auto1.com/img4b/98/4b984c1c5646eb2ac56e2096ecd1e537/pa/DZ79289_f429c6d9a3577a90a11545cc2c8819e3.jpg',
'https://img-pa.auto1.com/img4b/98/4b984c1c5646eb2ac56e2096ecd1e537/pa/DZ79289_3db2e0835e2b335134d0429037ee8259.jpg',
'https://img-pa.auto1.com/img4b/98/4b984c1c5646eb2ac56e2096ecd1e537/pa/DZ79289_7da1b082df028df2c8aff3e742733d1c.jpg',
'https://img-pa.auto1.com/img4b/98/4b984c1c5646eb2ac56e2096ecd1e537/pa/DZ79289_17143d94cb6d1ac0e1996c31a201576f.jpg',
'https://img-pa.auto1.com/img4b/98/4b984c1c5646eb2ac56e2096ecd1e537/pa/DZ79289_6089e201561ba17783642fee68ea55eb.jpg',
'https://img-pa.auto1.com/img4b/98/4b984c1c5646eb2ac56e2096ecd1e537/pa/DZ79289_57e2f8caf18361cd6b3edc026c2369d6.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ffbaf38-1261-55de-aa57-2a8a5e6cb02b/8ffbaf38-1261-55de-aa57-2a8a5e6cb02b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71162,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/98/4b984c1c5646eb2ac56e2096ecd1e537/pa/DZ79289_f8a4b5bf6eb91019e7b4defb74a90846.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ffbaf38-1261-55de-aa57-2a8a5e6cb02b/8ffbaf38-1261-55de-aa57-2a8a5e6cb02b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68822,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/98/4b984c1c5646eb2ac56e2096ecd1e537/pa/DZ79289_865cd850fbb9720eee64f0ab0817e2dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ffbaf38-1261-55de-aa57-2a8a5e6cb02b/8ffbaf38-1261-55de-aa57-2a8a5e6cb02b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72685,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/98/4b984c1c5646eb2ac56e2096ecd1e537/pa/DZ79289_faf6461ada47e3909ae52ecf375ed499.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ffbaf38-1261-55de-aa57-2a8a5e6cb02b/8ffbaf38-1261-55de-aa57-2a8a5e6cb02b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65398,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/98/4b984c1c5646eb2ac56e2096ecd1e537/pa/DZ79289_10adbeb5beb8762f46db2781dc6fbdfe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ffbaf38-1261-55de-aa57-2a8a5e6cb02b/8ffbaf38-1261-55de-aa57-2a8a5e6cb02b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65788,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/98/4b984c1c5646eb2ac56e2096ecd1e537/pa/DZ79289_f429c6d9a3577a90a11545cc2c8819e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ffbaf38-1261-55de-aa57-2a8a5e6cb02b/8ffbaf38-1261-55de-aa57-2a8a5e6cb02b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58529,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/98/4b984c1c5646eb2ac56e2096ecd1e537/pa/DZ79289_3db2e0835e2b335134d0429037ee8259.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ffbaf38-1261-55de-aa57-2a8a5e6cb02b/8ffbaf38-1261-55de-aa57-2a8a5e6cb02b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60501,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/98/4b984c1c5646eb2ac56e2096ecd1e537/pa/DZ79289_7da1b082df028df2c8aff3e742733d1c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ffbaf38-1261-55de-aa57-2a8a5e6cb02b/8ffbaf38-1261-55de-aa57-2a8a5e6cb02b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71690,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/98/4b984c1c5646eb2ac56e2096ecd1e537/pa/DZ79289_17143d94cb6d1ac0e1996c31a201576f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ffbaf38-1261-55de-aa57-2a8a5e6cb02b/8ffbaf38-1261-55de-aa57-2a8a5e6cb02b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70914,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/98/4b984c1c5646eb2ac56e2096ecd1e537/pa/DZ79289_6089e201561ba17783642fee68ea55eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ffbaf38-1261-55de-aa57-2a8a5e6cb02b/8ffbaf38-1261-55de-aa57-2a8a5e6cb02b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68417,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/98/4b984c1c5646eb2ac56e2096ecd1e537/pa/DZ79289_57e2f8caf18361cd6b3edc026c2369d6.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-12-04',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Passat 1.4 GTE',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ79289%27 HTTP/1.1" 200 None
2026-03-29 08:35:44 [auto1.be] INFO: Saving data for DZ79289: {'created_time': 1774773344.796559, 'last_price_update_time': 1774773344.796567, 'auction_closing_time': 1774884339.0}
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DZ79289') HTTP/1.1" 204 0
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: VE29498
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE29498%27 HTTP/1.1" 200 None
2026-03-29 08:35:44 [auto1.be] INFO: Scrape type for VE29498: 2
2026-03-29 08:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4424a2c-0a18-5ba4-a76e-7e49c49c31fb with identifier: VE29498
2026-03-29 08:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4424a2c-0a18-5ba4-a76e-7e49c49c31fb with scrape type 2
2026-03-29 08:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4424a2c-0a18-5ba4-a76e-7e49c49c31fb with scrape type 2
2026-03-29 08:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c4424a2c-0a18-5ba4-a76e-7e49c49c31fb, identifier: VE29498
2026-03-29 08:35:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BY53413/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c4424a2c-0a18-5ba4-a76e-7e49c49c31fb with identifier: VE29498
2026-03-29 08:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c4424a2c-0a18-5ba4-a76e-7e49c49c31fb with identifier: VE29498
2026-03-29 08:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c4424a2c-0a18-5ba4-a76e-7e49c49c31fb with identifier: VE29498 to the API
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:08:54Z',
'fuel_type': 'petrol',
'id': 'c4424a2c-0a18-5ba4-a76e-7e49c49c31fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE29498',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 113299,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-12-22',
'seller_name': None,
'title': 'Peugeot 207 1.4 VTi Tendance',
'transmission': 'manual',
'trim': 'Tendance',
'year': 2011}
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE29498%27 HTTP/1.1" 200 None
2026-03-29 08:35:45 [auto1.be] INFO: Saving data for VE29498: {'auction_closing_time': 1774883334.0, 'created_time': 1773136218.190234, 'last_price_update_time': 1774773345.262893}
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VE29498') HTTP/1.1" 204 0
2026-03-29 08:35:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:45 [auto1.be] INFO: Found listing with ID: BE62996
2026-03-29 08:35:45 [auto1.be] INFO: Found listing with ID: AM49333
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM49333%27 HTTP/1.1" 200 None
2026-03-29 08:35:45 [auto1.be] INFO: Scrape type for AM49333: 2
2026-03-29 08:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4da4b34-3834-5f77-853a-501355717ab8 with identifier: AM49333
2026-03-29 08:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4da4b34-3834-5f77-853a-501355717ab8 with scrape type 2
2026-03-29 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4da4b34-3834-5f77-853a-501355717ab8 with scrape type 2
2026-03-29 08:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b4da4b34-3834-5f77-853a-501355717ab8, identifier: AM49333
2026-03-29 08:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a20e57f3-b4bc-539e-aa39-15adc88a3859 with identifier: UZ99297
2026-03-29 08:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a20e57f3-b4bc-539e-aa39-15adc88a3859 with scrape type 1
2026-03-29 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a20e57f3-b4bc-539e-aa39-15adc88a3859
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fd9%252F20d9c3ef8505cff8b45b5f9a79b320b6%252Fpa%252FUZ99297_8a38e6608b679d39fc0e152fb4d98f40.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/d9/20d9c3ef8505cff8b45b5f9a79b320b6/pa/UZ99297_8a38e6608b679d39fc0e152fb4d98f40.jpg already downloaded
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fd9%252F20d9c3ef8505cff8b45b5f9a79b320b6%252Fpa%252FUZ99297_c4ae715449e777016d5d75b831a5f823.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/d9/20d9c3ef8505cff8b45b5f9a79b320b6/pa/UZ99297_c4ae715449e777016d5d75b831a5f823.jpg already downloaded
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fd9%252F20d9c3ef8505cff8b45b5f9a79b320b6%252Fpa%252FUZ99297_beecc5bc63f0d028d65f21e4760c2fc6.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/d9/20d9c3ef8505cff8b45b5f9a79b320b6/pa/UZ99297_beecc5bc63f0d028d65f21e4760c2fc6.jpg already downloaded
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fd9%252F20d9c3ef8505cff8b45b5f9a79b320b6%252Fpa%252FUZ99297_bc25331b31040457fc7f42a3c98d834b.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/d9/20d9c3ef8505cff8b45b5f9a79b320b6/pa/UZ99297_bc25331b31040457fc7f42a3c98d834b.jpg already downloaded
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fd9%252F20d9c3ef8505cff8b45b5f9a79b320b6%252Fpa%252FUZ99297_f4532b6a5036fb6472446e996a268729.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/d9/20d9c3ef8505cff8b45b5f9a79b320b6/pa/UZ99297_f4532b6a5036fb6472446e996a268729.jpg already downloaded
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fd9%252F20d9c3ef8505cff8b45b5f9a79b320b6%252Fpa%252FUZ99297_3e664d18c7fb9e98c0502e7a9231738d.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/d9/20d9c3ef8505cff8b45b5f9a79b320b6/pa/UZ99297_3e664d18c7fb9e98c0502e7a9231738d.jpg already downloaded
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fd9%252F20d9c3ef8505cff8b45b5f9a79b320b6%252Fpa%252FUZ99297_5ad32373d68e4d8de46f958429f028ca.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/d9/20d9c3ef8505cff8b45b5f9a79b320b6/pa/UZ99297_5ad32373d68e4d8de46f958429f028ca.jpg already downloaded
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fd9%252F20d9c3ef8505cff8b45b5f9a79b320b6%252Fpa%252FUZ99297_ff8ea7444ff5085c9f94641f6a8c17e8.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/d9/20d9c3ef8505cff8b45b5f9a79b320b6/pa/UZ99297_ff8ea7444ff5085c9f94641f6a8c17e8.jpg already downloaded
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fd9%252F20d9c3ef8505cff8b45b5f9a79b320b6%252Fpa%252FUZ99297_3f8358a0b902108b3c8efde22a2ba22c.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/d9/20d9c3ef8505cff8b45b5f9a79b320b6/pa/UZ99297_3f8358a0b902108b3c8efde22a2ba22c.jpg already downloaded
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252Fd9%252F20d9c3ef8505cff8b45b5f9a79b320b6%252Fpa%252FUZ99297_59db23cc2fdea5062cdaeb9baa9ae0f3.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/d9/20d9c3ef8505cff8b45b5f9a79b320b6/pa/UZ99297_59db23cc2fdea5062cdaeb9baa9ae0f3.jpg already downloaded
2026-03-29 08:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a20e57f3-b4bc-539e-aa39-15adc88a3859, identifier: UZ99297
2026-03-29 08:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b4da4b34-3834-5f77-853a-501355717ab8 with identifier: AM49333
2026-03-29 08:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b4da4b34-3834-5f77-853a-501355717ab8 with identifier: AM49333
2026-03-29 08:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b4da4b34-3834-5f77-853a-501355717ab8 with identifier: AM49333 to the API
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:46:26Z',
'fuel_type': 'diesel',
'id': 'b4da4b34-3834-5f77-853a-501355717ab8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM49333',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 231615,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-20',
'seller_name': None,
'title': 'Skoda Superb 1.6 TDI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2017}
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM49333%27 HTTP/1.1" 200 None
2026-03-29 08:35:45 [auto1.be] INFO: Saving data for AM49333: {'auction_closing_time': 1774885586.0, 'created_time': 1773384049.774807, 'last_price_update_time': 1774773345.98248}
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AM49333') HTTP/1.1" 204 0
2026-03-29 08:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a20e57f3-b4bc-539e-aa39-15adc88a3859 with identifier: UZ99297
2026-03-29 08:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a20e57f3-b4bc-539e-aa39-15adc88a3859 with identifier: UZ99297
2026-03-29 08:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a20e57f3-b4bc-539e-aa39-15adc88a3859 with identifier: UZ99297 to the API
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UZ99297>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.6L',
'engine_horse_power': 224,
'expiration_date': '2026-03-30T15:08:25Z',
'fuel_type': 'hybrid',
'id': 'a20e57f3-b4bc-539e-aa39-15adc88a3859',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ99297',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'DS Automobiles',
'model': 'DS7 Crossback',
'odometer': 99165,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img20/d9/20d9c3ef8505cff8b45b5f9a79b320b6/pa/UZ99297_8a38e6608b679d39fc0e152fb4d98f40.jpg',
'https://img-pa.auto1.com/img20/d9/20d9c3ef8505cff8b45b5f9a79b320b6/pa/UZ99297_c4ae715449e777016d5d75b831a5f823.jpg',
'https://img-pa.auto1.com/img20/d9/20d9c3ef8505cff8b45b5f9a79b320b6/pa/UZ99297_beecc5bc63f0d028d65f21e4760c2fc6.jpg',
'https://img-pa.auto1.com/img20/d9/20d9c3ef8505cff8b45b5f9a79b320b6/pa/UZ99297_bc25331b31040457fc7f42a3c98d834b.jpg',
'https://img-pa.auto1.com/img20/d9/20d9c3ef8505cff8b45b5f9a79b320b6/pa/UZ99297_f4532b6a5036fb6472446e996a268729.jpg',
'https://img-pa.auto1.com/img20/d9/20d9c3ef8505cff8b45b5f9a79b320b6/pa/UZ99297_3e664d18c7fb9e98c0502e7a9231738d.jpg',
'https://img-pa.auto1.com/img20/d9/20d9c3ef8505cff8b45b5f9a79b320b6/pa/UZ99297_5ad32373d68e4d8de46f958429f028ca.jpg',
'https://img-pa.auto1.com/img20/d9/20d9c3ef8505cff8b45b5f9a79b320b6/pa/UZ99297_ff8ea7444ff5085c9f94641f6a8c17e8.jpg',
'https://img-pa.auto1.com/img20/d9/20d9c3ef8505cff8b45b5f9a79b320b6/pa/UZ99297_3f8358a0b902108b3c8efde22a2ba22c.jpg',
'https://img-pa.auto1.com/img20/d9/20d9c3ef8505cff8b45b5f9a79b320b6/pa/UZ99297_59db23cc2fdea5062cdaeb9baa9ae0f3.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a20e57f3-b4bc-539e-aa39-15adc88a3859/a20e57f3-b4bc-539e-aa39-15adc88a3859_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94360,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/d9/20d9c3ef8505cff8b45b5f9a79b320b6/pa/UZ99297_8a38e6608b679d39fc0e152fb4d98f40.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a20e57f3-b4bc-539e-aa39-15adc88a3859/a20e57f3-b4bc-539e-aa39-15adc88a3859_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82501,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/d9/20d9c3ef8505cff8b45b5f9a79b320b6/pa/UZ99297_c4ae715449e777016d5d75b831a5f823.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a20e57f3-b4bc-539e-aa39-15adc88a3859/a20e57f3-b4bc-539e-aa39-15adc88a3859_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79315,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/d9/20d9c3ef8505cff8b45b5f9a79b320b6/pa/UZ99297_beecc5bc63f0d028d65f21e4760c2fc6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a20e57f3-b4bc-539e-aa39-15adc88a3859/a20e57f3-b4bc-539e-aa39-15adc88a3859_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65292,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/d9/20d9c3ef8505cff8b45b5f9a79b320b6/pa/UZ99297_bc25331b31040457fc7f42a3c98d834b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a20e57f3-b4bc-539e-aa39-15adc88a3859/a20e57f3-b4bc-539e-aa39-15adc88a3859_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77762,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/d9/20d9c3ef8505cff8b45b5f9a79b320b6/pa/UZ99297_f4532b6a5036fb6472446e996a268729.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a20e57f3-b4bc-539e-aa39-15adc88a3859/a20e57f3-b4bc-539e-aa39-15adc88a3859_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84947,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/d9/20d9c3ef8505cff8b45b5f9a79b320b6/pa/UZ99297_3e664d18c7fb9e98c0502e7a9231738d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a20e57f3-b4bc-539e-aa39-15adc88a3859/a20e57f3-b4bc-539e-aa39-15adc88a3859_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79781,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/d9/20d9c3ef8505cff8b45b5f9a79b320b6/pa/UZ99297_5ad32373d68e4d8de46f958429f028ca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a20e57f3-b4bc-539e-aa39-15adc88a3859/a20e57f3-b4bc-539e-aa39-15adc88a3859_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99506,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/d9/20d9c3ef8505cff8b45b5f9a79b320b6/pa/UZ99297_ff8ea7444ff5085c9f94641f6a8c17e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a20e57f3-b4bc-539e-aa39-15adc88a3859/a20e57f3-b4bc-539e-aa39-15adc88a3859_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82472,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/d9/20d9c3ef8505cff8b45b5f9a79b320b6/pa/UZ99297_3f8358a0b902108b3c8efde22a2ba22c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a20e57f3-b4bc-539e-aa39-15adc88a3859/a20e57f3-b4bc-539e-aa39-15adc88a3859_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60787,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/d9/20d9c3ef8505cff8b45b5f9a79b320b6/pa/UZ99297_59db23cc2fdea5062cdaeb9baa9ae0f3.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-05-11',
'seats_number': 5,
'seller_name': None,
'title': 'DS Automobiles DS7 Crossback 1.6 E-Tense Hybrid 4x2 So Chic',
'transmission': 'automatic',
'trim': '4x2 So Chic',
'year': 2021}
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UZ99297%27 HTTP/1.1" 200 None
2026-03-29 08:35:46 [auto1.be] INFO: Saving data for UZ99297: {'created_time': 1774773346.345587, 'last_price_update_time': 1774773346.345597, 'auction_closing_time': 1774883305.0}
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UZ99297') HTTP/1.1" 204 0
2026-03-29 08:35:46 [auto1.be] INFO: Found listing with ID: EL91929
2026-03-29 08:35:46 [auto1.be] INFO: Found listing with ID: FC05247
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC05247%27 HTTP/1.1" 200 None
2026-03-29 08:35:46 [auto1.be] INFO: Scrape type for FC05247: 1
2026-03-29 08:35:46 [auto1.be] INFO: Found listing with ID: NC38410
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC38410%27 HTTP/1.1" 200 None
2026-03-29 08:35:46 [auto1.be] INFO: Scrape type for NC38410: 1
2026-03-29 08:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LY35485/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:46 [auto1.be] INFO: Found listing with ID: LE91648
2026-03-29 08:35:46 [auto1.be] INFO: Found listing with ID: ZZ00486
2026-03-29 08:35:46 [auto1.be] INFO: Found listing with ID: TX69988
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX69988%27 HTTP/1.1" 200 None
2026-03-29 08:35:46 [auto1.be] INFO: Scrape type for TX69988: 1
2026-03-29 08:35:46 [auto1.be] INFO: Found listing with ID: HK94342
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK94342%27 HTTP/1.1" 200 None
2026-03-29 08:35:46 [auto1.be] INFO: Scrape type for HK94342: 2
2026-03-29 08:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8a1a118-5725-5b08-b241-db1b099168ec with identifier: HK94342
2026-03-29 08:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8a1a118-5725-5b08-b241-db1b099168ec with scrape type 2
2026-03-29 08:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8a1a118-5725-5b08-b241-db1b099168ec with scrape type 2
2026-03-29 08:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a8a1a118-5725-5b08-b241-db1b099168ec, identifier: HK94342
2026-03-29 08:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a8a1a118-5725-5b08-b241-db1b099168ec with identifier: HK94342
2026-03-29 08:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a8a1a118-5725-5b08-b241-db1b099168ec with identifier: HK94342
2026-03-29 08:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a8a1a118-5725-5b08-b241-db1b099168ec with identifier: HK94342 to the API
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:41:29Z',
'fuel_type': 'petrol',
'id': 'a8a1a118-5725-5b08-b241-db1b099168ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK94342',
'listing': 'auction',
'make': 'Fiat',
'model': 'Tipo',
'odometer': 138533,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-20',
'seller_name': None,
'title': 'Fiat Tipo 1.0 City Cross',
'transmission': 'manual',
'trim': 'City Cross',
'year': 2021}
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK94342%27 HTTP/1.1" 200 None
2026-03-29 08:35:46 [auto1.be] INFO: Saving data for HK94342: {'auction_closing_time': 1774885289.0, 'created_time': 1773238214.548595, 'last_price_update_time': 1774773346.887002}
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HK94342') HTTP/1.1" 204 0
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: YK14398
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: FC68971
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: SL05027
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL05027%27 HTTP/1.1" 200 None
2026-03-29 08:35:47 [auto1.be] INFO: Scrape type for SL05027: 2
2026-03-29 08:35:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f173e45-09e9-5fc0-ab20-7b77c6d52c97 with identifier: SL05027
2026-03-29 08:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f173e45-09e9-5fc0-ab20-7b77c6d52c97 with scrape type 2
2026-03-29 08:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f173e45-09e9-5fc0-ab20-7b77c6d52c97 with scrape type 2
2026-03-29 08:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4f173e45-09e9-5fc0-ab20-7b77c6d52c97, identifier: SL05027
2026-03-29 08:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4f173e45-09e9-5fc0-ab20-7b77c6d52c97 with identifier: SL05027
2026-03-29 08:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4f173e45-09e9-5fc0-ab20-7b77c6d52c97 with identifier: SL05027
2026-03-29 08:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4f173e45-09e9-5fc0-ab20-7b77c6d52c97 with identifier: SL05027 to the API
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:58:01Z',
'fuel_type': 'petrol',
'id': '4f173e45-09e9-5fc0-ab20-7b77c6d52c97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL05027',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 44112,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-06',
'seller_name': None,
'title': 'Skoda Octavia 1.2 TSI Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2011}
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL05027%27 HTTP/1.1" 200 None
2026-03-29 08:35:47 [auto1.be] INFO: Saving data for SL05027: {'auction_closing_time': 1774886281.0, 'created_time': 1773132780.283558, 'last_price_update_time': 1774773347.415283}
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SL05027') HTTP/1.1" 204 0
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: TE49371
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: EK47235
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK47235%27 HTTP/1.1" 200 None
2026-03-29 08:35:47 [auto1.be] INFO: Scrape type for EK47235: 1
2026-03-29 08:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KU68109/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: SJ26894
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ26894%27 HTTP/1.1" 200 None
2026-03-29 08:35:47 [auto1.be] INFO: Scrape type for SJ26894: 1
2026-03-29 08:35:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PJ34917> (referer: https://www.auto1.com/v1/car-details-view/PJ34917/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: VP06293
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP06293%27 HTTP/1.1" 200 None
2026-03-29 08:35:47 [auto1.be] INFO: Scrape type for VP06293: 1
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: CC34063
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: LD32822
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LD32822%27 HTTP/1.1" 200 None
2026-03-29 08:35:47 [auto1.be] INFO: Scrape type for LD32822: 2
2026-03-29 08:35:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8266e880-6d4b-514d-ad90-cc5d371771a3 with identifier: LD32822
2026-03-29 08:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8266e880-6d4b-514d-ad90-cc5d371771a3 with scrape type 2
2026-03-29 08:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8266e880-6d4b-514d-ad90-cc5d371771a3 with scrape type 2
2026-03-29 08:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8266e880-6d4b-514d-ad90-cc5d371771a3, identifier: LD32822
2026-03-29 08:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8266e880-6d4b-514d-ad90-cc5d371771a3 with identifier: LD32822
2026-03-29 08:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8266e880-6d4b-514d-ad90-cc5d371771a3 with identifier: LD32822
2026-03-29 08:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8266e880-6d4b-514d-ad90-cc5d371771a3 with identifier: LD32822 to the API
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 179,
'expiration_date': '2026-03-30T15:33:20Z',
'fuel_type': 'diesel',
'id': '8266e880-6d4b-514d-ad90-cc5d371771a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD32822',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Expert',
'odometer': 131722,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-10',
'seller_name': None,
'title': 'Peugeot Expert 2.0 Blue-HDi Premium TwinCab Edition L3',
'transmission': 'automatic',
'trim': 'Premium TwinCab Edition L3',
'year': 2021}
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LD32822%27 HTTP/1.1" 200 None
2026-03-29 08:35:47 [auto1.be] INFO: Saving data for LD32822: {'auction_closing_time': 1774884800.0, 'created_time': 1773384630.488052, 'last_price_update_time': 1774773347.901816}
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LD32822') HTTP/1.1" 204 0
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: DH17925
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH17925%27 HTTP/1.1" 200 None
2026-03-29 08:35:47 [auto1.be] INFO: Scrape type for DH17925: 2
2026-03-29 08:35:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d5aacbd-4ddd-551b-8988-a55e75dda84b with identifier: DH17925
2026-03-29 08:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d5aacbd-4ddd-551b-8988-a55e75dda84b with scrape type 2
2026-03-29 08:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d5aacbd-4ddd-551b-8988-a55e75dda84b with scrape type 2
2026-03-29 08:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8d5aacbd-4ddd-551b-8988-a55e75dda84b, identifier: DH17925
2026-03-29 08:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8d5aacbd-4ddd-551b-8988-a55e75dda84b with identifier: DH17925
2026-03-29 08:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8d5aacbd-4ddd-551b-8988-a55e75dda84b with identifier: DH17925
2026-03-29 08:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8d5aacbd-4ddd-551b-8988-a55e75dda84b with identifier: DH17925 to the API
2026-03-29 08:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:39:06Z',
'fuel_type': 'petrol',
'id': '8d5aacbd-4ddd-551b-8988-a55e75dda84b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH17925',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 15030,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-28',
'seller_name': None,
'title': 'Fiat 500 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2018}
2026-03-29 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH17925%27 HTTP/1.1" 200 None
2026-03-29 08:35:48 [auto1.be] INFO: Saving data for DH17925: {'auction_closing_time': 1774885146.0, 'created_time': 1773131983.706885, 'last_price_update_time': 1774773348.349709}
2026-03-29 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DH17925') HTTP/1.1" 204 0
2026-03-29 08:35:48 [auto1.be] INFO: Found listing with ID: UX89863
2026-03-29 08:35:48 [auto1.be] INFO: Found listing with ID: UX80051
2026-03-29 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX80051%27 HTTP/1.1" 200 None
2026-03-29 08:35:48 [auto1.be] INFO: Scrape type for UX80051: 2
2026-03-29 08:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6947e2e-d104-5494-92f0-6325a4a0ae6e with identifier: UX80051
2026-03-29 08:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6947e2e-d104-5494-92f0-6325a4a0ae6e with scrape type 2
2026-03-29 08:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6947e2e-d104-5494-92f0-6325a4a0ae6e with scrape type 2
2026-03-29 08:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f6947e2e-d104-5494-92f0-6325a4a0ae6e, identifier: UX80051
2026-03-29 08:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RC41327> (referer: https://www.auto1.com/v1/car-details-view/RC41327/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f6947e2e-d104-5494-92f0-6325a4a0ae6e with identifier: UX80051
2026-03-29 08:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f6947e2e-d104-5494-92f0-6325a4a0ae6e with identifier: UX80051
2026-03-29 08:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f6947e2e-d104-5494-92f0-6325a4a0ae6e with identifier: UX80051 to the API
2026-03-29 08:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:32:03Z',
'fuel_type': 'diesel',
'id': 'f6947e2e-d104-5494-92f0-6325a4a0ae6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX80051',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 133158,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-28',
'seller_name': None,
'title': 'Nissan Qashqai 1.5 Turbodiesel 360',
'transmission': 'manual',
'trim': '360',
'year': 2017}
2026-03-29 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX80051%27 HTTP/1.1" 200 None
2026-03-29 08:35:48 [auto1.be] INFO: Saving data for UX80051: {'auction_closing_time': 1774884723.0, 'created_time': 1773137443.089192, 'last_price_update_time': 1774773348.791398}
2026-03-29 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UX80051') HTTP/1.1" 204 0
2026-03-29 08:35:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23300f72-152c-592a-bcf7-132b1de7d21a with identifier: PJ34917
2026-03-29 08:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23300f72-152c-592a-bcf7-132b1de7d21a with scrape type 1
2026-03-29 08:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 23300f72-152c-592a-bcf7-132b1de7d21a
2026-03-29 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F72%252F2d72217f7bcbdcc9cf0a25f3329abc91%252Fpa%252FPJ34917_ac7550386194785e7f53f043c2b8d82f.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/72/2d72217f7bcbdcc9cf0a25f3329abc91/pa/PJ34917_ac7550386194785e7f53f043c2b8d82f.jpg already downloaded
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F72%252F2d72217f7bcbdcc9cf0a25f3329abc91%252Fpa%252FPJ34917_851f37c67d46d5fa1ed3c738b12b9a06.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/72/2d72217f7bcbdcc9cf0a25f3329abc91/pa/PJ34917_851f37c67d46d5fa1ed3c738b12b9a06.jpg already downloaded
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F72%252F2d72217f7bcbdcc9cf0a25f3329abc91%252Fpa%252FPJ34917_c510a43f7491aa3a7d631b617bb9bed3.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/72/2d72217f7bcbdcc9cf0a25f3329abc91/pa/PJ34917_c510a43f7491aa3a7d631b617bb9bed3.jpg already downloaded
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F72%252F2d72217f7bcbdcc9cf0a25f3329abc91%252Fpa%252FPJ34917_cc80808215589c5cd423416986629387.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/72/2d72217f7bcbdcc9cf0a25f3329abc91/pa/PJ34917_cc80808215589c5cd423416986629387.jpg already downloaded
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F72%252F2d72217f7bcbdcc9cf0a25f3329abc91%252Fpa%252FPJ34917_15c4ff4b451d928c179926692becf890.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/72/2d72217f7bcbdcc9cf0a25f3329abc91/pa/PJ34917_15c4ff4b451d928c179926692becf890.jpg already downloaded
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F72%252F2d72217f7bcbdcc9cf0a25f3329abc91%252Fpa%252FPJ34917_15c6e667942622759f4d1a9a125abdc6.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/72/2d72217f7bcbdcc9cf0a25f3329abc91/pa/PJ34917_15c6e667942622759f4d1a9a125abdc6.jpg already downloaded
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F72%252F2d72217f7bcbdcc9cf0a25f3329abc91%252Fpa%252FPJ34917_137225c3ee8e9f418ace14f66193d9e3.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/72/2d72217f7bcbdcc9cf0a25f3329abc91/pa/PJ34917_137225c3ee8e9f418ace14f66193d9e3.jpg already downloaded
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F72%252F2d72217f7bcbdcc9cf0a25f3329abc91%252Fpa%252FPJ34917_20246a9ae87ebfb6f2f11d30ff6451ee.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/72/2d72217f7bcbdcc9cf0a25f3329abc91/pa/PJ34917_20246a9ae87ebfb6f2f11d30ff6451ee.jpg already downloaded
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F72%252F2d72217f7bcbdcc9cf0a25f3329abc91%252Fpa%252FPJ34917_cb858d5fd1cb808b6cddd2a803bd16a9.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/72/2d72217f7bcbdcc9cf0a25f3329abc91/pa/PJ34917_cb858d5fd1cb808b6cddd2a803bd16a9.jpg already downloaded
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F72%252F2d72217f7bcbdcc9cf0a25f3329abc91%252Fpa%252FPJ34917_dcebff9e9028c671f3a184a919a53b9f.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/72/2d72217f7bcbdcc9cf0a25f3329abc91/pa/PJ34917_dcebff9e9028c671f3a184a919a53b9f.jpg already downloaded
2026-03-29 08:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 23300f72-152c-592a-bcf7-132b1de7d21a, identifier: PJ34917
2026-03-29 08:35:49 [auto1.be] INFO: Found listing with ID: MG99487
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG99487%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [auto1.be] INFO: Scrape type for MG99487: 1
2026-03-29 08:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BL31735> (referer: https://www.auto1.com/v1/car-details-view/BL31735/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YA34487> (referer: https://www.auto1.com/v1/car-details-view/YA34487/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 23300f72-152c-592a-bcf7-132b1de7d21a with identifier: PJ34917
2026-03-29 08:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 23300f72-152c-592a-bcf7-132b1de7d21a with identifier: PJ34917
2026-03-29 08:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 23300f72-152c-592a-bcf7-132b1de7d21a with identifier: PJ34917 to the API
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PJ34917>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 320,
'expiration_date': '2026-03-30T15:18:27Z',
'fuel_type': 'hybrid',
'id': '23300f72-152c-592a-bcf7-132b1de7d21a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ34917',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 186238,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img2d/72/2d72217f7bcbdcc9cf0a25f3329abc91/pa/PJ34917_ac7550386194785e7f53f043c2b8d82f.jpg',
'https://img-pa.auto1.com/img2d/72/2d72217f7bcbdcc9cf0a25f3329abc91/pa/PJ34917_851f37c67d46d5fa1ed3c738b12b9a06.jpg',
'https://img-pa.auto1.com/img2d/72/2d72217f7bcbdcc9cf0a25f3329abc91/pa/PJ34917_c510a43f7491aa3a7d631b617bb9bed3.jpg',
'https://img-pa.auto1.com/img2d/72/2d72217f7bcbdcc9cf0a25f3329abc91/pa/PJ34917_cc80808215589c5cd423416986629387.jpg',
'https://img-pa.auto1.com/img2d/72/2d72217f7bcbdcc9cf0a25f3329abc91/pa/PJ34917_15c4ff4b451d928c179926692becf890.jpg',
'https://img-pa.auto1.com/img2d/72/2d72217f7bcbdcc9cf0a25f3329abc91/pa/PJ34917_15c6e667942622759f4d1a9a125abdc6.jpg',
'https://img-pa.auto1.com/img2d/72/2d72217f7bcbdcc9cf0a25f3329abc91/pa/PJ34917_137225c3ee8e9f418ace14f66193d9e3.jpg',
'https://img-pa.auto1.com/img2d/72/2d72217f7bcbdcc9cf0a25f3329abc91/pa/PJ34917_20246a9ae87ebfb6f2f11d30ff6451ee.jpg',
'https://img-pa.auto1.com/img2d/72/2d72217f7bcbdcc9cf0a25f3329abc91/pa/PJ34917_cb858d5fd1cb808b6cddd2a803bd16a9.jpg',
'https://img-pa.auto1.com/img2d/72/2d72217f7bcbdcc9cf0a25f3329abc91/pa/PJ34917_dcebff9e9028c671f3a184a919a53b9f.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23300f72-152c-592a-bcf7-132b1de7d21a/23300f72-152c-592a-bcf7-132b1de7d21a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1838628,
'Height': 1080,
'OriginUrl': 'https://img-pa.auto1.com/img2d/72/2d72217f7bcbdcc9cf0a25f3329abc91/pa/PJ34917_ac7550386194785e7f53f043c2b8d82f.jpg',
'Width': 1920},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23300f72-152c-592a-bcf7-132b1de7d21a/23300f72-152c-592a-bcf7-132b1de7d21a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1999957,
'Height': 1080,
'OriginUrl': 'https://img-pa.auto1.com/img2d/72/2d72217f7bcbdcc9cf0a25f3329abc91/pa/PJ34917_851f37c67d46d5fa1ed3c738b12b9a06.jpg',
'Width': 1920},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23300f72-152c-592a-bcf7-132b1de7d21a/23300f72-152c-592a-bcf7-132b1de7d21a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63639,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/img2d/72/2d72217f7bcbdcc9cf0a25f3329abc91/pa/PJ34917_c510a43f7491aa3a7d631b617bb9bed3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23300f72-152c-592a-bcf7-132b1de7d21a/23300f72-152c-592a-bcf7-132b1de7d21a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2018492,
'Height': 1080,
'OriginUrl': 'https://img-pa.auto1.com/img2d/72/2d72217f7bcbdcc9cf0a25f3329abc91/pa/PJ34917_cc80808215589c5cd423416986629387.jpg',
'Width': 1920},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23300f72-152c-592a-bcf7-132b1de7d21a/23300f72-152c-592a-bcf7-132b1de7d21a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56518,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/img2d/72/2d72217f7bcbdcc9cf0a25f3329abc91/pa/PJ34917_15c4ff4b451d928c179926692becf890.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23300f72-152c-592a-bcf7-132b1de7d21a/23300f72-152c-592a-bcf7-132b1de7d21a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1771600,
'Height': 1080,
'OriginUrl': 'https://img-pa.auto1.com/img2d/72/2d72217f7bcbdcc9cf0a25f3329abc91/pa/PJ34917_15c6e667942622759f4d1a9a125abdc6.jpg',
'Width': 1920},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23300f72-152c-592a-bcf7-132b1de7d21a/23300f72-152c-592a-bcf7-132b1de7d21a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1995371,
'Height': 1080,
'OriginUrl': 'https://img-pa.auto1.com/img2d/72/2d72217f7bcbdcc9cf0a25f3329abc91/pa/PJ34917_137225c3ee8e9f418ace14f66193d9e3.jpg',
'Width': 1920},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23300f72-152c-592a-bcf7-132b1de7d21a/23300f72-152c-592a-bcf7-132b1de7d21a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1957207,
'Height': 1080,
'OriginUrl': 'https://img-pa.auto1.com/img2d/72/2d72217f7bcbdcc9cf0a25f3329abc91/pa/PJ34917_20246a9ae87ebfb6f2f11d30ff6451ee.jpg',
'Width': 1920},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23300f72-152c-592a-bcf7-132b1de7d21a/23300f72-152c-592a-bcf7-132b1de7d21a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1928732,
'Height': 1080,
'OriginUrl': 'https://img-pa.auto1.com/img2d/72/2d72217f7bcbdcc9cf0a25f3329abc91/pa/PJ34917_cb858d5fd1cb808b6cddd2a803bd16a9.jpg',
'Width': 1920},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23300f72-152c-592a-bcf7-132b1de7d21a/23300f72-152c-592a-bcf7-132b1de7d21a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54646,
'Height': 450,
'OriginUrl': 'https://img-pa.auto1.com/img2d/72/2d72217f7bcbdcc9cf0a25f3329abc91/pa/PJ34917_dcebff9e9028c671f3a184a919a53b9f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-05-17',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 350e 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2017}
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ34917%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [auto1.be] INFO: Saving data for PJ34917: {'created_time': 1774773349.597583, 'last_price_update_time': 1774773349.597593, 'auction_closing_time': 1774883907.0}
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PJ34917') HTTP/1.1" 204 0
2026-03-29 08:35:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:49 [auto1.be] INFO: Found listing with ID: AJ87899
2026-03-29 08:35:49 [auto1.be] INFO: Found listing with ID: RL01911
2026-03-29 08:35:49 [auto1.be] INFO: Found listing with ID: FG10633
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG10633%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [auto1.be] INFO: Scrape type for FG10633: 1
2026-03-29 08:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TT03576/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KD33371> (referer: https://www.auto1.com/v1/car-details-view/KD33371/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1ad459a-231d-5464-adab-1d532dddb027 with identifier: RC41327
2026-03-29 08:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1ad459a-231d-5464-adab-1d532dddb027 with scrape type 1
2026-03-29 08:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e1ad459a-231d-5464-adab-1d532dddb027
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F94%252F1f943c76af9ec4000dfb87d7d68cb47c%252Fpa%252FRC41327_48e8f786b5a3cb61c912093b9d2b87dd.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/94/1f943c76af9ec4000dfb87d7d68cb47c/pa/RC41327_48e8f786b5a3cb61c912093b9d2b87dd.jpg already downloaded
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F94%252F1f943c76af9ec4000dfb87d7d68cb47c%252Fpa%252FRC41327_69983ca4c11970ce3ec9238b5a2b7a9a.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/94/1f943c76af9ec4000dfb87d7d68cb47c/pa/RC41327_69983ca4c11970ce3ec9238b5a2b7a9a.jpg already downloaded
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F94%252F1f943c76af9ec4000dfb87d7d68cb47c%252Fpa%252FRC41327_9aa30e575bae7ee6778630044d6e8c92.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/94/1f943c76af9ec4000dfb87d7d68cb47c/pa/RC41327_9aa30e575bae7ee6778630044d6e8c92.jpg already downloaded
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F94%252F1f943c76af9ec4000dfb87d7d68cb47c%252Fpa%252FRC41327_370ce7ff88094b3f3e6d83d0c414113a.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/94/1f943c76af9ec4000dfb87d7d68cb47c/pa/RC41327_370ce7ff88094b3f3e6d83d0c414113a.jpg already downloaded
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F94%252F1f943c76af9ec4000dfb87d7d68cb47c%252Fpa%252FRC41327_6b5322e4cf62df9be09e86a0e0ae10e8.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/94/1f943c76af9ec4000dfb87d7d68cb47c/pa/RC41327_6b5322e4cf62df9be09e86a0e0ae10e8.jpg already downloaded
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F94%252F1f943c76af9ec4000dfb87d7d68cb47c%252Fpa%252FRC41327_87c6159e0bd648f29488558669b0f4b0.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/94/1f943c76af9ec4000dfb87d7d68cb47c/pa/RC41327_87c6159e0bd648f29488558669b0f4b0.jpg already downloaded
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F94%252F1f943c76af9ec4000dfb87d7d68cb47c%252Fpa%252FRC41327_65ce60e86e208867d3b9bea4c0e183ea.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/94/1f943c76af9ec4000dfb87d7d68cb47c/pa/RC41327_65ce60e86e208867d3b9bea4c0e183ea.jpg already downloaded
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F94%252F1f943c76af9ec4000dfb87d7d68cb47c%252Fpa%252FRC41327_9fc9f749e0a3f91642a97f97968a033e.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/94/1f943c76af9ec4000dfb87d7d68cb47c/pa/RC41327_9fc9f749e0a3f91642a97f97968a033e.jpg already downloaded
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F94%252F1f943c76af9ec4000dfb87d7d68cb47c%252Fpa%252FRC41327_006f8734a812c5d232ea8794900fc08e.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/94/1f943c76af9ec4000dfb87d7d68cb47c/pa/RC41327_006f8734a812c5d232ea8794900fc08e.jpg already downloaded
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1f%252F94%252F1f943c76af9ec4000dfb87d7d68cb47c%252Fpa%252FRC41327_8234fe96a2c756e8d01fb9be32705d84.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1f/94/1f943c76af9ec4000dfb87d7d68cb47c/pa/RC41327_8234fe96a2c756e8d01fb9be32705d84.jpg already downloaded
2026-03-29 08:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e1ad459a-231d-5464-adab-1d532dddb027, identifier: RC41327
2026-03-29 08:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7847e46-28c7-5a5d-8e42-0afcb6b8ea88 with identifier: BL31735
2026-03-29 08:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7847e46-28c7-5a5d-8e42-0afcb6b8ea88 with scrape type 1
2026-03-29 08:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d7847e46-28c7-5a5d-8e42-0afcb6b8ea88
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Feb%252F1bebd6a59fe491e3d60c24693a0c1049%252Fpa%252FBL31735_f4698ab526e660dd6b15547e87c885a7.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/eb/1bebd6a59fe491e3d60c24693a0c1049/pa/BL31735_f4698ab526e660dd6b15547e87c885a7.jpg already downloaded
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Feb%252F1bebd6a59fe491e3d60c24693a0c1049%252Fpa%252FBL31735_185b2fc1b89bc3c20863fabeeaa855eb.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/eb/1bebd6a59fe491e3d60c24693a0c1049/pa/BL31735_185b2fc1b89bc3c20863fabeeaa855eb.jpg already downloaded
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Feb%252F1bebd6a59fe491e3d60c24693a0c1049%252Fpa%252FBL31735_6585ee77935457d0f01d880eb12a1345.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/eb/1bebd6a59fe491e3d60c24693a0c1049/pa/BL31735_6585ee77935457d0f01d880eb12a1345.jpg already downloaded
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Feb%252F1bebd6a59fe491e3d60c24693a0c1049%252Fpa%252FBL31735_2f7eec8bff1cbe955ebd0a920c7cf37c.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/eb/1bebd6a59fe491e3d60c24693a0c1049/pa/BL31735_2f7eec8bff1cbe955ebd0a920c7cf37c.jpg already downloaded
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Feb%252F1bebd6a59fe491e3d60c24693a0c1049%252Fpa%252FBL31735_d90f982cbac09f580f9cc555200807a3.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/eb/1bebd6a59fe491e3d60c24693a0c1049/pa/BL31735_d90f982cbac09f580f9cc555200807a3.jpg already downloaded
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Feb%252F1bebd6a59fe491e3d60c24693a0c1049%252Fpa%252FBL31735_0e51468e7694dc3da84d725326363945.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/eb/1bebd6a59fe491e3d60c24693a0c1049/pa/BL31735_0e51468e7694dc3da84d725326363945.jpg already downloaded
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Feb%252F1bebd6a59fe491e3d60c24693a0c1049%252Fpa%252FBL31735_e0157992c1bf4089494a61d84b5a847e.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/eb/1bebd6a59fe491e3d60c24693a0c1049/pa/BL31735_e0157992c1bf4089494a61d84b5a847e.jpg already downloaded
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Feb%252F1bebd6a59fe491e3d60c24693a0c1049%252Fpa%252FBL31735_1951bda0241bf95fbc99519a92de9710.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/eb/1bebd6a59fe491e3d60c24693a0c1049/pa/BL31735_1951bda0241bf95fbc99519a92de9710.jpg already downloaded
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Feb%252F1bebd6a59fe491e3d60c24693a0c1049%252Fpa%252FBL31735_6c1aab1433108b7844ba4b2accd35edc.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/eb/1bebd6a59fe491e3d60c24693a0c1049/pa/BL31735_6c1aab1433108b7844ba4b2accd35edc.jpg already downloaded
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Feb%252F1bebd6a59fe491e3d60c24693a0c1049%252Fpa%252FBL31735_d8e64a512e74f9b97d40c58716a3e569.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/eb/1bebd6a59fe491e3d60c24693a0c1049/pa/BL31735_d8e64a512e74f9b97d40c58716a3e569.jpg already downloaded
2026-03-29 08:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d7847e46-28c7-5a5d-8e42-0afcb6b8ea88, identifier: BL31735
2026-03-29 08:35:50 [auto1.be] INFO: Channel: 24h | Page: 5 | totalHits: 1252 | hits on page: 40
2026-03-29 08:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e0ad950-0d11-54d2-a68f-6d6044c75d5d with identifier: YA34487
2026-03-29 08:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e0ad950-0d11-54d2-a68f-6d6044c75d5d with scrape type 1
2026-03-29 08:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2e0ad950-0d11-54d2-a68f-6d6044c75d5d
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F57%252F6857c470402e0c2f9a44315f448e4ed5%252Fpa%252FYA34487_3b32c007f08ccbfff03ba115e13e7a10.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_3b32c007f08ccbfff03ba115e13e7a10.jpg not downloaded yet
2026-03-29 08:35:50 [auto1.be] INFO: Found listing with ID: KE27400
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE27400%27 HTTP/1.1" 200 None
2026-03-29 08:35:50 [auto1.be] INFO: Scrape type for KE27400: 2
2026-03-29 08:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e2e3e2c-7830-5294-a766-013450d4de2e with identifier: KE27400
2026-03-29 08:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e2e3e2c-7830-5294-a766-013450d4de2e with scrape type 2
2026-03-29 08:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e2e3e2c-7830-5294-a766-013450d4de2e with scrape type 2
2026-03-29 08:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5e2e3e2c-7830-5294-a766-013450d4de2e, identifier: KE27400
2026-03-29 08:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e1ad459a-231d-5464-adab-1d532dddb027 with identifier: RC41327
2026-03-29 08:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e1ad459a-231d-5464-adab-1d532dddb027 with identifier: RC41327
2026-03-29 08:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e1ad459a-231d-5464-adab-1d532dddb027 with identifier: RC41327 to the API
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RC41327>
{'auction_title': '',
'c_o_2_emission_value': 30,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.4L',
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:55:50Z',
'fuel_type': 'hybrid',
'id': 'e1ad459a-231d-5464-adab-1d532dddb027',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC41327',
'listing': 'auction',
'location': 'BE, Bruxelles-Brussel',
'make': 'Skoda',
'model': 'Superb',
'odometer': 96672,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img1f/94/1f943c76af9ec4000dfb87d7d68cb47c/pa/RC41327_48e8f786b5a3cb61c912093b9d2b87dd.jpg',
'https://img-pa.auto1.com/img1f/94/1f943c76af9ec4000dfb87d7d68cb47c/pa/RC41327_69983ca4c11970ce3ec9238b5a2b7a9a.jpg',
'https://img-pa.auto1.com/img1f/94/1f943c76af9ec4000dfb87d7d68cb47c/pa/RC41327_9aa30e575bae7ee6778630044d6e8c92.jpg',
'https://img-pa.auto1.com/img1f/94/1f943c76af9ec4000dfb87d7d68cb47c/pa/RC41327_370ce7ff88094b3f3e6d83d0c414113a.jpg',
'https://img-pa.auto1.com/img1f/94/1f943c76af9ec4000dfb87d7d68cb47c/pa/RC41327_6b5322e4cf62df9be09e86a0e0ae10e8.jpg',
'https://img-pa.auto1.com/img1f/94/1f943c76af9ec4000dfb87d7d68cb47c/pa/RC41327_87c6159e0bd648f29488558669b0f4b0.jpg',
'https://img-pa.auto1.com/img1f/94/1f943c76af9ec4000dfb87d7d68cb47c/pa/RC41327_65ce60e86e208867d3b9bea4c0e183ea.jpg',
'https://img-pa.auto1.com/img1f/94/1f943c76af9ec4000dfb87d7d68cb47c/pa/RC41327_9fc9f749e0a3f91642a97f97968a033e.jpg',
'https://img-pa.auto1.com/img1f/94/1f943c76af9ec4000dfb87d7d68cb47c/pa/RC41327_006f8734a812c5d232ea8794900fc08e.jpg',
'https://img-pa.auto1.com/img1f/94/1f943c76af9ec4000dfb87d7d68cb47c/pa/RC41327_8234fe96a2c756e8d01fb9be32705d84.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ad459a-231d-5464-adab-1d532dddb027/e1ad459a-231d-5464-adab-1d532dddb027_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79560,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1f/94/1f943c76af9ec4000dfb87d7d68cb47c/pa/RC41327_48e8f786b5a3cb61c912093b9d2b87dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ad459a-231d-5464-adab-1d532dddb027/e1ad459a-231d-5464-adab-1d532dddb027_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70351,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1f/94/1f943c76af9ec4000dfb87d7d68cb47c/pa/RC41327_69983ca4c11970ce3ec9238b5a2b7a9a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ad459a-231d-5464-adab-1d532dddb027/e1ad459a-231d-5464-adab-1d532dddb027_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65546,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1f/94/1f943c76af9ec4000dfb87d7d68cb47c/pa/RC41327_9aa30e575bae7ee6778630044d6e8c92.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ad459a-231d-5464-adab-1d532dddb027/e1ad459a-231d-5464-adab-1d532dddb027_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59740,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1f/94/1f943c76af9ec4000dfb87d7d68cb47c/pa/RC41327_370ce7ff88094b3f3e6d83d0c414113a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ad459a-231d-5464-adab-1d532dddb027/e1ad459a-231d-5464-adab-1d532dddb027_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57408,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1f/94/1f943c76af9ec4000dfb87d7d68cb47c/pa/RC41327_6b5322e4cf62df9be09e86a0e0ae10e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ad459a-231d-5464-adab-1d532dddb027/e1ad459a-231d-5464-adab-1d532dddb027_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65997,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1f/94/1f943c76af9ec4000dfb87d7d68cb47c/pa/RC41327_87c6159e0bd648f29488558669b0f4b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ad459a-231d-5464-adab-1d532dddb027/e1ad459a-231d-5464-adab-1d532dddb027_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54016,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1f/94/1f943c76af9ec4000dfb87d7d68cb47c/pa/RC41327_65ce60e86e208867d3b9bea4c0e183ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ad459a-231d-5464-adab-1d532dddb027/e1ad459a-231d-5464-adab-1d532dddb027_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68759,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1f/94/1f943c76af9ec4000dfb87d7d68cb47c/pa/RC41327_9fc9f749e0a3f91642a97f97968a033e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ad459a-231d-5464-adab-1d532dddb027/e1ad459a-231d-5464-adab-1d532dddb027_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73474,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1f/94/1f943c76af9ec4000dfb87d7d68cb47c/pa/RC41327_006f8734a812c5d232ea8794900fc08e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ad459a-231d-5464-adab-1d532dddb027/e1ad459a-231d-5464-adab-1d532dddb027_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55772,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1f/94/1f943c76af9ec4000dfb87d7d68cb47c/pa/RC41327_8234fe96a2c756e8d01fb9be32705d84.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-09-09',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Superb 1.4 Plug-in Hybrid Ambition iV',
'transmission': 'automatic',
'trim': 'Ambition iV',
'year': 2021}
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC41327%27 HTTP/1.1" 200 None
2026-03-29 08:35:50 [auto1.be] INFO: Saving data for RC41327: {'created_time': 1774773350.644742, 'last_price_update_time': 1774773350.64475, 'auction_closing_time': 1774886150.0}
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RC41327') HTTP/1.1" 204 0
2026-03-29 08:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d7847e46-28c7-5a5d-8e42-0afcb6b8ea88 with identifier: BL31735
2026-03-29 08:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d7847e46-28c7-5a5d-8e42-0afcb6b8ea88 with identifier: BL31735
2026-03-29 08:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d7847e46-28c7-5a5d-8e42-0afcb6b8ea88 with identifier: BL31735 to the API
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BL31735>
{'auction_title': '',
'c_o_2_emission_value': 168,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 5',
'engine': '3.0L',
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:32:44Z',
'fuel_type': 'diesel',
'id': 'd7847e46-28c7-5a5d-8e42-0afcb6b8ea88',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL31735',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'BMW',
'model': '3er',
'odometer': 170971,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img1b/eb/1bebd6a59fe491e3d60c24693a0c1049/pa/BL31735_f4698ab526e660dd6b15547e87c885a7.jpg',
'https://img-pa.auto1.com/img1b/eb/1bebd6a59fe491e3d60c24693a0c1049/pa/BL31735_185b2fc1b89bc3c20863fabeeaa855eb.jpg',
'https://img-pa.auto1.com/img1b/eb/1bebd6a59fe491e3d60c24693a0c1049/pa/BL31735_6585ee77935457d0f01d880eb12a1345.jpg',
'https://img-pa.auto1.com/img1b/eb/1bebd6a59fe491e3d60c24693a0c1049/pa/BL31735_2f7eec8bff1cbe955ebd0a920c7cf37c.jpg',
'https://img-pa.auto1.com/img1b/eb/1bebd6a59fe491e3d60c24693a0c1049/pa/BL31735_d90f982cbac09f580f9cc555200807a3.jpg',
'https://img-pa.auto1.com/img1b/eb/1bebd6a59fe491e3d60c24693a0c1049/pa/BL31735_0e51468e7694dc3da84d725326363945.jpg',
'https://img-pa.auto1.com/img1b/eb/1bebd6a59fe491e3d60c24693a0c1049/pa/BL31735_e0157992c1bf4089494a61d84b5a847e.jpg',
'https://img-pa.auto1.com/img1b/eb/1bebd6a59fe491e3d60c24693a0c1049/pa/BL31735_1951bda0241bf95fbc99519a92de9710.jpg',
'https://img-pa.auto1.com/img1b/eb/1bebd6a59fe491e3d60c24693a0c1049/pa/BL31735_6c1aab1433108b7844ba4b2accd35edc.jpg',
'https://img-pa.auto1.com/img1b/eb/1bebd6a59fe491e3d60c24693a0c1049/pa/BL31735_d8e64a512e74f9b97d40c58716a3e569.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7847e46-28c7-5a5d-8e42-0afcb6b8ea88/d7847e46-28c7-5a5d-8e42-0afcb6b8ea88_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81664,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/eb/1bebd6a59fe491e3d60c24693a0c1049/pa/BL31735_f4698ab526e660dd6b15547e87c885a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7847e46-28c7-5a5d-8e42-0afcb6b8ea88/d7847e46-28c7-5a5d-8e42-0afcb6b8ea88_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73143,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/eb/1bebd6a59fe491e3d60c24693a0c1049/pa/BL31735_185b2fc1b89bc3c20863fabeeaa855eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7847e46-28c7-5a5d-8e42-0afcb6b8ea88/d7847e46-28c7-5a5d-8e42-0afcb6b8ea88_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77222,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/eb/1bebd6a59fe491e3d60c24693a0c1049/pa/BL31735_6585ee77935457d0f01d880eb12a1345.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7847e46-28c7-5a5d-8e42-0afcb6b8ea88/d7847e46-28c7-5a5d-8e42-0afcb6b8ea88_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74704,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/eb/1bebd6a59fe491e3d60c24693a0c1049/pa/BL31735_2f7eec8bff1cbe955ebd0a920c7cf37c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7847e46-28c7-5a5d-8e42-0afcb6b8ea88/d7847e46-28c7-5a5d-8e42-0afcb6b8ea88_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65832,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/eb/1bebd6a59fe491e3d60c24693a0c1049/pa/BL31735_d90f982cbac09f580f9cc555200807a3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7847e46-28c7-5a5d-8e42-0afcb6b8ea88/d7847e46-28c7-5a5d-8e42-0afcb6b8ea88_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85518,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/eb/1bebd6a59fe491e3d60c24693a0c1049/pa/BL31735_0e51468e7694dc3da84d725326363945.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7847e46-28c7-5a5d-8e42-0afcb6b8ea88/d7847e46-28c7-5a5d-8e42-0afcb6b8ea88_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84286,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/eb/1bebd6a59fe491e3d60c24693a0c1049/pa/BL31735_e0157992c1bf4089494a61d84b5a847e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7847e46-28c7-5a5d-8e42-0afcb6b8ea88/d7847e46-28c7-5a5d-8e42-0afcb6b8ea88_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72951,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/eb/1bebd6a59fe491e3d60c24693a0c1049/pa/BL31735_1951bda0241bf95fbc99519a92de9710.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7847e46-28c7-5a5d-8e42-0afcb6b8ea88/d7847e46-28c7-5a5d-8e42-0afcb6b8ea88_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77636,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/eb/1bebd6a59fe491e3d60c24693a0c1049/pa/BL31735_6c1aab1433108b7844ba4b2accd35edc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7847e46-28c7-5a5d-8e42-0afcb6b8ea88/d7847e46-28c7-5a5d-8e42-0afcb6b8ea88_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67314,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/eb/1bebd6a59fe491e3d60c24693a0c1049/pa/BL31735_d8e64a512e74f9b97d40c58716a3e569.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-05-26',
'seats_number': 4,
'seller_name': None,
'title': 'BMW 3er 325d',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BL31735%27 HTTP/1.1" 200 None
2026-03-29 08:35:50 [auto1.be] INFO: Saving data for BL31735: {'created_time': 1774773350.955364, 'last_price_update_time': 1774773350.955374, 'auction_closing_time': 1774884764.0}
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BL31735') HTTP/1.1" 204 0
2026-03-29 08:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5e2e3e2c-7830-5294-a766-013450d4de2e with identifier: KE27400
2026-03-29 08:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5e2e3e2c-7830-5294-a766-013450d4de2e with identifier: KE27400
2026-03-29 08:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5e2e3e2c-7830-5294-a766-013450d4de2e with identifier: KE27400 to the API
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 285,
'expiration_date': '2026-03-30T15:54:52Z',
'fuel_type': 'diesel',
'id': '5e2e3e2c-7830-5294-a766-013450d4de2e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE27400',
'listing': 'auction',
'make': 'BMW',
'model': '6er',
'odometer': 245019,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-06-21',
'seller_name': None,
'title': 'BMW 6er 635d',
'transmission': 'automatic',
'trim': '',
'year': 2009}
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE27400%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Saving data for KE27400: {'auction_closing_time': 1774886092.0, 'created_time': 1773866404.606123, 'last_price_update_time': 1774773351.271679}
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KE27400') HTTP/1.1" 204 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: SB67636
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: ZU13483
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU13483%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for ZU13483: 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: CE14127
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: KA88762
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: ML65590
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML65590%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for ML65590: 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: GG74067
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: HN37913
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: YU22338
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU22338%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for YU22338: 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: SW98803
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW98803%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for SW98803: 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: LP50838
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP50838%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for LP50838: 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: NH43704
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: MW29844
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW29844%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for MW29844: 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: FH45476
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH45476%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for FH45476: 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: NP55006
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP55006%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for NP55006: 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: XM15621
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: DP40243
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP40243%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for DP40243: 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: BR63185
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR63185%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for BR63185: 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: FM14350
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: WL66260
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: FY63763
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: CD50133
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: SZ16034
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: FP25504
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: BX88810
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: EJ45470
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: AK19302
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK19302%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for AK19302: 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: EZ00027
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: PD85961
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: NR82041
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR82041%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for NR82041: 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: HU84368
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU84368%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for HU84368: 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: CC85070
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC85070%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for CC85070: 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: KE26750
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: EA25293
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: SP00889
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP00889%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for SP00889: 2
2026-03-29 08:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40a4eaee-0660-5744-8f58-06aebbe7d68e with identifier: SP00889
2026-03-29 08:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40a4eaee-0660-5744-8f58-06aebbe7d68e with scrape type 2
2026-03-29 08:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40a4eaee-0660-5744-8f58-06aebbe7d68e with scrape type 2
2026-03-29 08:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 40a4eaee-0660-5744-8f58-06aebbe7d68e, identifier: SP00889
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F57%252F6857c470402e0c2f9a44315f448e4ed5%252Fpa%252FYA34487_1db4e22d42a76374f107158340e2181e.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_1db4e22d42a76374f107158340e2181e.jpg not downloaded yet
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: JV95971
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: LK25886
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK25886%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for LK25886: 2
2026-03-29 08:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71e014ce-426b-58c5-ae20-9af7a54bf9b3 with identifier: LK25886
2026-03-29 08:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71e014ce-426b-58c5-ae20-9af7a54bf9b3 with scrape type 2
2026-03-29 08:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71e014ce-426b-58c5-ae20-9af7a54bf9b3 with scrape type 2
2026-03-29 08:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 71e014ce-426b-58c5-ae20-9af7a54bf9b3, identifier: LK25886
2026-03-29 08:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 40a4eaee-0660-5744-8f58-06aebbe7d68e with identifier: SP00889
2026-03-29 08:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 40a4eaee-0660-5744-8f58-06aebbe7d68e with identifier: SP00889
2026-03-29 08:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 40a4eaee-0660-5744-8f58-06aebbe7d68e with identifier: SP00889 to the API
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:59:29Z',
'fuel_type': 'diesel',
'id': '40a4eaee-0660-5744-8f58-06aebbe7d68e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP00889',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 145219,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-17',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180 CDI Urban',
'transmission': 'automatic',
'trim': 'Urban',
'year': 2018}
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP00889%27 HTTP/1.1" 200 None
2026-03-29 08:35:52 [auto1.be] INFO: Saving data for SP00889: {'auction_closing_time': 1774886369.0, 'created_time': 1774557543.095385, 'last_price_update_time': 1774773352.080085}
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SP00889') HTTP/1.1" 204 0
2026-03-29 08:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6899e96-7df5-529b-a091-c64597f15c78 with identifier: KD33371
2026-03-29 08:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6899e96-7df5-529b-a091-c64597f15c78 with scrape type 1
2026-03-29 08:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f6899e96-7df5-529b-a091-c64597f15c78
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff7%252F53f73580a5809efd902dea31f92a0480%252Fpa%252FKD33371_85217cc18b2a555337bc7049b1dfc9e3.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f7/53f73580a5809efd902dea31f92a0480/pa/KD33371_85217cc18b2a555337bc7049b1dfc9e3.jpg already downloaded
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff7%252F53f73580a5809efd902dea31f92a0480%252Fpa%252FKD33371_3765551620d5a3efb6963bf8641c972e.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f7/53f73580a5809efd902dea31f92a0480/pa/KD33371_3765551620d5a3efb6963bf8641c972e.jpg already downloaded
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff7%252F53f73580a5809efd902dea31f92a0480%252Fpa%252FKD33371_8e9bf9b459d8a2b4530ffed2697a412c.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f7/53f73580a5809efd902dea31f92a0480/pa/KD33371_8e9bf9b459d8a2b4530ffed2697a412c.jpg already downloaded
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff7%252F53f73580a5809efd902dea31f92a0480%252Fpa%252FKD33371_cb1007bcffbf58ca9dcb78af7e7b3672.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f7/53f73580a5809efd902dea31f92a0480/pa/KD33371_cb1007bcffbf58ca9dcb78af7e7b3672.jpg already downloaded
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff7%252F53f73580a5809efd902dea31f92a0480%252Fpa%252FKD33371_d1b6b8050295d3bb2997d3df0b5d1bee.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f7/53f73580a5809efd902dea31f92a0480/pa/KD33371_d1b6b8050295d3bb2997d3df0b5d1bee.jpg already downloaded
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff7%252F53f73580a5809efd902dea31f92a0480%252Fpa%252FKD33371_2c3f3a023b2734a782830c7856745435.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f7/53f73580a5809efd902dea31f92a0480/pa/KD33371_2c3f3a023b2734a782830c7856745435.jpg already downloaded
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff7%252F53f73580a5809efd902dea31f92a0480%252Fpa%252FKD33371_7cdf2a07727ad689dc38dbb37d751ff0.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f7/53f73580a5809efd902dea31f92a0480/pa/KD33371_7cdf2a07727ad689dc38dbb37d751ff0.jpg already downloaded
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff7%252F53f73580a5809efd902dea31f92a0480%252Fpa%252FKD33371_5a10735f023c5f65aacda6c0a4f6fdec.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f7/53f73580a5809efd902dea31f92a0480/pa/KD33371_5a10735f023c5f65aacda6c0a4f6fdec.jpg already downloaded
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff7%252F53f73580a5809efd902dea31f92a0480%252Fpa%252FKD33371_d8639dda54fec95d9760820890f231f6.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f7/53f73580a5809efd902dea31f92a0480/pa/KD33371_d8639dda54fec95d9760820890f231f6.jpg already downloaded
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Ff7%252F53f73580a5809efd902dea31f92a0480%252Fpa%252FKD33371_6edd85dda8caed99d033fa4647f5d0ab.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/f7/53f73580a5809efd902dea31f92a0480/pa/KD33371_6edd85dda8caed99d033fa4647f5d0ab.jpg already downloaded
2026-03-29 08:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f6899e96-7df5-529b-a091-c64597f15c78, identifier: KD33371
2026-03-29 08:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 71e014ce-426b-58c5-ae20-9af7a54bf9b3 with identifier: LK25886
2026-03-29 08:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 71e014ce-426b-58c5-ae20-9af7a54bf9b3 with identifier: LK25886
2026-03-29 08:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 71e014ce-426b-58c5-ae20-9af7a54bf9b3 with identifier: LK25886 to the API
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 401,
'expiration_date': '2026-03-30T15:48:58Z',
'fuel_type': 'petrol',
'id': '71e014ce-426b-58c5-ae20-9af7a54bf9b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK25886',
'listing': 'auction',
'make': 'Dodge',
'model': 'Ram 1500',
'odometer': 183575,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-04',
'seller_name': None,
'title': 'Dodge Ram 1500 5.7 V8 4x4',
'transmission': 'automatic',
'trim': '4x4',
'year': 2017}
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK25886%27 HTTP/1.1" 200 None
2026-03-29 08:35:52 [auto1.be] INFO: Saving data for LK25886: {'auction_closing_time': 1774885738.0, 'created_time': 1774298167.967428, 'last_price_update_time': 1774773352.760304}
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LK25886') HTTP/1.1" 204 0
2026-03-29 08:35:52 [auto1.be] INFO: Found listing with ID: SR49598
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR49598%27 HTTP/1.1" 200 None
2026-03-29 08:35:52 [auto1.be] INFO: Scrape type for SR49598: 0
2026-03-29 08:35:52 [auto1.be] INFO: Found listing with ID: XU03064
2026-03-29 08:35:52 [auto1.be] INFO: Found listing with ID: NN99297
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN99297%27 HTTP/1.1" 200 None
2026-03-29 08:35:52 [auto1.be] INFO: Scrape type for NN99297: 2
2026-03-29 08:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bd6770b-a75a-5710-a004-ebad33427a3e with identifier: NN99297
2026-03-29 08:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bd6770b-a75a-5710-a004-ebad33427a3e with scrape type 2
2026-03-29 08:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bd6770b-a75a-5710-a004-ebad33427a3e with scrape type 2
2026-03-29 08:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9bd6770b-a75a-5710-a004-ebad33427a3e, identifier: NN99297
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F57%252F6857c470402e0c2f9a44315f448e4ed5%252Fpa%252FYA34487_ea0a41d2b1590e460e9f39c6cdd8aba5.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_ea0a41d2b1590e460e9f39c6cdd8aba5.jpg not downloaded yet
2026-03-29 08:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TM16461> (referer: https://www.auto1.com/v1/car-details-view/TM16461/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f6899e96-7df5-529b-a091-c64597f15c78 with identifier: KD33371
2026-03-29 08:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f6899e96-7df5-529b-a091-c64597f15c78 with identifier: KD33371
2026-03-29 08:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f6899e96-7df5-529b-a091-c64597f15c78 with identifier: KD33371 to the API
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KD33371>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:53:13Z',
'fuel_type': 'diesel',
'id': 'f6899e96-7df5-529b-a091-c64597f15c78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD33371',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Citroen',
'model': 'Jumpy',
'odometer': 179035,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img53/f7/53f73580a5809efd902dea31f92a0480/pa/KD33371_85217cc18b2a555337bc7049b1dfc9e3.jpg',
'https://img-pa.auto1.com/img53/f7/53f73580a5809efd902dea31f92a0480/pa/KD33371_3765551620d5a3efb6963bf8641c972e.jpg',
'https://img-pa.auto1.com/img53/f7/53f73580a5809efd902dea31f92a0480/pa/KD33371_8e9bf9b459d8a2b4530ffed2697a412c.jpg',
'https://img-pa.auto1.com/img53/f7/53f73580a5809efd902dea31f92a0480/pa/KD33371_cb1007bcffbf58ca9dcb78af7e7b3672.jpg',
'https://img-pa.auto1.com/img53/f7/53f73580a5809efd902dea31f92a0480/pa/KD33371_d1b6b8050295d3bb2997d3df0b5d1bee.jpg',
'https://img-pa.auto1.com/img53/f7/53f73580a5809efd902dea31f92a0480/pa/KD33371_2c3f3a023b2734a782830c7856745435.jpg',
'https://img-pa.auto1.com/img53/f7/53f73580a5809efd902dea31f92a0480/pa/KD33371_7cdf2a07727ad689dc38dbb37d751ff0.jpg',
'https://img-pa.auto1.com/img53/f7/53f73580a5809efd902dea31f92a0480/pa/KD33371_5a10735f023c5f65aacda6c0a4f6fdec.jpg',
'https://img-pa.auto1.com/img53/f7/53f73580a5809efd902dea31f92a0480/pa/KD33371_d8639dda54fec95d9760820890f231f6.jpg',
'https://img-pa.auto1.com/img53/f7/53f73580a5809efd902dea31f92a0480/pa/KD33371_6edd85dda8caed99d033fa4647f5d0ab.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6899e96-7df5-529b-a091-c64597f15c78/f6899e96-7df5-529b-a091-c64597f15c78_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75600,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/f7/53f73580a5809efd902dea31f92a0480/pa/KD33371_85217cc18b2a555337bc7049b1dfc9e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6899e96-7df5-529b-a091-c64597f15c78/f6899e96-7df5-529b-a091-c64597f15c78_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73692,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/f7/53f73580a5809efd902dea31f92a0480/pa/KD33371_3765551620d5a3efb6963bf8641c972e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6899e96-7df5-529b-a091-c64597f15c78/f6899e96-7df5-529b-a091-c64597f15c78_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69849,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/f7/53f73580a5809efd902dea31f92a0480/pa/KD33371_8e9bf9b459d8a2b4530ffed2697a412c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6899e96-7df5-529b-a091-c64597f15c78/f6899e96-7df5-529b-a091-c64597f15c78_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61705,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/f7/53f73580a5809efd902dea31f92a0480/pa/KD33371_cb1007bcffbf58ca9dcb78af7e7b3672.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6899e96-7df5-529b-a091-c64597f15c78/f6899e96-7df5-529b-a091-c64597f15c78_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76238,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/f7/53f73580a5809efd902dea31f92a0480/pa/KD33371_d1b6b8050295d3bb2997d3df0b5d1bee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6899e96-7df5-529b-a091-c64597f15c78/f6899e96-7df5-529b-a091-c64597f15c78_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77254,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/f7/53f73580a5809efd902dea31f92a0480/pa/KD33371_2c3f3a023b2734a782830c7856745435.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6899e96-7df5-529b-a091-c64597f15c78/f6899e96-7df5-529b-a091-c64597f15c78_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66751,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/f7/53f73580a5809efd902dea31f92a0480/pa/KD33371_7cdf2a07727ad689dc38dbb37d751ff0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6899e96-7df5-529b-a091-c64597f15c78/f6899e96-7df5-529b-a091-c64597f15c78_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82015,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/f7/53f73580a5809efd902dea31f92a0480/pa/KD33371_5a10735f023c5f65aacda6c0a4f6fdec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6899e96-7df5-529b-a091-c64597f15c78/f6899e96-7df5-529b-a091-c64597f15c78_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69207,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/f7/53f73580a5809efd902dea31f92a0480/pa/KD33371_d8639dda54fec95d9760820890f231f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6899e96-7df5-529b-a091-c64597f15c78/f6899e96-7df5-529b-a091-c64597f15c78_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74837,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/f7/53f73580a5809efd902dea31f92a0480/pa/KD33371_6edd85dda8caed99d033fa4647f5d0ab.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-11-22',
'seats_number': 3,
'seller_name': None,
'title': 'Citroen Jumpy 2.0 Blue-HDi Driver M',
'transmission': 'manual',
'trim': 'Driver M',
'year': 2018}
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD33371%27 HTTP/1.1" 200 None
2026-03-29 08:35:53 [auto1.be] INFO: Saving data for KD33371: {'created_time': 1774773353.276264, 'last_price_update_time': 1774773353.276273, 'auction_closing_time': 1774885993.0}
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KD33371') HTTP/1.1" 204 0
2026-03-29 08:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9bd6770b-a75a-5710-a004-ebad33427a3e with identifier: NN99297
2026-03-29 08:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9bd6770b-a75a-5710-a004-ebad33427a3e with identifier: NN99297
2026-03-29 08:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9bd6770b-a75a-5710-a004-ebad33427a3e with identifier: NN99297 to the API
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:51:47Z',
'fuel_type': 'petrol',
'id': '9bd6770b-a75a-5710-a004-ebad33427a3e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN99297',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20',
'odometer': 41663,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-08',
'seller_name': None,
'title': 'Hyundai i20 1.2 Go',
'transmission': 'manual',
'trim': 'Go',
'year': 2015}
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN99297%27 HTTP/1.1" 200 None
2026-03-29 08:35:53 [auto1.be] INFO: Saving data for NN99297: {'auction_closing_time': 1774885907.0, 'created_time': 1774557520.503704, 'last_price_update_time': 1774773353.59289}
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NN99297') HTTP/1.1" 204 0
2026-03-29 08:35:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:53 [auto1.be] INFO: Found listing with ID: UX94260
2026-03-29 08:35:53 [auto1.be] INFO: Found listing with ID: YW61664
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW61664%27 HTTP/1.1" 200 None
2026-03-29 08:35:53 [auto1.be] INFO: Scrape type for YW61664: 0
2026-03-29 08:35:53 [auto1.be] INFO: Found listing with ID: JS18374
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F57%252F6857c470402e0c2f9a44315f448e4ed5%252Fpa%252FYA34487_8e7afd96c62dcd8255414de4d3b05125.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_8e7afd96c62dcd8255414de4d3b05125.jpg not downloaded yet
2026-03-29 08:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CM14446/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da2b18a6-a949-5d5a-b92e-1aab4f2417d9 with identifier: TM16461
2026-03-29 08:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da2b18a6-a949-5d5a-b92e-1aab4f2417d9 with scrape type 1
2026-03-29 08:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item da2b18a6-a949-5d5a-b92e-1aab4f2417d9
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F5d%252Fc15d115adac7b64bda69f75aa9867ca3%252Fpa%252FTM16461_a10f9be4b1645154dffa7e6b65b1cfc5.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/5d/c15d115adac7b64bda69f75aa9867ca3/pa/TM16461_a10f9be4b1645154dffa7e6b65b1cfc5.jpg already downloaded
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F5d%252Fc15d115adac7b64bda69f75aa9867ca3%252Fpa%252FTM16461_d46681d8c520f16b94295b95893c3746.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/5d/c15d115adac7b64bda69f75aa9867ca3/pa/TM16461_d46681d8c520f16b94295b95893c3746.jpg already downloaded
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F5d%252Fc15d115adac7b64bda69f75aa9867ca3%252Fpa%252FTM16461_0621153486e471782c0b5bcafc55908d.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/5d/c15d115adac7b64bda69f75aa9867ca3/pa/TM16461_0621153486e471782c0b5bcafc55908d.jpg already downloaded
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F5d%252Fc15d115adac7b64bda69f75aa9867ca3%252Fpa%252FTM16461_282e500af288e090d278a8fc65f43ff9.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/5d/c15d115adac7b64bda69f75aa9867ca3/pa/TM16461_282e500af288e090d278a8fc65f43ff9.jpg already downloaded
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F5d%252Fc15d115adac7b64bda69f75aa9867ca3%252Fpa%252FTM16461_0aad3b0035a9112a4d5cba79b6ec7151.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/5d/c15d115adac7b64bda69f75aa9867ca3/pa/TM16461_0aad3b0035a9112a4d5cba79b6ec7151.jpg already downloaded
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F5d%252Fc15d115adac7b64bda69f75aa9867ca3%252Fpa%252FTM16461_711194ef59c591ece6f97ea58e418347.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/5d/c15d115adac7b64bda69f75aa9867ca3/pa/TM16461_711194ef59c591ece6f97ea58e418347.jpg already downloaded
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F5d%252Fc15d115adac7b64bda69f75aa9867ca3%252Fpa%252FTM16461_b66fc4108de09ec0e9b5c9c98c69a48f.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/5d/c15d115adac7b64bda69f75aa9867ca3/pa/TM16461_b66fc4108de09ec0e9b5c9c98c69a48f.jpg already downloaded
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F5d%252Fc15d115adac7b64bda69f75aa9867ca3%252Fpa%252FTM16461_0bd65b37a259579b8e5cb95de4fe1c33.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/5d/c15d115adac7b64bda69f75aa9867ca3/pa/TM16461_0bd65b37a259579b8e5cb95de4fe1c33.jpg already downloaded
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F5d%252Fc15d115adac7b64bda69f75aa9867ca3%252Fpa%252FTM16461_ef287a1886b30348002919b1aa854786.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/5d/c15d115adac7b64bda69f75aa9867ca3/pa/TM16461_ef287a1886b30348002919b1aa854786.jpg already downloaded
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F5d%252Fc15d115adac7b64bda69f75aa9867ca3%252Fpa%252FTM16461_58bef38fdf03801828f48d9e06921248.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/5d/c15d115adac7b64bda69f75aa9867ca3/pa/TM16461_58bef38fdf03801828f48d9e06921248.jpg already downloaded
2026-03-29 08:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: da2b18a6-a949-5d5a-b92e-1aab4f2417d9, identifier: TM16461
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F57%252F6857c470402e0c2f9a44315f448e4ed5%252Fpa%252FYA34487_2b40e27afba027550c3d79927851f19a.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_2b40e27afba027550c3d79927851f19a.jpg not downloaded yet
2026-03-29 08:35:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: da2b18a6-a949-5d5a-b92e-1aab4f2417d9 with identifier: TM16461
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-29 08:35:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 08:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: da2b18a6-a949-5d5a-b92e-1aab4f2417d9 with identifier: TM16461
2026-03-29 08:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: da2b18a6-a949-5d5a-b92e-1aab4f2417d9 with identifier: TM16461 to the API
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TM16461>
{'auction_title': '',
'c_o_2_emission_value': 107,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:57:26Z',
'fuel_type': 'diesel',
'id': 'da2b18a6-a949-5d5a-b92e-1aab4f2417d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM16461',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Dacia',
'model': 'Duster',
'odometer': 113727,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgc1/5d/c15d115adac7b64bda69f75aa9867ca3/pa/TM16461_a10f9be4b1645154dffa7e6b65b1cfc5.jpg',
'https://img-pa.auto1.com/imgc1/5d/c15d115adac7b64bda69f75aa9867ca3/pa/TM16461_d46681d8c520f16b94295b95893c3746.jpg',
'https://img-pa.auto1.com/imgc1/5d/c15d115adac7b64bda69f75aa9867ca3/pa/TM16461_0621153486e471782c0b5bcafc55908d.jpg',
'https://img-pa.auto1.com/imgc1/5d/c15d115adac7b64bda69f75aa9867ca3/pa/TM16461_282e500af288e090d278a8fc65f43ff9.jpg',
'https://img-pa.auto1.com/imgc1/5d/c15d115adac7b64bda69f75aa9867ca3/pa/TM16461_0aad3b0035a9112a4d5cba79b6ec7151.jpg',
'https://img-pa.auto1.com/imgc1/5d/c15d115adac7b64bda69f75aa9867ca3/pa/TM16461_711194ef59c591ece6f97ea58e418347.jpg',
'https://img-pa.auto1.com/imgc1/5d/c15d115adac7b64bda69f75aa9867ca3/pa/TM16461_b66fc4108de09ec0e9b5c9c98c69a48f.jpg',
'https://img-pa.auto1.com/imgc1/5d/c15d115adac7b64bda69f75aa9867ca3/pa/TM16461_0bd65b37a259579b8e5cb95de4fe1c33.jpg',
'https://img-pa.auto1.com/imgc1/5d/c15d115adac7b64bda69f75aa9867ca3/pa/TM16461_ef287a1886b30348002919b1aa854786.jpg',
'https://img-pa.auto1.com/imgc1/5d/c15d115adac7b64bda69f75aa9867ca3/pa/TM16461_58bef38fdf03801828f48d9e06921248.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da2b18a6-a949-5d5a-b92e-1aab4f2417d9/da2b18a6-a949-5d5a-b92e-1aab4f2417d9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117989,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/5d/c15d115adac7b64bda69f75aa9867ca3/pa/TM16461_a10f9be4b1645154dffa7e6b65b1cfc5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da2b18a6-a949-5d5a-b92e-1aab4f2417d9/da2b18a6-a949-5d5a-b92e-1aab4f2417d9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117989,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/5d/c15d115adac7b64bda69f75aa9867ca3/pa/TM16461_d46681d8c520f16b94295b95893c3746.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da2b18a6-a949-5d5a-b92e-1aab4f2417d9/da2b18a6-a949-5d5a-b92e-1aab4f2417d9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97461,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/5d/c15d115adac7b64bda69f75aa9867ca3/pa/TM16461_0621153486e471782c0b5bcafc55908d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da2b18a6-a949-5d5a-b92e-1aab4f2417d9/da2b18a6-a949-5d5a-b92e-1aab4f2417d9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90779,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/5d/c15d115adac7b64bda69f75aa9867ca3/pa/TM16461_282e500af288e090d278a8fc65f43ff9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da2b18a6-a949-5d5a-b92e-1aab4f2417d9/da2b18a6-a949-5d5a-b92e-1aab4f2417d9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93186,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/5d/c15d115adac7b64bda69f75aa9867ca3/pa/TM16461_0aad3b0035a9112a4d5cba79b6ec7151.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da2b18a6-a949-5d5a-b92e-1aab4f2417d9/da2b18a6-a949-5d5a-b92e-1aab4f2417d9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107900,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/5d/c15d115adac7b64bda69f75aa9867ca3/pa/TM16461_711194ef59c591ece6f97ea58e418347.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da2b18a6-a949-5d5a-b92e-1aab4f2417d9/da2b18a6-a949-5d5a-b92e-1aab4f2417d9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91268,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/5d/c15d115adac7b64bda69f75aa9867ca3/pa/TM16461_b66fc4108de09ec0e9b5c9c98c69a48f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da2b18a6-a949-5d5a-b92e-1aab4f2417d9/da2b18a6-a949-5d5a-b92e-1aab4f2417d9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120901,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/5d/c15d115adac7b64bda69f75aa9867ca3/pa/TM16461_0bd65b37a259579b8e5cb95de4fe1c33.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da2b18a6-a949-5d5a-b92e-1aab4f2417d9/da2b18a6-a949-5d5a-b92e-1aab4f2417d9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101085,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/5d/c15d115adac7b64bda69f75aa9867ca3/pa/TM16461_ef287a1886b30348002919b1aa854786.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da2b18a6-a949-5d5a-b92e-1aab4f2417d9/da2b18a6-a949-5d5a-b92e-1aab4f2417d9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73160,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/5d/c15d115adac7b64bda69f75aa9867ca3/pa/TM16461_58bef38fdf03801828f48d9e06921248.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-02-01',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Duster 1.5 Blue dCi Prestige',
'transmission': 'manual',
'trim': 'Prestige',
'year': 2021}
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM16461%27 HTTP/1.1" 200 None
2026-03-29 08:35:54 [auto1.be] INFO: Saving data for TM16461: {'created_time': 1774773354.365425, 'last_price_update_time': 1774773354.365438, 'auction_closing_time': 1774886246.0}
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TM16461') HTTP/1.1" 204 0
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F57%252F6857c470402e0c2f9a44315f448e4ed5%252Fpa%252FYA34487_e3fc83f8febd8ed7233923b52b5ca026.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_e3fc83f8febd8ed7233923b52b5ca026.jpg not downloaded yet
2026-03-29 08:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZM02853> (referer: https://www.auto1.com/v1/car-details-view/ZM02853/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F57%252F6857c470402e0c2f9a44315f448e4ed5%252Fpa%252FYA34487_b9c457263ce4ba0795c4497d8c99e3e7.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_b9c457263ce4ba0795c4497d8c99e3e7.jpg not downloaded yet
2026-03-29 08:35:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F57%252F6857c470402e0c2f9a44315f448e4ed5%252Fpa%252FYA34487_e86ed86a6be767705277445dab318065.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_e86ed86a6be767705277445dab318065.jpg not downloaded yet
2026-03-29 08:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KF56069> (referer: https://www.auto1.com/v1/car-details-view/KF56069/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F57%252F6857c470402e0c2f9a44315f448e4ed5%252Fpa%252FYA34487_f683d83391c61cfb372de4c1505e4cb4.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_f683d83391c61cfb372de4c1505e4cb4.jpg not downloaded yet
2026-03-29 08:35:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F57%252F6857c470402e0c2f9a44315f448e4ed5%252Fpa%252FYA34487_c48ee50b60eb83b2839caf9b2174b270.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_c48ee50b60eb83b2839caf9b2174b270.jpg not downloaded yet
2026-03-29 08:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BY53413> (referer: https://www.auto1.com/v1/car-details-view/BY53413/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FP22064/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8844db3f-1ebc-5003-becc-fc2258e1c876 with identifier: ZM02853
2026-03-29 08:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8844db3f-1ebc-5003-becc-fc2258e1c876 with scrape type 1
2026-03-29 08:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8844db3f-1ebc-5003-becc-fc2258e1c876
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Ff5%252Fc3f53dce665d290dc4073407ecb422bc%252Fpa%252FZM02853_b16fb9b245636bb27729ed9d1a206041.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/f5/c3f53dce665d290dc4073407ecb422bc/pa/ZM02853_b16fb9b245636bb27729ed9d1a206041.jpg already downloaded
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Ff5%252Fc3f53dce665d290dc4073407ecb422bc%252Fpa%252FZM02853_3c2b4fe2a3f976d995956f3bc4ceba48.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/f5/c3f53dce665d290dc4073407ecb422bc/pa/ZM02853_3c2b4fe2a3f976d995956f3bc4ceba48.jpg already downloaded
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Ff5%252Fc3f53dce665d290dc4073407ecb422bc%252Fpa%252FZM02853_d8db6b464eb355c89fde1f3b8a8ddbc7.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/f5/c3f53dce665d290dc4073407ecb422bc/pa/ZM02853_d8db6b464eb355c89fde1f3b8a8ddbc7.jpg already downloaded
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Ff5%252Fc3f53dce665d290dc4073407ecb422bc%252Fpa%252FZM02853_90a8d29bf71a14a93357910e04f93313.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/f5/c3f53dce665d290dc4073407ecb422bc/pa/ZM02853_90a8d29bf71a14a93357910e04f93313.jpg already downloaded
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Ff5%252Fc3f53dce665d290dc4073407ecb422bc%252Fpa%252FZM02853_98a9a93d9104d02a16a2e7ea1d22a382.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/f5/c3f53dce665d290dc4073407ecb422bc/pa/ZM02853_98a9a93d9104d02a16a2e7ea1d22a382.jpg already downloaded
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Ff5%252Fc3f53dce665d290dc4073407ecb422bc%252Fpa%252FZM02853_e156ec7b9e23360f3fad1c0fe880604c.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/f5/c3f53dce665d290dc4073407ecb422bc/pa/ZM02853_e156ec7b9e23360f3fad1c0fe880604c.jpg already downloaded
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Ff5%252Fc3f53dce665d290dc4073407ecb422bc%252Fpa%252FZM02853_3f9047e9d7939a82ebb56952510b3e42.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/f5/c3f53dce665d290dc4073407ecb422bc/pa/ZM02853_3f9047e9d7939a82ebb56952510b3e42.jpg already downloaded
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Ff5%252Fc3f53dce665d290dc4073407ecb422bc%252Fpa%252FZM02853_7d626d43741ede6e6d745def22856a56.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/f5/c3f53dce665d290dc4073407ecb422bc/pa/ZM02853_7d626d43741ede6e6d745def22856a56.jpg already downloaded
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Ff5%252Fc3f53dce665d290dc4073407ecb422bc%252Fpa%252FZM02853_a49c3bb1f9670b00f431d82b82fa58fe.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/f5/c3f53dce665d290dc4073407ecb422bc/pa/ZM02853_a49c3bb1f9670b00f431d82b82fa58fe.jpg already downloaded
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252Ff5%252Fc3f53dce665d290dc4073407ecb422bc%252Fpa%252FZM02853_c66bf50aedfe9654c30f20f17e709673.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/f5/c3f53dce665d290dc4073407ecb422bc/pa/ZM02853_c66bf50aedfe9654c30f20f17e709673.jpg already downloaded
2026-03-29 08:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8844db3f-1ebc-5003-becc-fc2258e1c876, identifier: ZM02853
2026-03-29 08:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8844db3f-1ebc-5003-becc-fc2258e1c876 with identifier: ZM02853
2026-03-29 08:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8844db3f-1ebc-5003-becc-fc2258e1c876 with identifier: ZM02853
2026-03-29 08:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8844db3f-1ebc-5003-becc-fc2258e1c876 with identifier: ZM02853 to the API
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZM02853>
{'auction_title': '',
'c_o_2_emission_value': 197,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D',
'engine': '1.7L',
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:38:13Z',
'fuel_type': 'diesel',
'id': '8844db3f-1ebc-5003-becc-fc2258e1c876',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM02853',
'listing': 'auction',
'location': 'BE, Milmort',
'make': 'Mercedes-Benz',
'model': 'Vito',
'odometer': 163148,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgc3/f5/c3f53dce665d290dc4073407ecb422bc/pa/ZM02853_b16fb9b245636bb27729ed9d1a206041.jpg',
'https://img-pa.auto1.com/imgc3/f5/c3f53dce665d290dc4073407ecb422bc/pa/ZM02853_3c2b4fe2a3f976d995956f3bc4ceba48.jpg',
'https://img-pa.auto1.com/imgc3/f5/c3f53dce665d290dc4073407ecb422bc/pa/ZM02853_d8db6b464eb355c89fde1f3b8a8ddbc7.jpg',
'https://img-pa.auto1.com/imgc3/f5/c3f53dce665d290dc4073407ecb422bc/pa/ZM02853_90a8d29bf71a14a93357910e04f93313.jpg',
'https://img-pa.auto1.com/imgc3/f5/c3f53dce665d290dc4073407ecb422bc/pa/ZM02853_98a9a93d9104d02a16a2e7ea1d22a382.jpg',
'https://img-pa.auto1.com/imgc3/f5/c3f53dce665d290dc4073407ecb422bc/pa/ZM02853_e156ec7b9e23360f3fad1c0fe880604c.jpg',
'https://img-pa.auto1.com/imgc3/f5/c3f53dce665d290dc4073407ecb422bc/pa/ZM02853_3f9047e9d7939a82ebb56952510b3e42.jpg',
'https://img-pa.auto1.com/imgc3/f5/c3f53dce665d290dc4073407ecb422bc/pa/ZM02853_7d626d43741ede6e6d745def22856a56.jpg',
'https://img-pa.auto1.com/imgc3/f5/c3f53dce665d290dc4073407ecb422bc/pa/ZM02853_a49c3bb1f9670b00f431d82b82fa58fe.jpg',
'https://img-pa.auto1.com/imgc3/f5/c3f53dce665d290dc4073407ecb422bc/pa/ZM02853_c66bf50aedfe9654c30f20f17e709673.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8844db3f-1ebc-5003-becc-fc2258e1c876/8844db3f-1ebc-5003-becc-fc2258e1c876_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46728,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/f5/c3f53dce665d290dc4073407ecb422bc/pa/ZM02853_b16fb9b245636bb27729ed9d1a206041.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8844db3f-1ebc-5003-becc-fc2258e1c876/8844db3f-1ebc-5003-becc-fc2258e1c876_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/f5/c3f53dce665d290dc4073407ecb422bc/pa/ZM02853_3c2b4fe2a3f976d995956f3bc4ceba48.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8844db3f-1ebc-5003-becc-fc2258e1c876/8844db3f-1ebc-5003-becc-fc2258e1c876_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47920,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/f5/c3f53dce665d290dc4073407ecb422bc/pa/ZM02853_d8db6b464eb355c89fde1f3b8a8ddbc7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8844db3f-1ebc-5003-becc-fc2258e1c876/8844db3f-1ebc-5003-becc-fc2258e1c876_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38321,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/f5/c3f53dce665d290dc4073407ecb422bc/pa/ZM02853_90a8d29bf71a14a93357910e04f93313.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8844db3f-1ebc-5003-becc-fc2258e1c876/8844db3f-1ebc-5003-becc-fc2258e1c876_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38494,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/f5/c3f53dce665d290dc4073407ecb422bc/pa/ZM02853_98a9a93d9104d02a16a2e7ea1d22a382.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8844db3f-1ebc-5003-becc-fc2258e1c876/8844db3f-1ebc-5003-becc-fc2258e1c876_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50366,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/f5/c3f53dce665d290dc4073407ecb422bc/pa/ZM02853_e156ec7b9e23360f3fad1c0fe880604c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8844db3f-1ebc-5003-becc-fc2258e1c876/8844db3f-1ebc-5003-becc-fc2258e1c876_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 32919,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/f5/c3f53dce665d290dc4073407ecb422bc/pa/ZM02853_3f9047e9d7939a82ebb56952510b3e42.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8844db3f-1ebc-5003-becc-fc2258e1c876/8844db3f-1ebc-5003-becc-fc2258e1c876_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54624,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/f5/c3f53dce665d290dc4073407ecb422bc/pa/ZM02853_7d626d43741ede6e6d745def22856a56.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8844db3f-1ebc-5003-becc-fc2258e1c876/8844db3f-1ebc-5003-becc-fc2258e1c876_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48012,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/f5/c3f53dce665d290dc4073407ecb422bc/pa/ZM02853_a49c3bb1f9670b00f431d82b82fa58fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8844db3f-1ebc-5003-becc-fc2258e1c876/8844db3f-1ebc-5003-becc-fc2258e1c876_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62377,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/f5/c3f53dce665d290dc4073407ecb422bc/pa/ZM02853_c66bf50aedfe9654c30f20f17e709673.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-01-24',
'seats_number': 3,
'seller_name': None,
'title': 'Mercedes-Benz Vito 114 CDI FWD lang',
'transmission': 'automatic',
'trim': 'FWD lang',
'year': 2021}
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM02853%27 HTTP/1.1" 200 None
2026-03-29 08:35:55 [auto1.be] INFO: Saving data for ZM02853: {'created_time': 1774773355.112354, 'last_price_update_time': 1774773355.112363, 'auction_closing_time': 1774885093.0}
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZM02853') HTTP/1.1" 204 0
2026-03-29 08:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3c14c78-7b78-58dc-bee0-4e0668b92fe5 with identifier: KF56069
2026-03-29 08:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3c14c78-7b78-58dc-bee0-4e0668b92fe5 with scrape type 1
2026-03-29 08:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a3c14c78-7b78-58dc-bee0-4e0668b92fe5
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fae%252F67ae3b68d6422763e070725d39e7b727%252Fpa%252FKF56069_1ec2d085571f9b26180c98b288b47a1b.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ae/67ae3b68d6422763e070725d39e7b727/pa/KF56069_1ec2d085571f9b26180c98b288b47a1b.jpg already downloaded
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fae%252F67ae3b68d6422763e070725d39e7b727%252Fpa%252FKF56069_1a6c01b3fa9d73fa1c2d23315d724291.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ae/67ae3b68d6422763e070725d39e7b727/pa/KF56069_1a6c01b3fa9d73fa1c2d23315d724291.jpg already downloaded
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fae%252F67ae3b68d6422763e070725d39e7b727%252Fpa%252FKF56069_e0c8755b34ba938e2a79fb3eb4c8e77d.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ae/67ae3b68d6422763e070725d39e7b727/pa/KF56069_e0c8755b34ba938e2a79fb3eb4c8e77d.jpg already downloaded
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fae%252F67ae3b68d6422763e070725d39e7b727%252Fpa%252FKF56069_8b61b4f29ea9b9d05ff141475b975b30.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ae/67ae3b68d6422763e070725d39e7b727/pa/KF56069_8b61b4f29ea9b9d05ff141475b975b30.jpg already downloaded
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fae%252F67ae3b68d6422763e070725d39e7b727%252Fpa%252FKF56069_593ec1c00f7bec22d4ba04b9f24b4f21.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ae/67ae3b68d6422763e070725d39e7b727/pa/KF56069_593ec1c00f7bec22d4ba04b9f24b4f21.jpg already downloaded
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fae%252F67ae3b68d6422763e070725d39e7b727%252Fpa%252FKF56069_91d28574c50ea37df6a0714baa572b6b.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ae/67ae3b68d6422763e070725d39e7b727/pa/KF56069_91d28574c50ea37df6a0714baa572b6b.jpg already downloaded
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fae%252F67ae3b68d6422763e070725d39e7b727%252Fpa%252FKF56069_b7b2e769197b056f17ca03e5aa58ba0a.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ae/67ae3b68d6422763e070725d39e7b727/pa/KF56069_b7b2e769197b056f17ca03e5aa58ba0a.jpg already downloaded
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fae%252F67ae3b68d6422763e070725d39e7b727%252Fpa%252FKF56069_93095980268700ec75fa561c8f8ceebc.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ae/67ae3b68d6422763e070725d39e7b727/pa/KF56069_93095980268700ec75fa561c8f8ceebc.jpg already downloaded
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fae%252F67ae3b68d6422763e070725d39e7b727%252Fpa%252FKF56069_77e045568f73ab6017e7b618ae830ec9.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ae/67ae3b68d6422763e070725d39e7b727/pa/KF56069_77e045568f73ab6017e7b618ae830ec9.jpg already downloaded
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252Fae%252F67ae3b68d6422763e070725d39e7b727%252Fpa%252FKF56069_ec7f0b9fc02300d5e7ee81c47f35648e.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/ae/67ae3b68d6422763e070725d39e7b727/pa/KF56069_ec7f0b9fc02300d5e7ee81c47f35648e.jpg already downloaded
2026-03-29 08:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a3c14c78-7b78-58dc-bee0-4e0668b92fe5, identifier: KF56069
2026-03-29 08:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e579294-b980-5f5f-851b-9186d1f9638e with identifier: BY53413
2026-03-29 08:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e579294-b980-5f5f-851b-9186d1f9638e with scrape type 1
2026-03-29 08:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7e579294-b980-5f5f-851b-9186d1f9638e
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fc0%252F3ec0c9a12d61a87afd0a7aa2cdd0a9b3%252Fpa%252FBY53413_aadcf85ef190338af991d801e2188f33.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/c0/3ec0c9a12d61a87afd0a7aa2cdd0a9b3/pa/BY53413_aadcf85ef190338af991d801e2188f33.jpg already downloaded
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fc0%252F3ec0c9a12d61a87afd0a7aa2cdd0a9b3%252Fpa%252FBY53413_5edf1ec5096ae043d6cbbacb53254027.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/c0/3ec0c9a12d61a87afd0a7aa2cdd0a9b3/pa/BY53413_5edf1ec5096ae043d6cbbacb53254027.jpg already downloaded
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fc0%252F3ec0c9a12d61a87afd0a7aa2cdd0a9b3%252Fpa%252FBY53413_0a6871b696d9dda8486137709b79b778.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/c0/3ec0c9a12d61a87afd0a7aa2cdd0a9b3/pa/BY53413_0a6871b696d9dda8486137709b79b778.jpg already downloaded
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fc0%252F3ec0c9a12d61a87afd0a7aa2cdd0a9b3%252Fpa%252FBY53413_92ed83f58ef06d1b76ca24c427751ac3.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/c0/3ec0c9a12d61a87afd0a7aa2cdd0a9b3/pa/BY53413_92ed83f58ef06d1b76ca24c427751ac3.jpg already downloaded
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fc0%252F3ec0c9a12d61a87afd0a7aa2cdd0a9b3%252Fpa%252FBY53413_a36e6080fe040e7ba192d9141df60a1b.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/c0/3ec0c9a12d61a87afd0a7aa2cdd0a9b3/pa/BY53413_a36e6080fe040e7ba192d9141df60a1b.jpg already downloaded
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fc0%252F3ec0c9a12d61a87afd0a7aa2cdd0a9b3%252Fpa%252FBY53413_f49312998aff17750c302a1a83059c63.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/c0/3ec0c9a12d61a87afd0a7aa2cdd0a9b3/pa/BY53413_f49312998aff17750c302a1a83059c63.jpg already downloaded
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fc0%252F3ec0c9a12d61a87afd0a7aa2cdd0a9b3%252Fpa%252FBY53413_4ecdcb4097ac9a5c1747b9d1d093128b.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/c0/3ec0c9a12d61a87afd0a7aa2cdd0a9b3/pa/BY53413_4ecdcb4097ac9a5c1747b9d1d093128b.jpg already downloaded
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fc0%252F3ec0c9a12d61a87afd0a7aa2cdd0a9b3%252Fpa%252FBY53413_8d81d84f8d3304f1c1382199dbd1a0dc.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/c0/3ec0c9a12d61a87afd0a7aa2cdd0a9b3/pa/BY53413_8d81d84f8d3304f1c1382199dbd1a0dc.jpg already downloaded
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fc0%252F3ec0c9a12d61a87afd0a7aa2cdd0a9b3%252Fpa%252FBY53413_b677b904f285da4801e1ac7a842c3b6e.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/c0/3ec0c9a12d61a87afd0a7aa2cdd0a9b3/pa/BY53413_b677b904f285da4801e1ac7a842c3b6e.jpg already downloaded
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252Fc0%252F3ec0c9a12d61a87afd0a7aa2cdd0a9b3%252Fpa%252FBY53413_89c9eb3d395d6c5ebaa6005fbbc64d07.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/c0/3ec0c9a12d61a87afd0a7aa2cdd0a9b3/pa/BY53413_89c9eb3d395d6c5ebaa6005fbbc64d07.jpg already downloaded
2026-03-29 08:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7e579294-b980-5f5f-851b-9186d1f9638e, identifier: BY53413
2026-03-29 08:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a3c14c78-7b78-58dc-bee0-4e0668b92fe5 with identifier: KF56069
2026-03-29 08:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a3c14c78-7b78-58dc-bee0-4e0668b92fe5 with identifier: KF56069
2026-03-29 08:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a3c14c78-7b78-58dc-bee0-4e0668b92fe5 with identifier: KF56069 to the API
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KF56069>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:06:25Z',
'fuel_type': 'diesel',
'id': 'a3c14c78-7b78-58dc-bee0-4e0668b92fe5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF56069',
'listing': 'auction',
'location': 'BE, Milmort',
'make': 'Audi',
'model': 'Q3 Sportback',
'odometer': 206778,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img67/ae/67ae3b68d6422763e070725d39e7b727/pa/KF56069_1ec2d085571f9b26180c98b288b47a1b.jpg',
'https://img-pa.auto1.com/img67/ae/67ae3b68d6422763e070725d39e7b727/pa/KF56069_1a6c01b3fa9d73fa1c2d23315d724291.jpg',
'https://img-pa.auto1.com/img67/ae/67ae3b68d6422763e070725d39e7b727/pa/KF56069_e0c8755b34ba938e2a79fb3eb4c8e77d.jpg',
'https://img-pa.auto1.com/img67/ae/67ae3b68d6422763e070725d39e7b727/pa/KF56069_8b61b4f29ea9b9d05ff141475b975b30.jpg',
'https://img-pa.auto1.com/img67/ae/67ae3b68d6422763e070725d39e7b727/pa/KF56069_593ec1c00f7bec22d4ba04b9f24b4f21.jpg',
'https://img-pa.auto1.com/img67/ae/67ae3b68d6422763e070725d39e7b727/pa/KF56069_91d28574c50ea37df6a0714baa572b6b.jpg',
'https://img-pa.auto1.com/img67/ae/67ae3b68d6422763e070725d39e7b727/pa/KF56069_b7b2e769197b056f17ca03e5aa58ba0a.jpg',
'https://img-pa.auto1.com/img67/ae/67ae3b68d6422763e070725d39e7b727/pa/KF56069_93095980268700ec75fa561c8f8ceebc.jpg',
'https://img-pa.auto1.com/img67/ae/67ae3b68d6422763e070725d39e7b727/pa/KF56069_77e045568f73ab6017e7b618ae830ec9.jpg',
'https://img-pa.auto1.com/img67/ae/67ae3b68d6422763e070725d39e7b727/pa/KF56069_ec7f0b9fc02300d5e7ee81c47f35648e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3c14c78-7b78-58dc-bee0-4e0668b92fe5/a3c14c78-7b78-58dc-bee0-4e0668b92fe5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58814,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/ae/67ae3b68d6422763e070725d39e7b727/pa/KF56069_1ec2d085571f9b26180c98b288b47a1b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3c14c78-7b78-58dc-bee0-4e0668b92fe5/a3c14c78-7b78-58dc-bee0-4e0668b92fe5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66626,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/ae/67ae3b68d6422763e070725d39e7b727/pa/KF56069_1a6c01b3fa9d73fa1c2d23315d724291.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3c14c78-7b78-58dc-bee0-4e0668b92fe5/a3c14c78-7b78-58dc-bee0-4e0668b92fe5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65390,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/ae/67ae3b68d6422763e070725d39e7b727/pa/KF56069_e0c8755b34ba938e2a79fb3eb4c8e77d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3c14c78-7b78-58dc-bee0-4e0668b92fe5/a3c14c78-7b78-58dc-bee0-4e0668b92fe5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65334,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/ae/67ae3b68d6422763e070725d39e7b727/pa/KF56069_8b61b4f29ea9b9d05ff141475b975b30.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3c14c78-7b78-58dc-bee0-4e0668b92fe5/a3c14c78-7b78-58dc-bee0-4e0668b92fe5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61754,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/ae/67ae3b68d6422763e070725d39e7b727/pa/KF56069_593ec1c00f7bec22d4ba04b9f24b4f21.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3c14c78-7b78-58dc-bee0-4e0668b92fe5/a3c14c78-7b78-58dc-bee0-4e0668b92fe5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67950,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/ae/67ae3b68d6422763e070725d39e7b727/pa/KF56069_91d28574c50ea37df6a0714baa572b6b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3c14c78-7b78-58dc-bee0-4e0668b92fe5/a3c14c78-7b78-58dc-bee0-4e0668b92fe5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58910,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/ae/67ae3b68d6422763e070725d39e7b727/pa/KF56069_b7b2e769197b056f17ca03e5aa58ba0a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3c14c78-7b78-58dc-bee0-4e0668b92fe5/a3c14c78-7b78-58dc-bee0-4e0668b92fe5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66066,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/ae/67ae3b68d6422763e070725d39e7b727/pa/KF56069_93095980268700ec75fa561c8f8ceebc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3c14c78-7b78-58dc-bee0-4e0668b92fe5/a3c14c78-7b78-58dc-bee0-4e0668b92fe5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63035,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/ae/67ae3b68d6422763e070725d39e7b727/pa/KF56069_77e045568f73ab6017e7b618ae830ec9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3c14c78-7b78-58dc-bee0-4e0668b92fe5/a3c14c78-7b78-58dc-bee0-4e0668b92fe5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69479,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/ae/67ae3b68d6422763e070725d39e7b727/pa/KF56069_ec7f0b9fc02300d5e7ee81c47f35648e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-05-31',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 Sportback 35 TDI S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2021}
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF56069%27 HTTP/1.1" 200 None
2026-03-29 08:35:56 [auto1.be] INFO: Saving data for KF56069: {'created_time': 1774773356.034194, 'last_price_update_time': 1774773356.034204, 'auction_closing_time': 1774883185.0}
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KF56069') HTTP/1.1" 204 0
2026-03-29 08:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7e579294-b980-5f5f-851b-9186d1f9638e with identifier: BY53413
2026-03-29 08:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7e579294-b980-5f5f-851b-9186d1f9638e with identifier: BY53413
2026-03-29 08:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7e579294-b980-5f5f-851b-9186d1f9638e with identifier: BY53413 to the API
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BY53413>
{'auction_title': '',
'c_o_2_emission_value': 135,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:23:37Z',
'fuel_type': 'petrol',
'id': '7e579294-b980-5f5f-851b-9186d1f9638e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY53413',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 83734,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img3e/c0/3ec0c9a12d61a87afd0a7aa2cdd0a9b3/pa/BY53413_aadcf85ef190338af991d801e2188f33.jpg',
'https://img-pa.auto1.com/img3e/c0/3ec0c9a12d61a87afd0a7aa2cdd0a9b3/pa/BY53413_5edf1ec5096ae043d6cbbacb53254027.jpg',
'https://img-pa.auto1.com/img3e/c0/3ec0c9a12d61a87afd0a7aa2cdd0a9b3/pa/BY53413_0a6871b696d9dda8486137709b79b778.jpg',
'https://img-pa.auto1.com/img3e/c0/3ec0c9a12d61a87afd0a7aa2cdd0a9b3/pa/BY53413_92ed83f58ef06d1b76ca24c427751ac3.jpg',
'https://img-pa.auto1.com/img3e/c0/3ec0c9a12d61a87afd0a7aa2cdd0a9b3/pa/BY53413_a36e6080fe040e7ba192d9141df60a1b.jpg',
'https://img-pa.auto1.com/img3e/c0/3ec0c9a12d61a87afd0a7aa2cdd0a9b3/pa/BY53413_f49312998aff17750c302a1a83059c63.jpg',
'https://img-pa.auto1.com/img3e/c0/3ec0c9a12d61a87afd0a7aa2cdd0a9b3/pa/BY53413_4ecdcb4097ac9a5c1747b9d1d093128b.jpg',
'https://img-pa.auto1.com/img3e/c0/3ec0c9a12d61a87afd0a7aa2cdd0a9b3/pa/BY53413_8d81d84f8d3304f1c1382199dbd1a0dc.jpg',
'https://img-pa.auto1.com/img3e/c0/3ec0c9a12d61a87afd0a7aa2cdd0a9b3/pa/BY53413_b677b904f285da4801e1ac7a842c3b6e.jpg',
'https://img-pa.auto1.com/img3e/c0/3ec0c9a12d61a87afd0a7aa2cdd0a9b3/pa/BY53413_89c9eb3d395d6c5ebaa6005fbbc64d07.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e579294-b980-5f5f-851b-9186d1f9638e/7e579294-b980-5f5f-851b-9186d1f9638e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100078,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/c0/3ec0c9a12d61a87afd0a7aa2cdd0a9b3/pa/BY53413_aadcf85ef190338af991d801e2188f33.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e579294-b980-5f5f-851b-9186d1f9638e/7e579294-b980-5f5f-851b-9186d1f9638e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100078,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/c0/3ec0c9a12d61a87afd0a7aa2cdd0a9b3/pa/BY53413_5edf1ec5096ae043d6cbbacb53254027.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e579294-b980-5f5f-851b-9186d1f9638e/7e579294-b980-5f5f-851b-9186d1f9638e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104638,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/c0/3ec0c9a12d61a87afd0a7aa2cdd0a9b3/pa/BY53413_0a6871b696d9dda8486137709b79b778.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e579294-b980-5f5f-851b-9186d1f9638e/7e579294-b980-5f5f-851b-9186d1f9638e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91704,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/c0/3ec0c9a12d61a87afd0a7aa2cdd0a9b3/pa/BY53413_92ed83f58ef06d1b76ca24c427751ac3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e579294-b980-5f5f-851b-9186d1f9638e/7e579294-b980-5f5f-851b-9186d1f9638e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99376,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/c0/3ec0c9a12d61a87afd0a7aa2cdd0a9b3/pa/BY53413_a36e6080fe040e7ba192d9141df60a1b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e579294-b980-5f5f-851b-9186d1f9638e/7e579294-b980-5f5f-851b-9186d1f9638e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111698,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/c0/3ec0c9a12d61a87afd0a7aa2cdd0a9b3/pa/BY53413_f49312998aff17750c302a1a83059c63.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e579294-b980-5f5f-851b-9186d1f9638e/7e579294-b980-5f5f-851b-9186d1f9638e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95052,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/c0/3ec0c9a12d61a87afd0a7aa2cdd0a9b3/pa/BY53413_4ecdcb4097ac9a5c1747b9d1d093128b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e579294-b980-5f5f-851b-9186d1f9638e/7e579294-b980-5f5f-851b-9186d1f9638e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109439,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/c0/3ec0c9a12d61a87afd0a7aa2cdd0a9b3/pa/BY53413_8d81d84f8d3304f1c1382199dbd1a0dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e579294-b980-5f5f-851b-9186d1f9638e/7e579294-b980-5f5f-851b-9186d1f9638e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107251,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/c0/3ec0c9a12d61a87afd0a7aa2cdd0a9b3/pa/BY53413_b677b904f285da4801e1ac7a842c3b6e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e579294-b980-5f5f-851b-9186d1f9638e/7e579294-b980-5f5f-851b-9186d1f9638e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103689,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/c0/3ec0c9a12d61a87afd0a7aa2cdd0a9b3/pa/BY53413_89c9eb3d395d6c5ebaa6005fbbc64d07.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-03-21',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 Progressive',
'transmission': 'manual',
'trim': 'Progressive',
'year': 2021}
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY53413%27 HTTP/1.1" 200 None
2026-03-29 08:35:56 [auto1.be] INFO: Saving data for BY53413: {'created_time': 1774773356.364231, 'last_price_update_time': 1774773356.364239, 'auction_closing_time': 1774884217.0}
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BY53413') HTTP/1.1" 204 0
2026-03-29 08:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EK47235/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_e3fc83f8febd8ed7233923b52b5ca026.jpg> (referer: https://www.auto1.com/)
2026-03-29 08:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_b9c457263ce4ba0795c4497d8c99e3e7.jpg> (referer: https://www.auto1.com/)
2026-03-29 08:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_c48ee50b60eb83b2839caf9b2174b270.jpg> (referer: https://www.auto1.com/)
2026-03-29 08:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LY35485> (referer: https://www.auto1.com/v1/car-details-view/LY35485/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_e86ed86a6be767705277445dab318065.jpg> (referer: https://www.auto1.com/)
2026-03-29 08:35:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-29 08:35:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-29 08:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 08:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f77aa0e2ed0>
2026-03-29 08:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 08:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0ad950-0d11-54d2-a68f-6d6044c75d5d/2e0ad950-0d11-54d2-a68f-6d6044c75d5d_image_5.jpg HTTP/1.1" 201 0
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F57%252F6857c470402e0c2f9a44315f448e4ed5%252Fpa%252FYA34487_e3fc83f8febd8ed7233923b52b5ca026.jpg') HTTP/1.1" 204 0
2026-03-29 08:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_e3fc83f8febd8ed7233923b52b5ca026.jpg saved to cache
2026-03-29 08:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2e0ad950-0d11-54d2-a68f-6d6044c75d5d
2026-03-29 08:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_8e7afd96c62dcd8255414de4d3b05125.jpg> (referer: https://www.auto1.com/)
2026-03-29 08:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_f683d83391c61cfb372de4c1505e4cb4.jpg> (referer: https://www.auto1.com/)
2026-03-29 08:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_ea0a41d2b1590e460e9f39c6cdd8aba5.jpg> (referer: https://www.auto1.com/)
2026-03-29 08:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_2b40e27afba027550c3d79927851f19a.jpg> (referer: https://www.auto1.com/)
2026-03-29 08:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 08:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f77a9f60d10>
2026-03-29 08:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 08:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0ad950-0d11-54d2-a68f-6d6044c75d5d/2e0ad950-0d11-54d2-a68f-6d6044c75d5d_image_6.jpg HTTP/1.1" 201 0
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F57%252F6857c470402e0c2f9a44315f448e4ed5%252Fpa%252FYA34487_b9c457263ce4ba0795c4497d8c99e3e7.jpg') HTTP/1.1" 204 0
2026-03-29 08:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_b9c457263ce4ba0795c4497d8c99e3e7.jpg saved to cache
2026-03-29 08:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2e0ad950-0d11-54d2-a68f-6d6044c75d5d
2026-03-29 08:35:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 08:35:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f77aa235110>
2026-03-29 08:35:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 08:35:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0ad950-0d11-54d2-a68f-6d6044c75d5d/2e0ad950-0d11-54d2-a68f-6d6044c75d5d_image_9.jpg HTTP/1.1" 201 0
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F57%252F6857c470402e0c2f9a44315f448e4ed5%252Fpa%252FYA34487_c48ee50b60eb83b2839caf9b2174b270.jpg') HTTP/1.1" 204 0
2026-03-29 08:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_c48ee50b60eb83b2839caf9b2174b270.jpg saved to cache
2026-03-29 08:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2e0ad950-0d11-54d2-a68f-6d6044c75d5d
2026-03-29 08:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76aece13-5887-5898-bffa-61f0719e5106 with identifier: LY35485
2026-03-29 08:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76aece13-5887-5898-bffa-61f0719e5106 with scrape type 1
2026-03-29 08:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 76aece13-5887-5898-bffa-61f0719e5106
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd3%252F62d3341187b6c0ed0453bb896b24576d%252Fpa%252FLY35485_d735ab9f4839c6f960b6f4d99c50c73d.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d3/62d3341187b6c0ed0453bb896b24576d/pa/LY35485_d735ab9f4839c6f960b6f4d99c50c73d.jpg already downloaded
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd3%252F62d3341187b6c0ed0453bb896b24576d%252Fpa%252FLY35485_0078179673e10f92ef4bae812c1672d1.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d3/62d3341187b6c0ed0453bb896b24576d/pa/LY35485_0078179673e10f92ef4bae812c1672d1.jpg already downloaded
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd3%252F62d3341187b6c0ed0453bb896b24576d%252Fpa%252FLY35485_2ee25f7a5d363de35746181f60c01807.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d3/62d3341187b6c0ed0453bb896b24576d/pa/LY35485_2ee25f7a5d363de35746181f60c01807.jpg already downloaded
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd3%252F62d3341187b6c0ed0453bb896b24576d%252Fpa%252FLY35485_80ec434e06b2e13b44b7434c6152dd83.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d3/62d3341187b6c0ed0453bb896b24576d/pa/LY35485_80ec434e06b2e13b44b7434c6152dd83.jpg already downloaded
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd3%252F62d3341187b6c0ed0453bb896b24576d%252Fpa%252FLY35485_87fdffc9f8acf368b0ac6ce24da93c8f.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d3/62d3341187b6c0ed0453bb896b24576d/pa/LY35485_87fdffc9f8acf368b0ac6ce24da93c8f.jpg already downloaded
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd3%252F62d3341187b6c0ed0453bb896b24576d%252Fpa%252FLY35485_6b581f0b989bd9afd2b92439b456895e.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d3/62d3341187b6c0ed0453bb896b24576d/pa/LY35485_6b581f0b989bd9afd2b92439b456895e.jpg already downloaded
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd3%252F62d3341187b6c0ed0453bb896b24576d%252Fpa%252FLY35485_0fd1c0dd37adf18a39cc9f08cf256417.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d3/62d3341187b6c0ed0453bb896b24576d/pa/LY35485_0fd1c0dd37adf18a39cc9f08cf256417.jpg already downloaded
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd3%252F62d3341187b6c0ed0453bb896b24576d%252Fpa%252FLY35485_936b61b33548461fd75bfa6a9da7f99f.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d3/62d3341187b6c0ed0453bb896b24576d/pa/LY35485_936b61b33548461fd75bfa6a9da7f99f.jpg already downloaded
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd3%252F62d3341187b6c0ed0453bb896b24576d%252Fpa%252FLY35485_29d7ed72a566acad444eb24bd273d378.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d3/62d3341187b6c0ed0453bb896b24576d/pa/LY35485_29d7ed72a566acad444eb24bd273d378.jpg already downloaded
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd3%252F62d3341187b6c0ed0453bb896b24576d%252Fpa%252FLY35485_df77961e08f866d5383547c8145ed247.png%27 HTTP/1.1" 200 None
2026-03-29 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d3/62d3341187b6c0ed0453bb896b24576d/pa/LY35485_df77961e08f866d5383547c8145ed247.png already downloaded
2026-03-29 08:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 76aece13-5887-5898-bffa-61f0719e5106, identifier: LY35485
2026-03-29 08:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 08:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f77aa0e0e50>
2026-03-29 08:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 08:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0ad950-0d11-54d2-a68f-6d6044c75d5d/2e0ad950-0d11-54d2-a68f-6d6044c75d5d_image_7.jpg HTTP/1.1" 201 0
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F57%252F6857c470402e0c2f9a44315f448e4ed5%252Fpa%252FYA34487_e86ed86a6be767705277445dab318065.jpg') HTTP/1.1" 204 0
2026-03-29 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_e86ed86a6be767705277445dab318065.jpg saved to cache
2026-03-29 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2e0ad950-0d11-54d2-a68f-6d6044c75d5d
2026-03-29 08:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 76aece13-5887-5898-bffa-61f0719e5106 with identifier: LY35485
2026-03-29 08:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 76aece13-5887-5898-bffa-61f0719e5106 with identifier: LY35485
2026-03-29 08:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 76aece13-5887-5898-bffa-61f0719e5106 with identifier: LY35485 to the API
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LY35485>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.3L',
'engine_horse_power': 280,
'expiration_date': '2026-03-30T15:39:33Z',
'fuel_type': 'hybrid',
'id': '76aece13-5887-5898-bffa-61f0719e5106',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY35485',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Alfa Romeo',
'model': 'Tonale',
'odometer': 45683,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img62/d3/62d3341187b6c0ed0453bb896b24576d/pa/LY35485_d735ab9f4839c6f960b6f4d99c50c73d.jpg',
'https://img-pa.auto1.com/img62/d3/62d3341187b6c0ed0453bb896b24576d/pa/LY35485_0078179673e10f92ef4bae812c1672d1.jpg',
'https://img-pa.auto1.com/img62/d3/62d3341187b6c0ed0453bb896b24576d/pa/LY35485_2ee25f7a5d363de35746181f60c01807.jpg',
'https://img-pa.auto1.com/img62/d3/62d3341187b6c0ed0453bb896b24576d/pa/LY35485_80ec434e06b2e13b44b7434c6152dd83.jpg',
'https://img-pa.auto1.com/img62/d3/62d3341187b6c0ed0453bb896b24576d/pa/LY35485_87fdffc9f8acf368b0ac6ce24da93c8f.jpg',
'https://img-pa.auto1.com/img62/d3/62d3341187b6c0ed0453bb896b24576d/pa/LY35485_6b581f0b989bd9afd2b92439b456895e.jpg',
'https://img-pa.auto1.com/img62/d3/62d3341187b6c0ed0453bb896b24576d/pa/LY35485_0fd1c0dd37adf18a39cc9f08cf256417.jpg',
'https://img-pa.auto1.com/img62/d3/62d3341187b6c0ed0453bb896b24576d/pa/LY35485_936b61b33548461fd75bfa6a9da7f99f.jpg',
'https://img-pa.auto1.com/img62/d3/62d3341187b6c0ed0453bb896b24576d/pa/LY35485_29d7ed72a566acad444eb24bd273d378.jpg',
'https://img-pa.auto1.com/img62/d3/62d3341187b6c0ed0453bb896b24576d/pa/LY35485_df77961e08f866d5383547c8145ed247.png'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76aece13-5887-5898-bffa-61f0719e5106/76aece13-5887-5898-bffa-61f0719e5106_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111493,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/d3/62d3341187b6c0ed0453bb896b24576d/pa/LY35485_d735ab9f4839c6f960b6f4d99c50c73d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76aece13-5887-5898-bffa-61f0719e5106/76aece13-5887-5898-bffa-61f0719e5106_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1032566,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img62/d3/62d3341187b6c0ed0453bb896b24576d/pa/LY35485_0078179673e10f92ef4bae812c1672d1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76aece13-5887-5898-bffa-61f0719e5106/76aece13-5887-5898-bffa-61f0719e5106_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91011,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/d3/62d3341187b6c0ed0453bb896b24576d/pa/LY35485_2ee25f7a5d363de35746181f60c01807.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76aece13-5887-5898-bffa-61f0719e5106/76aece13-5887-5898-bffa-61f0719e5106_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 846511,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img62/d3/62d3341187b6c0ed0453bb896b24576d/pa/LY35485_80ec434e06b2e13b44b7434c6152dd83.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76aece13-5887-5898-bffa-61f0719e5106/76aece13-5887-5898-bffa-61f0719e5106_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1071902,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img62/d3/62d3341187b6c0ed0453bb896b24576d/pa/LY35485_87fdffc9f8acf368b0ac6ce24da93c8f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76aece13-5887-5898-bffa-61f0719e5106/76aece13-5887-5898-bffa-61f0719e5106_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 127633,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/d3/62d3341187b6c0ed0453bb896b24576d/pa/LY35485_6b581f0b989bd9afd2b92439b456895e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76aece13-5887-5898-bffa-61f0719e5106/76aece13-5887-5898-bffa-61f0719e5106_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118171,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/d3/62d3341187b6c0ed0453bb896b24576d/pa/LY35485_0fd1c0dd37adf18a39cc9f08cf256417.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76aece13-5887-5898-bffa-61f0719e5106/76aece13-5887-5898-bffa-61f0719e5106_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1155048,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img62/d3/62d3341187b6c0ed0453bb896b24576d/pa/LY35485_936b61b33548461fd75bfa6a9da7f99f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76aece13-5887-5898-bffa-61f0719e5106/76aece13-5887-5898-bffa-61f0719e5106_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107283,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/d3/62d3341187b6c0ed0453bb896b24576d/pa/LY35485_29d7ed72a566acad444eb24bd273d378.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76aece13-5887-5898-bffa-61f0719e5106/76aece13-5887-5898-bffa-61f0719e5106_image_9.png',
'Extension': 'png',
'FileSizeInBytes': 851140,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/d3/62d3341187b6c0ed0453bb896b24576d/pa/LY35485_df77961e08f866d5383547c8145ed247.png',
'Width': 623}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2023-04-13',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Tonale 1.3 Plug-in Hybrid Veloce AWD',
'transmission': 'automatic',
'trim': 'Veloce AWD',
'year': 2023}
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY35485%27 HTTP/1.1" 200 None
2026-03-29 08:35:57 [auto1.be] INFO: Saving data for LY35485: {'created_time': 1774773357.686434, 'last_price_update_time': 1774773357.686445, 'auction_closing_time': 1774885173.0}
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LY35485') HTTP/1.1" 204 0
2026-03-29 08:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SJ26894/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VP06293/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TX69988/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_3b32c007f08ccbfff03ba115e13e7a10.jpg> (referer: https://www.auto1.com/)
2026-03-29 08:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_1db4e22d42a76374f107158340e2181e.jpg> (referer: https://www.auto1.com/)
2026-03-29 08:35:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KU68109> (referer: https://www.auto1.com/v1/car-details-view/KU68109/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 08:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f77aa0e0e10>
2026-03-29 08:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 08:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0ad950-0d11-54d2-a68f-6d6044c75d5d/2e0ad950-0d11-54d2-a68f-6d6044c75d5d_image_3.jpg HTTP/1.1" 201 0
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F57%252F6857c470402e0c2f9a44315f448e4ed5%252Fpa%252FYA34487_8e7afd96c62dcd8255414de4d3b05125.jpg') HTTP/1.1" 204 0
2026-03-29 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_8e7afd96c62dcd8255414de4d3b05125.jpg saved to cache
2026-03-29 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2e0ad950-0d11-54d2-a68f-6d6044c75d5d
2026-03-29 08:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 08:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f77a9e6ad10>
2026-03-29 08:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 08:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0ad950-0d11-54d2-a68f-6d6044c75d5d/2e0ad950-0d11-54d2-a68f-6d6044c75d5d_image_8.jpg HTTP/1.1" 201 0
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F57%252F6857c470402e0c2f9a44315f448e4ed5%252Fpa%252FYA34487_f683d83391c61cfb372de4c1505e4cb4.jpg') HTTP/1.1" 204 0
2026-03-29 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_f683d83391c61cfb372de4c1505e4cb4.jpg saved to cache
2026-03-29 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2e0ad950-0d11-54d2-a68f-6d6044c75d5d
2026-03-29 08:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 08:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f77aa20af10>
2026-03-29 08:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 08:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0ad950-0d11-54d2-a68f-6d6044c75d5d/2e0ad950-0d11-54d2-a68f-6d6044c75d5d_image_2.jpg HTTP/1.1" 201 0
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F57%252F6857c470402e0c2f9a44315f448e4ed5%252Fpa%252FYA34487_ea0a41d2b1590e460e9f39c6cdd8aba5.jpg') HTTP/1.1" 204 0
2026-03-29 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_ea0a41d2b1590e460e9f39c6cdd8aba5.jpg saved to cache
2026-03-29 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2e0ad950-0d11-54d2-a68f-6d6044c75d5d
2026-03-29 08:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 08:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f77a9e40490>
2026-03-29 08:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 08:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0ad950-0d11-54d2-a68f-6d6044c75d5d/2e0ad950-0d11-54d2-a68f-6d6044c75d5d_image_4.jpg HTTP/1.1" 201 0
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F57%252F6857c470402e0c2f9a44315f448e4ed5%252Fpa%252FYA34487_2b40e27afba027550c3d79927851f19a.jpg') HTTP/1.1" 204 0
2026-03-29 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_2b40e27afba027550c3d79927851f19a.jpg saved to cache
2026-03-29 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2e0ad950-0d11-54d2-a68f-6d6044c75d5d
2026-03-29 08:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MG99487/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 08:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f77a9e68710>
2026-03-29 08:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 08:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0ad950-0d11-54d2-a68f-6d6044c75d5d/2e0ad950-0d11-54d2-a68f-6d6044c75d5d_image_0.jpg HTTP/1.1" 201 0
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F57%252F6857c470402e0c2f9a44315f448e4ed5%252Fpa%252FYA34487_3b32c007f08ccbfff03ba115e13e7a10.jpg') HTTP/1.1" 204 0
2026-03-29 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_3b32c007f08ccbfff03ba115e13e7a10.jpg saved to cache
2026-03-29 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e0ad950-0d11-54d2-a68f-6d6044c75d5d
2026-03-29 08:35:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-29 08:35:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f77aa0ba010>
2026-03-29 08:35:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-29 08:35:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e0ad950-0d11-54d2-a68f-6d6044c75d5d/2e0ad950-0d11-54d2-a68f-6d6044c75d5d_image_1.jpg HTTP/1.1" 201 0
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252F57%252F6857c470402e0c2f9a44315f448e4ed5%252Fpa%252FYA34487_1db4e22d42a76374f107158340e2181e.jpg') HTTP/1.1" 204 0
2026-03-29 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_1db4e22d42a76374f107158340e2181e.jpg saved to cache
2026-03-29 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2e0ad950-0d11-54d2-a68f-6d6044c75d5d
2026-03-29 08:35:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2e0ad950-0d11-54d2-a68f-6d6044c75d5d, skipping ID generation
2026-03-29 08:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e0ad950-0d11-54d2-a68f-6d6044c75d5d with scrape type 1
2026-03-29 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2e0ad950-0d11-54d2-a68f-6d6044c75d5d sending to next pipeline
2026-03-29 08:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2e0ad950-0d11-54d2-a68f-6d6044c75d5d, identifier: YA34487
2026-03-29 08:35:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94bf3c81-26fd-5171-823f-591eb83e234e with identifier: KU68109
2026-03-29 08:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94bf3c81-26fd-5171-823f-591eb83e234e with scrape type 1
2026-03-29 08:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 94bf3c81-26fd-5171-823f-591eb83e234e
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F2c%252F8e2c0602aa2cfefaab8300f45bf4fa81%252Fpa%252FKU68109_f2234b8b7c0914339c57cc6053de61a0.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/2c/8e2c0602aa2cfefaab8300f45bf4fa81/pa/KU68109_f2234b8b7c0914339c57cc6053de61a0.jpg already downloaded
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F2c%252F8e2c0602aa2cfefaab8300f45bf4fa81%252Fpa%252FKU68109_20bbc450ce7a0577c82da8d329f660d0.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/2c/8e2c0602aa2cfefaab8300f45bf4fa81/pa/KU68109_20bbc450ce7a0577c82da8d329f660d0.jpg already downloaded
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F2c%252F8e2c0602aa2cfefaab8300f45bf4fa81%252Fpa%252FKU68109_d13c3a512400421c66ca6ac3753c1141.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/2c/8e2c0602aa2cfefaab8300f45bf4fa81/pa/KU68109_d13c3a512400421c66ca6ac3753c1141.jpg already downloaded
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F2c%252F8e2c0602aa2cfefaab8300f45bf4fa81%252Fpa%252FKU68109_41b5a80f6bff5c23a001bde430768c96.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/2c/8e2c0602aa2cfefaab8300f45bf4fa81/pa/KU68109_41b5a80f6bff5c23a001bde430768c96.jpg already downloaded
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F2c%252F8e2c0602aa2cfefaab8300f45bf4fa81%252Fpa%252FKU68109_17a25cb09f127db37125a5396b3ad9a3.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/2c/8e2c0602aa2cfefaab8300f45bf4fa81/pa/KU68109_17a25cb09f127db37125a5396b3ad9a3.jpg already downloaded
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F2c%252F8e2c0602aa2cfefaab8300f45bf4fa81%252Fpa%252FKU68109_956647296aa472e49e14af38a7a258d8.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/2c/8e2c0602aa2cfefaab8300f45bf4fa81/pa/KU68109_956647296aa472e49e14af38a7a258d8.jpg already downloaded
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F2c%252F8e2c0602aa2cfefaab8300f45bf4fa81%252Fpa%252FKU68109_a0123acf0fe936f7c99cac73e5535dc8.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/2c/8e2c0602aa2cfefaab8300f45bf4fa81/pa/KU68109_a0123acf0fe936f7c99cac73e5535dc8.jpg already downloaded
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F2c%252F8e2c0602aa2cfefaab8300f45bf4fa81%252Fpa%252FKU68109_ef6e6ede2ce8f0763cb3f068f5b4bf7d.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/2c/8e2c0602aa2cfefaab8300f45bf4fa81/pa/KU68109_ef6e6ede2ce8f0763cb3f068f5b4bf7d.jpg already downloaded
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F2c%252F8e2c0602aa2cfefaab8300f45bf4fa81%252Fpa%252FKU68109_4e231477660de5637ce046e8fa558805.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/2c/8e2c0602aa2cfefaab8300f45bf4fa81/pa/KU68109_4e231477660de5637ce046e8fa558805.jpg already downloaded
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252F2c%252F8e2c0602aa2cfefaab8300f45bf4fa81%252Fpa%252FKU68109_f5ed1f8e27f89cd9ab586b595c1203ca.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/2c/8e2c0602aa2cfefaab8300f45bf4fa81/pa/KU68109_f5ed1f8e27f89cd9ab586b595c1203ca.jpg already downloaded
2026-03-29 08:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 94bf3c81-26fd-5171-823f-591eb83e234e, identifier: KU68109
2026-03-29 08:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2e0ad950-0d11-54d2-a68f-6d6044c75d5d with identifier: YA34487
2026-03-29 08:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2e0ad950-0d11-54d2-a68f-6d6044c75d5d with identifier: YA34487
2026-03-29 08:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2e0ad950-0d11-54d2-a68f-6d6044c75d5d with identifier: YA34487 to the API
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_1db4e22d42a76374f107158340e2181e.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:05:25Z',
'fuel_type': 'petrol',
'id': '2e0ad950-0d11-54d2-a68f-6d6044c75d5d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA34487',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 83635,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0ad950-0d11-54d2-a68f-6d6044c75d5d/2e0ad950-0d11-54d2-a68f-6d6044c75d5d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92526,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_3b32c007f08ccbfff03ba115e13e7a10.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0ad950-0d11-54d2-a68f-6d6044c75d5d/2e0ad950-0d11-54d2-a68f-6d6044c75d5d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94237,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_1db4e22d42a76374f107158340e2181e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0ad950-0d11-54d2-a68f-6d6044c75d5d/2e0ad950-0d11-54d2-a68f-6d6044c75d5d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96891,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_ea0a41d2b1590e460e9f39c6cdd8aba5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0ad950-0d11-54d2-a68f-6d6044c75d5d/2e0ad950-0d11-54d2-a68f-6d6044c75d5d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84347,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_8e7afd96c62dcd8255414de4d3b05125.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0ad950-0d11-54d2-a68f-6d6044c75d5d/2e0ad950-0d11-54d2-a68f-6d6044c75d5d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90632,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_2b40e27afba027550c3d79927851f19a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0ad950-0d11-54d2-a68f-6d6044c75d5d/2e0ad950-0d11-54d2-a68f-6d6044c75d5d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92636,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_e3fc83f8febd8ed7233923b52b5ca026.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0ad950-0d11-54d2-a68f-6d6044c75d5d/2e0ad950-0d11-54d2-a68f-6d6044c75d5d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76459,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_b9c457263ce4ba0795c4497d8c99e3e7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0ad950-0d11-54d2-a68f-6d6044c75d5d/2e0ad950-0d11-54d2-a68f-6d6044c75d5d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89745,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_e86ed86a6be767705277445dab318065.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0ad950-0d11-54d2-a68f-6d6044c75d5d/2e0ad950-0d11-54d2-a68f-6d6044c75d5d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92526,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_f683d83391c61cfb372de4c1505e4cb4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e0ad950-0d11-54d2-a68f-6d6044c75d5d/2e0ad950-0d11-54d2-a68f-6d6044c75d5d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93670,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/57/6857c470402e0c2f9a44315f448e4ed5/pa/YA34487_c48ee50b60eb83b2839caf9b2174b270.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-08-13',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Octavia 1.5 TSI ACT Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2019}
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA34487%27 HTTP/1.1" 200 None
2026-03-29 08:35:58 [auto1.be] INFO: Saving data for YA34487: {'created_time': 1774773358.644465, 'last_price_update_time': 1774773358.644476, 'auction_closing_time': 1774883125.0}
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YA34487') HTTP/1.1" 204 0
2026-03-29 08:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 94bf3c81-26fd-5171-823f-591eb83e234e with identifier: KU68109
2026-03-29 08:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 94bf3c81-26fd-5171-823f-591eb83e234e with identifier: KU68109
2026-03-29 08:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 94bf3c81-26fd-5171-823f-591eb83e234e with identifier: KU68109 to the API
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KU68109>
{'auction_title': '',
'c_o_2_emission_value': 160,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.3L',
'engine_horse_power': 241,
'expiration_date': '2026-03-30T15:26:15Z',
'fuel_type': 'hybrid',
'id': '94bf3c81-26fd-5171-823f-591eb83e234e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU68109',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Jeep',
'model': 'Compass',
'odometer': 32625,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img8e/2c/8e2c0602aa2cfefaab8300f45bf4fa81/pa/KU68109_f2234b8b7c0914339c57cc6053de61a0.jpg',
'https://img-pa.auto1.com/img8e/2c/8e2c0602aa2cfefaab8300f45bf4fa81/pa/KU68109_20bbc450ce7a0577c82da8d329f660d0.jpg',
'https://img-pa.auto1.com/img8e/2c/8e2c0602aa2cfefaab8300f45bf4fa81/pa/KU68109_d13c3a512400421c66ca6ac3753c1141.jpg',
'https://img-pa.auto1.com/img8e/2c/8e2c0602aa2cfefaab8300f45bf4fa81/pa/KU68109_41b5a80f6bff5c23a001bde430768c96.jpg',
'https://img-pa.auto1.com/img8e/2c/8e2c0602aa2cfefaab8300f45bf4fa81/pa/KU68109_17a25cb09f127db37125a5396b3ad9a3.jpg',
'https://img-pa.auto1.com/img8e/2c/8e2c0602aa2cfefaab8300f45bf4fa81/pa/KU68109_956647296aa472e49e14af38a7a258d8.jpg',
'https://img-pa.auto1.com/img8e/2c/8e2c0602aa2cfefaab8300f45bf4fa81/pa/KU68109_a0123acf0fe936f7c99cac73e5535dc8.jpg',
'https://img-pa.auto1.com/img8e/2c/8e2c0602aa2cfefaab8300f45bf4fa81/pa/KU68109_ef6e6ede2ce8f0763cb3f068f5b4bf7d.jpg',
'https://img-pa.auto1.com/img8e/2c/8e2c0602aa2cfefaab8300f45bf4fa81/pa/KU68109_4e231477660de5637ce046e8fa558805.jpg',
'https://img-pa.auto1.com/img8e/2c/8e2c0602aa2cfefaab8300f45bf4fa81/pa/KU68109_f5ed1f8e27f89cd9ab586b595c1203ca.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94bf3c81-26fd-5171-823f-591eb83e234e/94bf3c81-26fd-5171-823f-591eb83e234e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70961,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img8e/2c/8e2c0602aa2cfefaab8300f45bf4fa81/pa/KU68109_f2234b8b7c0914339c57cc6053de61a0.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94bf3c81-26fd-5171-823f-591eb83e234e/94bf3c81-26fd-5171-823f-591eb83e234e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79486,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img8e/2c/8e2c0602aa2cfefaab8300f45bf4fa81/pa/KU68109_20bbc450ce7a0577c82da8d329f660d0.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94bf3c81-26fd-5171-823f-591eb83e234e/94bf3c81-26fd-5171-823f-591eb83e234e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73344,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img8e/2c/8e2c0602aa2cfefaab8300f45bf4fa81/pa/KU68109_d13c3a512400421c66ca6ac3753c1141.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94bf3c81-26fd-5171-823f-591eb83e234e/94bf3c81-26fd-5171-823f-591eb83e234e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68252,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img8e/2c/8e2c0602aa2cfefaab8300f45bf4fa81/pa/KU68109_41b5a80f6bff5c23a001bde430768c96.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94bf3c81-26fd-5171-823f-591eb83e234e/94bf3c81-26fd-5171-823f-591eb83e234e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73812,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img8e/2c/8e2c0602aa2cfefaab8300f45bf4fa81/pa/KU68109_17a25cb09f127db37125a5396b3ad9a3.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94bf3c81-26fd-5171-823f-591eb83e234e/94bf3c81-26fd-5171-823f-591eb83e234e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58447,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img8e/2c/8e2c0602aa2cfefaab8300f45bf4fa81/pa/KU68109_956647296aa472e49e14af38a7a258d8.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94bf3c81-26fd-5171-823f-591eb83e234e/94bf3c81-26fd-5171-823f-591eb83e234e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68782,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img8e/2c/8e2c0602aa2cfefaab8300f45bf4fa81/pa/KU68109_a0123acf0fe936f7c99cac73e5535dc8.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94bf3c81-26fd-5171-823f-591eb83e234e/94bf3c81-26fd-5171-823f-591eb83e234e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67470,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img8e/2c/8e2c0602aa2cfefaab8300f45bf4fa81/pa/KU68109_ef6e6ede2ce8f0763cb3f068f5b4bf7d.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94bf3c81-26fd-5171-823f-591eb83e234e/94bf3c81-26fd-5171-823f-591eb83e234e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73749,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/img8e/2c/8e2c0602aa2cfefaab8300f45bf4fa81/pa/KU68109_4e231477660de5637ce046e8fa558805.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94bf3c81-26fd-5171-823f-591eb83e234e/94bf3c81-26fd-5171-823f-591eb83e234e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82928,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8e/2c/8e2c0602aa2cfefaab8300f45bf4fa81/pa/KU68109_f5ed1f8e27f89cd9ab586b595c1203ca.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-01-30',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Compass 1.3 T4 4xe Plug-in Hybrid S',
'transmission': 'automatic',
'trim': 'S',
'year': 2022}
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU68109%27 HTTP/1.1" 200 None
2026-03-29 08:35:58 [auto1.be] INFO: Saving data for KU68109: {'created_time': 1774773358.971387, 'last_price_update_time': 1774773358.971395, 'auction_closing_time': 1774884375.0}
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KU68109') HTTP/1.1" 204 0
2026-03-29 08:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NC38410/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TT03576> (referer: https://www.auto1.com/v1/car-details-view/TT03576/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CM14446> (referer: https://www.auto1.com/v1/car-details-view/CM14446/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EK47235> (referer: https://www.auto1.com/v1/car-details-view/EK47235/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae18b013-7ea4-5fc8-b1d1-80276f7770d7 with identifier: TT03576
2026-03-29 08:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae18b013-7ea4-5fc8-b1d1-80276f7770d7 with scrape type 1
2026-03-29 08:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ae18b013-7ea4-5fc8-b1d1-80276f7770d7
2026-03-29 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F59%252Fa95918ea5443685ebf70d88f0fb44e15%252Fpa%252FTT03576_ea30a286b24e6028fd8b7dbce5490e60.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/59/a95918ea5443685ebf70d88f0fb44e15/pa/TT03576_ea30a286b24e6028fd8b7dbce5490e60.jpg already downloaded
2026-03-29 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F59%252Fa95918ea5443685ebf70d88f0fb44e15%252Fpa%252FTT03576_4cb66a5cc1b1e6f5f38ba678b38e40a5.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/59/a95918ea5443685ebf70d88f0fb44e15/pa/TT03576_4cb66a5cc1b1e6f5f38ba678b38e40a5.jpg already downloaded
2026-03-29 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F59%252Fa95918ea5443685ebf70d88f0fb44e15%252Fpa%252FTT03576_9832189e98efc13aa671e8839d2ce97c.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/59/a95918ea5443685ebf70d88f0fb44e15/pa/TT03576_9832189e98efc13aa671e8839d2ce97c.jpg already downloaded
2026-03-29 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F59%252Fa95918ea5443685ebf70d88f0fb44e15%252Fpa%252FTT03576_0cabd40fc8b364f6f7b1d92e380d07eb.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/59/a95918ea5443685ebf70d88f0fb44e15/pa/TT03576_0cabd40fc8b364f6f7b1d92e380d07eb.jpg already downloaded
2026-03-29 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F59%252Fa95918ea5443685ebf70d88f0fb44e15%252Fpa%252FTT03576_d578431a30441bfbf00dbe28ec844f25.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/59/a95918ea5443685ebf70d88f0fb44e15/pa/TT03576_d578431a30441bfbf00dbe28ec844f25.jpg already downloaded
2026-03-29 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F59%252Fa95918ea5443685ebf70d88f0fb44e15%252Fpa%252FTT03576_1dc14ef993ca7230d965e37418529b77.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/59/a95918ea5443685ebf70d88f0fb44e15/pa/TT03576_1dc14ef993ca7230d965e37418529b77.jpg already downloaded
2026-03-29 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F59%252Fa95918ea5443685ebf70d88f0fb44e15%252Fpa%252FTT03576_a0a68048e2f285be904f5f027f8fa15d.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/59/a95918ea5443685ebf70d88f0fb44e15/pa/TT03576_a0a68048e2f285be904f5f027f8fa15d.jpg already downloaded
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F59%252Fa95918ea5443685ebf70d88f0fb44e15%252Fpa%252FTT03576_3958bbe69ba828c1ec8c8c4875aef621.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/59/a95918ea5443685ebf70d88f0fb44e15/pa/TT03576_3958bbe69ba828c1ec8c8c4875aef621.jpg already downloaded
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F59%252Fa95918ea5443685ebf70d88f0fb44e15%252Fpa%252FTT03576_77bf36d9743a8e03f22d08055b66d5bf.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/59/a95918ea5443685ebf70d88f0fb44e15/pa/TT03576_77bf36d9743a8e03f22d08055b66d5bf.jpg already downloaded
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F59%252Fa95918ea5443685ebf70d88f0fb44e15%252Fpa%252FTT03576_b721a31ae802bc96fc1fd215fadf730f.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/59/a95918ea5443685ebf70d88f0fb44e15/pa/TT03576_b721a31ae802bc96fc1fd215fadf730f.jpg already downloaded
2026-03-29 08:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ae18b013-7ea4-5fc8-b1d1-80276f7770d7, identifier: TT03576
2026-03-29 08:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ae18b013-7ea4-5fc8-b1d1-80276f7770d7 with identifier: TT03576
2026-03-29 08:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ae18b013-7ea4-5fc8-b1d1-80276f7770d7 with identifier: TT03576
2026-03-29 08:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ae18b013-7ea4-5fc8-b1d1-80276f7770d7 with identifier: TT03576 to the API
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TT03576>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:28:28Z',
'fuel_type': 'petrol',
'id': 'ae18b013-7ea4-5fc8-b1d1-80276f7770d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT03576',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Hyundai',
'model': 'i20',
'odometer': 30038,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imga9/59/a95918ea5443685ebf70d88f0fb44e15/pa/TT03576_ea30a286b24e6028fd8b7dbce5490e60.jpg',
'https://img-pa.auto1.com/imga9/59/a95918ea5443685ebf70d88f0fb44e15/pa/TT03576_4cb66a5cc1b1e6f5f38ba678b38e40a5.jpg',
'https://img-pa.auto1.com/imga9/59/a95918ea5443685ebf70d88f0fb44e15/pa/TT03576_9832189e98efc13aa671e8839d2ce97c.jpg',
'https://img-pa.auto1.com/imga9/59/a95918ea5443685ebf70d88f0fb44e15/pa/TT03576_0cabd40fc8b364f6f7b1d92e380d07eb.jpg',
'https://img-pa.auto1.com/imga9/59/a95918ea5443685ebf70d88f0fb44e15/pa/TT03576_d578431a30441bfbf00dbe28ec844f25.jpg',
'https://img-pa.auto1.com/imga9/59/a95918ea5443685ebf70d88f0fb44e15/pa/TT03576_1dc14ef993ca7230d965e37418529b77.jpg',
'https://img-pa.auto1.com/imga9/59/a95918ea5443685ebf70d88f0fb44e15/pa/TT03576_a0a68048e2f285be904f5f027f8fa15d.jpg',
'https://img-pa.auto1.com/imga9/59/a95918ea5443685ebf70d88f0fb44e15/pa/TT03576_3958bbe69ba828c1ec8c8c4875aef621.jpg',
'https://img-pa.auto1.com/imga9/59/a95918ea5443685ebf70d88f0fb44e15/pa/TT03576_77bf36d9743a8e03f22d08055b66d5bf.jpg',
'https://img-pa.auto1.com/imga9/59/a95918ea5443685ebf70d88f0fb44e15/pa/TT03576_b721a31ae802bc96fc1fd215fadf730f.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae18b013-7ea4-5fc8-b1d1-80276f7770d7/ae18b013-7ea4-5fc8-b1d1-80276f7770d7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88569,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/59/a95918ea5443685ebf70d88f0fb44e15/pa/TT03576_ea30a286b24e6028fd8b7dbce5490e60.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae18b013-7ea4-5fc8-b1d1-80276f7770d7/ae18b013-7ea4-5fc8-b1d1-80276f7770d7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81867,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/59/a95918ea5443685ebf70d88f0fb44e15/pa/TT03576_4cb66a5cc1b1e6f5f38ba678b38e40a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae18b013-7ea4-5fc8-b1d1-80276f7770d7/ae18b013-7ea4-5fc8-b1d1-80276f7770d7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76739,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/59/a95918ea5443685ebf70d88f0fb44e15/pa/TT03576_9832189e98efc13aa671e8839d2ce97c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae18b013-7ea4-5fc8-b1d1-80276f7770d7/ae18b013-7ea4-5fc8-b1d1-80276f7770d7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66325,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/59/a95918ea5443685ebf70d88f0fb44e15/pa/TT03576_0cabd40fc8b364f6f7b1d92e380d07eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae18b013-7ea4-5fc8-b1d1-80276f7770d7/ae18b013-7ea4-5fc8-b1d1-80276f7770d7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77519,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/59/a95918ea5443685ebf70d88f0fb44e15/pa/TT03576_d578431a30441bfbf00dbe28ec844f25.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae18b013-7ea4-5fc8-b1d1-80276f7770d7/ae18b013-7ea4-5fc8-b1d1-80276f7770d7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78242,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/59/a95918ea5443685ebf70d88f0fb44e15/pa/TT03576_1dc14ef993ca7230d965e37418529b77.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae18b013-7ea4-5fc8-b1d1-80276f7770d7/ae18b013-7ea4-5fc8-b1d1-80276f7770d7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57812,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/59/a95918ea5443685ebf70d88f0fb44e15/pa/TT03576_a0a68048e2f285be904f5f027f8fa15d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae18b013-7ea4-5fc8-b1d1-80276f7770d7/ae18b013-7ea4-5fc8-b1d1-80276f7770d7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81328,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/59/a95918ea5443685ebf70d88f0fb44e15/pa/TT03576_3958bbe69ba828c1ec8c8c4875aef621.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae18b013-7ea4-5fc8-b1d1-80276f7770d7/ae18b013-7ea4-5fc8-b1d1-80276f7770d7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83097,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/59/a95918ea5443685ebf70d88f0fb44e15/pa/TT03576_77bf36d9743a8e03f22d08055b66d5bf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae18b013-7ea4-5fc8-b1d1-80276f7770d7/ae18b013-7ea4-5fc8-b1d1-80276f7770d7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66452,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/59/a95918ea5443685ebf70d88f0fb44e15/pa/TT03576_b721a31ae802bc96fc1fd215fadf730f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-01-31',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai i20 1.2 Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2015}
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT03576%27 HTTP/1.1" 200 None
2026-03-29 08:36:00 [auto1.be] INFO: Saving data for TT03576: {'created_time': 1774773360.487307, 'last_price_update_time': 1774773360.487315, 'auction_closing_time': 1774884508.0}
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TT03576') HTTP/1.1" 204 0
2026-03-29 08:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FG10633/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9b760a7-a7ff-59ea-ab7b-53438ef994b1 with identifier: CM14446
2026-03-29 08:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9b760a7-a7ff-59ea-ab7b-53438ef994b1 with scrape type 1
2026-03-29 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e9b760a7-a7ff-59ea-ab7b-53438ef994b1
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F46%252Fdd46be5efa8183fcf9af559c4be6193e%252Fpa%252FCM14446_0b8e36de99e7815fdc904fd4108e71ef.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/46/dd46be5efa8183fcf9af559c4be6193e/pa/CM14446_0b8e36de99e7815fdc904fd4108e71ef.jpg already downloaded
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F46%252Fdd46be5efa8183fcf9af559c4be6193e%252Fpa%252FCM14446_ae1cd66a68b0e1412ad1c19667b0bef9.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/46/dd46be5efa8183fcf9af559c4be6193e/pa/CM14446_ae1cd66a68b0e1412ad1c19667b0bef9.jpg already downloaded
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F46%252Fdd46be5efa8183fcf9af559c4be6193e%252Fpa%252FCM14446_0a73ad961beabab3a5c9b70bc9a19c15.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/46/dd46be5efa8183fcf9af559c4be6193e/pa/CM14446_0a73ad961beabab3a5c9b70bc9a19c15.jpg already downloaded
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F46%252Fdd46be5efa8183fcf9af559c4be6193e%252Fpa%252FCM14446_cb4a5dc467a40e8acd595eefae2e37d1.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/46/dd46be5efa8183fcf9af559c4be6193e/pa/CM14446_cb4a5dc467a40e8acd595eefae2e37d1.jpg already downloaded
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F46%252Fdd46be5efa8183fcf9af559c4be6193e%252Fpa%252FCM14446_be9cd7ebea02224f91953dbb16e18b5f.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/46/dd46be5efa8183fcf9af559c4be6193e/pa/CM14446_be9cd7ebea02224f91953dbb16e18b5f.jpg already downloaded
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F46%252Fdd46be5efa8183fcf9af559c4be6193e%252Fpa%252FCM14446_3f79459fefe75dfab1e41eadbad0c14d.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/46/dd46be5efa8183fcf9af559c4be6193e/pa/CM14446_3f79459fefe75dfab1e41eadbad0c14d.jpg already downloaded
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F46%252Fdd46be5efa8183fcf9af559c4be6193e%252Fpa%252FCM14446_85424d574d5aca60e898645f0df15d5d.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/46/dd46be5efa8183fcf9af559c4be6193e/pa/CM14446_85424d574d5aca60e898645f0df15d5d.jpg already downloaded
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F46%252Fdd46be5efa8183fcf9af559c4be6193e%252Fpa%252FCM14446_8c9dd440980e4fb50448addbe7c2368f.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/46/dd46be5efa8183fcf9af559c4be6193e/pa/CM14446_8c9dd440980e4fb50448addbe7c2368f.jpg already downloaded
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F46%252Fdd46be5efa8183fcf9af559c4be6193e%252Fpa%252FCM14446_a5dc828bcb005f6a17f2a8d3408c68f3.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/46/dd46be5efa8183fcf9af559c4be6193e/pa/CM14446_a5dc828bcb005f6a17f2a8d3408c68f3.jpg already downloaded
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F46%252Fdd46be5efa8183fcf9af559c4be6193e%252Fpa%252FCM14446_f48ae91c43d7b75748575ac2591ac3f4.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/46/dd46be5efa8183fcf9af559c4be6193e/pa/CM14446_f48ae91c43d7b75748575ac2591ac3f4.jpg already downloaded
2026-03-29 08:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e9b760a7-a7ff-59ea-ab7b-53438ef994b1, identifier: CM14446
2026-03-29 08:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98fc0584-d070-5dd9-9091-9d493915b03e with identifier: EK47235
2026-03-29 08:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98fc0584-d070-5dd9-9091-9d493915b03e with scrape type 1
2026-03-29 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 98fc0584-d070-5dd9-9091-9d493915b03e
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Fa8%252Fe0a8bffe353139871ba2e55b469f7699%252Fpa%252FEK47235_39eca8219cd8c5c0fd3710170ff4b5a7.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/a8/e0a8bffe353139871ba2e55b469f7699/pa/EK47235_39eca8219cd8c5c0fd3710170ff4b5a7.jpg already downloaded
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Fa8%252Fe0a8bffe353139871ba2e55b469f7699%252Fpa%252FEK47235_e47ddc49b4e87990bb884929ba1d8238.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/a8/e0a8bffe353139871ba2e55b469f7699/pa/EK47235_e47ddc49b4e87990bb884929ba1d8238.jpg already downloaded
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Fa8%252Fe0a8bffe353139871ba2e55b469f7699%252Fpa%252FEK47235_01be54a15aae06cfc49116ed99641ddf.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/a8/e0a8bffe353139871ba2e55b469f7699/pa/EK47235_01be54a15aae06cfc49116ed99641ddf.jpg already downloaded
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Fa8%252Fe0a8bffe353139871ba2e55b469f7699%252Fpa%252FEK47235_41a7976f6107a9f9cf48b020acd4d911.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/a8/e0a8bffe353139871ba2e55b469f7699/pa/EK47235_41a7976f6107a9f9cf48b020acd4d911.jpg already downloaded
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Fa8%252Fe0a8bffe353139871ba2e55b469f7699%252Fpa%252FEK47235_96a38f5403a404598c3d1cedb42d4315.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/a8/e0a8bffe353139871ba2e55b469f7699/pa/EK47235_96a38f5403a404598c3d1cedb42d4315.jpg already downloaded
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Fa8%252Fe0a8bffe353139871ba2e55b469f7699%252Fpa%252FEK47235_a10c4c1d004470c9155fec7eebd8d1ff.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/a8/e0a8bffe353139871ba2e55b469f7699/pa/EK47235_a10c4c1d004470c9155fec7eebd8d1ff.jpg already downloaded
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Fa8%252Fe0a8bffe353139871ba2e55b469f7699%252Fpa%252FEK47235_46eb9b04ece41bf715e7e6a3277a4e70.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/a8/e0a8bffe353139871ba2e55b469f7699/pa/EK47235_46eb9b04ece41bf715e7e6a3277a4e70.jpg already downloaded
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Fa8%252Fe0a8bffe353139871ba2e55b469f7699%252Fpa%252FEK47235_7694c6d91519257a33375c50d9212ff4.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/a8/e0a8bffe353139871ba2e55b469f7699/pa/EK47235_7694c6d91519257a33375c50d9212ff4.jpg already downloaded
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Fa8%252Fe0a8bffe353139871ba2e55b469f7699%252Fpa%252FEK47235_acb6d0557d7e9e23c3930a45954ba0cb.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/a8/e0a8bffe353139871ba2e55b469f7699/pa/EK47235_acb6d0557d7e9e23c3930a45954ba0cb.jpg already downloaded
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Fa8%252Fe0a8bffe353139871ba2e55b469f7699%252Fpa%252FEK47235_06dfc8f6ee1aa88c86ae5ca89b3c7d0f.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/a8/e0a8bffe353139871ba2e55b469f7699/pa/EK47235_06dfc8f6ee1aa88c86ae5ca89b3c7d0f.jpg already downloaded
2026-03-29 08:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 98fc0584-d070-5dd9-9091-9d493915b03e, identifier: EK47235
2026-03-29 08:36:01 [auto1.be] INFO: Channel: 24h | Page: 6 | totalHits: 1252 | hits on page: 40
2026-03-29 08:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e9b760a7-a7ff-59ea-ab7b-53438ef994b1 with identifier: CM14446
2026-03-29 08:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e9b760a7-a7ff-59ea-ab7b-53438ef994b1 with identifier: CM14446
2026-03-29 08:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e9b760a7-a7ff-59ea-ab7b-53438ef994b1 with identifier: CM14446 to the API
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CM14446>
{'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6C',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:36:39Z',
'fuel_type': 'diesel',
'id': 'e9b760a7-a7ff-59ea-ab7b-53438ef994b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM14446',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Skoda',
'model': 'Superb',
'odometer': 278852,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgdd/46/dd46be5efa8183fcf9af559c4be6193e/pa/CM14446_0b8e36de99e7815fdc904fd4108e71ef.jpg',
'https://img-pa.auto1.com/imgdd/46/dd46be5efa8183fcf9af559c4be6193e/pa/CM14446_ae1cd66a68b0e1412ad1c19667b0bef9.jpg',
'https://img-pa.auto1.com/imgdd/46/dd46be5efa8183fcf9af559c4be6193e/pa/CM14446_0a73ad961beabab3a5c9b70bc9a19c15.jpg',
'https://img-pa.auto1.com/imgdd/46/dd46be5efa8183fcf9af559c4be6193e/pa/CM14446_cb4a5dc467a40e8acd595eefae2e37d1.jpg',
'https://img-pa.auto1.com/imgdd/46/dd46be5efa8183fcf9af559c4be6193e/pa/CM14446_be9cd7ebea02224f91953dbb16e18b5f.jpg',
'https://img-pa.auto1.com/imgdd/46/dd46be5efa8183fcf9af559c4be6193e/pa/CM14446_3f79459fefe75dfab1e41eadbad0c14d.jpg',
'https://img-pa.auto1.com/imgdd/46/dd46be5efa8183fcf9af559c4be6193e/pa/CM14446_85424d574d5aca60e898645f0df15d5d.jpg',
'https://img-pa.auto1.com/imgdd/46/dd46be5efa8183fcf9af559c4be6193e/pa/CM14446_8c9dd440980e4fb50448addbe7c2368f.jpg',
'https://img-pa.auto1.com/imgdd/46/dd46be5efa8183fcf9af559c4be6193e/pa/CM14446_a5dc828bcb005f6a17f2a8d3408c68f3.jpg',
'https://img-pa.auto1.com/imgdd/46/dd46be5efa8183fcf9af559c4be6193e/pa/CM14446_f48ae91c43d7b75748575ac2591ac3f4.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b760a7-a7ff-59ea-ab7b-53438ef994b1/e9b760a7-a7ff-59ea-ab7b-53438ef994b1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69105,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/46/dd46be5efa8183fcf9af559c4be6193e/pa/CM14446_0b8e36de99e7815fdc904fd4108e71ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b760a7-a7ff-59ea-ab7b-53438ef994b1/e9b760a7-a7ff-59ea-ab7b-53438ef994b1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57483,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/46/dd46be5efa8183fcf9af559c4be6193e/pa/CM14446_ae1cd66a68b0e1412ad1c19667b0bef9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b760a7-a7ff-59ea-ab7b-53438ef994b1/e9b760a7-a7ff-59ea-ab7b-53438ef994b1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63419,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/46/dd46be5efa8183fcf9af559c4be6193e/pa/CM14446_0a73ad961beabab3a5c9b70bc9a19c15.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b760a7-a7ff-59ea-ab7b-53438ef994b1/e9b760a7-a7ff-59ea-ab7b-53438ef994b1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61214,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/46/dd46be5efa8183fcf9af559c4be6193e/pa/CM14446_cb4a5dc467a40e8acd595eefae2e37d1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b760a7-a7ff-59ea-ab7b-53438ef994b1/e9b760a7-a7ff-59ea-ab7b-53438ef994b1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65404,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/46/dd46be5efa8183fcf9af559c4be6193e/pa/CM14446_be9cd7ebea02224f91953dbb16e18b5f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b760a7-a7ff-59ea-ab7b-53438ef994b1/e9b760a7-a7ff-59ea-ab7b-53438ef994b1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69368,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/46/dd46be5efa8183fcf9af559c4be6193e/pa/CM14446_3f79459fefe75dfab1e41eadbad0c14d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b760a7-a7ff-59ea-ab7b-53438ef994b1/e9b760a7-a7ff-59ea-ab7b-53438ef994b1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62761,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/46/dd46be5efa8183fcf9af559c4be6193e/pa/CM14446_85424d574d5aca60e898645f0df15d5d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b760a7-a7ff-59ea-ab7b-53438ef994b1/e9b760a7-a7ff-59ea-ab7b-53438ef994b1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68893,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/46/dd46be5efa8183fcf9af559c4be6193e/pa/CM14446_8c9dd440980e4fb50448addbe7c2368f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b760a7-a7ff-59ea-ab7b-53438ef994b1/e9b760a7-a7ff-59ea-ab7b-53438ef994b1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63998,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/46/dd46be5efa8183fcf9af559c4be6193e/pa/CM14446_a5dc828bcb005f6a17f2a8d3408c68f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9b760a7-a7ff-59ea-ab7b-53438ef994b1/e9b760a7-a7ff-59ea-ab7b-53438ef994b1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60174,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/46/dd46be5efa8183fcf9af559c4be6193e/pa/CM14446_f48ae91c43d7b75748575ac2591ac3f4.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-11-15',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2017}
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM14446%27 HTTP/1.1" 200 None
2026-03-29 08:36:01 [auto1.be] INFO: Saving data for CM14446: {'created_time': 1774773361.37178, 'last_price_update_time': 1774773361.371789, 'auction_closing_time': 1774884999.0}
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CM14446') HTTP/1.1" 204 0
2026-03-29 08:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 98fc0584-d070-5dd9-9091-9d493915b03e with identifier: EK47235
2026-03-29 08:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 98fc0584-d070-5dd9-9091-9d493915b03e with identifier: EK47235
2026-03-29 08:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 98fc0584-d070-5dd9-9091-9d493915b03e with identifier: EK47235 to the API
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EK47235>
{'auction_title': '',
'c_o_2_emission_value': 95,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.5L',
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:12:29Z',
'fuel_type': 'diesel',
'id': '98fc0584-d070-5dd9-9091-9d493915b03e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK47235',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Renault',
'model': 'Captur',
'odometer': 94999,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imge0/a8/e0a8bffe353139871ba2e55b469f7699/pa/EK47235_39eca8219cd8c5c0fd3710170ff4b5a7.jpg',
'https://img-pa.auto1.com/imge0/a8/e0a8bffe353139871ba2e55b469f7699/pa/EK47235_e47ddc49b4e87990bb884929ba1d8238.jpg',
'https://img-pa.auto1.com/imge0/a8/e0a8bffe353139871ba2e55b469f7699/pa/EK47235_01be54a15aae06cfc49116ed99641ddf.jpg',
'https://img-pa.auto1.com/imge0/a8/e0a8bffe353139871ba2e55b469f7699/pa/EK47235_41a7976f6107a9f9cf48b020acd4d911.jpg',
'https://img-pa.auto1.com/imge0/a8/e0a8bffe353139871ba2e55b469f7699/pa/EK47235_96a38f5403a404598c3d1cedb42d4315.jpg',
'https://img-pa.auto1.com/imge0/a8/e0a8bffe353139871ba2e55b469f7699/pa/EK47235_a10c4c1d004470c9155fec7eebd8d1ff.jpg',
'https://img-pa.auto1.com/imge0/a8/e0a8bffe353139871ba2e55b469f7699/pa/EK47235_46eb9b04ece41bf715e7e6a3277a4e70.jpg',
'https://img-pa.auto1.com/imge0/a8/e0a8bffe353139871ba2e55b469f7699/pa/EK47235_7694c6d91519257a33375c50d9212ff4.jpg',
'https://img-pa.auto1.com/imge0/a8/e0a8bffe353139871ba2e55b469f7699/pa/EK47235_acb6d0557d7e9e23c3930a45954ba0cb.jpg',
'https://img-pa.auto1.com/imge0/a8/e0a8bffe353139871ba2e55b469f7699/pa/EK47235_06dfc8f6ee1aa88c86ae5ca89b3c7d0f.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc0584-d070-5dd9-9091-9d493915b03e/98fc0584-d070-5dd9-9091-9d493915b03e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73710,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/a8/e0a8bffe353139871ba2e55b469f7699/pa/EK47235_39eca8219cd8c5c0fd3710170ff4b5a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc0584-d070-5dd9-9091-9d493915b03e/98fc0584-d070-5dd9-9091-9d493915b03e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68031,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/a8/e0a8bffe353139871ba2e55b469f7699/pa/EK47235_e47ddc49b4e87990bb884929ba1d8238.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc0584-d070-5dd9-9091-9d493915b03e/98fc0584-d070-5dd9-9091-9d493915b03e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65586,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/a8/e0a8bffe353139871ba2e55b469f7699/pa/EK47235_01be54a15aae06cfc49116ed99641ddf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc0584-d070-5dd9-9091-9d493915b03e/98fc0584-d070-5dd9-9091-9d493915b03e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60658,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/a8/e0a8bffe353139871ba2e55b469f7699/pa/EK47235_41a7976f6107a9f9cf48b020acd4d911.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc0584-d070-5dd9-9091-9d493915b03e/98fc0584-d070-5dd9-9091-9d493915b03e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62088,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/a8/e0a8bffe353139871ba2e55b469f7699/pa/EK47235_96a38f5403a404598c3d1cedb42d4315.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc0584-d070-5dd9-9091-9d493915b03e/98fc0584-d070-5dd9-9091-9d493915b03e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70297,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/a8/e0a8bffe353139871ba2e55b469f7699/pa/EK47235_a10c4c1d004470c9155fec7eebd8d1ff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc0584-d070-5dd9-9091-9d493915b03e/98fc0584-d070-5dd9-9091-9d493915b03e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59805,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/a8/e0a8bffe353139871ba2e55b469f7699/pa/EK47235_46eb9b04ece41bf715e7e6a3277a4e70.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc0584-d070-5dd9-9091-9d493915b03e/98fc0584-d070-5dd9-9091-9d493915b03e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73276,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/a8/e0a8bffe353139871ba2e55b469f7699/pa/EK47235_7694c6d91519257a33375c50d9212ff4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc0584-d070-5dd9-9091-9d493915b03e/98fc0584-d070-5dd9-9091-9d493915b03e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70798,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/a8/e0a8bffe353139871ba2e55b469f7699/pa/EK47235_acb6d0557d7e9e23c3930a45954ba0cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc0584-d070-5dd9-9091-9d493915b03e/98fc0584-d070-5dd9-9091-9d493915b03e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64786,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/a8/e0a8bffe353139871ba2e55b469f7699/pa/EK47235_06dfc8f6ee1aa88c86ae5ca89b3c7d0f.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-03-20',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 1.5 dCi Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2015}
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK47235%27 HTTP/1.1" 200 None
2026-03-29 08:36:01 [auto1.be] INFO: Saving data for EK47235: {'created_time': 1774773361.694434, 'last_price_update_time': 1774773361.694444, 'auction_closing_time': 1774883549.0}
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EK47235') HTTP/1.1" 204 0
2026-03-29 08:36:01 [auto1.be] INFO: Found listing with ID: YW00445
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW00445%27 HTTP/1.1" 200 None
2026-03-29 08:36:01 [auto1.be] INFO: Scrape type for YW00445: 2
2026-03-29 08:36:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee789807-2656-5a8d-ab6c-7ecd3f0a44cd with identifier: YW00445
2026-03-29 08:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee789807-2656-5a8d-ab6c-7ecd3f0a44cd with scrape type 2
2026-03-29 08:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee789807-2656-5a8d-ab6c-7ecd3f0a44cd with scrape type 2
2026-03-29 08:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ee789807-2656-5a8d-ab6c-7ecd3f0a44cd, identifier: YW00445
2026-03-29 08:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ee789807-2656-5a8d-ab6c-7ecd3f0a44cd with identifier: YW00445
2026-03-29 08:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ee789807-2656-5a8d-ab6c-7ecd3f0a44cd with identifier: YW00445
2026-03-29 08:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ee789807-2656-5a8d-ab6c-7ecd3f0a44cd with identifier: YW00445 to the API
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 73,
'expiration_date': '2026-03-30T15:37:04Z',
'fuel_type': 'petrol',
'id': 'ee789807-2656-5a8d-ab6c-7ecd3f0a44cd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW00445',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 129627,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-29',
'seller_name': None,
'title': 'Renault Clio 1.2 Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2017}
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW00445%27 HTTP/1.1" 200 None
2026-03-29 08:36:02 [auto1.be] INFO: Saving data for YW00445: {'auction_closing_time': 1774885024.0, 'created_time': 1774557576.594724, 'last_price_update_time': 1774773362.12651}
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YW00445') HTTP/1.1" 204 0
2026-03-29 08:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BY20726> (referer: https://www.auto1.com/v1/car-details-view/BY20726/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:02 [auto1.be] INFO: Found listing with ID: JD01885
2026-03-29 08:36:02 [auto1.be] INFO: Found listing with ID: TX45109
2026-03-29 08:36:02 [auto1.be] INFO: Found listing with ID: GK88228
2026-03-29 08:36:02 [auto1.be] INFO: Found listing with ID: XZ48466
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ48466%27 HTTP/1.1" 200 None
2026-03-29 08:36:02 [auto1.be] INFO: Scrape type for XZ48466: 0
2026-03-29 08:36:02 [auto1.be] INFO: Found listing with ID: RP30975
2026-03-29 08:36:02 [auto1.be] INFO: Found listing with ID: TV92859
2026-03-29 08:36:02 [auto1.be] INFO: Found listing with ID: XZ54371
2026-03-29 08:36:02 [auto1.be] INFO: Found listing with ID: DW61635
2026-03-29 08:36:02 [auto1.be] INFO: Found listing with ID: BT09121
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT09121%27 HTTP/1.1" 200 None
2026-03-29 08:36:02 [auto1.be] INFO: Scrape type for BT09121: 0
2026-03-29 08:36:02 [auto1.be] INFO: Found listing with ID: GT11330
2026-03-29 08:36:02 [auto1.be] INFO: Found listing with ID: CX99155
2026-03-29 08:36:02 [auto1.be] INFO: Found listing with ID: CX21788
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX21788%27 HTTP/1.1" 200 None
2026-03-29 08:36:02 [auto1.be] INFO: Scrape type for CX21788: 2
2026-03-29 08:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 465c9300-8ddd-5bc8-8016-823cfd813a08 with identifier: CX21788
2026-03-29 08:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 465c9300-8ddd-5bc8-8016-823cfd813a08 with scrape type 2
2026-03-29 08:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 465c9300-8ddd-5bc8-8016-823cfd813a08 with scrape type 2
2026-03-29 08:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 465c9300-8ddd-5bc8-8016-823cfd813a08, identifier: CX21788
2026-03-29 08:36:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 465c9300-8ddd-5bc8-8016-823cfd813a08 with identifier: CX21788
2026-03-29 08:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 465c9300-8ddd-5bc8-8016-823cfd813a08 with identifier: CX21788
2026-03-29 08:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 465c9300-8ddd-5bc8-8016-823cfd813a08 with identifier: CX21788 to the API
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:14:38Z',
'fuel_type': 'diesel',
'id': '465c9300-8ddd-5bc8-8016-823cfd813a08',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX21788',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 291166,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-10',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 CDI BlueEfficiency Elegance',
'transmission': 'manual',
'trim': 'BlueEfficiency Elegance',
'year': 2011}
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX21788%27 HTTP/1.1" 200 None
2026-03-29 08:36:02 [auto1.be] INFO: Saving data for CX21788: {'auction_closing_time': 1774883678.0, 'created_time': 1774557583.177437, 'last_price_update_time': 1774773362.583756}
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CX21788') HTTP/1.1" 204 0
2026-03-29 08:36:02 [auto1.be] INFO: Found listing with ID: KX60472
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX60472%27 HTTP/1.1" 200 None
2026-03-29 08:36:02 [auto1.be] INFO: Scrape type for KX60472: 0
2026-03-29 08:36:02 [auto1.be] INFO: Found listing with ID: WE70666
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE70666%27 HTTP/1.1" 200 None
2026-03-29 08:36:02 [auto1.be] INFO: Scrape type for WE70666: 0
2026-03-29 08:36:02 [auto1.be] INFO: Found listing with ID: HS59761
2026-03-29 08:36:02 [auto1.be] INFO: Found listing with ID: LZ48262
2026-03-29 08:36:02 [auto1.be] INFO: Found listing with ID: RM46702
2026-03-29 08:36:02 [auto1.be] INFO: Found listing with ID: ML85388
2026-03-29 08:36:02 [auto1.be] INFO: Found listing with ID: AJ68637
2026-03-29 08:36:02 [auto1.be] INFO: Found listing with ID: HW95173
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW95173%27 HTTP/1.1" 200 None
2026-03-29 08:36:02 [auto1.be] INFO: Scrape type for HW95173: 0
2026-03-29 08:36:02 [auto1.be] INFO: Found listing with ID: SW90596
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW90596%27 HTTP/1.1" 200 None
2026-03-29 08:36:02 [auto1.be] INFO: Scrape type for SW90596: 2
2026-03-29 08:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7bd75cc-3f75-5907-b9e9-ffdf9172b0c6 with identifier: SW90596
2026-03-29 08:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7bd75cc-3f75-5907-b9e9-ffdf9172b0c6 with scrape type 2
2026-03-29 08:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7bd75cc-3f75-5907-b9e9-ffdf9172b0c6 with scrape type 2
2026-03-29 08:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d7bd75cc-3f75-5907-b9e9-ffdf9172b0c6, identifier: SW90596
2026-03-29 08:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d7bd75cc-3f75-5907-b9e9-ffdf9172b0c6 with identifier: SW90596
2026-03-29 08:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d7bd75cc-3f75-5907-b9e9-ffdf9172b0c6 with identifier: SW90596
2026-03-29 08:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d7bd75cc-3f75-5907-b9e9-ffdf9172b0c6 with identifier: SW90596 to the API
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:42:37Z',
'fuel_type': 'diesel',
'id': 'd7bd75cc-3f75-5907-b9e9-ffdf9172b0c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW90596',
'listing': 'auction',
'make': 'Infiniti',
'model': 'Q30',
'odometer': 221519,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-07',
'seller_name': None,
'title': 'Infiniti Q30 1.5 Diesel Premium',
'transmission': 'automatic',
'trim': 'Premium',
'year': 2018}
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW90596%27 HTTP/1.1" 200 None
2026-03-29 08:36:03 [auto1.be] INFO: Saving data for SW90596: {'auction_closing_time': 1774885357.0, 'created_time': 1774557515.519916, 'last_price_update_time': 1774773363.148616}
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SW90596') HTTP/1.1" 204 0
2026-03-29 08:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbe78aa8-c585-5b99-952d-41d8762c17ee with identifier: BY20726
2026-03-29 08:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbe78aa8-c585-5b99-952d-41d8762c17ee with scrape type 1
2026-03-29 08:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dbe78aa8-c585-5b99-952d-41d8762c17ee
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F90%252Fd7905601fe55af6e3950f92e8468787c%252Fpa%252FBY20726_f491113eeec62cc9ced281b6498b8eeb.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/90/d7905601fe55af6e3950f92e8468787c/pa/BY20726_f491113eeec62cc9ced281b6498b8eeb.jpg already downloaded
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F90%252Fd7905601fe55af6e3950f92e8468787c%252Fpa%252FBY20726_20488897e35ee70f066d7da6f54cd6eb.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/90/d7905601fe55af6e3950f92e8468787c/pa/BY20726_20488897e35ee70f066d7da6f54cd6eb.jpg already downloaded
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F90%252Fd7905601fe55af6e3950f92e8468787c%252Fpa%252FBY20726_19dcc2e92ce120205239c365080ef3b6.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/90/d7905601fe55af6e3950f92e8468787c/pa/BY20726_19dcc2e92ce120205239c365080ef3b6.jpg already downloaded
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F90%252Fd7905601fe55af6e3950f92e8468787c%252Fpa%252FBY20726_67504c91120b523338a574f637db2794.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/90/d7905601fe55af6e3950f92e8468787c/pa/BY20726_67504c91120b523338a574f637db2794.jpg already downloaded
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F90%252Fd7905601fe55af6e3950f92e8468787c%252Fpa%252FBY20726_45ef54686957e037a71d4406c725889a.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/90/d7905601fe55af6e3950f92e8468787c/pa/BY20726_45ef54686957e037a71d4406c725889a.jpg already downloaded
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F90%252Fd7905601fe55af6e3950f92e8468787c%252Fpa%252FBY20726_d2f2e51a5d61f801fa4865afd74089e7.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/90/d7905601fe55af6e3950f92e8468787c/pa/BY20726_d2f2e51a5d61f801fa4865afd74089e7.jpg already downloaded
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F90%252Fd7905601fe55af6e3950f92e8468787c%252Fpa%252FBY20726_572c735890030a6a5d386a2e104b36d6.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/90/d7905601fe55af6e3950f92e8468787c/pa/BY20726_572c735890030a6a5d386a2e104b36d6.jpg already downloaded
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F90%252Fd7905601fe55af6e3950f92e8468787c%252Fpa%252FBY20726_9f7d39c0e5d25e7d99a2c307216c1a69.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/90/d7905601fe55af6e3950f92e8468787c/pa/BY20726_9f7d39c0e5d25e7d99a2c307216c1a69.jpg already downloaded
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F90%252Fd7905601fe55af6e3950f92e8468787c%252Fpa%252FBY20726_8e963c4d0655378bbd982f218f9d006e.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/90/d7905601fe55af6e3950f92e8468787c/pa/BY20726_8e963c4d0655378bbd982f218f9d006e.jpg already downloaded
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F90%252Fd7905601fe55af6e3950f92e8468787c%252Fpa%252FBY20726_e40f932ea2af2a360dd57e6102150173.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/90/d7905601fe55af6e3950f92e8468787c/pa/BY20726_e40f932ea2af2a360dd57e6102150173.jpg already downloaded
2026-03-29 08:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dbe78aa8-c585-5b99-952d-41d8762c17ee, identifier: BY20726
2026-03-29 08:36:03 [auto1.be] INFO: Found listing with ID: HY77866
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY77866%27 HTTP/1.1" 200 None
2026-03-29 08:36:03 [auto1.be] INFO: Scrape type for HY77866: 0
2026-03-29 08:36:03 [auto1.be] INFO: Found listing with ID: CT30439
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CT30439%27 HTTP/1.1" 200 None
2026-03-29 08:36:03 [auto1.be] INFO: Scrape type for CT30439: 0
2026-03-29 08:36:03 [auto1.be] INFO: Found listing with ID: BD10300
2026-03-29 08:36:03 [auto1.be] INFO: Found listing with ID: JW86952
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW86952%27 HTTP/1.1" 200 None
2026-03-29 08:36:03 [auto1.be] INFO: Scrape type for JW86952: 2
2026-03-29 08:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3530de6-400f-5adc-933c-f0269a7613a1 with identifier: JW86952
2026-03-29 08:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3530de6-400f-5adc-933c-f0269a7613a1 with scrape type 2
2026-03-29 08:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3530de6-400f-5adc-933c-f0269a7613a1 with scrape type 2
2026-03-29 08:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d3530de6-400f-5adc-933c-f0269a7613a1, identifier: JW86952
2026-03-29 08:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dbe78aa8-c585-5b99-952d-41d8762c17ee with identifier: BY20726
2026-03-29 08:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dbe78aa8-c585-5b99-952d-41d8762c17ee with identifier: BY20726
2026-03-29 08:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dbe78aa8-c585-5b99-952d-41d8762c17ee with identifier: BY20726 to the API
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BY20726>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:26:24Z',
'fuel_type': 'diesel',
'id': 'dbe78aa8-c585-5b99-952d-41d8762c17ee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY20726',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Renault',
'model': 'Trafic',
'odometer': 146559,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgd7/90/d7905601fe55af6e3950f92e8468787c/pa/BY20726_f491113eeec62cc9ced281b6498b8eeb.jpg',
'https://img-pa.auto1.com/imgd7/90/d7905601fe55af6e3950f92e8468787c/pa/BY20726_20488897e35ee70f066d7da6f54cd6eb.jpg',
'https://img-pa.auto1.com/imgd7/90/d7905601fe55af6e3950f92e8468787c/pa/BY20726_19dcc2e92ce120205239c365080ef3b6.jpg',
'https://img-pa.auto1.com/imgd7/90/d7905601fe55af6e3950f92e8468787c/pa/BY20726_67504c91120b523338a574f637db2794.jpg',
'https://img-pa.auto1.com/imgd7/90/d7905601fe55af6e3950f92e8468787c/pa/BY20726_45ef54686957e037a71d4406c725889a.jpg',
'https://img-pa.auto1.com/imgd7/90/d7905601fe55af6e3950f92e8468787c/pa/BY20726_d2f2e51a5d61f801fa4865afd74089e7.jpg',
'https://img-pa.auto1.com/imgd7/90/d7905601fe55af6e3950f92e8468787c/pa/BY20726_572c735890030a6a5d386a2e104b36d6.jpg',
'https://img-pa.auto1.com/imgd7/90/d7905601fe55af6e3950f92e8468787c/pa/BY20726_9f7d39c0e5d25e7d99a2c307216c1a69.jpg',
'https://img-pa.auto1.com/imgd7/90/d7905601fe55af6e3950f92e8468787c/pa/BY20726_8e963c4d0655378bbd982f218f9d006e.jpg',
'https://img-pa.auto1.com/imgd7/90/d7905601fe55af6e3950f92e8468787c/pa/BY20726_e40f932ea2af2a360dd57e6102150173.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbe78aa8-c585-5b99-952d-41d8762c17ee/dbe78aa8-c585-5b99-952d-41d8762c17ee_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72181,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/90/d7905601fe55af6e3950f92e8468787c/pa/BY20726_f491113eeec62cc9ced281b6498b8eeb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbe78aa8-c585-5b99-952d-41d8762c17ee/dbe78aa8-c585-5b99-952d-41d8762c17ee_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72602,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/90/d7905601fe55af6e3950f92e8468787c/pa/BY20726_20488897e35ee70f066d7da6f54cd6eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbe78aa8-c585-5b99-952d-41d8762c17ee/dbe78aa8-c585-5b99-952d-41d8762c17ee_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57912,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/90/d7905601fe55af6e3950f92e8468787c/pa/BY20726_19dcc2e92ce120205239c365080ef3b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbe78aa8-c585-5b99-952d-41d8762c17ee/dbe78aa8-c585-5b99-952d-41d8762c17ee_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65056,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/90/d7905601fe55af6e3950f92e8468787c/pa/BY20726_67504c91120b523338a574f637db2794.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbe78aa8-c585-5b99-952d-41d8762c17ee/dbe78aa8-c585-5b99-952d-41d8762c17ee_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52390,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/90/d7905601fe55af6e3950f92e8468787c/pa/BY20726_45ef54686957e037a71d4406c725889a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbe78aa8-c585-5b99-952d-41d8762c17ee/dbe78aa8-c585-5b99-952d-41d8762c17ee_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55475,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/90/d7905601fe55af6e3950f92e8468787c/pa/BY20726_d2f2e51a5d61f801fa4865afd74089e7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbe78aa8-c585-5b99-952d-41d8762c17ee/dbe78aa8-c585-5b99-952d-41d8762c17ee_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56473,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/90/d7905601fe55af6e3950f92e8468787c/pa/BY20726_572c735890030a6a5d386a2e104b36d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbe78aa8-c585-5b99-952d-41d8762c17ee/dbe78aa8-c585-5b99-952d-41d8762c17ee_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74352,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/90/d7905601fe55af6e3950f92e8468787c/pa/BY20726_9f7d39c0e5d25e7d99a2c307216c1a69.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbe78aa8-c585-5b99-952d-41d8762c17ee/dbe78aa8-c585-5b99-952d-41d8762c17ee_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69845,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/90/d7905601fe55af6e3950f92e8468787c/pa/BY20726_8e963c4d0655378bbd982f218f9d006e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbe78aa8-c585-5b99-952d-41d8762c17ee/dbe78aa8-c585-5b99-952d-41d8762c17ee_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77897,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/90/d7905601fe55af6e3950f92e8468787c/pa/BY20726_e40f932ea2af2a360dd57e6102150173.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-03-03',
'seats_number': 6,
'seller_name': None,
'title': 'Renault Trafic 2.0 dCi L2H1 Doka 3,0t Komfort',
'transmission': 'manual',
'trim': 'L2H1 Doka 3,0t Komfort',
'year': 2020}
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY20726%27 HTTP/1.1" 200 None
2026-03-29 08:36:03 [auto1.be] INFO: Saving data for BY20726: {'created_time': 1774773363.866313, 'last_price_update_time': 1774773363.866322, 'auction_closing_time': 1774884384.0}
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BY20726') HTTP/1.1" 204 0
2026-03-29 08:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d3530de6-400f-5adc-933c-f0269a7613a1 with identifier: JW86952
2026-03-29 08:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d3530de6-400f-5adc-933c-f0269a7613a1 with identifier: JW86952
2026-03-29 08:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d3530de6-400f-5adc-933c-f0269a7613a1 with identifier: JW86952 to the API
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:57:38Z',
'fuel_type': 'petrol',
'id': 'd3530de6-400f-5adc-933c-f0269a7613a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW86952',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 115260,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-17',
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2019}
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW86952%27 HTTP/1.1" 200 None
2026-03-29 08:36:04 [auto1.be] INFO: Saving data for JW86952: {'auction_closing_time': 1774886258.0, 'created_time': 1774557463.944303, 'last_price_update_time': 1774773364.269123}
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JW86952') HTTP/1.1" 204 0
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: RK79502
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK79502%27 HTTP/1.1" 200 None
2026-03-29 08:36:04 [auto1.be] INFO: Scrape type for RK79502: 0
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: RK12486
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK12486%27 HTTP/1.1" 200 None
2026-03-29 08:36:04 [auto1.be] INFO: Scrape type for RK12486: 0
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: ZS70359
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: SE23508
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: SN78128
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN78128%27 HTTP/1.1" 200 None
2026-03-29 08:36:04 [auto1.be] INFO: Scrape type for SN78128: 2
2026-03-29 08:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46e50a49-ca63-5701-9f1e-73ae9e786a27 with identifier: SN78128
2026-03-29 08:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46e50a49-ca63-5701-9f1e-73ae9e786a27 with scrape type 2
2026-03-29 08:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46e50a49-ca63-5701-9f1e-73ae9e786a27 with scrape type 2
2026-03-29 08:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 46e50a49-ca63-5701-9f1e-73ae9e786a27, identifier: SN78128
2026-03-29 08:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TX69988> (referer: https://www.auto1.com/v1/car-details-view/TX69988/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MG99487> (referer: https://www.auto1.com/v1/car-details-view/MG99487/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VP06293> (referer: https://www.auto1.com/v1/car-details-view/VP06293/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 46e50a49-ca63-5701-9f1e-73ae9e786a27 with identifier: SN78128
2026-03-29 08:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 46e50a49-ca63-5701-9f1e-73ae9e786a27 with identifier: SN78128
2026-03-29 08:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 46e50a49-ca63-5701-9f1e-73ae9e786a27 with identifier: SN78128 to the API
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:45:34Z',
'fuel_type': 'diesel',
'id': '46e50a49-ca63-5701-9f1e-73ae9e786a27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN78128',
'listing': 'auction',
'make': 'Toyota',
'model': 'ProAce',
'odometer': 158900,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-04',
'seller_name': None,
'title': 'Toyota ProAce 1.6 D-4D L1H1 Kasten',
'transmission': 'manual',
'trim': 'L1H1 Kasten',
'year': 2016}
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN78128%27 HTTP/1.1" 200 None
2026-03-29 08:36:04 [auto1.be] INFO: Saving data for SN78128: {'auction_closing_time': 1774885534.0, 'created_time': 1774557436.84309, 'last_price_update_time': 1774773364.726036}
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SN78128') HTTP/1.1" 204 0
2026-03-29 08:36:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NC38410> (referer: https://www.auto1.com/v1/car-details-view/NC38410/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: WW99205
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: LH25651
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH25651%27 HTTP/1.1" 200 None
2026-03-29 08:36:04 [auto1.be] INFO: Scrape type for LH25651: 0
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: VM12927
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM12927%27 HTTP/1.1" 200 None
2026-03-29 08:36:04 [auto1.be] INFO: Scrape type for VM12927: 0
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: SD77902
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD77902%27 HTTP/1.1" 200 None
2026-03-29 08:36:04 [auto1.be] INFO: Scrape type for SD77902: 0
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: LK16000
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: EK72945
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK72945%27 HTTP/1.1" 200 None
2026-03-29 08:36:04 [auto1.be] INFO: Scrape type for EK72945: 0
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: WA10715
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: EB09170
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB09170%27 HTTP/1.1" 200 None
2026-03-29 08:36:04 [auto1.be] INFO: Scrape type for EB09170: 2
2026-03-29 08:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ed6c349-0194-50a2-9b7e-f83c48f59907 with identifier: EB09170
2026-03-29 08:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ed6c349-0194-50a2-9b7e-f83c48f59907 with scrape type 2
2026-03-29 08:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ed6c349-0194-50a2-9b7e-f83c48f59907 with scrape type 2
2026-03-29 08:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0ed6c349-0194-50a2-9b7e-f83c48f59907, identifier: EB09170
2026-03-29 08:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0ed6c349-0194-50a2-9b7e-f83c48f59907 with identifier: EB09170
2026-03-29 08:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0ed6c349-0194-50a2-9b7e-f83c48f59907 with identifier: EB09170
2026-03-29 08:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0ed6c349-0194-50a2-9b7e-f83c48f59907 with identifier: EB09170 to the API
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 341,
'expiration_date': '2026-03-30T15:32:16Z',
'fuel_type': 'hybrid',
'id': '0ed6c349-0194-50a2-9b7e-f83c48f59907',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB09170',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 47398,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-24',
'seller_name': None,
'title': 'Volvo XC60 2.0 T6 Plug-in Hybrid Inscription Expression AWD',
'transmission': 'automatic',
'trim': 'Inscription Expression AWD',
'year': 2021}
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB09170%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [auto1.be] INFO: Saving data for EB09170: {'auction_closing_time': 1774884736.0, 'created_time': 1774557528.012438, 'last_price_update_time': 1774773365.23612}
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EB09170') HTTP/1.1" 204 0
2026-03-29 08:36:05 [auto1.be] INFO: Found listing with ID: XN92471
2026-03-29 08:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c38fb94f-553b-5f9b-a384-07a2ce35879f with identifier: TX69988
2026-03-29 08:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c38fb94f-553b-5f9b-a384-07a2ce35879f with scrape type 1
2026-03-29 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c38fb94f-553b-5f9b-a384-07a2ce35879f
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F32%252F3e3252d31de88cfbb9639737cedab22b%252Fpa%252FTX69988_a8e7827cb7a1c868ce8beb794eaadbb9.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/32/3e3252d31de88cfbb9639737cedab22b/pa/TX69988_a8e7827cb7a1c868ce8beb794eaadbb9.jpg already downloaded
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F32%252F3e3252d31de88cfbb9639737cedab22b%252Fpa%252FTX69988_67e29d07b7f20171fc7464a601aa0370.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/32/3e3252d31de88cfbb9639737cedab22b/pa/TX69988_67e29d07b7f20171fc7464a601aa0370.jpg already downloaded
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F32%252F3e3252d31de88cfbb9639737cedab22b%252Fpa%252FTX69988_e2c492bfeeb20241ab359fa95e1b3d00.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/32/3e3252d31de88cfbb9639737cedab22b/pa/TX69988_e2c492bfeeb20241ab359fa95e1b3d00.jpg already downloaded
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F32%252F3e3252d31de88cfbb9639737cedab22b%252Fpa%252FTX69988_a22c9cf7d014d23c0c28111ccc7fa6be.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/32/3e3252d31de88cfbb9639737cedab22b/pa/TX69988_a22c9cf7d014d23c0c28111ccc7fa6be.jpg already downloaded
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F32%252F3e3252d31de88cfbb9639737cedab22b%252Fpa%252FTX69988_fdffdeded4f692549d0aecf281a5c4e9.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/32/3e3252d31de88cfbb9639737cedab22b/pa/TX69988_fdffdeded4f692549d0aecf281a5c4e9.jpg already downloaded
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F32%252F3e3252d31de88cfbb9639737cedab22b%252Fpa%252FTX69988_16461c32c83ad2cdf5fb9fff2c4ab47b.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/32/3e3252d31de88cfbb9639737cedab22b/pa/TX69988_16461c32c83ad2cdf5fb9fff2c4ab47b.jpg already downloaded
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F32%252F3e3252d31de88cfbb9639737cedab22b%252Fpa%252FTX69988_e69a3cbf3830e641951ee8eb7e9081c6.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/32/3e3252d31de88cfbb9639737cedab22b/pa/TX69988_e69a3cbf3830e641951ee8eb7e9081c6.jpg already downloaded
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F32%252F3e3252d31de88cfbb9639737cedab22b%252Fpa%252FTX69988_4f70d89d8aa1c21c91fb30659a5e9270.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/32/3e3252d31de88cfbb9639737cedab22b/pa/TX69988_4f70d89d8aa1c21c91fb30659a5e9270.jpg already downloaded
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F32%252F3e3252d31de88cfbb9639737cedab22b%252Fpa%252FTX69988_e9ddd182949130d6c5e620f57c22f9d1.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/32/3e3252d31de88cfbb9639737cedab22b/pa/TX69988_e9ddd182949130d6c5e620f57c22f9d1.jpg already downloaded
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F32%252F3e3252d31de88cfbb9639737cedab22b%252Fpa%252FTX69988_c7507a148e0159b6547033f920282fa6.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/32/3e3252d31de88cfbb9639737cedab22b/pa/TX69988_c7507a148e0159b6547033f920282fa6.jpg already downloaded
2026-03-29 08:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c38fb94f-553b-5f9b-a384-07a2ce35879f, identifier: TX69988
2026-03-29 08:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dce4a6ec-3b7f-52a1-acc4-59a620260b77 with identifier: MG99487
2026-03-29 08:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dce4a6ec-3b7f-52a1-acc4-59a620260b77 with scrape type 1
2026-03-29 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item dce4a6ec-3b7f-52a1-acc4-59a620260b77
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F89%252F9a898792dc4aa5c9c07b03113bf8c565%252Fpa%252FMG99487_c23255ee8ba25af860ff000dcdaba308.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/89/9a898792dc4aa5c9c07b03113bf8c565/pa/MG99487_c23255ee8ba25af860ff000dcdaba308.jpg already downloaded
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F89%252F9a898792dc4aa5c9c07b03113bf8c565%252Fpa%252FMG99487_75bdc0269b62c6bee8c440b047be122d.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/89/9a898792dc4aa5c9c07b03113bf8c565/pa/MG99487_75bdc0269b62c6bee8c440b047be122d.jpg already downloaded
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F89%252F9a898792dc4aa5c9c07b03113bf8c565%252Fpa%252FMG99487_78560f8b6026cba78e6748660c4a1a87.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/89/9a898792dc4aa5c9c07b03113bf8c565/pa/MG99487_78560f8b6026cba78e6748660c4a1a87.jpg already downloaded
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F89%252F9a898792dc4aa5c9c07b03113bf8c565%252Fpa%252FMG99487_a564181126b8970c2ba6ff7d87b8a4d9.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/89/9a898792dc4aa5c9c07b03113bf8c565/pa/MG99487_a564181126b8970c2ba6ff7d87b8a4d9.jpg already downloaded
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F89%252F9a898792dc4aa5c9c07b03113bf8c565%252Fpa%252FMG99487_886c93bf4d9bfcdd3848c315ab5bb20f.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/89/9a898792dc4aa5c9c07b03113bf8c565/pa/MG99487_886c93bf4d9bfcdd3848c315ab5bb20f.jpg already downloaded
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F89%252F9a898792dc4aa5c9c07b03113bf8c565%252Fpa%252FMG99487_f6802eb9b74fc19cc642a1e942a11a08.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/89/9a898792dc4aa5c9c07b03113bf8c565/pa/MG99487_f6802eb9b74fc19cc642a1e942a11a08.jpg already downloaded
2026-03-29 08:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dce4a6ec-3b7f-52a1-acc4-59a620260b77, identifier: MG99487
2026-03-29 08:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b21a6d9-a757-5b64-ba63-7c51e8ff72c0 with identifier: VP06293
2026-03-29 08:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b21a6d9-a757-5b64-ba63-7c51e8ff72c0 with scrape type 1
2026-03-29 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8b21a6d9-a757-5b64-ba63-7c51e8ff72c0
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fc0%252F05c0099589723ad9e46a61cd8884cd21%252Fpa%252FVP06293_48bc94e2185bfd0204ce4df82fef3d68.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/c0/05c0099589723ad9e46a61cd8884cd21/pa/VP06293_48bc94e2185bfd0204ce4df82fef3d68.jpg already downloaded
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fc0%252F05c0099589723ad9e46a61cd8884cd21%252Fpa%252FVP06293_bfa610a16a0d08f7cc309d4ca1260b3e.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/c0/05c0099589723ad9e46a61cd8884cd21/pa/VP06293_bfa610a16a0d08f7cc309d4ca1260b3e.jpg already downloaded
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fc0%252F05c0099589723ad9e46a61cd8884cd21%252Fpa%252FVP06293_cc91ed3951007e9ca5b6e324cdfe533b.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/c0/05c0099589723ad9e46a61cd8884cd21/pa/VP06293_cc91ed3951007e9ca5b6e324cdfe533b.jpg already downloaded
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fc0%252F05c0099589723ad9e46a61cd8884cd21%252Fpa%252FVP06293_02bcee13f92f4e581e6784d9d006db2b.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/c0/05c0099589723ad9e46a61cd8884cd21/pa/VP06293_02bcee13f92f4e581e6784d9d006db2b.jpg already downloaded
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fc0%252F05c0099589723ad9e46a61cd8884cd21%252Fpa%252FVP06293_806f20b96c2350851e12e51c2a8f94bf.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/c0/05c0099589723ad9e46a61cd8884cd21/pa/VP06293_806f20b96c2350851e12e51c2a8f94bf.jpg already downloaded
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fc0%252F05c0099589723ad9e46a61cd8884cd21%252Fpa%252FVP06293_0cb958220675faaaf37210d8506c175b.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/c0/05c0099589723ad9e46a61cd8884cd21/pa/VP06293_0cb958220675faaaf37210d8506c175b.jpg already downloaded
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fc0%252F05c0099589723ad9e46a61cd8884cd21%252Fpa%252FVP06293_b1395d448a75b379e1b83deb287ac10b.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/c0/05c0099589723ad9e46a61cd8884cd21/pa/VP06293_b1395d448a75b379e1b83deb287ac10b.jpg already downloaded
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fc0%252F05c0099589723ad9e46a61cd8884cd21%252Fpa%252FVP06293_c4da007b40d5cef7ab6e4d68afc1f15a.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/c0/05c0099589723ad9e46a61cd8884cd21/pa/VP06293_c4da007b40d5cef7ab6e4d68afc1f15a.jpg already downloaded
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fc0%252F05c0099589723ad9e46a61cd8884cd21%252Fpa%252FVP06293_1483dce76a97af5cdf3961a8932fe3ef.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/c0/05c0099589723ad9e46a61cd8884cd21/pa/VP06293_1483dce76a97af5cdf3961a8932fe3ef.jpg already downloaded
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg05%252Fc0%252F05c0099589723ad9e46a61cd8884cd21%252Fpa%252FVP06293_313af392c99b824f4921019733628190.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img05/c0/05c0099589723ad9e46a61cd8884cd21/pa/VP06293_313af392c99b824f4921019733628190.jpg already downloaded
2026-03-29 08:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8b21a6d9-a757-5b64-ba63-7c51e8ff72c0, identifier: VP06293
2026-03-29 08:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c38fb94f-553b-5f9b-a384-07a2ce35879f with identifier: TX69988
2026-03-29 08:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c38fb94f-553b-5f9b-a384-07a2ce35879f with identifier: TX69988
2026-03-29 08:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c38fb94f-553b-5f9b-a384-07a2ce35879f with identifier: TX69988 to the API
2026-03-29 08:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TX69988>
{'auction_title': '',
'c_o_2_emission_value': 131,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 5',
'engine': '2.1L',
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:20:30Z',
'fuel_type': 'diesel',
'id': 'c38fb94f-553b-5f9b-a384-07a2ce35879f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX69988',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 197330,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img3e/32/3e3252d31de88cfbb9639737cedab22b/pa/TX69988_a8e7827cb7a1c868ce8beb794eaadbb9.jpg',
'https://img-pa.auto1.com/img3e/32/3e3252d31de88cfbb9639737cedab22b/pa/TX69988_67e29d07b7f20171fc7464a601aa0370.jpg',
'https://img-pa.auto1.com/img3e/32/3e3252d31de88cfbb9639737cedab22b/pa/TX69988_e2c492bfeeb20241ab359fa95e1b3d00.jpg',
'https://img-pa.auto1.com/img3e/32/3e3252d31de88cfbb9639737cedab22b/pa/TX69988_a22c9cf7d014d23c0c28111ccc7fa6be.jpg',
'https://img-pa.auto1.com/img3e/32/3e3252d31de88cfbb9639737cedab22b/pa/TX69988_fdffdeded4f692549d0aecf281a5c4e9.jpg',
'https://img-pa.auto1.com/img3e/32/3e3252d31de88cfbb9639737cedab22b/pa/TX69988_16461c32c83ad2cdf5fb9fff2c4ab47b.jpg',
'https://img-pa.auto1.com/img3e/32/3e3252d31de88cfbb9639737cedab22b/pa/TX69988_e69a3cbf3830e641951ee8eb7e9081c6.jpg',
'https://img-pa.auto1.com/img3e/32/3e3252d31de88cfbb9639737cedab22b/pa/TX69988_4f70d89d8aa1c21c91fb30659a5e9270.jpg',
'https://img-pa.auto1.com/img3e/32/3e3252d31de88cfbb9639737cedab22b/pa/TX69988_e9ddd182949130d6c5e620f57c22f9d1.jpg',
'https://img-pa.auto1.com/img3e/32/3e3252d31de88cfbb9639737cedab22b/pa/TX69988_c7507a148e0159b6547033f920282fa6.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c38fb94f-553b-5f9b-a384-07a2ce35879f/c38fb94f-553b-5f9b-a384-07a2ce35879f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72328,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/32/3e3252d31de88cfbb9639737cedab22b/pa/TX69988_a8e7827cb7a1c868ce8beb794eaadbb9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c38fb94f-553b-5f9b-a384-07a2ce35879f/c38fb94f-553b-5f9b-a384-07a2ce35879f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73426,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/32/3e3252d31de88cfbb9639737cedab22b/pa/TX69988_67e29d07b7f20171fc7464a601aa0370.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c38fb94f-553b-5f9b-a384-07a2ce35879f/c38fb94f-553b-5f9b-a384-07a2ce35879f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66858,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/32/3e3252d31de88cfbb9639737cedab22b/pa/TX69988_e2c492bfeeb20241ab359fa95e1b3d00.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c38fb94f-553b-5f9b-a384-07a2ce35879f/c38fb94f-553b-5f9b-a384-07a2ce35879f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62533,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/32/3e3252d31de88cfbb9639737cedab22b/pa/TX69988_a22c9cf7d014d23c0c28111ccc7fa6be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c38fb94f-553b-5f9b-a384-07a2ce35879f/c38fb94f-553b-5f9b-a384-07a2ce35879f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64296,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/32/3e3252d31de88cfbb9639737cedab22b/pa/TX69988_fdffdeded4f692549d0aecf281a5c4e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c38fb94f-553b-5f9b-a384-07a2ce35879f/c38fb94f-553b-5f9b-a384-07a2ce35879f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67878,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/32/3e3252d31de88cfbb9639737cedab22b/pa/TX69988_16461c32c83ad2cdf5fb9fff2c4ab47b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c38fb94f-553b-5f9b-a384-07a2ce35879f/c38fb94f-553b-5f9b-a384-07a2ce35879f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65321,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/32/3e3252d31de88cfbb9639737cedab22b/pa/TX69988_e69a3cbf3830e641951ee8eb7e9081c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c38fb94f-553b-5f9b-a384-07a2ce35879f/c38fb94f-553b-5f9b-a384-07a2ce35879f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74407,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/32/3e3252d31de88cfbb9639737cedab22b/pa/TX69988_4f70d89d8aa1c21c91fb30659a5e9270.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c38fb94f-553b-5f9b-a384-07a2ce35879f/c38fb94f-553b-5f9b-a384-07a2ce35879f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68159,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/32/3e3252d31de88cfbb9639737cedab22b/pa/TX69988_e9ddd182949130d6c5e620f57c22f9d1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c38fb94f-553b-5f9b-a384-07a2ce35879f/c38fb94f-553b-5f9b-a384-07a2ce35879f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58450,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/32/3e3252d31de88cfbb9639737cedab22b/pa/TX69988_c7507a148e0159b6547033f920282fa6.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-09-24',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 CDI BlueEfficiency Avantgarde',
'transmission': 'manual',
'trim': 'BlueEfficiency Avantgarde',
'year': 2013}
2026-03-29 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX69988%27 HTTP/1.1" 200 None
2026-03-29 08:36:06 [auto1.be] INFO: Saving data for TX69988: {'created_time': 1774773366.410223, 'last_price_update_time': 1774773366.410232, 'auction_closing_time': 1774884030.0}
2026-03-29 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TX69988') HTTP/1.1" 204 0
2026-03-29 08:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dce4a6ec-3b7f-52a1-acc4-59a620260b77 with identifier: MG99487
2026-03-29 08:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dce4a6ec-3b7f-52a1-acc4-59a620260b77 with identifier: MG99487
2026-03-29 08:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dce4a6ec-3b7f-52a1-acc4-59a620260b77 with identifier: MG99487 to the API
2026-03-29 08:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MG99487>
{'auction_title': '',
'c_o_2_emission_value': 153,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.4L',
'engine_horse_power': 88,
'expiration_date': '2026-03-30T15:43:10Z',
'fuel_type': 'petrol',
'id': 'dce4a6ec-3b7f-52a1-acc4-59a620260b77',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG99487',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Citroen',
'model': 'C4',
'odometer': 111028,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img9a/89/9a898792dc4aa5c9c07b03113bf8c565/pa/MG99487_c23255ee8ba25af860ff000dcdaba308.jpg',
'https://img-pa.auto1.com/img9a/89/9a898792dc4aa5c9c07b03113bf8c565/pa/MG99487_75bdc0269b62c6bee8c440b047be122d.jpg',
'https://img-pa.auto1.com/img9a/89/9a898792dc4aa5c9c07b03113bf8c565/pa/MG99487_78560f8b6026cba78e6748660c4a1a87.jpg',
'https://img-pa.auto1.com/img9a/89/9a898792dc4aa5c9c07b03113bf8c565/pa/MG99487_a564181126b8970c2ba6ff7d87b8a4d9.jpg',
'https://img-pa.auto1.com/img9a/89/9a898792dc4aa5c9c07b03113bf8c565/pa/MG99487_886c93bf4d9bfcdd3848c315ab5bb20f.jpg',
'https://img-pa.auto1.com/img9a/89/9a898792dc4aa5c9c07b03113bf8c565/pa/MG99487_f6802eb9b74fc19cc642a1e942a11a08.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dce4a6ec-3b7f-52a1-acc4-59a620260b77/dce4a6ec-3b7f-52a1-acc4-59a620260b77_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80141,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/89/9a898792dc4aa5c9c07b03113bf8c565/pa/MG99487_c23255ee8ba25af860ff000dcdaba308.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dce4a6ec-3b7f-52a1-acc4-59a620260b77/dce4a6ec-3b7f-52a1-acc4-59a620260b77_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76137,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/89/9a898792dc4aa5c9c07b03113bf8c565/pa/MG99487_75bdc0269b62c6bee8c440b047be122d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dce4a6ec-3b7f-52a1-acc4-59a620260b77/dce4a6ec-3b7f-52a1-acc4-59a620260b77_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79508,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/89/9a898792dc4aa5c9c07b03113bf8c565/pa/MG99487_78560f8b6026cba78e6748660c4a1a87.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dce4a6ec-3b7f-52a1-acc4-59a620260b77/dce4a6ec-3b7f-52a1-acc4-59a620260b77_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72367,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/89/9a898792dc4aa5c9c07b03113bf8c565/pa/MG99487_a564181126b8970c2ba6ff7d87b8a4d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dce4a6ec-3b7f-52a1-acc4-59a620260b77/dce4a6ec-3b7f-52a1-acc4-59a620260b77_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110426,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/89/9a898792dc4aa5c9c07b03113bf8c565/pa/MG99487_886c93bf4d9bfcdd3848c315ab5bb20f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dce4a6ec-3b7f-52a1-acc4-59a620260b77/dce4a6ec-3b7f-52a1-acc4-59a620260b77_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103459,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/89/9a898792dc4aa5c9c07b03113bf8c565/pa/MG99487_f6802eb9b74fc19cc642a1e942a11a08.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-03-05',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 1.4 Advance',
'transmission': 'manual',
'trim': 'Advance',
'year': 2009}
2026-03-29 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG99487%27 HTTP/1.1" 200 None
2026-03-29 08:36:06 [auto1.be] INFO: Saving data for MG99487: {'created_time': 1774773366.733442, 'last_price_update_time': 1774773366.733452, 'auction_closing_time': 1774885390.0}
2026-03-29 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MG99487') HTTP/1.1" 204 0
2026-03-29 08:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8b21a6d9-a757-5b64-ba63-7c51e8ff72c0 with identifier: VP06293
2026-03-29 08:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8b21a6d9-a757-5b64-ba63-7c51e8ff72c0 with identifier: VP06293
2026-03-29 08:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8b21a6d9-a757-5b64-ba63-7c51e8ff72c0 with identifier: VP06293 to the API
2026-03-29 08:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VP06293>
{'auction_title': '',
'c_o_2_emission_value': 130,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.1L',
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:57:04Z',
'fuel_type': 'diesel',
'id': '8b21a6d9-a757-5b64-ba63-7c51e8ff72c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP06293',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 352678,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img05/c0/05c0099589723ad9e46a61cd8884cd21/pa/VP06293_48bc94e2185bfd0204ce4df82fef3d68.jpg',
'https://img-pa.auto1.com/img05/c0/05c0099589723ad9e46a61cd8884cd21/pa/VP06293_bfa610a16a0d08f7cc309d4ca1260b3e.jpg',
'https://img-pa.auto1.com/img05/c0/05c0099589723ad9e46a61cd8884cd21/pa/VP06293_cc91ed3951007e9ca5b6e324cdfe533b.jpg',
'https://img-pa.auto1.com/img05/c0/05c0099589723ad9e46a61cd8884cd21/pa/VP06293_02bcee13f92f4e581e6784d9d006db2b.jpg',
'https://img-pa.auto1.com/img05/c0/05c0099589723ad9e46a61cd8884cd21/pa/VP06293_806f20b96c2350851e12e51c2a8f94bf.jpg',
'https://img-pa.auto1.com/img05/c0/05c0099589723ad9e46a61cd8884cd21/pa/VP06293_0cb958220675faaaf37210d8506c175b.jpg',
'https://img-pa.auto1.com/img05/c0/05c0099589723ad9e46a61cd8884cd21/pa/VP06293_b1395d448a75b379e1b83deb287ac10b.jpg',
'https://img-pa.auto1.com/img05/c0/05c0099589723ad9e46a61cd8884cd21/pa/VP06293_c4da007b40d5cef7ab6e4d68afc1f15a.jpg',
'https://img-pa.auto1.com/img05/c0/05c0099589723ad9e46a61cd8884cd21/pa/VP06293_1483dce76a97af5cdf3961a8932fe3ef.jpg',
'https://img-pa.auto1.com/img05/c0/05c0099589723ad9e46a61cd8884cd21/pa/VP06293_313af392c99b824f4921019733628190.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b21a6d9-a757-5b64-ba63-7c51e8ff72c0/8b21a6d9-a757-5b64-ba63-7c51e8ff72c0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69201,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/c0/05c0099589723ad9e46a61cd8884cd21/pa/VP06293_48bc94e2185bfd0204ce4df82fef3d68.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b21a6d9-a757-5b64-ba63-7c51e8ff72c0/8b21a6d9-a757-5b64-ba63-7c51e8ff72c0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62690,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/c0/05c0099589723ad9e46a61cd8884cd21/pa/VP06293_bfa610a16a0d08f7cc309d4ca1260b3e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b21a6d9-a757-5b64-ba63-7c51e8ff72c0/8b21a6d9-a757-5b64-ba63-7c51e8ff72c0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70437,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/c0/05c0099589723ad9e46a61cd8884cd21/pa/VP06293_cc91ed3951007e9ca5b6e324cdfe533b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b21a6d9-a757-5b64-ba63-7c51e8ff72c0/8b21a6d9-a757-5b64-ba63-7c51e8ff72c0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55371,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/c0/05c0099589723ad9e46a61cd8884cd21/pa/VP06293_02bcee13f92f4e581e6784d9d006db2b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b21a6d9-a757-5b64-ba63-7c51e8ff72c0/8b21a6d9-a757-5b64-ba63-7c51e8ff72c0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64029,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/c0/05c0099589723ad9e46a61cd8884cd21/pa/VP06293_806f20b96c2350851e12e51c2a8f94bf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b21a6d9-a757-5b64-ba63-7c51e8ff72c0/8b21a6d9-a757-5b64-ba63-7c51e8ff72c0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65980,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/c0/05c0099589723ad9e46a61cd8884cd21/pa/VP06293_0cb958220675faaaf37210d8506c175b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b21a6d9-a757-5b64-ba63-7c51e8ff72c0/8b21a6d9-a757-5b64-ba63-7c51e8ff72c0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49918,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/c0/05c0099589723ad9e46a61cd8884cd21/pa/VP06293_b1395d448a75b379e1b83deb287ac10b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b21a6d9-a757-5b64-ba63-7c51e8ff72c0/8b21a6d9-a757-5b64-ba63-7c51e8ff72c0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62918,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/c0/05c0099589723ad9e46a61cd8884cd21/pa/VP06293_c4da007b40d5cef7ab6e4d68afc1f15a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b21a6d9-a757-5b64-ba63-7c51e8ff72c0/8b21a6d9-a757-5b64-ba63-7c51e8ff72c0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58339,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/c0/05c0099589723ad9e46a61cd8884cd21/pa/VP06293_1483dce76a97af5cdf3961a8932fe3ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b21a6d9-a757-5b64-ba63-7c51e8ff72c0/8b21a6d9-a757-5b64-ba63-7c51e8ff72c0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70941,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img05/c0/05c0099589723ad9e46a61cd8884cd21/pa/VP06293_313af392c99b824f4921019733628190.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-09-15',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 CDI T BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'T BlueEfficiency Avantgarde',
'year': 2013}
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP06293%27 HTTP/1.1" 200 None
2026-03-29 08:36:07 [auto1.be] INFO: Saving data for VP06293: {'created_time': 1774773367.054977, 'last_price_update_time': 1774773367.054986, 'auction_closing_time': 1774886224.0}
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VP06293') HTTP/1.1" 204 0
2026-03-29 08:36:07 [scrapy.extensions.logstats] INFO: Crawled 73 pages (at 73 pages/min), scraped 84 items (at 84 items/min)
2026-03-29 08:36:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-29 08:36:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f712844a-dcff-5ddb-aa90-705b45ea9a54 with identifier: NC38410
2026-03-29 08:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f712844a-dcff-5ddb-aa90-705b45ea9a54 with scrape type 1
2026-03-29 08:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item f712844a-dcff-5ddb-aa90-705b45ea9a54
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F61%252F7b61d8a3786b2dd90f87ee9b4ab43e1b%252Fpa%252FNC38410_1f65418de928f55bc7bf5f52fc7c71c1.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/61/7b61d8a3786b2dd90f87ee9b4ab43e1b/pa/NC38410_1f65418de928f55bc7bf5f52fc7c71c1.jpg already downloaded
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F61%252F7b61d8a3786b2dd90f87ee9b4ab43e1b%252Fpa%252FNC38410_208c20296a4201111bed0274f3002b03.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/61/7b61d8a3786b2dd90f87ee9b4ab43e1b/pa/NC38410_208c20296a4201111bed0274f3002b03.jpg already downloaded
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F61%252F7b61d8a3786b2dd90f87ee9b4ab43e1b%252Fpa%252FNC38410_13c9fb56379b9925ac153da9d796bc75.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/61/7b61d8a3786b2dd90f87ee9b4ab43e1b/pa/NC38410_13c9fb56379b9925ac153da9d796bc75.jpg already downloaded
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F61%252F7b61d8a3786b2dd90f87ee9b4ab43e1b%252Fpa%252FNC38410_6385973ca4266647d174e6a4ffa442c5.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/61/7b61d8a3786b2dd90f87ee9b4ab43e1b/pa/NC38410_6385973ca4266647d174e6a4ffa442c5.jpg already downloaded
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F61%252F7b61d8a3786b2dd90f87ee9b4ab43e1b%252Fpa%252FNC38410_32e861342643be8cd5a1f4352c498789.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/61/7b61d8a3786b2dd90f87ee9b4ab43e1b/pa/NC38410_32e861342643be8cd5a1f4352c498789.jpg already downloaded
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F61%252F7b61d8a3786b2dd90f87ee9b4ab43e1b%252Fpa%252FNC38410_d22173a9ed4ee24ea6a77bfca9f56a6e.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/61/7b61d8a3786b2dd90f87ee9b4ab43e1b/pa/NC38410_d22173a9ed4ee24ea6a77bfca9f56a6e.jpg already downloaded
2026-03-29 08:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f712844a-dcff-5ddb-aa90-705b45ea9a54, identifier: NC38410
2026-03-29 08:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f712844a-dcff-5ddb-aa90-705b45ea9a54 with identifier: NC38410
2026-03-29 08:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f712844a-dcff-5ddb-aa90-705b45ea9a54 with identifier: NC38410
2026-03-29 08:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f712844a-dcff-5ddb-aa90-705b45ea9a54 with identifier: NC38410 to the API
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NC38410>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 3',
'engine': '2.1L',
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:16:15Z',
'fuel_type': 'diesel',
'id': 'f712844a-dcff-5ddb-aa90-705b45ea9a54',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC38410',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 259231,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img7b/61/7b61d8a3786b2dd90f87ee9b4ab43e1b/pa/NC38410_1f65418de928f55bc7bf5f52fc7c71c1.jpg',
'https://img-pa.auto1.com/img7b/61/7b61d8a3786b2dd90f87ee9b4ab43e1b/pa/NC38410_208c20296a4201111bed0274f3002b03.jpg',
'https://img-pa.auto1.com/img7b/61/7b61d8a3786b2dd90f87ee9b4ab43e1b/pa/NC38410_13c9fb56379b9925ac153da9d796bc75.jpg',
'https://img-pa.auto1.com/img7b/61/7b61d8a3786b2dd90f87ee9b4ab43e1b/pa/NC38410_6385973ca4266647d174e6a4ffa442c5.jpg',
'https://img-pa.auto1.com/img7b/61/7b61d8a3786b2dd90f87ee9b4ab43e1b/pa/NC38410_32e861342643be8cd5a1f4352c498789.jpg',
'https://img-pa.auto1.com/img7b/61/7b61d8a3786b2dd90f87ee9b4ab43e1b/pa/NC38410_d22173a9ed4ee24ea6a77bfca9f56a6e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f712844a-dcff-5ddb-aa90-705b45ea9a54/f712844a-dcff-5ddb-aa90-705b45ea9a54_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78793,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/61/7b61d8a3786b2dd90f87ee9b4ab43e1b/pa/NC38410_1f65418de928f55bc7bf5f52fc7c71c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f712844a-dcff-5ddb-aa90-705b45ea9a54/f712844a-dcff-5ddb-aa90-705b45ea9a54_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83973,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/61/7b61d8a3786b2dd90f87ee9b4ab43e1b/pa/NC38410_208c20296a4201111bed0274f3002b03.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f712844a-dcff-5ddb-aa90-705b45ea9a54/f712844a-dcff-5ddb-aa90-705b45ea9a54_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80906,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/61/7b61d8a3786b2dd90f87ee9b4ab43e1b/pa/NC38410_13c9fb56379b9925ac153da9d796bc75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f712844a-dcff-5ddb-aa90-705b45ea9a54/f712844a-dcff-5ddb-aa90-705b45ea9a54_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54852,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/61/7b61d8a3786b2dd90f87ee9b4ab43e1b/pa/NC38410_6385973ca4266647d174e6a4ffa442c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f712844a-dcff-5ddb-aa90-705b45ea9a54/f712844a-dcff-5ddb-aa90-705b45ea9a54_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81335,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/61/7b61d8a3786b2dd90f87ee9b4ab43e1b/pa/NC38410_32e861342643be8cd5a1f4352c498789.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f712844a-dcff-5ddb-aa90-705b45ea9a54/f712844a-dcff-5ddb-aa90-705b45ea9a54_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92859,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7b/61/7b61d8a3786b2dd90f87ee9b4ab43e1b/pa/NC38410_d22173a9ed4ee24ea6a77bfca9f56a6e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2002-07-04',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 CDI Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2002}
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC38410%27 HTTP/1.1" 200 None
2026-03-29 08:36:07 [auto1.be] INFO: Saving data for NC38410: {'created_time': 1774773367.584151, 'last_price_update_time': 1774773367.584159, 'auction_closing_time': 1774883775.0}
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NC38410') HTTP/1.1" 204 0
2026-03-29 08:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FG10633> (referer: https://www.auto1.com/v1/car-details-view/FG10633/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7f2a8a4-f020-5a4f-ab88-eabb5ddda350 with identifier: FG10633
2026-03-29 08:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7f2a8a4-f020-5a4f-ab88-eabb5ddda350 with scrape type 1
2026-03-29 08:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c7f2a8a4-f020-5a4f-ab88-eabb5ddda350
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fd1%252F0ad1ca531de8054dc45511034bafa131%252Fpa%252FFG10633_5977b6c8b33495a69a856d978ee0aea9.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/d1/0ad1ca531de8054dc45511034bafa131/pa/FG10633_5977b6c8b33495a69a856d978ee0aea9.jpg already downloaded
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fd1%252F0ad1ca531de8054dc45511034bafa131%252Fpa%252FFG10633_a6f61f37406c8a4b1225b5bbca7daf35.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/d1/0ad1ca531de8054dc45511034bafa131/pa/FG10633_a6f61f37406c8a4b1225b5bbca7daf35.jpg already downloaded
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fd1%252F0ad1ca531de8054dc45511034bafa131%252Fpa%252FFG10633_a90dd3983c0341e1aede20f16f020ee8.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/d1/0ad1ca531de8054dc45511034bafa131/pa/FG10633_a90dd3983c0341e1aede20f16f020ee8.jpg already downloaded
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fd1%252F0ad1ca531de8054dc45511034bafa131%252Fpa%252FFG10633_b3384bf03a216c5d41e04a13ebd0d099.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/d1/0ad1ca531de8054dc45511034bafa131/pa/FG10633_b3384bf03a216c5d41e04a13ebd0d099.jpg already downloaded
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fd1%252F0ad1ca531de8054dc45511034bafa131%252Fpa%252FFG10633_8185d0b6ae03ffa244b68b387be9dea5.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/d1/0ad1ca531de8054dc45511034bafa131/pa/FG10633_8185d0b6ae03ffa244b68b387be9dea5.jpg already downloaded
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fd1%252F0ad1ca531de8054dc45511034bafa131%252Fpa%252FFG10633_925e082cd5dafcdb33c5c8be2beb8fa7.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/d1/0ad1ca531de8054dc45511034bafa131/pa/FG10633_925e082cd5dafcdb33c5c8be2beb8fa7.jpg already downloaded
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fd1%252F0ad1ca531de8054dc45511034bafa131%252Fpa%252FFG10633_765f42bb0f6995a583162d979809852b.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/d1/0ad1ca531de8054dc45511034bafa131/pa/FG10633_765f42bb0f6995a583162d979809852b.jpg already downloaded
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fd1%252F0ad1ca531de8054dc45511034bafa131%252Fpa%252FFG10633_0600869b81de12798cd09bffccb17730.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/d1/0ad1ca531de8054dc45511034bafa131/pa/FG10633_0600869b81de12798cd09bffccb17730.jpg already downloaded
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fd1%252F0ad1ca531de8054dc45511034bafa131%252Fpa%252FFG10633_92cdf4ec04fa95965a0ecae6ab0092bd.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/d1/0ad1ca531de8054dc45511034bafa131/pa/FG10633_92cdf4ec04fa95965a0ecae6ab0092bd.jpg already downloaded
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fd1%252F0ad1ca531de8054dc45511034bafa131%252Fpa%252FFG10633_15eb15b19f37271c2850115750700d9e.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/d1/0ad1ca531de8054dc45511034bafa131/pa/FG10633_15eb15b19f37271c2850115750700d9e.jpg already downloaded
2026-03-29 08:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c7f2a8a4-f020-5a4f-ab88-eabb5ddda350, identifier: FG10633
2026-03-29 08:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c7f2a8a4-f020-5a4f-ab88-eabb5ddda350 with identifier: FG10633
2026-03-29 08:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c7f2a8a4-f020-5a4f-ab88-eabb5ddda350 with identifier: FG10633
2026-03-29 08:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c7f2a8a4-f020-5a4f-ab88-eabb5ddda350 with identifier: FG10633 to the API
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FG10633>
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:21:37Z',
'fuel_type': 'petrol',
'id': 'c7f2a8a4-f020-5a4f-ab88-eabb5ddda350',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG10633',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Peugeot',
'model': '208',
'odometer': 72809,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 22,
'photo_urls': ['https://img-pa.auto1.com/img0a/d1/0ad1ca531de8054dc45511034bafa131/pa/FG10633_5977b6c8b33495a69a856d978ee0aea9.jpg',
'https://img-pa.auto1.com/img0a/d1/0ad1ca531de8054dc45511034bafa131/pa/FG10633_a6f61f37406c8a4b1225b5bbca7daf35.jpg',
'https://img-pa.auto1.com/img0a/d1/0ad1ca531de8054dc45511034bafa131/pa/FG10633_a90dd3983c0341e1aede20f16f020ee8.jpg',
'https://img-pa.auto1.com/img0a/d1/0ad1ca531de8054dc45511034bafa131/pa/FG10633_b3384bf03a216c5d41e04a13ebd0d099.jpg',
'https://img-pa.auto1.com/img0a/d1/0ad1ca531de8054dc45511034bafa131/pa/FG10633_8185d0b6ae03ffa244b68b387be9dea5.jpg',
'https://img-pa.auto1.com/img0a/d1/0ad1ca531de8054dc45511034bafa131/pa/FG10633_925e082cd5dafcdb33c5c8be2beb8fa7.jpg',
'https://img-pa.auto1.com/img0a/d1/0ad1ca531de8054dc45511034bafa131/pa/FG10633_765f42bb0f6995a583162d979809852b.jpg',
'https://img-pa.auto1.com/img0a/d1/0ad1ca531de8054dc45511034bafa131/pa/FG10633_0600869b81de12798cd09bffccb17730.jpg',
'https://img-pa.auto1.com/img0a/d1/0ad1ca531de8054dc45511034bafa131/pa/FG10633_92cdf4ec04fa95965a0ecae6ab0092bd.jpg',
'https://img-pa.auto1.com/img0a/d1/0ad1ca531de8054dc45511034bafa131/pa/FG10633_15eb15b19f37271c2850115750700d9e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7f2a8a4-f020-5a4f-ab88-eabb5ddda350/c7f2a8a4-f020-5a4f-ab88-eabb5ddda350_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91397,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/d1/0ad1ca531de8054dc45511034bafa131/pa/FG10633_5977b6c8b33495a69a856d978ee0aea9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7f2a8a4-f020-5a4f-ab88-eabb5ddda350/c7f2a8a4-f020-5a4f-ab88-eabb5ddda350_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99832,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/d1/0ad1ca531de8054dc45511034bafa131/pa/FG10633_a6f61f37406c8a4b1225b5bbca7daf35.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7f2a8a4-f020-5a4f-ab88-eabb5ddda350/c7f2a8a4-f020-5a4f-ab88-eabb5ddda350_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97184,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/d1/0ad1ca531de8054dc45511034bafa131/pa/FG10633_a90dd3983c0341e1aede20f16f020ee8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7f2a8a4-f020-5a4f-ab88-eabb5ddda350/c7f2a8a4-f020-5a4f-ab88-eabb5ddda350_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91746,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/d1/0ad1ca531de8054dc45511034bafa131/pa/FG10633_b3384bf03a216c5d41e04a13ebd0d099.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7f2a8a4-f020-5a4f-ab88-eabb5ddda350/c7f2a8a4-f020-5a4f-ab88-eabb5ddda350_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91437,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/d1/0ad1ca531de8054dc45511034bafa131/pa/FG10633_8185d0b6ae03ffa244b68b387be9dea5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7f2a8a4-f020-5a4f-ab88-eabb5ddda350/c7f2a8a4-f020-5a4f-ab88-eabb5ddda350_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83323,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/d1/0ad1ca531de8054dc45511034bafa131/pa/FG10633_925e082cd5dafcdb33c5c8be2beb8fa7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7f2a8a4-f020-5a4f-ab88-eabb5ddda350/c7f2a8a4-f020-5a4f-ab88-eabb5ddda350_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89023,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/d1/0ad1ca531de8054dc45511034bafa131/pa/FG10633_765f42bb0f6995a583162d979809852b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7f2a8a4-f020-5a4f-ab88-eabb5ddda350/c7f2a8a4-f020-5a4f-ab88-eabb5ddda350_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106506,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/d1/0ad1ca531de8054dc45511034bafa131/pa/FG10633_0600869b81de12798cd09bffccb17730.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7f2a8a4-f020-5a4f-ab88-eabb5ddda350/c7f2a8a4-f020-5a4f-ab88-eabb5ddda350_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72956,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/d1/0ad1ca531de8054dc45511034bafa131/pa/FG10633_92cdf4ec04fa95965a0ecae6ab0092bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7f2a8a4-f020-5a4f-ab88-eabb5ddda350/c7f2a8a4-f020-5a4f-ab88-eabb5ddda350_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74726,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/d1/0ad1ca531de8054dc45511034bafa131/pa/FG10633_15eb15b19f37271c2850115750700d9e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-01-17',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Signature',
'transmission': 'manual',
'trim': 'Signature',
'year': 2019}
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG10633%27 HTTP/1.1" 200 None
2026-03-29 08:36:09 [auto1.be] INFO: Saving data for FG10633: {'created_time': 1774773369.246395, 'last_price_update_time': 1774773369.246404, 'auction_closing_time': 1774884097.0}
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FG10633') HTTP/1.1" 204 0
2026-03-29 08:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:13 [auto1.be] INFO: Channel: 24h | Page: 7 | totalHits: 1252 | hits on page: 40
2026-03-29 08:36:13 [auto1.be] INFO: Found listing with ID: NB03494
2026-03-29 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB03494%27 HTTP/1.1" 200 None
2026-03-29 08:36:13 [auto1.be] INFO: Scrape type for NB03494: 0
2026-03-29 08:36:13 [auto1.be] INFO: Found listing with ID: CK14854
2026-03-29 08:36:13 [auto1.be] INFO: Found listing with ID: WJ85942
2026-03-29 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ85942%27 HTTP/1.1" 200 None
2026-03-29 08:36:13 [auto1.be] INFO: Scrape type for WJ85942: 0
2026-03-29 08:36:13 [auto1.be] INFO: Found listing with ID: ZL62218
2026-03-29 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL62218%27 HTTP/1.1" 200 None
2026-03-29 08:36:13 [auto1.be] INFO: Scrape type for ZL62218: 0
2026-03-29 08:36:13 [auto1.be] INFO: Found listing with ID: KG55279
2026-03-29 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG55279%27 HTTP/1.1" 200 None
2026-03-29 08:36:13 [auto1.be] INFO: Scrape type for KG55279: 2
2026-03-29 08:36:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8960310-7c5d-51c0-b05a-5286b81cbb22 with identifier: KG55279
2026-03-29 08:36:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8960310-7c5d-51c0-b05a-5286b81cbb22 with scrape type 2
2026-03-29 08:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8960310-7c5d-51c0-b05a-5286b81cbb22 with scrape type 2
2026-03-29 08:36:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d8960310-7c5d-51c0-b05a-5286b81cbb22, identifier: KG55279
2026-03-29 08:36:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d8960310-7c5d-51c0-b05a-5286b81cbb22 with identifier: KG55279
2026-03-29 08:36:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d8960310-7c5d-51c0-b05a-5286b81cbb22 with identifier: KG55279
2026-03-29 08:36:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d8960310-7c5d-51c0-b05a-5286b81cbb22 with identifier: KG55279 to the API
2026-03-29 08:36:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:59:15Z',
'fuel_type': 'petrol',
'id': 'd8960310-7c5d-51c0-b05a-5286b81cbb22',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG55279',
'listing': 'auction',
'make': 'Opel',
'model': 'Meriva',
'odometer': 107056,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-09-28',
'seller_name': None,
'title': 'Opel Meriva 1.4 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2008}
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG55279%27 HTTP/1.1" 200 None
2026-03-29 08:36:14 [auto1.be] INFO: Saving data for KG55279: {'auction_closing_time': 1774886355.0, 'created_time': 1774557544.726713, 'last_price_update_time': 1774773374.07664}
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KG55279') HTTP/1.1" 204 0
2026-03-29 08:36:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: JS91211
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: EX56301
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: DL13581
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: EL84394
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL84394%27 HTTP/1.1" 200 None
2026-03-29 08:36:14 [auto1.be] INFO: Scrape type for EL84394: 0
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: WG23357
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG23357%27 HTTP/1.1" 200 None
2026-03-29 08:36:14 [auto1.be] INFO: Scrape type for WG23357: 0
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: HP15544
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: PB67516
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: XB95573
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: ND89972
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: LG37246
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: JB70681
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB70681%27 HTTP/1.1" 200 None
2026-03-29 08:36:14 [auto1.be] INFO: Scrape type for JB70681: 0
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: JS91755
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS91755%27 HTTP/1.1" 200 None
2026-03-29 08:36:14 [auto1.be] INFO: Scrape type for JS91755: 0
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: EV46077
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV46077%27 HTTP/1.1" 200 None
2026-03-29 08:36:14 [auto1.be] INFO: Scrape type for EV46077: 0
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: FB34577
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: JV80966
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV80966%27 HTTP/1.1" 200 None
2026-03-29 08:36:14 [auto1.be] INFO: Scrape type for JV80966: 2
2026-03-29 08:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb7558e3-2cb4-5a8b-adea-0384455187d7 with identifier: JV80966
2026-03-29 08:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb7558e3-2cb4-5a8b-adea-0384455187d7 with scrape type 2
2026-03-29 08:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb7558e3-2cb4-5a8b-adea-0384455187d7 with scrape type 2
2026-03-29 08:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fb7558e3-2cb4-5a8b-adea-0384455187d7, identifier: JV80966
2026-03-29 08:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fb7558e3-2cb4-5a8b-adea-0384455187d7 with identifier: JV80966
2026-03-29 08:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fb7558e3-2cb4-5a8b-adea-0384455187d7 with identifier: JV80966
2026-03-29 08:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fb7558e3-2cb4-5a8b-adea-0384455187d7 with identifier: JV80966 to the API
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:59:28Z',
'fuel_type': 'diesel',
'id': 'fb7558e3-2cb4-5a8b-adea-0384455187d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV80966',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 118060,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-26',
'seller_name': None,
'title': 'Ford Focus 1.5 EcoBlue TDCi Cool&Connect',
'transmission': 'manual',
'trim': 'Cool&Connect',
'year': 2020}
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV80966%27 HTTP/1.1" 200 None
2026-03-29 08:36:14 [auto1.be] INFO: Saving data for JV80966: {'auction_closing_time': 1774886368.0, 'created_time': 1774557583.917276, 'last_price_update_time': 1774773374.583084}
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JV80966') HTTP/1.1" 204 0
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: GR79063
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR79063%27 HTTP/1.1" 200 None
2026-03-29 08:36:14 [auto1.be] INFO: Scrape type for GR79063: 0
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: PR27183
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR27183%27 HTTP/1.1" 200 None
2026-03-29 08:36:14 [auto1.be] INFO: Scrape type for PR27183: 2
2026-03-29 08:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f65751a-a9b9-53be-b964-58a154fdbf52 with identifier: PR27183
2026-03-29 08:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f65751a-a9b9-53be-b964-58a154fdbf52 with scrape type 2
2026-03-29 08:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f65751a-a9b9-53be-b964-58a154fdbf52 with scrape type 2
2026-03-29 08:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5f65751a-a9b9-53be-b964-58a154fdbf52, identifier: PR27183
2026-03-29 08:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5f65751a-a9b9-53be-b964-58a154fdbf52 with identifier: PR27183
2026-03-29 08:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5f65751a-a9b9-53be-b964-58a154fdbf52 with identifier: PR27183
2026-03-29 08:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5f65751a-a9b9-53be-b964-58a154fdbf52 with identifier: PR27183 to the API
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:04:47Z',
'fuel_type': 'diesel',
'id': '5f65751a-a9b9-53be-b964-58a154fdbf52',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR27183',
'listing': 'auction',
'make': 'Citroen',
'model': 'Jumpy',
'odometer': 162236,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-06',
'seller_name': None,
'title': 'Citroen Jumpy 1.6 HDi L1H1 27 Kasten',
'transmission': 'manual',
'trim': 'L1H1 27 Kasten',
'year': 2016}
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR27183%27 HTTP/1.1" 200 None
2026-03-29 08:36:16 [auto1.be] INFO: Saving data for PR27183: {'auction_closing_time': 1774883087.0, 'created_time': 1774557473.251058, 'last_price_update_time': 1774773376.085612}
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PR27183') HTTP/1.1" 204 0
2026-03-29 08:36:16 [auto1.be] INFO: Found listing with ID: KP74596
2026-03-29 08:36:16 [auto1.be] INFO: Found listing with ID: TL70885
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL70885%27 HTTP/1.1" 200 None
2026-03-29 08:36:16 [auto1.be] INFO: Scrape type for TL70885: 2
2026-03-29 08:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73ca0251-7234-5965-976e-1562d61880cc with identifier: TL70885
2026-03-29 08:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73ca0251-7234-5965-976e-1562d61880cc with scrape type 2
2026-03-29 08:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73ca0251-7234-5965-976e-1562d61880cc with scrape type 2
2026-03-29 08:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 73ca0251-7234-5965-976e-1562d61880cc, identifier: TL70885
2026-03-29 08:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 73ca0251-7234-5965-976e-1562d61880cc with identifier: TL70885
2026-03-29 08:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 73ca0251-7234-5965-976e-1562d61880cc with identifier: TL70885
2026-03-29 08:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 73ca0251-7234-5965-976e-1562d61880cc with identifier: TL70885 to the API
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 73,
'expiration_date': '2026-03-30T15:05:27Z',
'fuel_type': 'petrol',
'id': '73ca0251-7234-5965-976e-1562d61880cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL70885',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 118945,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-14',
'seller_name': None,
'title': 'Peugeot 207 1.4 Tendance',
'transmission': 'manual',
'trim': 'Tendance',
'year': 2009}
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL70885%27 HTTP/1.1" 200 None
2026-03-29 08:36:16 [auto1.be] INFO: Saving data for TL70885: {'auction_closing_time': 1774883127.0, 'created_time': 1774557549.57697, 'last_price_update_time': 1774773376.555361}
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TL70885') HTTP/1.1" 204 0
2026-03-29 08:36:16 [auto1.be] INFO: Found listing with ID: JW06840
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW06840%27 HTTP/1.1" 200 None
2026-03-29 08:36:16 [auto1.be] INFO: Scrape type for JW06840: 0
2026-03-29 08:36:16 [auto1.be] INFO: Found listing with ID: RR43173
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR43173%27 HTTP/1.1" 200 None
2026-03-29 08:36:16 [auto1.be] INFO: Scrape type for RR43173: 0
2026-03-29 08:36:16 [auto1.be] INFO: Found listing with ID: BN63741
2026-03-29 08:36:16 [auto1.be] INFO: Found listing with ID: NV81106
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV81106%27 HTTP/1.1" 200 None
2026-03-29 08:36:16 [auto1.be] INFO: Scrape type for NV81106: 0
2026-03-29 08:36:16 [auto1.be] INFO: Found listing with ID: GL29646
2026-03-29 08:36:16 [auto1.be] INFO: Found listing with ID: ZG73435
2026-03-29 08:36:16 [auto1.be] INFO: Found listing with ID: HS23763
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS23763%27 HTTP/1.1" 200 None
2026-03-29 08:36:16 [auto1.be] INFO: Scrape type for HS23763: 2
2026-03-29 08:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63c6c41d-00f3-5167-bdf6-b847dc50bb63 with identifier: HS23763
2026-03-29 08:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63c6c41d-00f3-5167-bdf6-b847dc50bb63 with scrape type 2
2026-03-29 08:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63c6c41d-00f3-5167-bdf6-b847dc50bb63 with scrape type 2
2026-03-29 08:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 63c6c41d-00f3-5167-bdf6-b847dc50bb63, identifier: HS23763
2026-03-29 08:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 63c6c41d-00f3-5167-bdf6-b847dc50bb63 with identifier: HS23763
2026-03-29 08:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 63c6c41d-00f3-5167-bdf6-b847dc50bb63 with identifier: HS23763
2026-03-29 08:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 63c6c41d-00f3-5167-bdf6-b847dc50bb63 with identifier: HS23763 to the API
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:26:28Z',
'fuel_type': 'diesel',
'id': '63c6c41d-00f3-5167-bdf6-b847dc50bb63',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS23763',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 162430,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-08',
'seller_name': None,
'title': 'Renault Megane 1.5 dCi Energy BOSE-Edition',
'transmission': 'automatic',
'trim': 'BOSE-Edition',
'year': 2017}
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS23763%27 HTTP/1.1" 200 None
2026-03-29 08:36:17 [auto1.be] INFO: Saving data for HS23763: {'auction_closing_time': 1774884388.0, 'created_time': 1774557458.303033, 'last_price_update_time': 1774773377.046153}
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HS23763') HTTP/1.1" 204 0
2026-03-29 08:36:17 [auto1.be] INFO: Found listing with ID: RA46458
2026-03-29 08:36:17 [auto1.be] INFO: Found listing with ID: VE53331
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE53331%27 HTTP/1.1" 200 None
2026-03-29 08:36:17 [auto1.be] INFO: Scrape type for VE53331: 2
2026-03-29 08:36:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3998579b-cd59-553e-b52c-f4016f7450c0 with identifier: VE53331
2026-03-29 08:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3998579b-cd59-553e-b52c-f4016f7450c0 with scrape type 2
2026-03-29 08:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3998579b-cd59-553e-b52c-f4016f7450c0 with scrape type 2
2026-03-29 08:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3998579b-cd59-553e-b52c-f4016f7450c0, identifier: VE53331
2026-03-29 08:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3998579b-cd59-553e-b52c-f4016f7450c0 with identifier: VE53331
2026-03-29 08:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3998579b-cd59-553e-b52c-f4016f7450c0 with identifier: VE53331
2026-03-29 08:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3998579b-cd59-553e-b52c-f4016f7450c0 with identifier: VE53331 to the API
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 132,
'expiration_date': '2026-03-30T15:23:38Z',
'fuel_type': 'petrol',
'id': '3998579b-cd59-553e-b52c-f4016f7450c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE53331',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 146236,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-16',
'seller_name': None,
'title': 'Hyundai Tucson 1.6 Comfort 2WD',
'transmission': 'manual',
'trim': 'Comfort 2WD',
'year': 2018}
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE53331%27 HTTP/1.1" 200 None
2026-03-29 08:36:17 [auto1.be] INFO: Saving data for VE53331: {'auction_closing_time': 1774884218.0, 'created_time': 1774557580.403077, 'last_price_update_time': 1774773377.553619}
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VE53331') HTTP/1.1" 204 0
2026-03-29 08:36:17 [auto1.be] INFO: Found listing with ID: HD23270
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HD23270%27 HTTP/1.1" 200 None
2026-03-29 08:36:17 [auto1.be] INFO: Scrape type for HD23270: 0
2026-03-29 08:36:17 [auto1.be] INFO: Found listing with ID: HP14917
2026-03-29 08:36:17 [auto1.be] INFO: Found listing with ID: WK92284
2026-03-29 08:36:17 [auto1.be] INFO: Found listing with ID: GX61337
2026-03-29 08:36:17 [auto1.be] INFO: Found listing with ID: UL34611
2026-03-29 08:36:17 [auto1.be] INFO: Found listing with ID: MW76341
2026-03-29 08:36:17 [auto1.be] INFO: Found listing with ID: AA49507
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AA49507%27 HTTP/1.1" 200 None
2026-03-29 08:36:17 [auto1.be] INFO: Scrape type for AA49507: 0
2026-03-29 08:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:18 [auto1.be] INFO: Channel: 24h | Page: 8 | totalHits: 1252 | hits on page: 40
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: EZ55101
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: TH53375
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: RH88749
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: LE66186
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: RK42644
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: AP73624
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: JV18684
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV18684%27 HTTP/1.1" 200 None
2026-03-29 08:36:18 [auto1.be] INFO: Scrape type for JV18684: 0
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: DF44974
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: DW87206
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: NY99560
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: NC25574
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: ZM46816
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: RY85405
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY85405%27 HTTP/1.1" 200 None
2026-03-29 08:36:18 [auto1.be] INFO: Scrape type for RY85405: 0
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: BA52354
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA52354%27 HTTP/1.1" 200 None
2026-03-29 08:36:18 [auto1.be] INFO: Scrape type for BA52354: 0
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: NG50909
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: TU47744
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: GD11285
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: UC23117
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC23117%27 HTTP/1.1" 200 None
2026-03-29 08:36:18 [auto1.be] INFO: Scrape type for UC23117: 0
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: RS46918
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS46918%27 HTTP/1.1" 200 None
2026-03-29 08:36:18 [auto1.be] INFO: Scrape type for RS46918: 0
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: GF24104
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF24104%27 HTTP/1.1" 200 None
2026-03-29 08:36:18 [auto1.be] INFO: Scrape type for GF24104: 0
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: NG90127
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: PJ82537
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ82537%27 HTTP/1.1" 200 None
2026-03-29 08:36:18 [auto1.be] INFO: Scrape type for PJ82537: 0
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: BT94428
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT94428%27 HTTP/1.1" 200 None
2026-03-29 08:36:18 [auto1.be] INFO: Scrape type for BT94428: 0
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: WC55286
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC55286%27 HTTP/1.1" 200 None
2026-03-29 08:36:18 [auto1.be] INFO: Scrape type for WC55286: 0
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: CC17071
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: KH63709
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: YN02015
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: MG81689
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG81689%27 HTTP/1.1" 200 None
2026-03-29 08:36:18 [auto1.be] INFO: Scrape type for MG81689: 0
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: VW32861
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: PE83293
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: WA92632
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: ZL15279
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL15279%27 HTTP/1.1" 200 None
2026-03-29 08:36:18 [auto1.be] INFO: Scrape type for ZL15279: 0
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: RW14221
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: WV47829
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: AK54797
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: LK29098
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: YP74524
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YP74524%27 HTTP/1.1" 200 None
2026-03-29 08:36:18 [auto1.be] INFO: Scrape type for YP74524: 0
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: YG22909
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: DY69036
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: BP14655
2026-03-29 08:36:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SJ26894> (referer: https://www.auto1.com/v1/car-details-view/SJ26894/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9292186-a00f-57a4-bfcf-5aeb81d47889 with identifier: SJ26894
2026-03-29 08:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9292186-a00f-57a4-bfcf-5aeb81d47889 with scrape type 1
2026-03-29 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a9292186-a00f-57a4-bfcf-5aeb81d47889
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Ff5%252F81f5a73a1fa42eebc1ea5583a02de404%252Fpa%252FSJ26894_0ebe22dcfa77044fa74e2c782ce0e18b.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/f5/81f5a73a1fa42eebc1ea5583a02de404/pa/SJ26894_0ebe22dcfa77044fa74e2c782ce0e18b.jpg already downloaded
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Ff5%252F81f5a73a1fa42eebc1ea5583a02de404%252Fpa%252FSJ26894_38c0aaefbfeeb861a060ae0ce43b9396.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/f5/81f5a73a1fa42eebc1ea5583a02de404/pa/SJ26894_38c0aaefbfeeb861a060ae0ce43b9396.jpg already downloaded
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Ff5%252F81f5a73a1fa42eebc1ea5583a02de404%252Fpa%252FSJ26894_3a1a63fd5dc0fd408eaf041ba4f83f16.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/f5/81f5a73a1fa42eebc1ea5583a02de404/pa/SJ26894_3a1a63fd5dc0fd408eaf041ba4f83f16.jpg already downloaded
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Ff5%252F81f5a73a1fa42eebc1ea5583a02de404%252Fpa%252FSJ26894_f70f13f324dfa02c3b96cbf32634bd88.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/f5/81f5a73a1fa42eebc1ea5583a02de404/pa/SJ26894_f70f13f324dfa02c3b96cbf32634bd88.jpg already downloaded
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Ff5%252F81f5a73a1fa42eebc1ea5583a02de404%252Fpa%252FSJ26894_778b6b09bff5001f9961919446c32050.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/f5/81f5a73a1fa42eebc1ea5583a02de404/pa/SJ26894_778b6b09bff5001f9961919446c32050.jpg already downloaded
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Ff5%252F81f5a73a1fa42eebc1ea5583a02de404%252Fpa%252FSJ26894_a28a9bfb7b36c8d03a727f20007386b9.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/f5/81f5a73a1fa42eebc1ea5583a02de404/pa/SJ26894_a28a9bfb7b36c8d03a727f20007386b9.jpg already downloaded
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Ff5%252F81f5a73a1fa42eebc1ea5583a02de404%252Fpa%252FSJ26894_0862e0637a874badf59dd92a20286ce6.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/f5/81f5a73a1fa42eebc1ea5583a02de404/pa/SJ26894_0862e0637a874badf59dd92a20286ce6.jpg already downloaded
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Ff5%252F81f5a73a1fa42eebc1ea5583a02de404%252Fpa%252FSJ26894_68695f1ae1bcf5cadeebf00b735684f7.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/f5/81f5a73a1fa42eebc1ea5583a02de404/pa/SJ26894_68695f1ae1bcf5cadeebf00b735684f7.jpg already downloaded
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Ff5%252F81f5a73a1fa42eebc1ea5583a02de404%252Fpa%252FSJ26894_50b9e62a0e19e3bf3dbaf4ba23fecc85.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/f5/81f5a73a1fa42eebc1ea5583a02de404/pa/SJ26894_50b9e62a0e19e3bf3dbaf4ba23fecc85.jpg already downloaded
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Ff5%252F81f5a73a1fa42eebc1ea5583a02de404%252Fpa%252FSJ26894_2b5bdcb0cc35169bcf3989e064abf4ce.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/f5/81f5a73a1fa42eebc1ea5583a02de404/pa/SJ26894_2b5bdcb0cc35169bcf3989e064abf4ce.jpg already downloaded
2026-03-29 08:36:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a9292186-a00f-57a4-bfcf-5aeb81d47889, identifier: SJ26894
2026-03-29 08:36:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a9292186-a00f-57a4-bfcf-5aeb81d47889 with identifier: SJ26894
2026-03-29 08:36:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a9292186-a00f-57a4-bfcf-5aeb81d47889 with identifier: SJ26894
2026-03-29 08:36:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a9292186-a00f-57a4-bfcf-5aeb81d47889 with identifier: SJ26894 to the API
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SJ26894>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 92,
'expiration_date': '2026-03-30T15:36:37Z',
'fuel_type': 'diesel',
'id': 'a9292186-a00f-57a4-bfcf-5aeb81d47889',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ26894',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Peugeot',
'model': '208',
'odometer': 119376,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 14,
'photo_urls': ['https://img-pa.auto1.com/img81/f5/81f5a73a1fa42eebc1ea5583a02de404/pa/SJ26894_0ebe22dcfa77044fa74e2c782ce0e18b.jpg',
'https://img-pa.auto1.com/img81/f5/81f5a73a1fa42eebc1ea5583a02de404/pa/SJ26894_38c0aaefbfeeb861a060ae0ce43b9396.jpg',
'https://img-pa.auto1.com/img81/f5/81f5a73a1fa42eebc1ea5583a02de404/pa/SJ26894_3a1a63fd5dc0fd408eaf041ba4f83f16.jpg',
'https://img-pa.auto1.com/img81/f5/81f5a73a1fa42eebc1ea5583a02de404/pa/SJ26894_f70f13f324dfa02c3b96cbf32634bd88.jpg',
'https://img-pa.auto1.com/img81/f5/81f5a73a1fa42eebc1ea5583a02de404/pa/SJ26894_778b6b09bff5001f9961919446c32050.jpg',
'https://img-pa.auto1.com/img81/f5/81f5a73a1fa42eebc1ea5583a02de404/pa/SJ26894_a28a9bfb7b36c8d03a727f20007386b9.jpg',
'https://img-pa.auto1.com/img81/f5/81f5a73a1fa42eebc1ea5583a02de404/pa/SJ26894_0862e0637a874badf59dd92a20286ce6.jpg',
'https://img-pa.auto1.com/img81/f5/81f5a73a1fa42eebc1ea5583a02de404/pa/SJ26894_68695f1ae1bcf5cadeebf00b735684f7.jpg',
'https://img-pa.auto1.com/img81/f5/81f5a73a1fa42eebc1ea5583a02de404/pa/SJ26894_50b9e62a0e19e3bf3dbaf4ba23fecc85.jpg',
'https://img-pa.auto1.com/img81/f5/81f5a73a1fa42eebc1ea5583a02de404/pa/SJ26894_2b5bdcb0cc35169bcf3989e064abf4ce.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9292186-a00f-57a4-bfcf-5aeb81d47889/a9292186-a00f-57a4-bfcf-5aeb81d47889_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94480,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/f5/81f5a73a1fa42eebc1ea5583a02de404/pa/SJ26894_0ebe22dcfa77044fa74e2c782ce0e18b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9292186-a00f-57a4-bfcf-5aeb81d47889/a9292186-a00f-57a4-bfcf-5aeb81d47889_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87290,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/f5/81f5a73a1fa42eebc1ea5583a02de404/pa/SJ26894_38c0aaefbfeeb861a060ae0ce43b9396.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9292186-a00f-57a4-bfcf-5aeb81d47889/a9292186-a00f-57a4-bfcf-5aeb81d47889_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73412,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/f5/81f5a73a1fa42eebc1ea5583a02de404/pa/SJ26894_3a1a63fd5dc0fd408eaf041ba4f83f16.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9292186-a00f-57a4-bfcf-5aeb81d47889/a9292186-a00f-57a4-bfcf-5aeb81d47889_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77182,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/f5/81f5a73a1fa42eebc1ea5583a02de404/pa/SJ26894_f70f13f324dfa02c3b96cbf32634bd88.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9292186-a00f-57a4-bfcf-5aeb81d47889/a9292186-a00f-57a4-bfcf-5aeb81d47889_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81582,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/f5/81f5a73a1fa42eebc1ea5583a02de404/pa/SJ26894_778b6b09bff5001f9961919446c32050.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9292186-a00f-57a4-bfcf-5aeb81d47889/a9292186-a00f-57a4-bfcf-5aeb81d47889_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77801,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/f5/81f5a73a1fa42eebc1ea5583a02de404/pa/SJ26894_a28a9bfb7b36c8d03a727f20007386b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9292186-a00f-57a4-bfcf-5aeb81d47889/a9292186-a00f-57a4-bfcf-5aeb81d47889_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68996,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/f5/81f5a73a1fa42eebc1ea5583a02de404/pa/SJ26894_0862e0637a874badf59dd92a20286ce6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9292186-a00f-57a4-bfcf-5aeb81d47889/a9292186-a00f-57a4-bfcf-5aeb81d47889_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90271,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/f5/81f5a73a1fa42eebc1ea5583a02de404/pa/SJ26894_68695f1ae1bcf5cadeebf00b735684f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9292186-a00f-57a4-bfcf-5aeb81d47889/a9292186-a00f-57a4-bfcf-5aeb81d47889_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84245,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/f5/81f5a73a1fa42eebc1ea5583a02de404/pa/SJ26894_50b9e62a0e19e3bf3dbaf4ba23fecc85.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9292186-a00f-57a4-bfcf-5aeb81d47889/a9292186-a00f-57a4-bfcf-5aeb81d47889_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73946,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/f5/81f5a73a1fa42eebc1ea5583a02de404/pa/SJ26894_2b5bdcb0cc35169bcf3989e064abf4ce.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-01-30',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.6 HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2014}
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ26894%27 HTTP/1.1" 200 None
2026-03-29 08:36:19 [auto1.be] INFO: Saving data for SJ26894: {'created_time': 1774773379.111647, 'last_price_update_time': 1774773379.111656, 'auction_closing_time': 1774884997.0}
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SJ26894') HTTP/1.1" 204 0
2026-03-29 08:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:20 [auto1.be] INFO: Channel: 24h | Page: 9 | totalHits: 1252 | hits on page: 40
2026-03-29 08:36:20 [auto1.be] INFO: Found listing with ID: RZ47312
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ47312%27 HTTP/1.1" 200 None
2026-03-29 08:36:20 [auto1.be] INFO: Scrape type for RZ47312: 2
2026-03-29 08:36:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 522ac188-a2f0-54c8-8094-c7986a060761 with identifier: RZ47312
2026-03-29 08:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 522ac188-a2f0-54c8-8094-c7986a060761 with scrape type 2
2026-03-29 08:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 522ac188-a2f0-54c8-8094-c7986a060761 with scrape type 2
2026-03-29 08:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 522ac188-a2f0-54c8-8094-c7986a060761, identifier: RZ47312
2026-03-29 08:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 522ac188-a2f0-54c8-8094-c7986a060761 with identifier: RZ47312
2026-03-29 08:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 522ac188-a2f0-54c8-8094-c7986a060761 with identifier: RZ47312
2026-03-29 08:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 522ac188-a2f0-54c8-8094-c7986a060761 with identifier: RZ47312 to the API
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:10:30Z',
'fuel_type': 'petrol',
'id': '522ac188-a2f0-54c8-8094-c7986a060761',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ47312',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 153502,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-23',
'seller_name': None,
'title': 'Renault Clio 0.9 Iconic',
'transmission': 'manual',
'trim': 'Iconic',
'year': 2016}
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ47312%27 HTTP/1.1" 200 None
2026-03-29 08:36:20 [auto1.be] INFO: Saving data for RZ47312: {'auction_closing_time': 1774883430.0, 'created_time': 1774557528.859222, 'last_price_update_time': 1774773380.660492}
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RZ47312') HTTP/1.1" 204 0
2026-03-29 08:36:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:20 [auto1.be] INFO: Found listing with ID: ND78338
2026-03-29 08:36:20 [auto1.be] INFO: Found listing with ID: LK55982
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK55982%27 HTTP/1.1" 200 None
2026-03-29 08:36:20 [auto1.be] INFO: Scrape type for LK55982: 0
2026-03-29 08:36:20 [auto1.be] INFO: Found listing with ID: DW77345
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW77345%27 HTTP/1.1" 200 None
2026-03-29 08:36:20 [auto1.be] INFO: Scrape type for DW77345: 0
2026-03-29 08:36:20 [auto1.be] INFO: Found listing with ID: NN42853
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN42853%27 HTTP/1.1" 200 None
2026-03-29 08:36:20 [auto1.be] INFO: Scrape type for NN42853: 0
2026-03-29 08:36:20 [auto1.be] INFO: Found listing with ID: CS90165
2026-03-29 08:36:20 [auto1.be] INFO: Found listing with ID: LA76788
2026-03-29 08:36:20 [auto1.be] INFO: Found listing with ID: HB19534
2026-03-29 08:36:20 [auto1.be] INFO: Found listing with ID: AY47657
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY47657%27 HTTP/1.1" 200 None
2026-03-29 08:36:20 [auto1.be] INFO: Scrape type for AY47657: 0
2026-03-29 08:36:20 [auto1.be] INFO: Found listing with ID: BU27000
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU27000%27 HTTP/1.1" 200 None
2026-03-29 08:36:20 [auto1.be] INFO: Scrape type for BU27000: 0
2026-03-29 08:36:20 [auto1.be] INFO: Found listing with ID: PL61351
2026-03-29 08:36:20 [auto1.be] INFO: Found listing with ID: AE13452
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE13452%27 HTTP/1.1" 200 None
2026-03-29 08:36:20 [auto1.be] INFO: Scrape type for AE13452: 0
2026-03-29 08:36:20 [auto1.be] INFO: Found listing with ID: FG26500
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG26500%27 HTTP/1.1" 200 None
2026-03-29 08:36:20 [auto1.be] INFO: Scrape type for FG26500: 0
2026-03-29 08:36:20 [auto1.be] INFO: Found listing with ID: MC44479
2026-03-29 08:36:20 [auto1.be] INFO: Found listing with ID: WP32655
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP32655%27 HTTP/1.1" 200 None
2026-03-29 08:36:20 [auto1.be] INFO: Scrape type for WP32655: 0
2026-03-29 08:36:20 [auto1.be] INFO: Found listing with ID: SC04496
2026-03-29 08:36:20 [auto1.be] INFO: Found listing with ID: CC56747
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC56747%27 HTTP/1.1" 200 None
2026-03-29 08:36:20 [auto1.be] INFO: Scrape type for CC56747: 2
2026-03-29 08:36:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79a1b969-fbb5-57df-a009-0ca297dac6f2 with identifier: CC56747
2026-03-29 08:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79a1b969-fbb5-57df-a009-0ca297dac6f2 with scrape type 2
2026-03-29 08:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79a1b969-fbb5-57df-a009-0ca297dac6f2 with scrape type 2
2026-03-29 08:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 79a1b969-fbb5-57df-a009-0ca297dac6f2, identifier: CC56747
2026-03-29 08:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 79a1b969-fbb5-57df-a009-0ca297dac6f2 with identifier: CC56747
2026-03-29 08:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 79a1b969-fbb5-57df-a009-0ca297dac6f2 with identifier: CC56747
2026-03-29 08:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 79a1b969-fbb5-57df-a009-0ca297dac6f2 with identifier: CC56747 to the API
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:44:55Z',
'fuel_type': 'diesel',
'id': '79a1b969-fbb5-57df-a009-0ca297dac6f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC56747',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 152936,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-04',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Highline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Highline BlueMotion Tech',
'year': 2016}
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC56747%27 HTTP/1.1" 200 None
2026-03-29 08:36:21 [auto1.be] INFO: Saving data for CC56747: {'auction_closing_time': 1774885495.0, 'created_time': 1774557540.286488, 'last_price_update_time': 1774773381.205012}
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CC56747') HTTP/1.1" 204 0
2026-03-29 08:36:21 [auto1.be] INFO: Found listing with ID: XJ47711
2026-03-29 08:36:21 [auto1.be] INFO: Found listing with ID: CK49467
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK49467%27 HTTP/1.1" 200 None
2026-03-29 08:36:21 [auto1.be] INFO: Scrape type for CK49467: 0
2026-03-29 08:36:21 [auto1.be] INFO: Found listing with ID: JA34397
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JA34397%27 HTTP/1.1" 200 None
2026-03-29 08:36:21 [auto1.be] INFO: Scrape type for JA34397: 0
2026-03-29 08:36:21 [auto1.be] INFO: Found listing with ID: XC31503
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC31503%27 HTTP/1.1" 200 None
2026-03-29 08:36:21 [auto1.be] INFO: Scrape type for XC31503: 2
2026-03-29 08:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20fb55a4-bc54-58df-bbe8-bd3234b9e464 with identifier: XC31503
2026-03-29 08:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20fb55a4-bc54-58df-bbe8-bd3234b9e464 with scrape type 2
2026-03-29 08:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20fb55a4-bc54-58df-bbe8-bd3234b9e464 with scrape type 2
2026-03-29 08:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 20fb55a4-bc54-58df-bbe8-bd3234b9e464, identifier: XC31503
2026-03-29 08:36:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 20fb55a4-bc54-58df-bbe8-bd3234b9e464 with identifier: XC31503
2026-03-29 08:36:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 20fb55a4-bc54-58df-bbe8-bd3234b9e464 with identifier: XC31503
2026-03-29 08:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 20fb55a4-bc54-58df-bbe8-bd3234b9e464 with identifier: XC31503 to the API
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:19:43Z',
'fuel_type': 'petrol',
'id': '20fb55a4-bc54-58df-bbe8-bd3234b9e464',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC31503',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 130320,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-12',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2018}
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC31503%27 HTTP/1.1" 200 None
2026-03-29 08:36:21 [auto1.be] INFO: Saving data for XC31503: {'auction_closing_time': 1774883983.0, 'created_time': 1774557558.5286, 'last_price_update_time': 1774773381.72787}
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XC31503') HTTP/1.1" 204 0
2026-03-29 08:36:21 [auto1.be] INFO: Found listing with ID: LE58292
2026-03-29 08:36:21 [auto1.be] INFO: Found listing with ID: DL17322
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL17322%27 HTTP/1.1" 200 None
2026-03-29 08:36:21 [auto1.be] INFO: Scrape type for DL17322: 0
2026-03-29 08:36:21 [auto1.be] INFO: Found listing with ID: SE12861
2026-03-29 08:36:21 [auto1.be] INFO: Found listing with ID: BJ27729
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ27729%27 HTTP/1.1" 200 None
2026-03-29 08:36:21 [auto1.be] INFO: Scrape type for BJ27729: 0
2026-03-29 08:36:21 [auto1.be] INFO: Found listing with ID: EN18719
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN18719%27 HTTP/1.1" 200 None
2026-03-29 08:36:21 [auto1.be] INFO: Scrape type for EN18719: 0
2026-03-29 08:36:21 [auto1.be] INFO: Found listing with ID: DP96573
2026-03-29 08:36:21 [auto1.be] INFO: Found listing with ID: YM63500
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM63500%27 HTTP/1.1" 200 None
2026-03-29 08:36:21 [auto1.be] INFO: Scrape type for YM63500: 0
2026-03-29 08:36:21 [auto1.be] INFO: Found listing with ID: WH07577
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH07577%27 HTTP/1.1" 200 None
2026-03-29 08:36:21 [auto1.be] INFO: Scrape type for WH07577: 2
2026-03-29 08:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7da79ca0-21e1-5e34-bca8-668ba4bbcf64 with identifier: WH07577
2026-03-29 08:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7da79ca0-21e1-5e34-bca8-668ba4bbcf64 with scrape type 2
2026-03-29 08:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7da79ca0-21e1-5e34-bca8-668ba4bbcf64 with scrape type 2
2026-03-29 08:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7da79ca0-21e1-5e34-bca8-668ba4bbcf64, identifier: WH07577
2026-03-29 08:36:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7da79ca0-21e1-5e34-bca8-668ba4bbcf64 with identifier: WH07577
2026-03-29 08:36:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7da79ca0-21e1-5e34-bca8-668ba4bbcf64 with identifier: WH07577
2026-03-29 08:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7da79ca0-21e1-5e34-bca8-668ba4bbcf64 with identifier: WH07577 to the API
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:54:10Z',
'fuel_type': 'petrol',
'id': '7da79ca0-21e1-5e34-bca8-668ba4bbcf64',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH07577',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3 Sportback',
'odometer': 91621,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-01',
'seller_name': None,
'title': 'Audi Q3 Sportback 35 TFSI Mild-Hybrid ACT',
'transmission': 'automatic',
'trim': 'ACT',
'year': 2022}
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH07577%27 HTTP/1.1" 200 None
2026-03-29 08:36:22 [auto1.be] INFO: Saving data for WH07577: {'auction_closing_time': 1774886050.0, 'created_time': 1774557541.521377, 'last_price_update_time': 1774773382.23102}
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WH07577') HTTP/1.1" 204 0
2026-03-29 08:36:22 [auto1.be] INFO: Found listing with ID: LJ91533
2026-03-29 08:36:22 [auto1.be] INFO: Found listing with ID: TY52799
2026-03-29 08:36:22 [auto1.be] INFO: Found listing with ID: EM18277
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM18277%27 HTTP/1.1" 200 None
2026-03-29 08:36:22 [auto1.be] INFO: Scrape type for EM18277: 0
2026-03-29 08:36:22 [auto1.be] INFO: Found listing with ID: XJ49438
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ49438%27 HTTP/1.1" 200 None
2026-03-29 08:36:22 [auto1.be] INFO: Scrape type for XJ49438: 0
2026-03-29 08:36:22 [auto1.be] INFO: Found listing with ID: ZB59407
2026-03-29 08:36:22 [auto1.be] INFO: Found listing with ID: YW29468
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW29468%27 HTTP/1.1" 200 None
2026-03-29 08:36:22 [auto1.be] INFO: Scrape type for YW29468: 0
2026-03-29 08:36:22 [auto1.be] INFO: Found listing with ID: NU46591
2026-03-29 08:36:22 [auto1.be] INFO: Found listing with ID: AS01915
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AS01915%27 HTTP/1.1" 200 None
2026-03-29 08:36:22 [auto1.be] INFO: Scrape type for AS01915: 0
2026-03-29 08:36:22 [auto1.be] INFO: Found listing with ID: AB44644
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB44644%27 HTTP/1.1" 200 None
2026-03-29 08:36:22 [auto1.be] INFO: Scrape type for AB44644: 0
2026-03-29 08:36:22 [auto1.be] INFO: Found listing with ID: XM93272
2026-03-29 08:36:22 [auto1.be] INFO: Found listing with ID: TL07516
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL07516%27 HTTP/1.1" 200 None
2026-03-29 08:36:22 [auto1.be] INFO: Scrape type for TL07516: 2
2026-03-29 08:36:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64d1b045-7053-5402-a147-86c043a03d45 with identifier: TL07516
2026-03-29 08:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64d1b045-7053-5402-a147-86c043a03d45 with scrape type 2
2026-03-29 08:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64d1b045-7053-5402-a147-86c043a03d45 with scrape type 2
2026-03-29 08:36:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 64d1b045-7053-5402-a147-86c043a03d45, identifier: TL07516
2026-03-29 08:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 64d1b045-7053-5402-a147-86c043a03d45 with identifier: TL07516
2026-03-29 08:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 64d1b045-7053-5402-a147-86c043a03d45 with identifier: TL07516
2026-03-29 08:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 64d1b045-7053-5402-a147-86c043a03d45 with identifier: TL07516 to the API
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 55,
'expiration_date': '2026-03-30T15:41:40Z',
'fuel_type': 'petrol',
'id': '64d1b045-7053-5402-a147-86c043a03d45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL07516',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 126427,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-04-15',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2007}
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL07516%27 HTTP/1.1" 200 None
2026-03-29 08:36:22 [auto1.be] INFO: Saving data for TL07516: {'auction_closing_time': 1774885300.0, 'created_time': 1774557554.058786, 'last_price_update_time': 1774773382.900445}
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TL07516') HTTP/1.1" 204 0
2026-03-29 08:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:23 [auto1.be] INFO: Channel: 24h | Page: 10 | totalHits: 1252 | hits on page: 40
2026-03-29 08:36:23 [auto1.be] INFO: Found listing with ID: JK00802
2026-03-29 08:36:23 [auto1.be] INFO: Found listing with ID: CS76215
2026-03-29 08:36:23 [auto1.be] INFO: Found listing with ID: WD81319
2026-03-29 08:36:23 [auto1.be] INFO: Found listing with ID: WA82695
2026-03-29 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA82695%27 HTTP/1.1" 200 None
2026-03-29 08:36:23 [auto1.be] INFO: Scrape type for WA82695: 0
2026-03-29 08:36:23 [auto1.be] INFO: Found listing with ID: ZM54310
2026-03-29 08:36:23 [auto1.be] INFO: Found listing with ID: AF68960
2026-03-29 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF68960%27 HTTP/1.1" 200 None
2026-03-29 08:36:23 [auto1.be] INFO: Scrape type for AF68960: 0
2026-03-29 08:36:23 [auto1.be] INFO: Found listing with ID: RW94228
2026-03-29 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW94228%27 HTTP/1.1" 200 None
2026-03-29 08:36:23 [auto1.be] INFO: Scrape type for RW94228: 0
2026-03-29 08:36:23 [auto1.be] INFO: Found listing with ID: FE52220
2026-03-29 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE52220%27 HTTP/1.1" 200 None
2026-03-29 08:36:24 [auto1.be] INFO: Scrape type for FE52220: 0
2026-03-29 08:36:24 [auto1.be] INFO: Found listing with ID: MZ83142
2026-03-29 08:36:24 [auto1.be] INFO: Found listing with ID: YG62523
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG62523%27 HTTP/1.1" 200 None
2026-03-29 08:36:24 [auto1.be] INFO: Scrape type for YG62523: 0
2026-03-29 08:36:24 [auto1.be] INFO: Found listing with ID: CA72484
2026-03-29 08:36:24 [auto1.be] INFO: Found listing with ID: XK61886
2026-03-29 08:36:24 [auto1.be] INFO: Found listing with ID: VU61418
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU61418%27 HTTP/1.1" 200 None
2026-03-29 08:36:24 [auto1.be] INFO: Scrape type for VU61418: 0
2026-03-29 08:36:24 [auto1.be] INFO: Found listing with ID: ZF47475
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF47475%27 HTTP/1.1" 200 None
2026-03-29 08:36:24 [auto1.be] INFO: Scrape type for ZF47475: 0
2026-03-29 08:36:24 [auto1.be] INFO: Found listing with ID: XC82229
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC82229%27 HTTP/1.1" 200 None
2026-03-29 08:36:24 [auto1.be] INFO: Scrape type for XC82229: 0
2026-03-29 08:36:24 [auto1.be] INFO: Found listing with ID: SD60477
2026-03-29 08:36:24 [auto1.be] INFO: Found listing with ID: PP48497
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PP48497%27 HTTP/1.1" 200 None
2026-03-29 08:36:24 [auto1.be] INFO: Scrape type for PP48497: 0
2026-03-29 08:36:24 [auto1.be] INFO: Found listing with ID: YB47559
2026-03-29 08:36:24 [auto1.be] INFO: Found listing with ID: PT26763
2026-03-29 08:36:24 [auto1.be] INFO: Found listing with ID: PN18532
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN18532%27 HTTP/1.1" 200 None
2026-03-29 08:36:24 [auto1.be] INFO: Scrape type for PN18532: 0
2026-03-29 08:36:24 [auto1.be] INFO: Found listing with ID: VD09174
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VD09174%27 HTTP/1.1" 200 None
2026-03-29 08:36:24 [auto1.be] INFO: Scrape type for VD09174: 0
2026-03-29 08:36:24 [auto1.be] INFO: Found listing with ID: DH81993
2026-03-29 08:36:24 [auto1.be] INFO: Found listing with ID: FY33898
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY33898%27 HTTP/1.1" 200 None
2026-03-29 08:36:24 [auto1.be] INFO: Scrape type for FY33898: 0
2026-03-29 08:36:24 [auto1.be] INFO: Found listing with ID: ST89131
2026-03-29 08:36:24 [auto1.be] INFO: Found listing with ID: TU68669
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU68669%27 HTTP/1.1" 200 None
2026-03-29 08:36:24 [auto1.be] INFO: Scrape type for TU68669: 0
2026-03-29 08:36:24 [auto1.be] INFO: Found listing with ID: PC96861
2026-03-29 08:36:24 [auto1.be] INFO: Found listing with ID: PH64665
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH64665%27 HTTP/1.1" 200 None
2026-03-29 08:36:24 [auto1.be] INFO: Scrape type for PH64665: 0
2026-03-29 08:36:24 [auto1.be] INFO: Found listing with ID: RH07818
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH07818%27 HTTP/1.1" 200 None
2026-03-29 08:36:24 [auto1.be] INFO: Scrape type for RH07818: 0
2026-03-29 08:36:24 [auto1.be] INFO: Found listing with ID: LT97220
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT97220%27 HTTP/1.1" 200 None
2026-03-29 08:36:24 [auto1.be] INFO: Scrape type for LT97220: 0
2026-03-29 08:36:24 [auto1.be] INFO: Found listing with ID: ML35155
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML35155%27 HTTP/1.1" 200 None
2026-03-29 08:36:24 [auto1.be] INFO: Scrape type for ML35155: 0
2026-03-29 08:36:24 [auto1.be] INFO: Found listing with ID: UB84637
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB84637%27 HTTP/1.1" 200 None
2026-03-29 08:36:24 [auto1.be] INFO: Scrape type for UB84637: 2
2026-03-29 08:36:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68da693b-5610-5786-addd-9fe7fcbc7473 with identifier: UB84637
2026-03-29 08:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68da693b-5610-5786-addd-9fe7fcbc7473 with scrape type 2
2026-03-29 08:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68da693b-5610-5786-addd-9fe7fcbc7473 with scrape type 2
2026-03-29 08:36:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 68da693b-5610-5786-addd-9fe7fcbc7473, identifier: UB84637
2026-03-29 08:36:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 68da693b-5610-5786-addd-9fe7fcbc7473 with identifier: UB84637
2026-03-29 08:36:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 68da693b-5610-5786-addd-9fe7fcbc7473 with identifier: UB84637
2026-03-29 08:36:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 68da693b-5610-5786-addd-9fe7fcbc7473 with identifier: UB84637 to the API
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 174,
'expiration_date': '2026-03-30T15:15:58Z',
'fuel_type': 'diesel',
'id': '68da693b-5610-5786-addd-9fe7fcbc7473',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB84637',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Grand Sport',
'odometer': 49845,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-21',
'seller_name': None,
'title': 'Opel Insignia Grand Sport 2.0 CDTI Ultimate',
'transmission': 'automatic',
'trim': 'Ultimate',
'year': 2021}
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB84637%27 HTTP/1.1" 200 None
2026-03-29 08:36:24 [auto1.be] INFO: Saving data for UB84637: {'auction_closing_time': 1774883758.0, 'created_time': 1774557581.440424, 'last_price_update_time': 1774773384.620966}
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UB84637') HTTP/1.1" 204 0
2026-03-29 08:36:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:24 [auto1.be] INFO: Found listing with ID: XJ82974
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ82974%27 HTTP/1.1" 200 None
2026-03-29 08:36:24 [auto1.be] INFO: Scrape type for XJ82974: 2
2026-03-29 08:36:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1742d93-7462-576b-bc9f-40c1ddd0ac02 with identifier: XJ82974
2026-03-29 08:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1742d93-7462-576b-bc9f-40c1ddd0ac02 with scrape type 2
2026-03-29 08:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1742d93-7462-576b-bc9f-40c1ddd0ac02 with scrape type 2
2026-03-29 08:36:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d1742d93-7462-576b-bc9f-40c1ddd0ac02, identifier: XJ82974
2026-03-29 08:36:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d1742d93-7462-576b-bc9f-40c1ddd0ac02 with identifier: XJ82974
2026-03-29 08:36:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d1742d93-7462-576b-bc9f-40c1ddd0ac02 with identifier: XJ82974
2026-03-29 08:36:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d1742d93-7462-576b-bc9f-40c1ddd0ac02 with identifier: XJ82974 to the API
2026-03-29 08:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:33:38Z',
'fuel_type': 'petrol',
'id': 'd1742d93-7462-576b-bc9f-40c1ddd0ac02',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ82974',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 80186,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-27',
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2016}
2026-03-29 08:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ82974%27 HTTP/1.1" 200 None
2026-03-29 08:36:25 [auto1.be] INFO: Saving data for XJ82974: {'auction_closing_time': 1774884818.0, 'created_time': 1774557500.710287, 'last_price_update_time': 1774773385.148751}
2026-03-29 08:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XJ82974') HTTP/1.1" 204 0
2026-03-29 08:36:25 [auto1.be] INFO: Found listing with ID: YV36261
2026-03-29 08:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV36261%27 HTTP/1.1" 200 None
2026-03-29 08:36:25 [auto1.be] INFO: Scrape type for YV36261: 0
2026-03-29 08:36:25 [auto1.be] INFO: Found listing with ID: MB19665
2026-03-29 08:36:25 [auto1.be] INFO: Found listing with ID: SJ78748
2026-03-29 08:36:25 [auto1.be] INFO: Found listing with ID: UM90025
2026-03-29 08:36:25 [auto1.be] INFO: Found listing with ID: NC04706
2026-03-29 08:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC04706%27 HTTP/1.1" 200 None
2026-03-29 08:36:25 [auto1.be] INFO: Scrape type for NC04706: 0
2026-03-29 08:36:25 [auto1.be] INFO: Found listing with ID: CD06973
2026-03-29 08:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD06973%27 HTTP/1.1" 200 None
2026-03-29 08:36:25 [auto1.be] INFO: Scrape type for CD06973: 0
2026-03-29 08:36:25 [auto1.be] INFO: Found listing with ID: LW74134
2026-03-29 08:36:25 [auto1.be] INFO: Found listing with ID: AM54260
2026-03-29 08:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FC05247/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:26 [auto1.be] INFO: Channel: 24h | Page: 11 | totalHits: 1252 | hits on page: 40
2026-03-29 08:36:26 [auto1.be] INFO: Found listing with ID: WP77061
2026-03-29 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP77061%27 HTTP/1.1" 200 None
2026-03-29 08:36:26 [auto1.be] INFO: Scrape type for WP77061: 0
2026-03-29 08:36:26 [auto1.be] INFO: Found listing with ID: WE68493
2026-03-29 08:36:26 [auto1.be] INFO: Found listing with ID: TK93480
2026-03-29 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK93480%27 HTTP/1.1" 200 None
2026-03-29 08:36:26 [auto1.be] INFO: Scrape type for TK93480: 0
2026-03-29 08:36:26 [auto1.be] INFO: Found listing with ID: ZJ47299
2026-03-29 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ47299%27 HTTP/1.1" 200 None
2026-03-29 08:36:26 [auto1.be] INFO: Scrape type for ZJ47299: 0
2026-03-29 08:36:26 [auto1.be] INFO: Found listing with ID: JJ10339
2026-03-29 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ10339%27 HTTP/1.1" 200 None
2026-03-29 08:36:26 [auto1.be] INFO: Scrape type for JJ10339: 0
2026-03-29 08:36:26 [auto1.be] INFO: Found listing with ID: RW29034
2026-03-29 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW29034%27 HTTP/1.1" 200 None
2026-03-29 08:36:26 [auto1.be] INFO: Scrape type for RW29034: 2
2026-03-29 08:36:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: deeb25f1-968c-59fd-a3b3-4e95be57668e with identifier: RW29034
2026-03-29 08:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item deeb25f1-968c-59fd-a3b3-4e95be57668e with scrape type 2
2026-03-29 08:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item deeb25f1-968c-59fd-a3b3-4e95be57668e with scrape type 2
2026-03-29 08:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: deeb25f1-968c-59fd-a3b3-4e95be57668e, identifier: RW29034
2026-03-29 08:36:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: deeb25f1-968c-59fd-a3b3-4e95be57668e with identifier: RW29034
2026-03-29 08:36:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: deeb25f1-968c-59fd-a3b3-4e95be57668e with identifier: RW29034
2026-03-29 08:36:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: deeb25f1-968c-59fd-a3b3-4e95be57668e with identifier: RW29034 to the API
2026-03-29 08:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:52:04Z',
'fuel_type': 'diesel',
'id': 'deeb25f1-968c-59fd-a3b3-4e95be57668e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW29034',
'listing': 'auction',
'make': 'Fiat',
'model': 'Doblo',
'odometer': 33539,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-14',
'seller_name': None,
'title': 'Fiat Doblo 1.3 JTD Basis Kasten',
'transmission': 'manual',
'trim': 'Basis Kasten',
'year': 2011}
2026-03-29 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW29034%27 HTTP/1.1" 200 None
2026-03-29 08:36:26 [auto1.be] INFO: Saving data for RW29034: {'auction_closing_time': 1774885924.0, 'created_time': 1774557528.288267, 'last_price_update_time': 1774773386.785179}
2026-03-29 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RW29034') HTTP/1.1" 204 0
2026-03-29 08:36:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:26 [auto1.be] INFO: Found listing with ID: KD31542
2026-03-29 08:36:26 [auto1.be] INFO: Found listing with ID: FV97066
2026-03-29 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV97066%27 HTTP/1.1" 200 None
2026-03-29 08:36:26 [auto1.be] INFO: Scrape type for FV97066: 0
2026-03-29 08:36:26 [auto1.be] INFO: Found listing with ID: DW89258
2026-03-29 08:36:26 [auto1.be] INFO: Found listing with ID: AU32211
2026-03-29 08:36:26 [auto1.be] INFO: Found listing with ID: RA68631
2026-03-29 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA68631%27 HTTP/1.1" 200 None
2026-03-29 08:36:26 [auto1.be] INFO: Scrape type for RA68631: 0
2026-03-29 08:36:26 [auto1.be] INFO: Found listing with ID: HA88594
2026-03-29 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HA88594%27 HTTP/1.1" 200 None
2026-03-29 08:36:26 [auto1.be] INFO: Scrape type for HA88594: 0
2026-03-29 08:36:26 [auto1.be] INFO: Found listing with ID: DB63111
2026-03-29 08:36:26 [auto1.be] INFO: Found listing with ID: JZ16543
2026-03-29 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ16543%27 HTTP/1.1" 200 None
2026-03-29 08:36:26 [auto1.be] INFO: Scrape type for JZ16543: 0
2026-03-29 08:36:26 [auto1.be] INFO: Found listing with ID: SX32022
2026-03-29 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX32022%27 HTTP/1.1" 200 None
2026-03-29 08:36:27 [auto1.be] INFO: Scrape type for SX32022: 0
2026-03-29 08:36:27 [auto1.be] INFO: Found listing with ID: NP17382
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP17382%27 HTTP/1.1" 200 None
2026-03-29 08:36:27 [auto1.be] INFO: Scrape type for NP17382: 0
2026-03-29 08:36:27 [auto1.be] INFO: Found listing with ID: TF03002
2026-03-29 08:36:27 [auto1.be] INFO: Found listing with ID: KK24955
2026-03-29 08:36:27 [auto1.be] INFO: Found listing with ID: BA13225
2026-03-29 08:36:27 [auto1.be] INFO: Found listing with ID: TE72836
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE72836%27 HTTP/1.1" 200 None
2026-03-29 08:36:27 [auto1.be] INFO: Scrape type for TE72836: 0
2026-03-29 08:36:27 [auto1.be] INFO: Found listing with ID: HY58683
2026-03-29 08:36:27 [auto1.be] INFO: Found listing with ID: SS18683
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SS18683%27 HTTP/1.1" 200 None
2026-03-29 08:36:27 [auto1.be] INFO: Scrape type for SS18683: 0
2026-03-29 08:36:27 [auto1.be] INFO: Found listing with ID: XC12599
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC12599%27 HTTP/1.1" 200 None
2026-03-29 08:36:27 [auto1.be] INFO: Scrape type for XC12599: 0
2026-03-29 08:36:27 [auto1.be] INFO: Found listing with ID: ZJ76170
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ76170%27 HTTP/1.1" 200 None
2026-03-29 08:36:27 [auto1.be] INFO: Scrape type for ZJ76170: 0
2026-03-29 08:36:27 [auto1.be] INFO: Found listing with ID: XK75143
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK75143%27 HTTP/1.1" 200 None
2026-03-29 08:36:27 [auto1.be] INFO: Scrape type for XK75143: 0
2026-03-29 08:36:27 [auto1.be] INFO: Found listing with ID: NP23299
2026-03-29 08:36:27 [auto1.be] INFO: Found listing with ID: UA98228
2026-03-29 08:36:27 [auto1.be] INFO: Found listing with ID: VT00410
2026-03-29 08:36:27 [auto1.be] INFO: Found listing with ID: ZH69808
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH69808%27 HTTP/1.1" 200 None
2026-03-29 08:36:27 [auto1.be] INFO: Scrape type for ZH69808: 0
2026-03-29 08:36:27 [auto1.be] INFO: Found listing with ID: WJ68976
2026-03-29 08:36:27 [auto1.be] INFO: Found listing with ID: CS08088
2026-03-29 08:36:27 [auto1.be] INFO: Found listing with ID: TH19224
2026-03-29 08:36:27 [auto1.be] INFO: Found listing with ID: XE73160
2026-03-29 08:36:27 [auto1.be] INFO: Found listing with ID: VH38978
2026-03-29 08:36:27 [auto1.be] INFO: Found listing with ID: DY96127
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY96127%27 HTTP/1.1" 200 None
2026-03-29 08:36:27 [auto1.be] INFO: Scrape type for DY96127: 0
2026-03-29 08:36:27 [auto1.be] INFO: Found listing with ID: HT10085
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT10085%27 HTTP/1.1" 200 None
2026-03-29 08:36:27 [auto1.be] INFO: Scrape type for HT10085: 0
2026-03-29 08:36:27 [auto1.be] INFO: Found listing with ID: BB40778
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB40778%27 HTTP/1.1" 200 None
2026-03-29 08:36:27 [auto1.be] INFO: Scrape type for BB40778: 0
2026-03-29 08:36:27 [auto1.be] INFO: Found listing with ID: DP96261
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP96261%27 HTTP/1.1" 200 None
2026-03-29 08:36:27 [auto1.be] INFO: Scrape type for DP96261: 0
2026-03-29 08:36:27 [auto1.be] INFO: Found listing with ID: DK43204
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK43204%27 HTTP/1.1" 200 None
2026-03-29 08:36:27 [auto1.be] INFO: Scrape type for DK43204: 0
2026-03-29 08:36:27 [auto1.be] INFO: Found listing with ID: WH41445
2026-03-29 08:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FC05247> (referer: https://www.auto1.com/v1/car-details-view/FC05247/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1701abc-dc4b-55f3-bb73-db53af5c457c with identifier: FC05247
2026-03-29 08:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1701abc-dc4b-55f3-bb73-db53af5c457c with scrape type 1
2026-03-29 08:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d1701abc-dc4b-55f3-bb73-db53af5c457c
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F36%252F1036e4d86b8051625f782775b2ccbe31%252Fpa%252FFC05247_4f15d32a79326f247ec63e66e6383165.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/36/1036e4d86b8051625f782775b2ccbe31/pa/FC05247_4f15d32a79326f247ec63e66e6383165.jpg already downloaded
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F36%252F1036e4d86b8051625f782775b2ccbe31%252Fpa%252FFC05247_b35913a62d4b4076c05769673efe6b26.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/36/1036e4d86b8051625f782775b2ccbe31/pa/FC05247_b35913a62d4b4076c05769673efe6b26.jpg already downloaded
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F36%252F1036e4d86b8051625f782775b2ccbe31%252Fpa%252FFC05247_d67a91166c373f505d02589d22aefef9.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/36/1036e4d86b8051625f782775b2ccbe31/pa/FC05247_d67a91166c373f505d02589d22aefef9.jpg already downloaded
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F36%252F1036e4d86b8051625f782775b2ccbe31%252Fpa%252FFC05247_79cdd75c2b201234fe4c2721f9144044.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/36/1036e4d86b8051625f782775b2ccbe31/pa/FC05247_79cdd75c2b201234fe4c2721f9144044.jpg already downloaded
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F36%252F1036e4d86b8051625f782775b2ccbe31%252Fpa%252FFC05247_b10060b7f65862b48572b0981ff1b612.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/36/1036e4d86b8051625f782775b2ccbe31/pa/FC05247_b10060b7f65862b48572b0981ff1b612.jpg already downloaded
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F36%252F1036e4d86b8051625f782775b2ccbe31%252Fpa%252FFC05247_49edf9cf79fff7f8e5a158d9e45c8538.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/36/1036e4d86b8051625f782775b2ccbe31/pa/FC05247_49edf9cf79fff7f8e5a158d9e45c8538.jpg already downloaded
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F36%252F1036e4d86b8051625f782775b2ccbe31%252Fpa%252FFC05247_cb08037fae18e3e39195c620dbdac88e.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/36/1036e4d86b8051625f782775b2ccbe31/pa/FC05247_cb08037fae18e3e39195c620dbdac88e.jpg already downloaded
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F36%252F1036e4d86b8051625f782775b2ccbe31%252Fpa%252FFC05247_6a4728d3c61cd16c284ecb51a8c64d78.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/36/1036e4d86b8051625f782775b2ccbe31/pa/FC05247_6a4728d3c61cd16c284ecb51a8c64d78.jpg already downloaded
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F36%252F1036e4d86b8051625f782775b2ccbe31%252Fpa%252FFC05247_64993d63668b92d27ff3c1e8d07e06f1.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/36/1036e4d86b8051625f782775b2ccbe31/pa/FC05247_64993d63668b92d27ff3c1e8d07e06f1.jpg already downloaded
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F36%252F1036e4d86b8051625f782775b2ccbe31%252Fpa%252FFC05247_2103b865f9d83c26993caa80494d731a.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/36/1036e4d86b8051625f782775b2ccbe31/pa/FC05247_2103b865f9d83c26993caa80494d731a.jpg already downloaded
2026-03-29 08:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d1701abc-dc4b-55f3-bb73-db53af5c457c, identifier: FC05247
2026-03-29 08:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d1701abc-dc4b-55f3-bb73-db53af5c457c with identifier: FC05247
2026-03-29 08:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d1701abc-dc4b-55f3-bb73-db53af5c457c with identifier: FC05247
2026-03-29 08:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d1701abc-dc4b-55f3-bb73-db53af5c457c with identifier: FC05247 to the API
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FC05247>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:03:26Z',
'fuel_type': 'petrol',
'id': 'd1701abc-dc4b-55f3-bb73-db53af5c457c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC05247',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Volkswagen',
'model': 'Tiguan Allspace',
'odometer': 94550,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img10/36/1036e4d86b8051625f782775b2ccbe31/pa/FC05247_4f15d32a79326f247ec63e66e6383165.jpg',
'https://img-pa.auto1.com/img10/36/1036e4d86b8051625f782775b2ccbe31/pa/FC05247_b35913a62d4b4076c05769673efe6b26.jpg',
'https://img-pa.auto1.com/img10/36/1036e4d86b8051625f782775b2ccbe31/pa/FC05247_d67a91166c373f505d02589d22aefef9.jpg',
'https://img-pa.auto1.com/img10/36/1036e4d86b8051625f782775b2ccbe31/pa/FC05247_79cdd75c2b201234fe4c2721f9144044.jpg',
'https://img-pa.auto1.com/img10/36/1036e4d86b8051625f782775b2ccbe31/pa/FC05247_b10060b7f65862b48572b0981ff1b612.jpg',
'https://img-pa.auto1.com/img10/36/1036e4d86b8051625f782775b2ccbe31/pa/FC05247_49edf9cf79fff7f8e5a158d9e45c8538.jpg',
'https://img-pa.auto1.com/img10/36/1036e4d86b8051625f782775b2ccbe31/pa/FC05247_cb08037fae18e3e39195c620dbdac88e.jpg',
'https://img-pa.auto1.com/img10/36/1036e4d86b8051625f782775b2ccbe31/pa/FC05247_6a4728d3c61cd16c284ecb51a8c64d78.jpg',
'https://img-pa.auto1.com/img10/36/1036e4d86b8051625f782775b2ccbe31/pa/FC05247_64993d63668b92d27ff3c1e8d07e06f1.jpg',
'https://img-pa.auto1.com/img10/36/1036e4d86b8051625f782775b2ccbe31/pa/FC05247_2103b865f9d83c26993caa80494d731a.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1701abc-dc4b-55f3-bb73-db53af5c457c/d1701abc-dc4b-55f3-bb73-db53af5c457c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68490,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/36/1036e4d86b8051625f782775b2ccbe31/pa/FC05247_4f15d32a79326f247ec63e66e6383165.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1701abc-dc4b-55f3-bb73-db53af5c457c/d1701abc-dc4b-55f3-bb73-db53af5c457c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72507,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/36/1036e4d86b8051625f782775b2ccbe31/pa/FC05247_b35913a62d4b4076c05769673efe6b26.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1701abc-dc4b-55f3-bb73-db53af5c457c/d1701abc-dc4b-55f3-bb73-db53af5c457c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66024,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/36/1036e4d86b8051625f782775b2ccbe31/pa/FC05247_d67a91166c373f505d02589d22aefef9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1701abc-dc4b-55f3-bb73-db53af5c457c/d1701abc-dc4b-55f3-bb73-db53af5c457c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61536,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/36/1036e4d86b8051625f782775b2ccbe31/pa/FC05247_79cdd75c2b201234fe4c2721f9144044.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1701abc-dc4b-55f3-bb73-db53af5c457c/d1701abc-dc4b-55f3-bb73-db53af5c457c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60633,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/36/1036e4d86b8051625f782775b2ccbe31/pa/FC05247_b10060b7f65862b48572b0981ff1b612.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1701abc-dc4b-55f3-bb73-db53af5c457c/d1701abc-dc4b-55f3-bb73-db53af5c457c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67847,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/36/1036e4d86b8051625f782775b2ccbe31/pa/FC05247_49edf9cf79fff7f8e5a158d9e45c8538.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1701abc-dc4b-55f3-bb73-db53af5c457c/d1701abc-dc4b-55f3-bb73-db53af5c457c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64240,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/36/1036e4d86b8051625f782775b2ccbe31/pa/FC05247_cb08037fae18e3e39195c620dbdac88e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1701abc-dc4b-55f3-bb73-db53af5c457c/d1701abc-dc4b-55f3-bb73-db53af5c457c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71070,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/36/1036e4d86b8051625f782775b2ccbe31/pa/FC05247_6a4728d3c61cd16c284ecb51a8c64d78.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1701abc-dc4b-55f3-bb73-db53af5c457c/d1701abc-dc4b-55f3-bb73-db53af5c457c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69029,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/36/1036e4d86b8051625f782775b2ccbe31/pa/FC05247_64993d63668b92d27ff3c1e8d07e06f1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1701abc-dc4b-55f3-bb73-db53af5c457c/d1701abc-dc4b-55f3-bb73-db53af5c457c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72220,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/36/1036e4d86b8051625f782775b2ccbe31/pa/FC05247_2103b865f9d83c26993caa80494d731a.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-03-16',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan Allspace 2.0 TSI Highline 4Motion',
'transmission': 'automatic',
'trim': 'Highline 4Motion',
'year': 2020}
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC05247%27 HTTP/1.1" 200 None
2026-03-29 08:36:27 [auto1.be] INFO: Saving data for FC05247: {'created_time': 1774773387.893056, 'last_price_update_time': 1774773387.893065, 'auction_closing_time': 1774883006.0}
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FC05247') HTTP/1.1" 204 0
2026-03-29 08:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:28 [auto1.be] INFO: Channel: 24h | Page: 12 | totalHits: 1252 | hits on page: 40
2026-03-29 08:36:28 [auto1.be] INFO: Found listing with ID: MD04738
2026-03-29 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD04738%27 HTTP/1.1" 200 None
2026-03-29 08:36:28 [auto1.be] INFO: Scrape type for MD04738: 0
2026-03-29 08:36:28 [auto1.be] INFO: Found listing with ID: WG62431
2026-03-29 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG62431%27 HTTP/1.1" 200 None
2026-03-29 08:36:28 [auto1.be] INFO: Scrape type for WG62431: 0
2026-03-29 08:36:28 [auto1.be] INFO: Found listing with ID: CB86664
2026-03-29 08:36:28 [auto1.be] INFO: Found listing with ID: NW54949
2026-03-29 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NW54949%27 HTTP/1.1" 200 None
2026-03-29 08:36:28 [auto1.be] INFO: Scrape type for NW54949: 0
2026-03-29 08:36:28 [auto1.be] INFO: Found listing with ID: ZK51965
2026-03-29 08:36:28 [auto1.be] INFO: Found listing with ID: TT75307
2026-03-29 08:36:28 [auto1.be] INFO: Found listing with ID: EP09858
2026-03-29 08:36:28 [auto1.be] INFO: Found listing with ID: CW40114
2026-03-29 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW40114%27 HTTP/1.1" 200 None
2026-03-29 08:36:28 [auto1.be] INFO: Scrape type for CW40114: 0
2026-03-29 08:36:28 [auto1.be] INFO: Found listing with ID: DH21315
2026-03-29 08:36:28 [auto1.be] INFO: Found listing with ID: EW63431
2026-03-29 08:36:28 [auto1.be] INFO: Found listing with ID: GH94077
2026-03-29 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH94077%27 HTTP/1.1" 200 None
2026-03-29 08:36:28 [auto1.be] INFO: Scrape type for GH94077: 0
2026-03-29 08:36:28 [auto1.be] INFO: Found listing with ID: RG44645
2026-03-29 08:36:28 [auto1.be] INFO: Found listing with ID: DS23322
2026-03-29 08:36:28 [auto1.be] INFO: Found listing with ID: LU38585
2026-03-29 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU38585%27 HTTP/1.1" 200 None
2026-03-29 08:36:28 [auto1.be] INFO: Scrape type for LU38585: 0
2026-03-29 08:36:28 [auto1.be] INFO: Found listing with ID: GW63299
2026-03-29 08:36:28 [auto1.be] INFO: Found listing with ID: JF41683
2026-03-29 08:36:28 [auto1.be] INFO: Found listing with ID: GJ23391
2026-03-29 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ23391%27 HTTP/1.1" 200 None
2026-03-29 08:36:28 [auto1.be] INFO: Scrape type for GJ23391: 0
2026-03-29 08:36:28 [auto1.be] INFO: Found listing with ID: VM57702
2026-03-29 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM57702%27 HTTP/1.1" 200 None
2026-03-29 08:36:28 [auto1.be] INFO: Scrape type for VM57702: 0
2026-03-29 08:36:28 [auto1.be] INFO: Found listing with ID: FT96499
2026-03-29 08:36:28 [auto1.be] INFO: Found listing with ID: XR84470
2026-03-29 08:36:28 [auto1.be] INFO: Found listing with ID: FL46625
2026-03-29 08:36:28 [auto1.be] INFO: Found listing with ID: AX12673
2026-03-29 08:36:28 [auto1.be] INFO: Found listing with ID: GF63829
2026-03-29 08:36:28 [auto1.be] INFO: Found listing with ID: JH02802
2026-03-29 08:36:28 [auto1.be] INFO: Found listing with ID: KG19380
2026-03-29 08:36:28 [auto1.be] INFO: Found listing with ID: HH24769
2026-03-29 08:36:28 [auto1.be] INFO: Found listing with ID: CA55783
2026-03-29 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA55783%27 HTTP/1.1" 200 None
2026-03-29 08:36:28 [auto1.be] INFO: Scrape type for CA55783: 2
2026-03-29 08:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b96d2813-0fc5-5472-9bd6-a85f0326fd17 with identifier: CA55783
2026-03-29 08:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b96d2813-0fc5-5472-9bd6-a85f0326fd17 with scrape type 2
2026-03-29 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b96d2813-0fc5-5472-9bd6-a85f0326fd17 with scrape type 2
2026-03-29 08:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b96d2813-0fc5-5472-9bd6-a85f0326fd17, identifier: CA55783
2026-03-29 08:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b96d2813-0fc5-5472-9bd6-a85f0326fd17 with identifier: CA55783
2026-03-29 08:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b96d2813-0fc5-5472-9bd6-a85f0326fd17 with identifier: CA55783
2026-03-29 08:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b96d2813-0fc5-5472-9bd6-a85f0326fd17 with identifier: CA55783 to the API
2026-03-29 08:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:22:46Z',
'fuel_type': 'petrol',
'id': 'b96d2813-0fc5-5472-9bd6-a85f0326fd17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA55783',
'listing': 'auction',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 127030,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-23',
'seller_name': None,
'title': 'Renault Kadjar 1.2 TCe Energy Bose Edition',
'transmission': 'manual',
'trim': 'Bose Edition',
'year': 2018}
2026-03-29 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA55783%27 HTTP/1.1" 200 None
2026-03-29 08:36:29 [auto1.be] INFO: Saving data for CA55783: {'auction_closing_time': 1774884166.0, 'created_time': 1774557428.492931, 'last_price_update_time': 1774773389.329774}
2026-03-29 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CA55783') HTTP/1.1" 204 0
2026-03-29 08:36:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:29 [auto1.be] INFO: Found listing with ID: EP14144
2026-03-29 08:36:29 [auto1.be] INFO: Found listing with ID: HP74170
2026-03-29 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP74170%27 HTTP/1.1" 200 None
2026-03-29 08:36:29 [auto1.be] INFO: Scrape type for HP74170: 0
2026-03-29 08:36:29 [auto1.be] INFO: Found listing with ID: EG14798
2026-03-29 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG14798%27 HTTP/1.1" 200 None
2026-03-29 08:36:29 [auto1.be] INFO: Scrape type for EG14798: 0
2026-03-29 08:36:29 [auto1.be] INFO: Found listing with ID: YN26679
2026-03-29 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN26679%27 HTTP/1.1" 200 None
2026-03-29 08:36:29 [auto1.be] INFO: Scrape type for YN26679: 0
2026-03-29 08:36:29 [auto1.be] INFO: Found listing with ID: HX42019
2026-03-29 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX42019%27 HTTP/1.1" 200 None
2026-03-29 08:36:29 [auto1.be] INFO: Scrape type for HX42019: 0
2026-03-29 08:36:29 [auto1.be] INFO: Found listing with ID: JW58136
2026-03-29 08:36:29 [auto1.be] INFO: Found listing with ID: RM51088
2026-03-29 08:36:29 [auto1.be] INFO: Found listing with ID: KW38150
2026-03-29 08:36:29 [auto1.be] INFO: Found listing with ID: SV05686
2026-03-29 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV05686%27 HTTP/1.1" 200 None
2026-03-29 08:36:29 [auto1.be] INFO: Scrape type for SV05686: 0
2026-03-29 08:36:29 [auto1.be] INFO: Found listing with ID: JC96921
2026-03-29 08:36:29 [auto1.be] INFO: Found listing with ID: CS46874
2026-03-29 08:36:29 [auto1.be] INFO: Found listing with ID: GG55355
2026-03-29 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG55355%27 HTTP/1.1" 200 None
2026-03-29 08:36:29 [auto1.be] INFO: Scrape type for GG55355: 0
2026-03-29 08:36:29 [auto1.be] INFO: Found listing with ID: TK63545
2026-03-29 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK63545%27 HTTP/1.1" 200 None
2026-03-29 08:36:29 [auto1.be] INFO: Scrape type for TK63545: 2
2026-03-29 08:36:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 681647e4-ce55-599e-a8ac-87af81fae583 with identifier: TK63545
2026-03-29 08:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 681647e4-ce55-599e-a8ac-87af81fae583 with scrape type 2
2026-03-29 08:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 681647e4-ce55-599e-a8ac-87af81fae583 with scrape type 2
2026-03-29 08:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 681647e4-ce55-599e-a8ac-87af81fae583, identifier: TK63545
2026-03-29 08:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 681647e4-ce55-599e-a8ac-87af81fae583 with identifier: TK63545
2026-03-29 08:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 681647e4-ce55-599e-a8ac-87af81fae583 with identifier: TK63545
2026-03-29 08:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 681647e4-ce55-599e-a8ac-87af81fae583 with identifier: TK63545 to the API
2026-03-29 08:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:59:32Z',
'fuel_type': 'diesel',
'id': '681647e4-ce55-599e-a8ac-87af81fae583',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK63545',
'listing': 'auction',
'make': 'Renault',
'model': 'Grand Modus',
'odometer': 49012,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-06-30',
'seller_name': None,
'title': 'Renault Grand Modus 1.5 dCi Lafuma',
'transmission': 'automatic',
'trim': 'Lafuma',
'year': 2010}
2026-03-29 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK63545%27 HTTP/1.1" 200 None
2026-03-29 08:36:29 [auto1.be] INFO: Saving data for TK63545: {'auction_closing_time': 1774886372.0, 'created_time': 1774557507.935121, 'last_price_update_time': 1774773389.909896}
2026-03-29 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TK63545') HTTP/1.1" 204 0
2026-03-29 08:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FP22064> (referer: https://www.auto1.com/v1/car-details-view/FP22064/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b634c0a-20c8-5733-91d8-e3b70cb6f8da with identifier: FP22064
2026-03-29 08:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b634c0a-20c8-5733-91d8-e3b70cb6f8da with scrape type 1
2026-03-29 08:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b634c0a-20c8-5733-91d8-e3b70cb6f8da
2026-03-29 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F45%252F0c4531f8d4d0256f28fffc5d8c471371%252Fpa%252FFP22064_ca83e96fb6a80f1ab84627813e9d864c.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/45/0c4531f8d4d0256f28fffc5d8c471371/pa/FP22064_ca83e96fb6a80f1ab84627813e9d864c.jpg already downloaded
2026-03-29 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F45%252F0c4531f8d4d0256f28fffc5d8c471371%252Fpa%252FFP22064_6da2d57f289ae42cafeeb8a76087ed6d.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/45/0c4531f8d4d0256f28fffc5d8c471371/pa/FP22064_6da2d57f289ae42cafeeb8a76087ed6d.jpg already downloaded
2026-03-29 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F45%252F0c4531f8d4d0256f28fffc5d8c471371%252Fpa%252FFP22064_6f0c07718b11429be2875c33f80421ca.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/45/0c4531f8d4d0256f28fffc5d8c471371/pa/FP22064_6f0c07718b11429be2875c33f80421ca.jpg already downloaded
2026-03-29 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F45%252F0c4531f8d4d0256f28fffc5d8c471371%252Fpa%252FFP22064_38106cbcde3fbdac143d0f3471bac1f9.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/45/0c4531f8d4d0256f28fffc5d8c471371/pa/FP22064_38106cbcde3fbdac143d0f3471bac1f9.jpg already downloaded
2026-03-29 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F45%252F0c4531f8d4d0256f28fffc5d8c471371%252Fpa%252FFP22064_0948376257a97067c29efca5ab136206.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/45/0c4531f8d4d0256f28fffc5d8c471371/pa/FP22064_0948376257a97067c29efca5ab136206.jpg already downloaded
2026-03-29 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F45%252F0c4531f8d4d0256f28fffc5d8c471371%252Fpa%252FFP22064_6c6057fa157c3f65bfe98010e8f0db54.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/45/0c4531f8d4d0256f28fffc5d8c471371/pa/FP22064_6c6057fa157c3f65bfe98010e8f0db54.jpg already downloaded
2026-03-29 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F45%252F0c4531f8d4d0256f28fffc5d8c471371%252Fpa%252FFP22064_38098a7af96eba4003af913785ceaf5d.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/45/0c4531f8d4d0256f28fffc5d8c471371/pa/FP22064_38098a7af96eba4003af913785ceaf5d.jpg already downloaded
2026-03-29 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F45%252F0c4531f8d4d0256f28fffc5d8c471371%252Fpa%252FFP22064_6e4fa8169805917bbb1f49f6b746721a.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/45/0c4531f8d4d0256f28fffc5d8c471371/pa/FP22064_6e4fa8169805917bbb1f49f6b746721a.jpg already downloaded
2026-03-29 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F45%252F0c4531f8d4d0256f28fffc5d8c471371%252Fpa%252FFP22064_5c4ac8926e914361db10e0a8f7bae3ea.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/45/0c4531f8d4d0256f28fffc5d8c471371/pa/FP22064_5c4ac8926e914361db10e0a8f7bae3ea.jpg already downloaded
2026-03-29 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F45%252F0c4531f8d4d0256f28fffc5d8c471371%252Fpa%252FFP22064_e5fef190d070de31fb9f98a2c8375d26.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/45/0c4531f8d4d0256f28fffc5d8c471371/pa/FP22064_e5fef190d070de31fb9f98a2c8375d26.jpg already downloaded
2026-03-29 08:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9b634c0a-20c8-5733-91d8-e3b70cb6f8da, identifier: FP22064
2026-03-29 08:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9b634c0a-20c8-5733-91d8-e3b70cb6f8da with identifier: FP22064
2026-03-29 08:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9b634c0a-20c8-5733-91d8-e3b70cb6f8da with identifier: FP22064
2026-03-29 08:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9b634c0a-20c8-5733-91d8-e3b70cb6f8da with identifier: FP22064 to the API
2026-03-29 08:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FP22064>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:24:50Z',
'fuel_type': 'diesel',
'id': '9b634c0a-20c8-5733-91d8-e3b70cb6f8da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP22064',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'BMW',
'model': '1er',
'odometer': 281023,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img0c/45/0c4531f8d4d0256f28fffc5d8c471371/pa/FP22064_ca83e96fb6a80f1ab84627813e9d864c.jpg',
'https://img-pa.auto1.com/img0c/45/0c4531f8d4d0256f28fffc5d8c471371/pa/FP22064_6da2d57f289ae42cafeeb8a76087ed6d.jpg',
'https://img-pa.auto1.com/img0c/45/0c4531f8d4d0256f28fffc5d8c471371/pa/FP22064_6f0c07718b11429be2875c33f80421ca.jpg',
'https://img-pa.auto1.com/img0c/45/0c4531f8d4d0256f28fffc5d8c471371/pa/FP22064_38106cbcde3fbdac143d0f3471bac1f9.jpg',
'https://img-pa.auto1.com/img0c/45/0c4531f8d4d0256f28fffc5d8c471371/pa/FP22064_0948376257a97067c29efca5ab136206.jpg',
'https://img-pa.auto1.com/img0c/45/0c4531f8d4d0256f28fffc5d8c471371/pa/FP22064_6c6057fa157c3f65bfe98010e8f0db54.jpg',
'https://img-pa.auto1.com/img0c/45/0c4531f8d4d0256f28fffc5d8c471371/pa/FP22064_38098a7af96eba4003af913785ceaf5d.jpg',
'https://img-pa.auto1.com/img0c/45/0c4531f8d4d0256f28fffc5d8c471371/pa/FP22064_6e4fa8169805917bbb1f49f6b746721a.jpg',
'https://img-pa.auto1.com/img0c/45/0c4531f8d4d0256f28fffc5d8c471371/pa/FP22064_5c4ac8926e914361db10e0a8f7bae3ea.jpg',
'https://img-pa.auto1.com/img0c/45/0c4531f8d4d0256f28fffc5d8c471371/pa/FP22064_e5fef190d070de31fb9f98a2c8375d26.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b634c0a-20c8-5733-91d8-e3b70cb6f8da/9b634c0a-20c8-5733-91d8-e3b70cb6f8da_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64919,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/45/0c4531f8d4d0256f28fffc5d8c471371/pa/FP22064_ca83e96fb6a80f1ab84627813e9d864c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b634c0a-20c8-5733-91d8-e3b70cb6f8da/9b634c0a-20c8-5733-91d8-e3b70cb6f8da_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66003,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/45/0c4531f8d4d0256f28fffc5d8c471371/pa/FP22064_6da2d57f289ae42cafeeb8a76087ed6d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b634c0a-20c8-5733-91d8-e3b70cb6f8da/9b634c0a-20c8-5733-91d8-e3b70cb6f8da_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63238,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/45/0c4531f8d4d0256f28fffc5d8c471371/pa/FP22064_6f0c07718b11429be2875c33f80421ca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b634c0a-20c8-5733-91d8-e3b70cb6f8da/9b634c0a-20c8-5733-91d8-e3b70cb6f8da_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57602,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/45/0c4531f8d4d0256f28fffc5d8c471371/pa/FP22064_38106cbcde3fbdac143d0f3471bac1f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b634c0a-20c8-5733-91d8-e3b70cb6f8da/9b634c0a-20c8-5733-91d8-e3b70cb6f8da_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58528,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/45/0c4531f8d4d0256f28fffc5d8c471371/pa/FP22064_0948376257a97067c29efca5ab136206.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b634c0a-20c8-5733-91d8-e3b70cb6f8da/9b634c0a-20c8-5733-91d8-e3b70cb6f8da_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62944,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/45/0c4531f8d4d0256f28fffc5d8c471371/pa/FP22064_6c6057fa157c3f65bfe98010e8f0db54.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b634c0a-20c8-5733-91d8-e3b70cb6f8da/9b634c0a-20c8-5733-91d8-e3b70cb6f8da_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57502,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/45/0c4531f8d4d0256f28fffc5d8c471371/pa/FP22064_38098a7af96eba4003af913785ceaf5d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b634c0a-20c8-5733-91d8-e3b70cb6f8da/9b634c0a-20c8-5733-91d8-e3b70cb6f8da_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65457,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/45/0c4531f8d4d0256f28fffc5d8c471371/pa/FP22064_6e4fa8169805917bbb1f49f6b746721a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b634c0a-20c8-5733-91d8-e3b70cb6f8da/9b634c0a-20c8-5733-91d8-e3b70cb6f8da_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68947,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/45/0c4531f8d4d0256f28fffc5d8c471371/pa/FP22064_5c4ac8926e914361db10e0a8f7bae3ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b634c0a-20c8-5733-91d8-e3b70cb6f8da/9b634c0a-20c8-5733-91d8-e3b70cb6f8da_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63699,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/45/0c4531f8d4d0256f28fffc5d8c471371/pa/FP22064_e5fef190d070de31fb9f98a2c8375d26.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-04-01',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 116d EfficientDynamics Edition',
'transmission': 'manual',
'trim': 'EfficientDynamics Edition',
'year': 2014}
2026-03-29 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP22064%27 HTTP/1.1" 200 None
2026-03-29 08:36:30 [auto1.be] INFO: Saving data for FP22064: {'created_time': 1774773390.658866, 'last_price_update_time': 1774773390.658877, 'auction_closing_time': 1774884290.0}
2026-03-29 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FP22064') HTTP/1.1" 204 0
2026-03-29 08:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:31 [auto1.be] INFO: Channel: 24h | Page: 13 | totalHits: 1252 | hits on page: 40
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: MP28046
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MP28046%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for MP28046: 0
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: HG61894
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: RB98158
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: WA78577
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: NP75657
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP75657%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for NP75657: 0
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: BC49055
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: JJ27182
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ27182%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for JJ27182: 0
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: EG19315
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG19315%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for EG19315: 0
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: CD53749
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD53749%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for CD53749: 0
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: KN88676
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KN88676%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for KN88676: 0
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: RX75304
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: DG02903
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: WU67286
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: LL08256
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: CG84069
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG84069%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for CG84069: 0
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: AV28567
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: WB95668
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: FS62191
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: WU43595
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: HK81119
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK81119%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for HK81119: 0
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: ZJ33794
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ33794%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for ZJ33794: 0
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: VF88831
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: VK66376
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK66376%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for VK66376: 0
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: RA11008
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: KV01738
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV01738%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for KV01738: 0
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: EE45657
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EE45657%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for EE45657: 2
2026-03-29 08:36:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1adca9e0-0bbf-5cb5-9425-dd1ea75e826c with identifier: EE45657
2026-03-29 08:36:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1adca9e0-0bbf-5cb5-9425-dd1ea75e826c with scrape type 2
2026-03-29 08:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1adca9e0-0bbf-5cb5-9425-dd1ea75e826c with scrape type 2
2026-03-29 08:36:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1adca9e0-0bbf-5cb5-9425-dd1ea75e826c, identifier: EE45657
2026-03-29 08:36:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1adca9e0-0bbf-5cb5-9425-dd1ea75e826c with identifier: EE45657
2026-03-29 08:36:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1adca9e0-0bbf-5cb5-9425-dd1ea75e826c with identifier: EE45657
2026-03-29 08:36:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1adca9e0-0bbf-5cb5-9425-dd1ea75e826c with identifier: EE45657 to the API
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:46:36Z',
'fuel_type': 'diesel',
'id': '1adca9e0-0bbf-5cb5-9425-dd1ea75e826c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE45657',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 138780,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-14',
'seller_name': None,
'title': 'Land Rover Evoque 2.0 ed4 Pure',
'transmission': 'manual',
'trim': 'Pure',
'year': 2015}
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EE45657%27 HTTP/1.1" 200 None
2026-03-29 08:36:32 [auto1.be] INFO: Saving data for EE45657: {'auction_closing_time': 1774885596.0, 'created_time': 1774557522.339571, 'last_price_update_time': 1774773392.157073}
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EE45657') HTTP/1.1" 204 0
2026-03-29 08:36:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: PS61885
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: UW52037
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW52037%27 HTTP/1.1" 200 None
2026-03-29 08:36:32 [auto1.be] INFO: Scrape type for UW52037: 0
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: YW15851
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: NS97708
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS97708%27 HTTP/1.1" 200 None
2026-03-29 08:36:32 [auto1.be] INFO: Scrape type for NS97708: 0
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: MB15455
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB15455%27 HTTP/1.1" 200 None
2026-03-29 08:36:32 [auto1.be] INFO: Scrape type for MB15455: 0
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: RY14212
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY14212%27 HTTP/1.1" 200 None
2026-03-29 08:36:32 [auto1.be] INFO: Scrape type for RY14212: 0
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: PB96026
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB96026%27 HTTP/1.1" 200 None
2026-03-29 08:36:32 [auto1.be] INFO: Scrape type for PB96026: 0
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: EL33380
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL33380%27 HTTP/1.1" 200 None
2026-03-29 08:36:32 [auto1.be] INFO: Scrape type for EL33380: 0
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: UH14890
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UH14890%27 HTTP/1.1" 200 None
2026-03-29 08:36:32 [auto1.be] INFO: Scrape type for UH14890: 0
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: YK73361
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK73361%27 HTTP/1.1" 200 None
2026-03-29 08:36:32 [auto1.be] INFO: Scrape type for YK73361: 0
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: FF99790
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF99790%27 HTTP/1.1" 200 None
2026-03-29 08:36:32 [auto1.be] INFO: Scrape type for FF99790: 0
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: DP88518
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP88518%27 HTTP/1.1" 200 None
2026-03-29 08:36:32 [auto1.be] INFO: Scrape type for DP88518: 0
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: XL26167
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: YJ00240
2026-03-29 08:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:48 [auto1.be] INFO: Channel: 24h | Page: 14 | totalHits: 1252 | hits on page: 40
2026-03-29 08:36:48 [auto1.be] INFO: Found listing with ID: NB09051
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB09051%27 HTTP/1.1" 200 None
2026-03-29 08:36:48 [auto1.be] INFO: Scrape type for NB09051: 0
2026-03-29 08:36:48 [auto1.be] INFO: Found listing with ID: GF65026
2026-03-29 08:36:48 [auto1.be] INFO: Found listing with ID: HS49836
2026-03-29 08:36:48 [auto1.be] INFO: Found listing with ID: CU87114
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU87114%27 HTTP/1.1" 200 None
2026-03-29 08:36:48 [auto1.be] INFO: Scrape type for CU87114: 0
2026-03-29 08:36:48 [auto1.be] INFO: Found listing with ID: BV41613
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV41613%27 HTTP/1.1" 200 None
2026-03-29 08:36:48 [auto1.be] INFO: Scrape type for BV41613: 0
2026-03-29 08:36:48 [auto1.be] INFO: Found listing with ID: UX15937
2026-03-29 08:36:48 [auto1.be] INFO: Found listing with ID: RU19747
2026-03-29 08:36:48 [auto1.be] INFO: Found listing with ID: ZS27075
2026-03-29 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZS27075%27 HTTP/1.1" 200 None
2026-03-29 08:36:49 [auto1.be] INFO: Scrape type for ZS27075: 0
2026-03-29 08:36:49 [auto1.be] INFO: Found listing with ID: UA67521
2026-03-29 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA67521%27 HTTP/1.1" 200 None
2026-03-29 08:36:49 [auto1.be] INFO: Scrape type for UA67521: 2
2026-03-29 08:36:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d784d92e-8b86-579c-9fd5-fe2688df45fa with identifier: UA67521
2026-03-29 08:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d784d92e-8b86-579c-9fd5-fe2688df45fa with scrape type 2
2026-03-29 08:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d784d92e-8b86-579c-9fd5-fe2688df45fa with scrape type 2
2026-03-29 08:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d784d92e-8b86-579c-9fd5-fe2688df45fa, identifier: UA67521
2026-03-29 08:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d784d92e-8b86-579c-9fd5-fe2688df45fa with identifier: UA67521
2026-03-29 08:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d784d92e-8b86-579c-9fd5-fe2688df45fa with identifier: UA67521
2026-03-29 08:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d784d92e-8b86-579c-9fd5-fe2688df45fa with identifier: UA67521 to the API
2026-03-29 08:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 114,
'expiration_date': '2026-03-30T15:40:28Z',
'fuel_type': 'petrol',
'id': 'd784d92e-8b86-579c-9fd5-fe2688df45fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA67521',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 14527,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-26',
'seller_name': None,
'title': 'Volkswagen Caddy 1.5 TSI',
'transmission': 'manual',
'trim': '',
'year': 2023}
2026-03-29 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA67521%27 HTTP/1.1" 200 None
2026-03-29 08:36:49 [auto1.be] INFO: Saving data for UA67521: {'auction_closing_time': 1774885228.0, 'created_time': 1774557565.107562, 'last_price_update_time': 1774773409.416565}
2026-03-29 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UA67521') HTTP/1.1" 204 0
2026-03-29 08:36:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:49 [auto1.be] INFO: Found listing with ID: CS20047
2026-03-29 08:36:49 [auto1.be] INFO: Found listing with ID: MK30308
2026-03-29 08:36:49 [auto1.be] INFO: Found listing with ID: FA61625
2026-03-29 08:36:49 [auto1.be] INFO: Found listing with ID: YA85838
2026-03-29 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA85838%27 HTTP/1.1" 200 None
2026-03-29 08:36:49 [auto1.be] INFO: Scrape type for YA85838: 0
2026-03-29 08:36:49 [auto1.be] INFO: Found listing with ID: RL24593
2026-03-29 08:36:49 [auto1.be] INFO: Found listing with ID: PJ20685
2026-03-29 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ20685%27 HTTP/1.1" 200 None
2026-03-29 08:36:49 [auto1.be] INFO: Scrape type for PJ20685: 0
2026-03-29 08:36:49 [auto1.be] INFO: Found listing with ID: XV14848
2026-03-29 08:36:49 [auto1.be] INFO: Found listing with ID: DY20434
2026-03-29 08:36:49 [auto1.be] INFO: Found listing with ID: CH15764
2026-03-29 08:36:49 [auto1.be] INFO: Found listing with ID: HY35953
2026-03-29 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY35953%27 HTTP/1.1" 200 None
2026-03-29 08:36:49 [auto1.be] INFO: Scrape type for HY35953: 2
2026-03-29 08:36:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f1ea3d3-760e-53b2-a424-c38729b313d2 with identifier: HY35953
2026-03-29 08:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f1ea3d3-760e-53b2-a424-c38729b313d2 with scrape type 2
2026-03-29 08:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f1ea3d3-760e-53b2-a424-c38729b313d2 with scrape type 2
2026-03-29 08:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5f1ea3d3-760e-53b2-a424-c38729b313d2, identifier: HY35953
2026-03-29 08:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5f1ea3d3-760e-53b2-a424-c38729b313d2 with identifier: HY35953
2026-03-29 08:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5f1ea3d3-760e-53b2-a424-c38729b313d2 with identifier: HY35953
2026-03-29 08:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5f1ea3d3-760e-53b2-a424-c38729b313d2 with identifier: HY35953 to the API
2026-03-29 08:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:09:52Z',
'fuel_type': 'petrol',
'id': '5f1ea3d3-760e-53b2-a424-c38729b313d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY35953',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 174399,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-04-13',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 160',
'transmission': 'manual',
'trim': '',
'year': 2010}
2026-03-29 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY35953%27 HTTP/1.1" 200 None
2026-03-29 08:36:49 [auto1.be] INFO: Saving data for HY35953: {'auction_closing_time': 1774883392.0, 'created_time': 1774557579.471235, 'last_price_update_time': 1774773409.947341}
2026-03-29 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HY35953') HTTP/1.1" 204 0
2026-03-29 08:36:49 [auto1.be] INFO: Found listing with ID: AX58227
2026-03-29 08:36:49 [auto1.be] INFO: Found listing with ID: GG92230
2026-03-29 08:36:49 [auto1.be] INFO: Found listing with ID: HM69306
2026-03-29 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM69306%27 HTTP/1.1" 200 None
2026-03-29 08:36:49 [auto1.be] INFO: Scrape type for HM69306: 0
2026-03-29 08:36:49 [auto1.be] INFO: Found listing with ID: XC97675
2026-03-29 08:36:49 [auto1.be] INFO: Found listing with ID: LE04651
2026-03-29 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE04651%27 HTTP/1.1" 200 None
2026-03-29 08:36:49 [auto1.be] INFO: Scrape type for LE04651: 0
2026-03-29 08:36:49 [auto1.be] INFO: Found listing with ID: XZ27909
2026-03-29 08:36:49 [auto1.be] INFO: Found listing with ID: CV26650
2026-03-29 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV26650%27 HTTP/1.1" 200 None
2026-03-29 08:36:50 [auto1.be] INFO: Scrape type for CV26650: 0
2026-03-29 08:36:50 [auto1.be] INFO: Found listing with ID: XH41981
2026-03-29 08:36:50 [auto1.be] INFO: Found listing with ID: SV23823
2026-03-29 08:36:50 [auto1.be] INFO: Found listing with ID: HW65369
2026-03-29 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW65369%27 HTTP/1.1" 200 None
2026-03-29 08:36:50 [auto1.be] INFO: Scrape type for HW65369: 0
2026-03-29 08:36:50 [auto1.be] INFO: Found listing with ID: YC48670
2026-03-29 08:36:50 [auto1.be] INFO: Found listing with ID: MK11042
2026-03-29 08:36:50 [auto1.be] INFO: Found listing with ID: SZ23077
2026-03-29 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ23077%27 HTTP/1.1" 200 None
2026-03-29 08:36:50 [auto1.be] INFO: Scrape type for SZ23077: 2
2026-03-29 08:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96a43030-c3fb-5bec-8db5-534207806117 with identifier: SZ23077
2026-03-29 08:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96a43030-c3fb-5bec-8db5-534207806117 with scrape type 2
2026-03-29 08:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96a43030-c3fb-5bec-8db5-534207806117 with scrape type 2
2026-03-29 08:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 96a43030-c3fb-5bec-8db5-534207806117, identifier: SZ23077
2026-03-29 08:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 96a43030-c3fb-5bec-8db5-534207806117 with identifier: SZ23077
2026-03-29 08:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 96a43030-c3fb-5bec-8db5-534207806117 with identifier: SZ23077
2026-03-29 08:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 96a43030-c3fb-5bec-8db5-534207806117 with identifier: SZ23077 to the API
2026-03-29 08:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:46:00Z',
'fuel_type': 'petrol',
'id': '96a43030-c3fb-5bec-8db5-534207806117',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ23077',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 137354,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-05',
'seller_name': None,
'title': 'BMW 2er 218i Gran Coupe Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2021}
2026-03-29 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ23077%27 HTTP/1.1" 200 None
2026-03-29 08:36:50 [auto1.be] INFO: Saving data for SZ23077: {'auction_closing_time': 1774885560.0, 'created_time': 1774557494.015964, 'last_price_update_time': 1774773410.464108}
2026-03-29 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SZ23077') HTTP/1.1" 204 0
2026-03-29 08:36:50 [auto1.be] INFO: Found listing with ID: TS47815
2026-03-29 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS47815%27 HTTP/1.1" 200 None
2026-03-29 08:36:50 [auto1.be] INFO: Scrape type for TS47815: 0
2026-03-29 08:36:50 [auto1.be] INFO: Found listing with ID: RU10603
2026-03-29 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU10603%27 HTTP/1.1" 200 None
2026-03-29 08:36:50 [auto1.be] INFO: Scrape type for RU10603: 0
2026-03-29 08:36:50 [auto1.be] INFO: Found listing with ID: SX30605
2026-03-29 08:36:50 [auto1.be] INFO: Found listing with ID: AX51995
2026-03-29 08:36:50 [auto1.be] INFO: Found listing with ID: KW80684
2026-03-29 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW80684%27 HTTP/1.1" 200 None
2026-03-29 08:36:50 [auto1.be] INFO: Scrape type for KW80684: 0
2026-03-29 08:36:50 [auto1.be] INFO: Found listing with ID: LF90651
2026-03-29 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF90651%27 HTTP/1.1" 200 None
2026-03-29 08:36:50 [auto1.be] INFO: Scrape type for LF90651: 0
2026-03-29 08:36:50 [auto1.be] INFO: Found listing with ID: TH79553
2026-03-29 08:36:50 [auto1.be] INFO: Found listing with ID: ZJ26609
2026-03-29 08:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:51 [auto1.be] INFO: Channel: 24h | Page: 15 | totalHits: 1252 | hits on page: 40
2026-03-29 08:36:51 [auto1.be] INFO: Found listing with ID: EK41744
2026-03-29 08:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK41744%27 HTTP/1.1" 200 None
2026-03-29 08:36:51 [auto1.be] INFO: Scrape type for EK41744: 0
2026-03-29 08:36:51 [auto1.be] INFO: Found listing with ID: BV36868
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV36868%27 HTTP/1.1" 200 None
2026-03-29 08:36:52 [auto1.be] INFO: Scrape type for BV36868: 0
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: JB98140
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB98140%27 HTTP/1.1" 200 None
2026-03-29 08:36:52 [auto1.be] INFO: Scrape type for JB98140: 0
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: ED70069
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: RM32931
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM32931%27 HTTP/1.1" 200 None
2026-03-29 08:36:52 [auto1.be] INFO: Scrape type for RM32931: 0
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: SK81997
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK81997%27 HTTP/1.1" 200 None
2026-03-29 08:36:52 [auto1.be] INFO: Scrape type for SK81997: 0
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: XE15288
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: PJ31589
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ31589%27 HTTP/1.1" 200 None
2026-03-29 08:36:52 [auto1.be] INFO: Scrape type for PJ31589: 0
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: MN41841
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: TV22564
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: UF59925
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF59925%27 HTTP/1.1" 200 None
2026-03-29 08:36:52 [auto1.be] INFO: Scrape type for UF59925: 0
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: UA82763
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: YX48939
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: RA81540
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA81540%27 HTTP/1.1" 200 None
2026-03-29 08:36:52 [auto1.be] INFO: Scrape type for RA81540: 0
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: RW15578
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: LW38679
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: WG20951
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG20951%27 HTTP/1.1" 200 None
2026-03-29 08:36:52 [auto1.be] INFO: Scrape type for WG20951: 2
2026-03-29 08:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18e3f3b6-e72f-5ee3-99d7-0aef4708b08d with identifier: WG20951
2026-03-29 08:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18e3f3b6-e72f-5ee3-99d7-0aef4708b08d with scrape type 2
2026-03-29 08:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18e3f3b6-e72f-5ee3-99d7-0aef4708b08d with scrape type 2
2026-03-29 08:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 18e3f3b6-e72f-5ee3-99d7-0aef4708b08d, identifier: WG20951
2026-03-29 08:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 18e3f3b6-e72f-5ee3-99d7-0aef4708b08d with identifier: WG20951
2026-03-29 08:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 18e3f3b6-e72f-5ee3-99d7-0aef4708b08d with identifier: WG20951
2026-03-29 08:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 18e3f3b6-e72f-5ee3-99d7-0aef4708b08d with identifier: WG20951 to the API
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:29:53Z',
'fuel_type': 'diesel',
'id': '18e3f3b6-e72f-5ee3-99d7-0aef4708b08d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG20951',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 94341,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-22',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2020}
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG20951%27 HTTP/1.1" 200 None
2026-03-29 08:36:52 [auto1.be] INFO: Saving data for WG20951: {'auction_closing_time': 1774884593.0, 'created_time': 1774557537.788328, 'last_price_update_time': 1774773412.519236}
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WG20951') HTTP/1.1" 204 0
2026-03-29 08:36:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: UW21644
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: AG87445
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG87445%27 HTTP/1.1" 200 None
2026-03-29 08:36:52 [auto1.be] INFO: Scrape type for AG87445: 0
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: LX45606
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LX45606%27 HTTP/1.1" 200 None
2026-03-29 08:36:52 [auto1.be] INFO: Scrape type for LX45606: 0
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: DE21401
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE21401%27 HTTP/1.1" 200 None
2026-03-29 08:36:52 [auto1.be] INFO: Scrape type for DE21401: 0
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: MJ77172
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: RK68346
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: VE52917
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE52917%27 HTTP/1.1" 200 None
2026-03-29 08:36:52 [auto1.be] INFO: Scrape type for VE52917: 0
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: GC03502
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC03502%27 HTTP/1.1" 200 None
2026-03-29 08:36:52 [auto1.be] INFO: Scrape type for GC03502: 0
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: JX04101
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: YA14339
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA14339%27 HTTP/1.1" 200 None
2026-03-29 08:36:52 [auto1.be] INFO: Scrape type for YA14339: 0
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: SD15124
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: RR03336
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: JZ92177
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ92177%27 HTTP/1.1" 200 None
2026-03-29 08:36:52 [auto1.be] INFO: Scrape type for JZ92177: 0
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: PF95077
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: WE56106
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: BC32945
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC32945%27 HTTP/1.1" 200 None
2026-03-29 08:36:52 [auto1.be] INFO: Scrape type for BC32945: 0
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: NB71425
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB71425%27 HTTP/1.1" 200 None
2026-03-29 08:36:52 [auto1.be] INFO: Scrape type for NB71425: 0
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: HJ67440
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ67440%27 HTTP/1.1" 200 None
2026-03-29 08:36:52 [auto1.be] INFO: Scrape type for HJ67440: 0
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: SF89359
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF89359%27 HTTP/1.1" 200 None
2026-03-29 08:36:52 [auto1.be] INFO: Scrape type for SF89359: 0
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: PN62826
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN62826%27 HTTP/1.1" 200 None
2026-03-29 08:36:52 [auto1.be] INFO: Scrape type for PN62826: 0
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: ZP07177
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: EF70909
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EF70909%27 HTTP/1.1" 200 None
2026-03-29 08:36:52 [auto1.be] INFO: Scrape type for EF70909: 0
2026-03-29 08:36:52 [auto1.be] INFO: Found listing with ID: FC28046
2026-03-29 08:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:53 [auto1.be] INFO: Channel: 24h | Page: 16 | totalHits: 1252 | hits on page: 40
2026-03-29 08:36:53 [auto1.be] INFO: Found listing with ID: FP68376
2026-03-29 08:36:53 [auto1.be] INFO: Found listing with ID: VL69873
2026-03-29 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL69873%27 HTTP/1.1" 200 None
2026-03-29 08:36:53 [auto1.be] INFO: Scrape type for VL69873: 0
2026-03-29 08:36:53 [auto1.be] INFO: Found listing with ID: AF71611
2026-03-29 08:36:53 [auto1.be] INFO: Found listing with ID: FR21473
2026-03-29 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR21473%27 HTTP/1.1" 200 None
2026-03-29 08:36:53 [auto1.be] INFO: Scrape type for FR21473: 0
2026-03-29 08:36:53 [auto1.be] INFO: Found listing with ID: FK29667
2026-03-29 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK29667%27 HTTP/1.1" 200 None
2026-03-29 08:36:53 [auto1.be] INFO: Scrape type for FK29667: 0
2026-03-29 08:36:53 [auto1.be] INFO: Found listing with ID: FG88533
2026-03-29 08:36:53 [auto1.be] INFO: Found listing with ID: AV34296
2026-03-29 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV34296%27 HTTP/1.1" 200 None
2026-03-29 08:36:53 [auto1.be] INFO: Scrape type for AV34296: 0
2026-03-29 08:36:53 [auto1.be] INFO: Found listing with ID: ET09366
2026-03-29 08:36:53 [auto1.be] INFO: Found listing with ID: SB45161
2026-03-29 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB45161%27 HTTP/1.1" 200 None
2026-03-29 08:36:53 [auto1.be] INFO: Scrape type for SB45161: 0
2026-03-29 08:36:53 [auto1.be] INFO: Found listing with ID: YF28674
2026-03-29 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF28674%27 HTTP/1.1" 200 None
2026-03-29 08:36:53 [auto1.be] INFO: Scrape type for YF28674: 0
2026-03-29 08:36:53 [auto1.be] INFO: Found listing with ID: SR34780
2026-03-29 08:36:53 [auto1.be] INFO: Found listing with ID: NK56969
2026-03-29 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK56969%27 HTTP/1.1" 200 None
2026-03-29 08:36:53 [auto1.be] INFO: Scrape type for NK56969: 0
2026-03-29 08:36:53 [auto1.be] INFO: Found listing with ID: MT09894
2026-03-29 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MT09894%27 HTTP/1.1" 200 None
2026-03-29 08:36:53 [auto1.be] INFO: Scrape type for MT09894: 0
2026-03-29 08:36:53 [auto1.be] INFO: Found listing with ID: WB76864
2026-03-29 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB76864%27 HTTP/1.1" 200 None
2026-03-29 08:36:53 [auto1.be] INFO: Scrape type for WB76864: 0
2026-03-29 08:36:53 [auto1.be] INFO: Found listing with ID: JZ88652
2026-03-29 08:36:53 [auto1.be] INFO: Found listing with ID: ZF81780
2026-03-29 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF81780%27 HTTP/1.1" 200 None
2026-03-29 08:36:53 [auto1.be] INFO: Scrape type for ZF81780: 0
2026-03-29 08:36:53 [auto1.be] INFO: Found listing with ID: UV91092
2026-03-29 08:36:53 [auto1.be] INFO: Found listing with ID: JX62848
2026-03-29 08:36:53 [auto1.be] INFO: Found listing with ID: BS55977
2026-03-29 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS55977%27 HTTP/1.1" 200 None
2026-03-29 08:36:53 [auto1.be] INFO: Scrape type for BS55977: 0
2026-03-29 08:36:53 [auto1.be] INFO: Found listing with ID: ET18736
2026-03-29 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET18736%27 HTTP/1.1" 200 None
2026-03-29 08:36:53 [auto1.be] INFO: Scrape type for ET18736: 0
2026-03-29 08:36:53 [auto1.be] INFO: Found listing with ID: MA69424
2026-03-29 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA69424%27 HTTP/1.1" 200 None
2026-03-29 08:36:53 [auto1.be] INFO: Scrape type for MA69424: 0
2026-03-29 08:36:53 [auto1.be] INFO: Found listing with ID: ZR45530
2026-03-29 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR45530%27 HTTP/1.1" 200 None
2026-03-29 08:36:53 [auto1.be] INFO: Scrape type for ZR45530: 0
2026-03-29 08:36:53 [auto1.be] INFO: Found listing with ID: VW08902
2026-03-29 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW08902%27 HTTP/1.1" 200 None
2026-03-29 08:36:53 [auto1.be] INFO: Scrape type for VW08902: 0
2026-03-29 08:36:53 [auto1.be] INFO: Found listing with ID: FS38787
2026-03-29 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS38787%27 HTTP/1.1" 200 None
2026-03-29 08:36:53 [auto1.be] INFO: Scrape type for FS38787: 0
2026-03-29 08:36:53 [auto1.be] INFO: Found listing with ID: HT09098
2026-03-29 08:36:53 [auto1.be] INFO: Found listing with ID: KP16038
2026-03-29 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP16038%27 HTTP/1.1" 200 None
2026-03-29 08:36:54 [auto1.be] INFO: Scrape type for KP16038: 0
2026-03-29 08:36:54 [auto1.be] INFO: Found listing with ID: KC19835
2026-03-29 08:36:54 [auto1.be] INFO: Found listing with ID: VU16052
2026-03-29 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU16052%27 HTTP/1.1" 200 None
2026-03-29 08:36:54 [auto1.be] INFO: Scrape type for VU16052: 0
2026-03-29 08:36:54 [auto1.be] INFO: Found listing with ID: HM47736
2026-03-29 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM47736%27 HTTP/1.1" 200 None
2026-03-29 08:36:54 [auto1.be] INFO: Scrape type for HM47736: 0
2026-03-29 08:36:54 [auto1.be] INFO: Found listing with ID: GF03232
2026-03-29 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF03232%27 HTTP/1.1" 200 None
2026-03-29 08:36:54 [auto1.be] INFO: Scrape type for GF03232: 0
2026-03-29 08:36:54 [auto1.be] INFO: Found listing with ID: UC56570
2026-03-29 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC56570%27 HTTP/1.1" 200 None
2026-03-29 08:36:54 [auto1.be] INFO: Scrape type for UC56570: 0
2026-03-29 08:36:54 [auto1.be] INFO: Found listing with ID: NN67810
2026-03-29 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN67810%27 HTTP/1.1" 200 None
2026-03-29 08:36:54 [auto1.be] INFO: Scrape type for NN67810: 0
2026-03-29 08:36:54 [auto1.be] INFO: Found listing with ID: FE88671
2026-03-29 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE88671%27 HTTP/1.1" 200 None
2026-03-29 08:36:54 [auto1.be] INFO: Scrape type for FE88671: 0
2026-03-29 08:36:54 [auto1.be] INFO: Found listing with ID: ZM54686
2026-03-29 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM54686%27 HTTP/1.1" 200 None
2026-03-29 08:36:54 [auto1.be] INFO: Scrape type for ZM54686: 0
2026-03-29 08:36:54 [auto1.be] INFO: Found listing with ID: GR78986
2026-03-29 08:36:54 [auto1.be] INFO: Found listing with ID: CP42003
2026-03-29 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP42003%27 HTTP/1.1" 200 None
2026-03-29 08:36:54 [auto1.be] INFO: Scrape type for CP42003: 0
2026-03-29 08:36:54 [auto1.be] INFO: Found listing with ID: RN56335
2026-03-29 08:36:54 [auto1.be] INFO: Found listing with ID: RF80171
2026-03-29 08:36:54 [auto1.be] INFO: Found listing with ID: ZF78419
2026-03-29 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF78419%27 HTTP/1.1" 200 None
2026-03-29 08:36:54 [auto1.be] INFO: Scrape type for ZF78419: 0
2026-03-29 08:36:54 [auto1.be] INFO: Found listing with ID: DT24627
2026-03-29 08:36:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:55 [auto1.be] INFO: Channel: 24h | Page: 17 | totalHits: 1252 | hits on page: 40
2026-03-29 08:36:55 [auto1.be] INFO: Found listing with ID: YM99739
2026-03-29 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM99739%27 HTTP/1.1" 200 None
2026-03-29 08:36:55 [auto1.be] INFO: Scrape type for YM99739: 0
2026-03-29 08:36:55 [auto1.be] INFO: Found listing with ID: CH83928
2026-03-29 08:36:55 [auto1.be] INFO: Found listing with ID: YT15018
2026-03-29 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YT15018%27 HTTP/1.1" 200 None
2026-03-29 08:36:55 [auto1.be] INFO: Scrape type for YT15018: 0
2026-03-29 08:36:55 [auto1.be] INFO: Found listing with ID: BC69430
2026-03-29 08:36:55 [auto1.be] INFO: Found listing with ID: BU90061
2026-03-29 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU90061%27 HTTP/1.1" 200 None
2026-03-29 08:36:55 [auto1.be] INFO: Scrape type for BU90061: 0
2026-03-29 08:36:55 [auto1.be] INFO: Found listing with ID: EV01420
2026-03-29 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV01420%27 HTTP/1.1" 200 None
2026-03-29 08:36:55 [auto1.be] INFO: Scrape type for EV01420: 2
2026-03-29 08:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5c5eadd-3797-54fb-a3b8-7ec3624c6765 with identifier: EV01420
2026-03-29 08:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5c5eadd-3797-54fb-a3b8-7ec3624c6765 with scrape type 2
2026-03-29 08:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5c5eadd-3797-54fb-a3b8-7ec3624c6765 with scrape type 2
2026-03-29 08:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b5c5eadd-3797-54fb-a3b8-7ec3624c6765, identifier: EV01420
2026-03-29 08:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b5c5eadd-3797-54fb-a3b8-7ec3624c6765 with identifier: EV01420
2026-03-29 08:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b5c5eadd-3797-54fb-a3b8-7ec3624c6765 with identifier: EV01420
2026-03-29 08:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b5c5eadd-3797-54fb-a3b8-7ec3624c6765 with identifier: EV01420 to the API
2026-03-29 08:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:56:06Z',
'fuel_type': 'hybrid',
'id': 'b5c5eadd-3797-54fb-a3b8-7ec3624c6765',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV01420',
'listing': 'auction',
'make': 'Toyota',
'model': 'C-HR',
'odometer': 121300,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-21',
'seller_name': None,
'title': 'Toyota C-HR 1.8 Hybrid Active',
'transmission': 'automatic',
'trim': 'Active',
'year': 2018}
2026-03-29 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV01420%27 HTTP/1.1" 200 None
2026-03-29 08:36:55 [auto1.be] INFO: Saving data for EV01420: {'auction_closing_time': 1774886166.0, 'created_time': 1774557545.352942, 'last_price_update_time': 1774773415.752905}
2026-03-29 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EV01420') HTTP/1.1" 204 0
2026-03-29 08:36:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:55 [auto1.be] INFO: Found listing with ID: PS72966
2026-03-29 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS72966%27 HTTP/1.1" 200 None
2026-03-29 08:36:55 [auto1.be] INFO: Scrape type for PS72966: 0
2026-03-29 08:36:55 [auto1.be] INFO: Found listing with ID: CR22525
2026-03-29 08:36:55 [auto1.be] INFO: Found listing with ID: HF54985
2026-03-29 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HF54985%27 HTTP/1.1" 200 None
2026-03-29 08:36:55 [auto1.be] INFO: Scrape type for HF54985: 0
2026-03-29 08:36:55 [auto1.be] INFO: Found listing with ID: GH94733
2026-03-29 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH94733%27 HTTP/1.1" 200 None
2026-03-29 08:36:55 [auto1.be] INFO: Scrape type for GH94733: 0
2026-03-29 08:36:55 [auto1.be] INFO: Found listing with ID: CP91123
2026-03-29 08:36:55 [auto1.be] INFO: Found listing with ID: FA30680
2026-03-29 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA30680%27 HTTP/1.1" 200 None
2026-03-29 08:36:55 [auto1.be] INFO: Scrape type for FA30680: 0
2026-03-29 08:36:55 [auto1.be] INFO: Found listing with ID: WL65720
2026-03-29 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL65720%27 HTTP/1.1" 200 None
2026-03-29 08:36:55 [auto1.be] INFO: Scrape type for WL65720: 0
2026-03-29 08:36:55 [auto1.be] INFO: Found listing with ID: KM67426
2026-03-29 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM67426%27 HTTP/1.1" 200 None
2026-03-29 08:36:55 [auto1.be] INFO: Scrape type for KM67426: 0
2026-03-29 08:36:55 [auto1.be] INFO: Found listing with ID: DM52841
2026-03-29 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM52841%27 HTTP/1.1" 200 None
2026-03-29 08:36:55 [auto1.be] INFO: Scrape type for DM52841: 0
2026-03-29 08:36:55 [auto1.be] INFO: Found listing with ID: YH09444
2026-03-29 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH09444%27 HTTP/1.1" 200 None
2026-03-29 08:36:55 [auto1.be] INFO: Scrape type for YH09444: 0
2026-03-29 08:36:55 [auto1.be] INFO: Found listing with ID: JP67733
2026-03-29 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JP67733%27 HTTP/1.1" 200 None
2026-03-29 08:36:56 [auto1.be] INFO: Scrape type for JP67733: 0
2026-03-29 08:36:56 [auto1.be] INFO: Found listing with ID: RB53949
2026-03-29 08:36:56 [auto1.be] INFO: Found listing with ID: XD36076
2026-03-29 08:36:56 [auto1.be] INFO: Found listing with ID: RK05604
2026-03-29 08:36:56 [auto1.be] INFO: Found listing with ID: WA39171
2026-03-29 08:36:56 [auto1.be] INFO: Found listing with ID: AL21659
2026-03-29 08:36:56 [auto1.be] INFO: Found listing with ID: DC47068
2026-03-29 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC47068%27 HTTP/1.1" 200 None
2026-03-29 08:36:56 [auto1.be] INFO: Scrape type for DC47068: 0
2026-03-29 08:36:56 [auto1.be] INFO: Found listing with ID: ES19550
2026-03-29 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES19550%27 HTTP/1.1" 200 None
2026-03-29 08:36:56 [auto1.be] INFO: Scrape type for ES19550: 0
2026-03-29 08:36:56 [auto1.be] INFO: Found listing with ID: ZH14429
2026-03-29 08:36:56 [auto1.be] INFO: Found listing with ID: VV25356
2026-03-29 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VV25356%27 HTTP/1.1" 200 None
2026-03-29 08:36:56 [auto1.be] INFO: Scrape type for VV25356: 0
2026-03-29 08:36:56 [auto1.be] INFO: Found listing with ID: GS99704
2026-03-29 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS99704%27 HTTP/1.1" 200 None
2026-03-29 08:36:56 [auto1.be] INFO: Scrape type for GS99704: 0
2026-03-29 08:36:56 [auto1.be] INFO: Found listing with ID: YJ44532
2026-03-29 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ44532%27 HTTP/1.1" 200 None
2026-03-29 08:36:56 [auto1.be] INFO: Scrape type for YJ44532: 0
2026-03-29 08:36:56 [auto1.be] INFO: Found listing with ID: UD97693
2026-03-29 08:36:56 [auto1.be] INFO: Found listing with ID: VM79296
2026-03-29 08:36:56 [auto1.be] INFO: Found listing with ID: YF30387
2026-03-29 08:36:56 [auto1.be] INFO: Found listing with ID: NU98421
2026-03-29 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU98421%27 HTTP/1.1" 200 None
2026-03-29 08:36:56 [auto1.be] INFO: Scrape type for NU98421: 0
2026-03-29 08:36:56 [auto1.be] INFO: Found listing with ID: DY95002
2026-03-29 08:36:56 [auto1.be] INFO: Found listing with ID: HL95749
2026-03-29 08:36:56 [auto1.be] INFO: Found listing with ID: SA79242
2026-03-29 08:36:56 [auto1.be] INFO: Found listing with ID: KF81819
2026-03-29 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF81819%27 HTTP/1.1" 200 None
2026-03-29 08:36:56 [auto1.be] INFO: Scrape type for KF81819: 0
2026-03-29 08:36:56 [auto1.be] INFO: Found listing with ID: WC10504
2026-03-29 08:36:56 [auto1.be] INFO: Found listing with ID: KU12802
2026-03-29 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU12802%27 HTTP/1.1" 200 None
2026-03-29 08:36:56 [auto1.be] INFO: Scrape type for KU12802: 2
2026-03-29 08:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a1c80e8-a996-510d-963b-0b20f35b4714 with identifier: KU12802
2026-03-29 08:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a1c80e8-a996-510d-963b-0b20f35b4714 with scrape type 2
2026-03-29 08:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a1c80e8-a996-510d-963b-0b20f35b4714 with scrape type 2
2026-03-29 08:36:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0a1c80e8-a996-510d-963b-0b20f35b4714, identifier: KU12802
2026-03-29 08:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0a1c80e8-a996-510d-963b-0b20f35b4714 with identifier: KU12802
2026-03-29 08:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0a1c80e8-a996-510d-963b-0b20f35b4714 with identifier: KU12802
2026-03-29 08:36:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0a1c80e8-a996-510d-963b-0b20f35b4714 with identifier: KU12802 to the API
2026-03-29 08:36:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:53:41Z',
'fuel_type': 'diesel',
'id': '0a1c80e8-a996-510d-963b-0b20f35b4714',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU12802',
'listing': 'auction',
'make': 'Dacia',
'model': 'Lodgy',
'odometer': 221022,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-16',
'seller_name': None,
'title': 'Dacia Lodgy 1.5 dCi Diesel Laureate',
'transmission': 'manual',
'trim': 'Laureate',
'year': 2013}
2026-03-29 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU12802%27 HTTP/1.1" 200 None
2026-03-29 08:36:56 [auto1.be] INFO: Saving data for KU12802: {'auction_closing_time': 1774886021.0, 'created_time': 1774557492.564324, 'last_price_update_time': 1774773416.547857}
2026-03-29 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KU12802') HTTP/1.1" 204 0
2026-03-29 08:36:56 [auto1.be] INFO: Found listing with ID: CE58685
2026-03-29 08:36:56 [auto1.be] INFO: Found listing with ID: YH98972
2026-03-29 08:36:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:57 [auto1.be] INFO: Channel: 24h | Page: 18 | totalHits: 1252 | hits on page: 40
2026-03-29 08:36:57 [auto1.be] INFO: Found listing with ID: BJ55526
2026-03-29 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ55526%27 HTTP/1.1" 200 None
2026-03-29 08:36:57 [auto1.be] INFO: Scrape type for BJ55526: 0
2026-03-29 08:36:57 [auto1.be] INFO: Found listing with ID: GP50240
2026-03-29 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP50240%27 HTTP/1.1" 200 None
2026-03-29 08:36:57 [auto1.be] INFO: Scrape type for GP50240: 0
2026-03-29 08:36:57 [auto1.be] INFO: Found listing with ID: SR93497
2026-03-29 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR93497%27 HTTP/1.1" 200 None
2026-03-29 08:36:57 [auto1.be] INFO: Scrape type for SR93497: 0
2026-03-29 08:36:57 [auto1.be] INFO: Found listing with ID: GN45273
2026-03-29 08:36:57 [auto1.be] INFO: Found listing with ID: TW22956
2026-03-29 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW22956%27 HTTP/1.1" 200 None
2026-03-29 08:36:57 [auto1.be] INFO: Scrape type for TW22956: 2
2026-03-29 08:36:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6284fe65-c9e2-5fba-8b4b-9a82be49dc51 with identifier: TW22956
2026-03-29 08:36:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6284fe65-c9e2-5fba-8b4b-9a82be49dc51 with scrape type 2
2026-03-29 08:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6284fe65-c9e2-5fba-8b4b-9a82be49dc51 with scrape type 2
2026-03-29 08:36:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6284fe65-c9e2-5fba-8b4b-9a82be49dc51, identifier: TW22956
2026-03-29 08:36:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6284fe65-c9e2-5fba-8b4b-9a82be49dc51 with identifier: TW22956
2026-03-29 08:36:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6284fe65-c9e2-5fba-8b4b-9a82be49dc51 with identifier: TW22956
2026-03-29 08:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6284fe65-c9e2-5fba-8b4b-9a82be49dc51 with identifier: TW22956 to the API
2026-03-29 08:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 283,
'expiration_date': '2026-03-30T15:05:05Z',
'fuel_type': 'hybrid',
'id': '6284fe65-c9e2-5fba-8b4b-9a82be49dc51',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW22956',
'listing': 'auction',
'make': 'Volvo',
'model': 'V60',
'odometer': 228232,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-03',
'seller_name': None,
'title': 'Volvo V60 2.4 D6 Plug-in Hybrid Summum AWD',
'transmission': 'automatic',
'trim': 'Summum AWD',
'year': 2014}
2026-03-29 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW22956%27 HTTP/1.1" 200 None
2026-03-29 08:36:58 [auto1.be] INFO: Saving data for TW22956: {'auction_closing_time': 1774883105.0, 'created_time': 1774557567.67692, 'last_price_update_time': 1774773418.005791}
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TW22956') HTTP/1.1" 204 0
2026-03-29 08:36:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:58 [auto1.be] INFO: Found listing with ID: AE23838
2026-03-29 08:36:58 [auto1.be] INFO: Found listing with ID: MF96479
2026-03-29 08:36:58 [auto1.be] INFO: Found listing with ID: WD60187
2026-03-29 08:36:58 [auto1.be] INFO: Found listing with ID: KF59500
2026-03-29 08:36:58 [auto1.be] INFO: Found listing with ID: ZT52703
2026-03-29 08:36:58 [auto1.be] INFO: Found listing with ID: ZR52684
2026-03-29 08:36:58 [auto1.be] INFO: Found listing with ID: GP69185
2026-03-29 08:36:58 [auto1.be] INFO: Found listing with ID: DF09339
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF09339%27 HTTP/1.1" 200 None
2026-03-29 08:36:58 [auto1.be] INFO: Scrape type for DF09339: 0
2026-03-29 08:36:58 [auto1.be] INFO: Found listing with ID: LY80968
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY80968%27 HTTP/1.1" 200 None
2026-03-29 08:36:58 [auto1.be] INFO: Scrape type for LY80968: 0
2026-03-29 08:36:58 [auto1.be] INFO: Found listing with ID: CN47453
2026-03-29 08:36:58 [auto1.be] INFO: Found listing with ID: BX96549
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX96549%27 HTTP/1.1" 200 None
2026-03-29 08:36:58 [auto1.be] INFO: Scrape type for BX96549: 0
2026-03-29 08:36:58 [auto1.be] INFO: Found listing with ID: LM94739
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM94739%27 HTTP/1.1" 200 None
2026-03-29 08:36:58 [auto1.be] INFO: Scrape type for LM94739: 2
2026-03-29 08:36:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4aeb3cc8-f65d-5432-b1f8-532bac2ed33b with identifier: LM94739
2026-03-29 08:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4aeb3cc8-f65d-5432-b1f8-532bac2ed33b with scrape type 2
2026-03-29 08:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4aeb3cc8-f65d-5432-b1f8-532bac2ed33b with scrape type 2
2026-03-29 08:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4aeb3cc8-f65d-5432-b1f8-532bac2ed33b, identifier: LM94739
2026-03-29 08:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4aeb3cc8-f65d-5432-b1f8-532bac2ed33b with identifier: LM94739
2026-03-29 08:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4aeb3cc8-f65d-5432-b1f8-532bac2ed33b with identifier: LM94739
2026-03-29 08:36:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4aeb3cc8-f65d-5432-b1f8-532bac2ed33b with identifier: LM94739 to the API
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:42:35Z',
'fuel_type': 'diesel',
'id': '4aeb3cc8-f65d-5432-b1f8-532bac2ed33b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM94739',
'listing': 'auction',
'make': 'Citroen',
'model': 'Jumpy',
'odometer': 93719,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-13',
'seller_name': None,
'title': 'Citroen Jumpy 1.6 HDi L1H1 27 Kasten',
'transmission': 'manual',
'trim': 'L1H1 27 Kasten',
'year': 2016}
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM94739%27 HTTP/1.1" 200 None
2026-03-29 08:36:58 [auto1.be] INFO: Saving data for LM94739: {'auction_closing_time': 1774885355.0, 'created_time': 1774557493.226975, 'last_price_update_time': 1774773418.478356}
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LM94739') HTTP/1.1" 204 0
2026-03-29 08:36:58 [auto1.be] INFO: Found listing with ID: UT35373
2026-03-29 08:36:58 [auto1.be] INFO: Found listing with ID: KW15988
2026-03-29 08:36:58 [auto1.be] INFO: Found listing with ID: ZR23499
2026-03-29 08:36:58 [auto1.be] INFO: Found listing with ID: YR29884
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YR29884%27 HTTP/1.1" 200 None
2026-03-29 08:36:58 [auto1.be] INFO: Scrape type for YR29884: 0
2026-03-29 08:36:58 [auto1.be] INFO: Found listing with ID: NK28391
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK28391%27 HTTP/1.1" 200 None
2026-03-29 08:36:58 [auto1.be] INFO: Scrape type for NK28391: 0
2026-03-29 08:36:58 [auto1.be] INFO: Found listing with ID: KF50538
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF50538%27 HTTP/1.1" 200 None
2026-03-29 08:36:58 [auto1.be] INFO: Scrape type for KF50538: 0
2026-03-29 08:36:58 [auto1.be] INFO: Found listing with ID: ZR56949
2026-03-29 08:36:58 [auto1.be] INFO: Found listing with ID: MA06269
2026-03-29 08:36:58 [auto1.be] INFO: Found listing with ID: VZ78935
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ78935%27 HTTP/1.1" 200 None
2026-03-29 08:36:58 [auto1.be] INFO: Scrape type for VZ78935: 0
2026-03-29 08:36:58 [auto1.be] INFO: Found listing with ID: YU72813
2026-03-29 08:36:58 [auto1.be] INFO: Found listing with ID: CB53563
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB53563%27 HTTP/1.1" 200 None
2026-03-29 08:36:58 [auto1.be] INFO: Scrape type for CB53563: 0
2026-03-29 08:36:58 [auto1.be] INFO: Found listing with ID: NR94896
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR94896%27 HTTP/1.1" 200 None
2026-03-29 08:36:58 [auto1.be] INFO: Scrape type for NR94896: 0
2026-03-29 08:36:58 [auto1.be] INFO: Found listing with ID: GW69223
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW69223%27 HTTP/1.1" 200 None
2026-03-29 08:36:58 [auto1.be] INFO: Scrape type for GW69223: 2
2026-03-29 08:36:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79a5edd5-90b6-58cc-ad3f-f133d9393958 with identifier: GW69223
2026-03-29 08:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79a5edd5-90b6-58cc-ad3f-f133d9393958 with scrape type 2
2026-03-29 08:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79a5edd5-90b6-58cc-ad3f-f133d9393958 with scrape type 2
2026-03-29 08:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 79a5edd5-90b6-58cc-ad3f-f133d9393958, identifier: GW69223
2026-03-29 08:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 79a5edd5-90b6-58cc-ad3f-f133d9393958 with identifier: GW69223
2026-03-29 08:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 79a5edd5-90b6-58cc-ad3f-f133d9393958 with identifier: GW69223
2026-03-29 08:36:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 79a5edd5-90b6-58cc-ad3f-f133d9393958 with identifier: GW69223 to the API
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:47:33Z',
'fuel_type': 'petrol',
'id': '79a5edd5-90b6-58cc-ad3f-f133d9393958',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW69223',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 70481,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-15',
'seller_name': None,
'title': 'Skoda Octavia 1.5 TSI ACT Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2019}
2026-03-29 08:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW69223%27 HTTP/1.1" 200 None
2026-03-29 08:36:59 [auto1.be] INFO: Saving data for GW69223: {'auction_closing_time': 1774885653.0, 'created_time': 1774557564.216653, 'last_price_update_time': 1774773419.068344}
2026-03-29 08:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GW69223') HTTP/1.1" 204 0
2026-03-29 08:36:59 [auto1.be] INFO: Found listing with ID: BV56621
2026-03-29 08:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV56621%27 HTTP/1.1" 200 None
2026-03-29 08:36:59 [auto1.be] INFO: Scrape type for BV56621: 0
2026-03-29 08:36:59 [auto1.be] INFO: Found listing with ID: CM40127
2026-03-29 08:36:59 [auto1.be] INFO: Found listing with ID: UB84592
2026-03-29 08:36:59 [auto1.be] INFO: Found listing with ID: HT96077
2026-03-29 08:36:59 [auto1.be] INFO: Found listing with ID: LE55631
2026-03-29 08:36:59 [auto1.be] INFO: Found listing with ID: AK84541
2026-03-29 08:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK84541%27 HTTP/1.1" 200 None
2026-03-29 08:36:59 [auto1.be] INFO: Scrape type for AK84541: 0
2026-03-29 08:36:59 [auto1.be] INFO: Found listing with ID: PM96543
2026-03-29 08:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM96543%27 HTTP/1.1" 200 None
2026-03-29 08:36:59 [auto1.be] INFO: Scrape type for PM96543: 0
2026-03-29 08:36:59 [auto1.be] INFO: Found listing with ID: KF52558
2026-03-29 08:36:59 [auto1.be] INFO: Found listing with ID: NM84060
2026-03-29 08:36:59 [auto1.be] INFO: Found listing with ID: TW64249
2026-03-29 08:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:37:00 [auto1.be] INFO: Channel: 24h | Page: 19 | totalHits: 1252 | hits on page: 40
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: XE64009
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE64009%27 HTTP/1.1" 200 None
2026-03-29 08:37:00 [auto1.be] INFO: Scrape type for XE64009: 0
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: KU26204
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU26204%27 HTTP/1.1" 200 None
2026-03-29 08:37:00 [auto1.be] INFO: Scrape type for KU26204: 0
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: ZN66630
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN66630%27 HTTP/1.1" 200 None
2026-03-29 08:37:00 [auto1.be] INFO: Scrape type for ZN66630: 0
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: PY81659
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: ZG50395
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG50395%27 HTTP/1.1" 200 None
2026-03-29 08:37:00 [auto1.be] INFO: Scrape type for ZG50395: 0
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: TM97404
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM97404%27 HTTP/1.1" 200 None
2026-03-29 08:37:00 [auto1.be] INFO: Scrape type for TM97404: 0
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: UV50609
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: ZZ47044
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ47044%27 HTTP/1.1" 200 None
2026-03-29 08:37:00 [auto1.be] INFO: Scrape type for ZZ47044: 0
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: UT04463
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT04463%27 HTTP/1.1" 200 None
2026-03-29 08:37:00 [auto1.be] INFO: Scrape type for UT04463: 0
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: WK14396
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: WE53696
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE53696%27 HTTP/1.1" 200 None
2026-03-29 08:37:00 [auto1.be] INFO: Scrape type for WE53696: 0
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: RW49064
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: NP69529
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP69529%27 HTTP/1.1" 200 None
2026-03-29 08:37:00 [auto1.be] INFO: Scrape type for NP69529: 0
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: WU38196
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU38196%27 HTTP/1.1" 200 None
2026-03-29 08:37:00 [auto1.be] INFO: Scrape type for WU38196: 0
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: ZL81412
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: FC74189
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC74189%27 HTTP/1.1" 200 None
2026-03-29 08:37:00 [auto1.be] INFO: Scrape type for FC74189: 0
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: CS98471
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: KC69840
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: ZR84759
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: WG89987
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: FE56390
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE56390%27 HTTP/1.1" 200 None
2026-03-29 08:37:00 [auto1.be] INFO: Scrape type for FE56390: 0
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: BR84638
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR84638%27 HTTP/1.1" 200 None
2026-03-29 08:37:00 [auto1.be] INFO: Scrape type for BR84638: 0
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: WC98842
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: VM06685
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: TS87931
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: UL72077
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL72077%27 HTTP/1.1" 200 None
2026-03-29 08:37:00 [auto1.be] INFO: Scrape type for UL72077: 0
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: VZ08217
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ08217%27 HTTP/1.1" 200 None
2026-03-29 08:37:00 [auto1.be] INFO: Scrape type for VZ08217: 0
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: UJ89543
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: SZ60181
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: JZ97752
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: YL00049
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL00049%27 HTTP/1.1" 200 None
2026-03-29 08:37:00 [auto1.be] INFO: Scrape type for YL00049: 0
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: SF38570
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: CG91643
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: CP13942
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP13942%27 HTTP/1.1" 200 None
2026-03-29 08:37:00 [auto1.be] INFO: Scrape type for CP13942: 0
2026-03-29 08:37:00 [auto1.be] INFO: Found listing with ID: RE48196
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE48196%27 HTTP/1.1" 200 None
2026-03-29 08:37:00 [auto1.be] INFO: Scrape type for RE48196: 2
2026-03-29 08:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd237f58-eccc-50ed-b36d-78cba6c28d6a with identifier: RE48196
2026-03-29 08:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd237f58-eccc-50ed-b36d-78cba6c28d6a with scrape type 2
2026-03-29 08:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd237f58-eccc-50ed-b36d-78cba6c28d6a with scrape type 2
2026-03-29 08:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dd237f58-eccc-50ed-b36d-78cba6c28d6a, identifier: RE48196
2026-03-29 08:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dd237f58-eccc-50ed-b36d-78cba6c28d6a with identifier: RE48196
2026-03-29 08:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dd237f58-eccc-50ed-b36d-78cba6c28d6a with identifier: RE48196
2026-03-29 08:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dd237f58-eccc-50ed-b36d-78cba6c28d6a with identifier: RE48196 to the API
2026-03-29 08:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:21:32Z',
'fuel_type': 'diesel',
'id': 'dd237f58-eccc-50ed-b36d-78cba6c28d6a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE48196',
'listing': 'auction',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 206620,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-21',
'seller_name': None,
'title': 'Citroen Berlingo 1.6 HDi Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2013}
2026-03-29 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE48196%27 HTTP/1.1" 200 None
2026-03-29 08:37:01 [auto1.be] INFO: Saving data for RE48196: {'auction_closing_time': 1774884092.0, 'created_time': 1774557447.875121, 'last_price_update_time': 1774773421.343707}
2026-03-29 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RE48196') HTTP/1.1" 204 0
2026-03-29 08:37:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:37:01 [auto1.be] INFO: Found listing with ID: MS23670
2026-03-29 08:37:01 [auto1.be] INFO: Found listing with ID: CU40853
2026-03-29 08:37:01 [auto1.be] INFO: Found listing with ID: VA59143
2026-03-29 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA59143%27 HTTP/1.1" 200 None
2026-03-29 08:37:01 [auto1.be] INFO: Scrape type for VA59143: 0
2026-03-29 08:37:01 [auto1.be] INFO: Found listing with ID: PR31064
2026-03-29 08:37:01 [auto1.be] INFO: Found listing with ID: KC33551
2026-03-29 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC33551%27 HTTP/1.1" 200 None
2026-03-29 08:37:01 [auto1.be] INFO: Scrape type for KC33551: 0
2026-03-29 08:37:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:37:02 [auto1.be] INFO: Channel: 24h | Page: 20 | totalHits: 1252 | hits on page: 40
2026-03-29 08:37:02 [auto1.be] INFO: Found listing with ID: CE65833
2026-03-29 08:37:02 [auto1.be] INFO: Found listing with ID: VA87646
2026-03-29 08:37:02 [auto1.be] INFO: Found listing with ID: RA65802
2026-03-29 08:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA65802%27 HTTP/1.1" 200 None
2026-03-29 08:37:02 [auto1.be] INFO: Scrape type for RA65802: 0
2026-03-29 08:37:02 [auto1.be] INFO: Found listing with ID: MJ08102
2026-03-29 08:37:02 [auto1.be] INFO: Found listing with ID: CF04837
2026-03-29 08:37:02 [auto1.be] INFO: Found listing with ID: TS87416
2026-03-29 08:37:02 [auto1.be] INFO: Found listing with ID: YB94076
2026-03-29 08:37:02 [auto1.be] INFO: Found listing with ID: JM27578
2026-03-29 08:37:02 [auto1.be] INFO: Found listing with ID: ZA01438
2026-03-29 08:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZA01438%27 HTTP/1.1" 200 None
2026-03-29 08:37:02 [auto1.be] INFO: Scrape type for ZA01438: 0
2026-03-29 08:37:02 [auto1.be] INFO: Found listing with ID: VJ27978
2026-03-29 08:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VJ27978%27 HTTP/1.1" 200 None
2026-03-29 08:37:02 [auto1.be] INFO: Scrape type for VJ27978: 0
2026-03-29 08:37:02 [auto1.be] INFO: Found listing with ID: DF96327
2026-03-29 08:37:02 [auto1.be] INFO: Found listing with ID: MC94265
2026-03-29 08:37:02 [auto1.be] INFO: Found listing with ID: VP90118
2026-03-29 08:37:02 [auto1.be] INFO: Found listing with ID: PY58607
2026-03-29 08:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY58607%27 HTTP/1.1" 200 None
2026-03-29 08:37:02 [auto1.be] INFO: Scrape type for PY58607: 0
2026-03-29 08:37:02 [auto1.be] INFO: Found listing with ID: PK93774
2026-03-29 08:37:02 [auto1.be] INFO: Found listing with ID: BT72678
2026-03-29 08:37:02 [auto1.be] INFO: Found listing with ID: TK06008
2026-03-29 08:37:02 [auto1.be] INFO: Found listing with ID: VP91071
2026-03-29 08:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP91071%27 HTTP/1.1" 200 None
2026-03-29 08:37:02 [auto1.be] INFO: Scrape type for VP91071: 2
2026-03-29 08:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fe4da8e-e9ba-5e9f-b32e-cd0cde767e0a with identifier: VP91071
2026-03-29 08:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fe4da8e-e9ba-5e9f-b32e-cd0cde767e0a with scrape type 2
2026-03-29 08:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fe4da8e-e9ba-5e9f-b32e-cd0cde767e0a with scrape type 2
2026-03-29 08:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9fe4da8e-e9ba-5e9f-b32e-cd0cde767e0a, identifier: VP91071
2026-03-29 08:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9fe4da8e-e9ba-5e9f-b32e-cd0cde767e0a with identifier: VP91071
2026-03-29 08:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9fe4da8e-e9ba-5e9f-b32e-cd0cde767e0a with identifier: VP91071
2026-03-29 08:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9fe4da8e-e9ba-5e9f-b32e-cd0cde767e0a with identifier: VP91071 to the API
2026-03-29 08:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:17:58Z',
'fuel_type': 'petrol',
'id': '9fe4da8e-e9ba-5e9f-b32e-cd0cde767e0a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP91071',
'listing': 'auction',
'make': 'Peugeot',
'model': '206',
'odometer': 129499,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-05-26',
'seller_name': None,
'title': 'Peugeot 206 1.4 Generation',
'transmission': 'manual',
'trim': 'Generation',
'year': 2008}
2026-03-29 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP91071%27 HTTP/1.1" 200 None
2026-03-29 08:37:03 [auto1.be] INFO: Saving data for VP91071: {'auction_closing_time': 1774883878.0, 'created_time': 1774557465.388795, 'last_price_update_time': 1774773423.055722}
2026-03-29 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VP91071') HTTP/1.1" 204 0
2026-03-29 08:37:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:37:03 [auto1.be] INFO: Found listing with ID: NM63028
2026-03-29 08:37:03 [auto1.be] INFO: Found listing with ID: JY53618
2026-03-29 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY53618%27 HTTP/1.1" 200 None
2026-03-29 08:37:03 [auto1.be] INFO: Scrape type for JY53618: 0
2026-03-29 08:37:03 [auto1.be] INFO: Found listing with ID: VB55746
2026-03-29 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB55746%27 HTTP/1.1" 200 None
2026-03-29 08:37:03 [auto1.be] INFO: Scrape type for VB55746: 0
2026-03-29 08:37:03 [auto1.be] INFO: Found listing with ID: GS48835
2026-03-29 08:37:03 [auto1.be] INFO: Found listing with ID: FA63464
2026-03-29 08:37:03 [auto1.be] INFO: Found listing with ID: XA29570
2026-03-29 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XA29570%27 HTTP/1.1" 200 None
2026-03-29 08:37:03 [auto1.be] INFO: Scrape type for XA29570: 0
2026-03-29 08:37:03 [auto1.be] INFO: Found listing with ID: MG12074
2026-03-29 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG12074%27 HTTP/1.1" 200 None
2026-03-29 08:37:03 [auto1.be] INFO: Scrape type for MG12074: 0
2026-03-29 08:37:03 [auto1.be] INFO: Found listing with ID: YD21406
2026-03-29 08:37:03 [auto1.be] INFO: Found listing with ID: XJ95743
2026-03-29 08:37:03 [auto1.be] INFO: Found listing with ID: DB02418
2026-03-29 08:37:03 [auto1.be] INFO: Found listing with ID: XT36171
2026-03-29 08:37:03 [auto1.be] INFO: Found listing with ID: MC66522
2026-03-29 08:37:03 [auto1.be] INFO: Found listing with ID: ZK00678
2026-03-29 08:37:03 [auto1.be] INFO: Found listing with ID: DE33834
2026-03-29 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE33834%27 HTTP/1.1" 200 None
2026-03-29 08:37:03 [auto1.be] INFO: Scrape type for DE33834: 2
2026-03-29 08:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0346a38f-a7f7-5f29-800a-bb81ada4be6b with identifier: DE33834
2026-03-29 08:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0346a38f-a7f7-5f29-800a-bb81ada4be6b with scrape type 2
2026-03-29 08:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0346a38f-a7f7-5f29-800a-bb81ada4be6b with scrape type 2
2026-03-29 08:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0346a38f-a7f7-5f29-800a-bb81ada4be6b, identifier: DE33834
2026-03-29 08:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0346a38f-a7f7-5f29-800a-bb81ada4be6b with identifier: DE33834
2026-03-29 08:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0346a38f-a7f7-5f29-800a-bb81ada4be6b with identifier: DE33834
2026-03-29 08:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0346a38f-a7f7-5f29-800a-bb81ada4be6b with identifier: DE33834 to the API
2026-03-29 08:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:11:41Z',
'fuel_type': 'petrol',
'id': '0346a38f-a7f7-5f29-800a-bb81ada4be6b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE33834',
'listing': 'auction',
'make': 'Lancia',
'model': 'Ypsilon',
'odometer': 93865,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-19',
'seller_name': None,
'title': 'Lancia Ypsilon 1.2 Platino',
'transmission': 'manual',
'trim': 'Platino',
'year': 2011}
2026-03-29 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE33834%27 HTTP/1.1" 200 None
2026-03-29 08:37:03 [auto1.be] INFO: Saving data for DE33834: {'auction_closing_time': 1774883501.0, 'created_time': 1774557563.91213, 'last_price_update_time': 1774773423.660456}
2026-03-29 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DE33834') HTTP/1.1" 204 0
2026-03-29 08:37:03 [auto1.be] INFO: Found listing with ID: HH62001
2026-03-29 08:37:03 [auto1.be] INFO: Found listing with ID: WF76478
2026-03-29 08:37:03 [auto1.be] INFO: Found listing with ID: SC59712
2026-03-29 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC59712%27 HTTP/1.1" 200 None
2026-03-29 08:37:03 [auto1.be] INFO: Scrape type for SC59712: 0
2026-03-29 08:37:03 [auto1.be] INFO: Found listing with ID: XH49609
2026-03-29 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH49609%27 HTTP/1.1" 200 None
2026-03-29 08:37:03 [auto1.be] INFO: Scrape type for XH49609: 0
2026-03-29 08:37:03 [auto1.be] INFO: Found listing with ID: SU72836
2026-03-29 08:37:03 [auto1.be] INFO: Found listing with ID: ME81448
2026-03-29 08:37:03 [auto1.be] INFO: Found listing with ID: GV27154
2026-03-29 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV27154%27 HTTP/1.1" 200 None
2026-03-29 08:37:03 [auto1.be] INFO: Scrape type for GV27154: 0
2026-03-29 08:37:03 [auto1.be] INFO: Found listing with ID: XC10139
2026-03-29 08:37:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:37:04 [auto1.be] INFO: Channel: 24h | Page: 21 | totalHits: 1252 | hits on page: 40
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: JS25395
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: RL32581
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: GA09150
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: BN53670
2026-03-29 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BN53670%27 HTTP/1.1" 200 None
2026-03-29 08:37:04 [auto1.be] INFO: Scrape type for BN53670: 0
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: CR21244
2026-03-29 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CR21244%27 HTTP/1.1" 200 None
2026-03-29 08:37:04 [auto1.be] INFO: Scrape type for CR21244: 0
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: FY43318
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: FR80699
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: NM33768
2026-03-29 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM33768%27 HTTP/1.1" 200 None
2026-03-29 08:37:04 [auto1.be] INFO: Scrape type for NM33768: 0
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: ZX33086
2026-03-29 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX33086%27 HTTP/1.1" 200 None
2026-03-29 08:37:04 [auto1.be] INFO: Scrape type for ZX33086: 0
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: BP38818
2026-03-29 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP38818%27 HTTP/1.1" 200 None
2026-03-29 08:37:04 [auto1.be] INFO: Scrape type for BP38818: 0
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: XT87195
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: KP16725
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: GS68920
2026-03-29 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS68920%27 HTTP/1.1" 200 None
2026-03-29 08:37:04 [auto1.be] INFO: Scrape type for GS68920: 0
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: WP21428
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: XC64567
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: AU41446
2026-03-29 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU41446%27 HTTP/1.1" 200 None
2026-03-29 08:37:04 [auto1.be] INFO: Scrape type for AU41446: 0
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: NJ59863
2026-03-29 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ59863%27 HTTP/1.1" 200 None
2026-03-29 08:37:04 [auto1.be] INFO: Scrape type for NJ59863: 0
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: EX63844
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: XB11874
2026-03-29 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB11874%27 HTTP/1.1" 200 None
2026-03-29 08:37:04 [auto1.be] INFO: Scrape type for XB11874: 0
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: VA07887
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: FJ79675
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: XT90325
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: CS46585
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: CG39340
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: MX90898
2026-03-29 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX90898%27 HTTP/1.1" 200 None
2026-03-29 08:37:04 [auto1.be] INFO: Scrape type for MX90898: 0
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: LP39108
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: NZ84501
2026-03-29 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ84501%27 HTTP/1.1" 200 None
2026-03-29 08:37:04 [auto1.be] INFO: Scrape type for NZ84501: 0
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: LM00165
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: LF23330
2026-03-29 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF23330%27 HTTP/1.1" 200 None
2026-03-29 08:37:04 [auto1.be] INFO: Scrape type for LF23330: 0
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: GH45635
2026-03-29 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH45635%27 HTTP/1.1" 200 None
2026-03-29 08:37:04 [auto1.be] INFO: Scrape type for GH45635: 0
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: SC36479
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: AB25804
2026-03-29 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB25804%27 HTTP/1.1" 200 None
2026-03-29 08:37:04 [auto1.be] INFO: Scrape type for AB25804: 0
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: TX85632
2026-03-29 08:37:04 [auto1.be] INFO: Found listing with ID: AD33980
2026-03-29 08:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD33980%27 HTTP/1.1" 200 None
2026-03-29 08:37:05 [auto1.be] INFO: Scrape type for AD33980: 0
2026-03-29 08:37:05 [auto1.be] INFO: Found listing with ID: CH34151
2026-03-29 08:37:05 [auto1.be] INFO: Found listing with ID: VP78411
2026-03-29 08:37:05 [auto1.be] INFO: Found listing with ID: DM43787
2026-03-29 08:37:05 [auto1.be] INFO: Found listing with ID: SA37733
2026-03-29 08:37:05 [auto1.be] INFO: Found listing with ID: ED59297
2026-03-29 08:37:05 [auto1.be] INFO: Found listing with ID: SL51907
2026-03-29 08:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL51907%27 HTTP/1.1" 200 None
2026-03-29 08:37:05 [auto1.be] INFO: Scrape type for SL51907: 0
2026-03-29 08:37:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:37:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:37:06 [auto1.be] INFO: Channel: 24h | Page: 22 | totalHits: 1252 | hits on page: 40
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: DU38710
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: JC93215
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC93215%27 HTTP/1.1" 200 None
2026-03-29 08:37:06 [auto1.be] INFO: Scrape type for JC93215: 0
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: TD70367
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD70367%27 HTTP/1.1" 200 None
2026-03-29 08:37:06 [auto1.be] INFO: Scrape type for TD70367: 0
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: YK80434
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: VZ63754
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: TU11660
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: JW78855
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW78855%27 HTTP/1.1" 200 None
2026-03-29 08:37:06 [auto1.be] INFO: Scrape type for JW78855: 0
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: LP97900
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP97900%27 HTTP/1.1" 200 None
2026-03-29 08:37:06 [auto1.be] INFO: Scrape type for LP97900: 0
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: LP07116
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: RX86056
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX86056%27 HTTP/1.1" 200 None
2026-03-29 08:37:06 [auto1.be] INFO: Scrape type for RX86056: 0
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: AW74184
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: BK01349
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: BA37972
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: XL43279
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL43279%27 HTTP/1.1" 200 None
2026-03-29 08:37:06 [auto1.be] INFO: Scrape type for XL43279: 2
2026-03-29 08:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e61ddf2-108f-51dd-b934-ef49eda36b47 with identifier: XL43279
2026-03-29 08:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e61ddf2-108f-51dd-b934-ef49eda36b47 with scrape type 2
2026-03-29 08:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e61ddf2-108f-51dd-b934-ef49eda36b47 with scrape type 2
2026-03-29 08:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9e61ddf2-108f-51dd-b934-ef49eda36b47, identifier: XL43279
2026-03-29 08:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9e61ddf2-108f-51dd-b934-ef49eda36b47 with identifier: XL43279
2026-03-29 08:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9e61ddf2-108f-51dd-b934-ef49eda36b47 with identifier: XL43279
2026-03-29 08:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9e61ddf2-108f-51dd-b934-ef49eda36b47 with identifier: XL43279 to the API
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:58:51Z',
'fuel_type': 'diesel',
'id': '9e61ddf2-108f-51dd-b934-ef49eda36b47',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL43279',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 204240,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-15',
'seller_name': None,
'title': 'Skoda Octavia 1.6 TDI GreenLine',
'transmission': 'manual',
'trim': 'GreenLine',
'year': 2016}
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL43279%27 HTTP/1.1" 200 None
2026-03-29 08:37:06 [auto1.be] INFO: Saving data for XL43279: {'auction_closing_time': 1774886331.0, 'created_time': 1774557431.051864, 'last_price_update_time': 1774773426.564046}
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XL43279') HTTP/1.1" 204 0
2026-03-29 08:37:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: SC85120
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: TW09601
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: TZ99758
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: RH32729
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH32729%27 HTTP/1.1" 200 None
2026-03-29 08:37:06 [auto1.be] INFO: Scrape type for RH32729: 0
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: UU12218
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: LT47332
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT47332%27 HTTP/1.1" 200 None
2026-03-29 08:37:06 [auto1.be] INFO: Scrape type for LT47332: 0
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: DY28234
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: WS04459
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WS04459%27 HTTP/1.1" 200 None
2026-03-29 08:37:06 [auto1.be] INFO: Scrape type for WS04459: 0
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: KS43499
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS43499%27 HTTP/1.1" 200 None
2026-03-29 08:37:06 [auto1.be] INFO: Scrape type for KS43499: 0
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: PB25162
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: UA44051
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA44051%27 HTTP/1.1" 200 None
2026-03-29 08:37:06 [auto1.be] INFO: Scrape type for UA44051: 0
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: PY12122
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: BZ65544
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ65544%27 HTTP/1.1" 200 None
2026-03-29 08:37:06 [auto1.be] INFO: Scrape type for BZ65544: 0
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: HZ19238
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ19238%27 HTTP/1.1" 200 None
2026-03-29 08:37:06 [auto1.be] INFO: Scrape type for HZ19238: 0
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: KU11213
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: DC17534
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: AT20959
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AT20959%27 HTTP/1.1" 200 None
2026-03-29 08:37:06 [auto1.be] INFO: Scrape type for AT20959: 0
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: JM34078
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM34078%27 HTTP/1.1" 200 None
2026-03-29 08:37:06 [auto1.be] INFO: Scrape type for JM34078: 0
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: WP69561
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: YS56392
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: VB04696
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: RR89556
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: XM10489
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM10489%27 HTTP/1.1" 200 None
2026-03-29 08:37:06 [auto1.be] INFO: Scrape type for XM10489: 0
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: RS45224
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS45224%27 HTTP/1.1" 200 None
2026-03-29 08:37:06 [auto1.be] INFO: Scrape type for RS45224: 0
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: UW48678
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW48678%27 HTTP/1.1" 200 None
2026-03-29 08:37:06 [auto1.be] INFO: Scrape type for UW48678: 0
2026-03-29 08:37:06 [auto1.be] INFO: Found listing with ID: FH97290
2026-03-29 08:37:06 [scrapy.extensions.logstats] INFO: Crawled 94 pages (at 21 pages/min), scraped 119 items (at 35 items/min)
2026-03-29 08:37:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-29 08:37:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:37:07 [auto1.be] INFO: Channel: 24h | Page: 23 | totalHits: 1252 | hits on page: 40
2026-03-29 08:37:07 [auto1.be] INFO: Found listing with ID: SZ65946
2026-03-29 08:37:07 [auto1.be] INFO: Found listing with ID: XJ24324
2026-03-29 08:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ24324%27 HTTP/1.1" 200 None
2026-03-29 08:37:07 [auto1.be] INFO: Scrape type for XJ24324: 0
2026-03-29 08:37:07 [auto1.be] INFO: Found listing with ID: MV82025
2026-03-29 08:37:07 [auto1.be] INFO: Found listing with ID: MZ51776
2026-03-29 08:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ51776%27 HTTP/1.1" 200 None
2026-03-29 08:37:07 [auto1.be] INFO: Scrape type for MZ51776: 0
2026-03-29 08:37:07 [auto1.be] INFO: Found listing with ID: WH33984
2026-03-29 08:37:07 [auto1.be] INFO: Found listing with ID: HU58936
2026-03-29 08:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU58936%27 HTTP/1.1" 200 None
2026-03-29 08:37:07 [auto1.be] INFO: Scrape type for HU58936: 0
2026-03-29 08:37:07 [auto1.be] INFO: Found listing with ID: ET79377
2026-03-29 08:37:07 [auto1.be] INFO: Found listing with ID: UR44884
2026-03-29 08:37:07 [auto1.be] INFO: Found listing with ID: LC46636
2026-03-29 08:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LC46636%27 HTTP/1.1" 200 None
2026-03-29 08:37:07 [auto1.be] INFO: Scrape type for LC46636: 0
2026-03-29 08:37:07 [auto1.be] INFO: Found listing with ID: HM84114
2026-03-29 08:37:07 [auto1.be] INFO: Found listing with ID: FN16517
2026-03-29 08:37:07 [auto1.be] INFO: Found listing with ID: UF35860
2026-03-29 08:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF35860%27 HTTP/1.1" 200 None
2026-03-29 08:37:07 [auto1.be] INFO: Scrape type for UF35860: 2
2026-03-29 08:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cae05e32-fe1d-51b7-ad9a-9a527d456b92 with identifier: UF35860
2026-03-29 08:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cae05e32-fe1d-51b7-ad9a-9a527d456b92 with scrape type 2
2026-03-29 08:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cae05e32-fe1d-51b7-ad9a-9a527d456b92 with scrape type 2
2026-03-29 08:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cae05e32-fe1d-51b7-ad9a-9a527d456b92, identifier: UF35860
2026-03-29 08:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cae05e32-fe1d-51b7-ad9a-9a527d456b92 with identifier: UF35860
2026-03-29 08:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cae05e32-fe1d-51b7-ad9a-9a527d456b92 with identifier: UF35860
2026-03-29 08:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cae05e32-fe1d-51b7-ad9a-9a527d456b92 with identifier: UF35860 to the API
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:42:15Z',
'fuel_type': 'diesel',
'id': 'cae05e32-fe1d-51b7-ad9a-9a527d456b92',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF35860',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 88536,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-29',
'seller_name': None,
'title': 'Peugeot 308 1.6 Blue-HDi Access',
'transmission': 'manual',
'trim': 'Access',
'year': 2016}
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF35860%27 HTTP/1.1" 200 None
2026-03-29 08:37:08 [auto1.be] INFO: Saving data for UF35860: {'auction_closing_time': 1774885335.0, 'created_time': 1774557539.934275, 'last_price_update_time': 1774773428.320989}
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UF35860') HTTP/1.1" 204 0
2026-03-29 08:37:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:37:08 [auto1.be] INFO: Found listing with ID: SC73086
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC73086%27 HTTP/1.1" 200 None
2026-03-29 08:37:08 [auto1.be] INFO: Scrape type for SC73086: 0
2026-03-29 08:37:08 [auto1.be] INFO: Found listing with ID: PR84870
2026-03-29 08:37:08 [auto1.be] INFO: Found listing with ID: NN69701
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN69701%27 HTTP/1.1" 200 None
2026-03-29 08:37:08 [auto1.be] INFO: Scrape type for NN69701: 0
2026-03-29 08:37:08 [auto1.be] INFO: Found listing with ID: KG53590
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG53590%27 HTTP/1.1" 200 None
2026-03-29 08:37:08 [auto1.be] INFO: Scrape type for KG53590: 0
2026-03-29 08:37:08 [auto1.be] INFO: Found listing with ID: ZX32272
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX32272%27 HTTP/1.1" 200 None
2026-03-29 08:37:08 [auto1.be] INFO: Scrape type for ZX32272: 0
2026-03-29 08:37:08 [auto1.be] INFO: Found listing with ID: WK50026
2026-03-29 08:37:08 [auto1.be] INFO: Found listing with ID: MK20825
2026-03-29 08:37:08 [auto1.be] INFO: Found listing with ID: YS48127
2026-03-29 08:37:08 [auto1.be] INFO: Found listing with ID: RF74485
2026-03-29 08:37:08 [auto1.be] INFO: Found listing with ID: NC57966
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC57966%27 HTTP/1.1" 200 None
2026-03-29 08:37:08 [auto1.be] INFO: Scrape type for NC57966: 0
2026-03-29 08:37:08 [auto1.be] INFO: Found listing with ID: FU04844
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FU04844%27 HTTP/1.1" 200 None
2026-03-29 08:37:08 [auto1.be] INFO: Scrape type for FU04844: 0
2026-03-29 08:37:08 [auto1.be] INFO: Found listing with ID: FC28385
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC28385%27 HTTP/1.1" 200 None
2026-03-29 08:37:08 [auto1.be] INFO: Scrape type for FC28385: 0
2026-03-29 08:37:08 [auto1.be] INFO: Found listing with ID: MU18005
2026-03-29 08:37:08 [auto1.be] INFO: Found listing with ID: UM95648
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM95648%27 HTTP/1.1" 200 None
2026-03-29 08:37:08 [auto1.be] INFO: Scrape type for UM95648: 0
2026-03-29 08:37:08 [auto1.be] INFO: Found listing with ID: VA32651
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA32651%27 HTTP/1.1" 200 None
2026-03-29 08:37:08 [auto1.be] INFO: Scrape type for VA32651: 0
2026-03-29 08:37:08 [auto1.be] INFO: Found listing with ID: KV94769
2026-03-29 08:37:08 [auto1.be] INFO: Found listing with ID: LG02466
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG02466%27 HTTP/1.1" 200 None
2026-03-29 08:37:08 [auto1.be] INFO: Scrape type for LG02466: 0
2026-03-29 08:37:08 [auto1.be] INFO: Found listing with ID: ZC67013
2026-03-29 08:37:08 [auto1.be] INFO: Found listing with ID: MZ96160
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ96160%27 HTTP/1.1" 200 None
2026-03-29 08:37:08 [auto1.be] INFO: Scrape type for MZ96160: 0
2026-03-29 08:37:08 [auto1.be] INFO: Found listing with ID: DD08232
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD08232%27 HTTP/1.1" 200 None
2026-03-29 08:37:08 [auto1.be] INFO: Scrape type for DD08232: 0
2026-03-29 08:37:08 [auto1.be] INFO: Found listing with ID: ZK51287
2026-03-29 08:37:08 [auto1.be] INFO: Found listing with ID: JX00156
2026-03-29 08:37:08 [auto1.be] INFO: Found listing with ID: UN77217
2026-03-29 08:37:08 [auto1.be] INFO: Found listing with ID: VA33507
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA33507%27 HTTP/1.1" 200 None
2026-03-29 08:37:08 [auto1.be] INFO: Scrape type for VA33507: 0
2026-03-29 08:37:08 [auto1.be] INFO: Found listing with ID: FM00077
2026-03-29 08:37:08 [auto1.be] INFO: Found listing with ID: NS73936
2026-03-29 08:37:08 [auto1.be] INFO: Found listing with ID: LY58233
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY58233%27 HTTP/1.1" 200 None
2026-03-29 08:37:08 [auto1.be] INFO: Scrape type for LY58233: 0
2026-03-29 08:37:08 [auto1.be] INFO: Found listing with ID: XH30316
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH30316%27 HTTP/1.1" 200 None
2026-03-29 08:37:08 [auto1.be] INFO: Scrape type for XH30316: 0
2026-03-29 08:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:37:10 [auto1.be] INFO: Channel: 24h | Page: 24 | totalHits: 1252 | hits on page: 40
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: RK82839
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: LE69229
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: CN29269
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: HE95946
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: ZN76480
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: BY25509
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY25509%27 HTTP/1.1" 200 None
2026-03-29 08:37:10 [auto1.be] INFO: Scrape type for BY25509: 0
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: TR87241
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: PU90284
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU90284%27 HTTP/1.1" 200 None
2026-03-29 08:37:10 [auto1.be] INFO: Scrape type for PU90284: 0
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: VC92856
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VC92856%27 HTTP/1.1" 200 None
2026-03-29 08:37:10 [auto1.be] INFO: Scrape type for VC92856: 2
2026-03-29 08:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 170033d5-e694-5b56-85da-656784e780ca with identifier: VC92856
2026-03-29 08:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 170033d5-e694-5b56-85da-656784e780ca with scrape type 2
2026-03-29 08:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 170033d5-e694-5b56-85da-656784e780ca with scrape type 2
2026-03-29 08:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 170033d5-e694-5b56-85da-656784e780ca, identifier: VC92856
2026-03-29 08:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 170033d5-e694-5b56-85da-656784e780ca with identifier: VC92856
2026-03-29 08:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 170033d5-e694-5b56-85da-656784e780ca with identifier: VC92856
2026-03-29 08:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 170033d5-e694-5b56-85da-656784e780ca with identifier: VC92856 to the API
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 401,
'expiration_date': '2026-03-30T15:49:59Z',
'fuel_type': 'petrol',
'id': '170033d5-e694-5b56-85da-656784e780ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC92856',
'listing': 'auction',
'make': 'Dodge',
'model': 'Ram 1500',
'odometer': 132361,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-16',
'seller_name': None,
'title': 'Dodge Ram 1500 5.7 V8 4x4',
'transmission': 'automatic',
'trim': '4x4',
'year': 2019}
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VC92856%27 HTTP/1.1" 200 None
2026-03-29 08:37:10 [auto1.be] INFO: Saving data for VC92856: {'auction_closing_time': 1774885799.0, 'created_time': 1774471416.187323, 'last_price_update_time': 1774773430.609445}
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VC92856') HTTP/1.1" 204 0
2026-03-29 08:37:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: DJ08738
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: FN69818
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: XB17770
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: SN22557
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: MV28568
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: FW88759
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: FZ81347
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FZ81347%27 HTTP/1.1" 200 None
2026-03-29 08:37:10 [auto1.be] INFO: Scrape type for FZ81347: 0
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: CX83686
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX83686%27 HTTP/1.1" 200 None
2026-03-29 08:37:10 [auto1.be] INFO: Scrape type for CX83686: 0
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: FR50529
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR50529%27 HTTP/1.1" 200 None
2026-03-29 08:37:10 [auto1.be] INFO: Scrape type for FR50529: 0
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: PS82481
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: UU07035
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: WL68728
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: MR51068
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: PY41942
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY41942%27 HTTP/1.1" 200 None
2026-03-29 08:37:10 [auto1.be] INFO: Scrape type for PY41942: 0
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: TP16646
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP16646%27 HTTP/1.1" 200 None
2026-03-29 08:37:10 [auto1.be] INFO: Scrape type for TP16646: 0
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: AZ39903
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: HB98543
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: RU48742
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU48742%27 HTTP/1.1" 200 None
2026-03-29 08:37:10 [auto1.be] INFO: Scrape type for RU48742: 0
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: DK63787
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK63787%27 HTTP/1.1" 200 None
2026-03-29 08:37:10 [auto1.be] INFO: Scrape type for DK63787: 0
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: KG87325
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG87325%27 HTTP/1.1" 200 None
2026-03-29 08:37:10 [auto1.be] INFO: Scrape type for KG87325: 0
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: HU17820
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU17820%27 HTTP/1.1" 200 None
2026-03-29 08:37:10 [auto1.be] INFO: Scrape type for HU17820: 0
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: NL83155
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: NV75936
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV75936%27 HTTP/1.1" 200 None
2026-03-29 08:37:10 [auto1.be] INFO: Scrape type for NV75936: 0
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: AW25378
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AW25378%27 HTTP/1.1" 200 None
2026-03-29 08:37:10 [auto1.be] INFO: Scrape type for AW25378: 0
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: PF94112
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: XT95399
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: NT98676
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: ZA12378
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: LS82290
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LS82290%27 HTTP/1.1" 200 None
2026-03-29 08:37:10 [auto1.be] INFO: Scrape type for LS82290: 0
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: FJ54867
2026-03-29 08:37:10 [auto1.be] INFO: Found listing with ID: CM51817
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM51817%27 HTTP/1.1" 200 None
2026-03-29 08:37:10 [auto1.be] INFO: Scrape type for CM51817: 0
2026-03-29 08:37:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:37:11 [auto1.be] INFO: Channel: 24h | Page: 25 | totalHits: 1252 | hits on page: 40
2026-03-29 08:37:11 [auto1.be] INFO: Found listing with ID: FA04427
2026-03-29 08:37:11 [auto1.be] INFO: Found listing with ID: KD88013
2026-03-29 08:37:11 [auto1.be] INFO: Found listing with ID: YY44687
2026-03-29 08:37:11 [auto1.be] INFO: Found listing with ID: BX66623
2026-03-29 08:37:11 [auto1.be] INFO: Found listing with ID: NJ37001
2026-03-29 08:37:11 [auto1.be] INFO: Found listing with ID: DM24490
2026-03-29 08:37:11 [auto1.be] INFO: Found listing with ID: PM87207
2026-03-29 08:37:11 [auto1.be] INFO: Found listing with ID: RD23593
2026-03-29 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD23593%27 HTTP/1.1" 200 None
2026-03-29 08:37:11 [auto1.be] INFO: Scrape type for RD23593: 0
2026-03-29 08:37:11 [auto1.be] INFO: Found listing with ID: XW30503
2026-03-29 08:37:11 [auto1.be] INFO: Found listing with ID: GD95033
2026-03-29 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GD95033%27 HTTP/1.1" 200 None
2026-03-29 08:37:11 [auto1.be] INFO: Scrape type for GD95033: 0
2026-03-29 08:37:11 [auto1.be] INFO: Found listing with ID: UE36464
2026-03-29 08:37:11 [auto1.be] INFO: Found listing with ID: ER02883
2026-03-29 08:37:11 [auto1.be] INFO: Found listing with ID: LG99308
2026-03-29 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG99308%27 HTTP/1.1" 200 None
2026-03-29 08:37:11 [auto1.be] INFO: Scrape type for LG99308: 0
2026-03-29 08:37:11 [auto1.be] INFO: Found listing with ID: KW17867
2026-03-29 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW17867%27 HTTP/1.1" 200 None
2026-03-29 08:37:11 [auto1.be] INFO: Scrape type for KW17867: 0
2026-03-29 08:37:11 [auto1.be] INFO: Found listing with ID: HT18059
2026-03-29 08:37:11 [auto1.be] INFO: Found listing with ID: PE64709
2026-03-29 08:37:11 [auto1.be] INFO: Found listing with ID: HS15781
2026-03-29 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS15781%27 HTTP/1.1" 200 None
2026-03-29 08:37:11 [auto1.be] INFO: Scrape type for HS15781: 0
2026-03-29 08:37:11 [auto1.be] INFO: Found listing with ID: HT80629
2026-03-29 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT80629%27 HTTP/1.1" 200 None
2026-03-29 08:37:11 [auto1.be] INFO: Scrape type for HT80629: 0
2026-03-29 08:37:11 [auto1.be] INFO: Found listing with ID: FT23017
2026-03-29 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT23017%27 HTTP/1.1" 200 None
2026-03-29 08:37:11 [auto1.be] INFO: Scrape type for FT23017: 0
2026-03-29 08:37:11 [auto1.be] INFO: Found listing with ID: ZM05640
2026-03-29 08:37:11 [auto1.be] INFO: Found listing with ID: KT01454
2026-03-29 08:37:11 [auto1.be] INFO: Found listing with ID: AC59433
2026-03-29 08:37:11 [auto1.be] INFO: Found listing with ID: MY75694
2026-03-29 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MY75694%27 HTTP/1.1" 200 None
2026-03-29 08:37:11 [auto1.be] INFO: Scrape type for MY75694: 0
2026-03-29 08:37:11 [auto1.be] INFO: Found listing with ID: LH19076
2026-03-29 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH19076%27 HTTP/1.1" 200 None
2026-03-29 08:37:12 [auto1.be] INFO: Scrape type for LH19076: 0
2026-03-29 08:37:12 [auto1.be] INFO: Found listing with ID: GM68229
2026-03-29 08:37:12 [auto1.be] INFO: Found listing with ID: LK30146
2026-03-29 08:37:12 [auto1.be] INFO: Found listing with ID: FT86060
2026-03-29 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT86060%27 HTTP/1.1" 200 None
2026-03-29 08:37:12 [auto1.be] INFO: Scrape type for FT86060: 0
2026-03-29 08:37:12 [auto1.be] INFO: Found listing with ID: TF49476
2026-03-29 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF49476%27 HTTP/1.1" 200 None
2026-03-29 08:37:12 [auto1.be] INFO: Scrape type for TF49476: 0
2026-03-29 08:37:12 [auto1.be] INFO: Found listing with ID: JT63704
2026-03-29 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT63704%27 HTTP/1.1" 200 None
2026-03-29 08:37:12 [auto1.be] INFO: Scrape type for JT63704: 0
2026-03-29 08:37:12 [auto1.be] INFO: Found listing with ID: UA37218
2026-03-29 08:37:12 [auto1.be] INFO: Found listing with ID: SX16585
2026-03-29 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX16585%27 HTTP/1.1" 200 None
2026-03-29 08:37:12 [auto1.be] INFO: Scrape type for SX16585: 0
2026-03-29 08:37:12 [auto1.be] INFO: Found listing with ID: TF43790
2026-03-29 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF43790%27 HTTP/1.1" 200 None
2026-03-29 08:37:12 [auto1.be] INFO: Scrape type for TF43790: 0
2026-03-29 08:37:12 [auto1.be] INFO: Found listing with ID: NZ75648
2026-03-29 08:37:12 [auto1.be] INFO: Found listing with ID: ER91021
2026-03-29 08:37:12 [auto1.be] INFO: Found listing with ID: LF44164
2026-03-29 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF44164%27 HTTP/1.1" 200 None
2026-03-29 08:37:12 [auto1.be] INFO: Scrape type for LF44164: 0
2026-03-29 08:37:12 [auto1.be] INFO: Found listing with ID: SV00163
2026-03-29 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV00163%27 HTTP/1.1" 200 None
2026-03-29 08:37:12 [auto1.be] INFO: Scrape type for SV00163: 0
2026-03-29 08:37:12 [auto1.be] INFO: Found listing with ID: EM88075
2026-03-29 08:37:12 [auto1.be] INFO: Found listing with ID: VM07385
2026-03-29 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM07385%27 HTTP/1.1" 200 None
2026-03-29 08:37:12 [auto1.be] INFO: Scrape type for VM07385: 0
2026-03-29 08:37:12 [auto1.be] INFO: Found listing with ID: WC19794
2026-03-29 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC19794%27 HTTP/1.1" 200 None
2026-03-29 08:37:12 [auto1.be] INFO: Scrape type for WC19794: 0
2026-03-29 08:37:12 [auto1.be] INFO: Found listing with ID: UV16393
2026-03-29 08:37:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:37:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:37:13 [auto1.be] INFO: Channel: 24h | Page: 26 | totalHits: 1252 | hits on page: 40
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: AY92488
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: SB51494
2026-03-29 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB51494%27 HTTP/1.1" 200 None
2026-03-29 08:37:13 [auto1.be] INFO: Scrape type for SB51494: 0
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: KM81672
2026-03-29 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM81672%27 HTTP/1.1" 200 None
2026-03-29 08:37:13 [auto1.be] INFO: Scrape type for KM81672: 0
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: JC37428
2026-03-29 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC37428%27 HTTP/1.1" 200 None
2026-03-29 08:37:13 [auto1.be] INFO: Scrape type for JC37428: 0
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: RL22884
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: WH35268
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: DZ29736
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: BT48733
2026-03-29 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT48733%27 HTTP/1.1" 200 None
2026-03-29 08:37:13 [auto1.be] INFO: Scrape type for BT48733: 0
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: JM52918
2026-03-29 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM52918%27 HTTP/1.1" 200 None
2026-03-29 08:37:13 [auto1.be] INFO: Scrape type for JM52918: 0
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: PJ47204
2026-03-29 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ47204%27 HTTP/1.1" 200 None
2026-03-29 08:37:13 [auto1.be] INFO: Scrape type for PJ47204: 0
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: WV93881
2026-03-29 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV93881%27 HTTP/1.1" 200 None
2026-03-29 08:37:13 [auto1.be] INFO: Scrape type for WV93881: 0
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: ZN30582
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: DW89604
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: WV93759
2026-03-29 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV93759%27 HTTP/1.1" 200 None
2026-03-29 08:37:13 [auto1.be] INFO: Scrape type for WV93759: 0
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: JB30712
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: XK23104
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: SG83875
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: UM29446
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: XS20349
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: TA24587
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: MM51411
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: EM05161
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: HZ76034
2026-03-29 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ76034%27 HTTP/1.1" 200 None
2026-03-29 08:37:13 [auto1.be] INFO: Scrape type for HZ76034: 0
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: US61524
2026-03-29 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27US61524%27 HTTP/1.1" 200 None
2026-03-29 08:37:13 [auto1.be] INFO: Scrape type for US61524: 0
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: DP44577
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: KU92863
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: XU79591
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: LM11563
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: VZ26705
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: GW19918
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: UY14877
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: WJ93890
2026-03-29 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ93890%27 HTTP/1.1" 200 None
2026-03-29 08:37:13 [auto1.be] INFO: Scrape type for WJ93890: 0
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: DN00999
2026-03-29 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DN00999%27 HTTP/1.1" 200 None
2026-03-29 08:37:13 [auto1.be] INFO: Scrape type for DN00999: 0
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: GN49517
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: BE30988
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: ZW40078
2026-03-29 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZW40078%27 HTTP/1.1" 200 None
2026-03-29 08:37:13 [auto1.be] INFO: Scrape type for ZW40078: 0
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: YW96446
2026-03-29 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW96446%27 HTTP/1.1" 200 None
2026-03-29 08:37:13 [auto1.be] INFO: Scrape type for YW96446: 0
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: LA99224
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: UE64828
2026-03-29 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE64828%27 HTTP/1.1" 200 None
2026-03-29 08:37:13 [auto1.be] INFO: Scrape type for UE64828: 0
2026-03-29 08:37:13 [auto1.be] INFO: Found listing with ID: GJ36560
2026-03-29 08:37:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:37:14 [auto1.be] INFO: Channel: 24h | Page: 27 | totalHits: 1252 | hits on page: 40
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: KF94293
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF94293%27 HTTP/1.1" 200 None
2026-03-29 08:37:14 [auto1.be] INFO: Scrape type for KF94293: 0
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: ER36240
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: SD86163
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: LM13926
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM13926%27 HTTP/1.1" 200 None
2026-03-29 08:37:14 [auto1.be] INFO: Scrape type for LM13926: 0
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: AE63964
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE63964%27 HTTP/1.1" 200 None
2026-03-29 08:37:14 [auto1.be] INFO: Scrape type for AE63964: 0
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: SL57288
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL57288%27 HTTP/1.1" 200 None
2026-03-29 08:37:14 [auto1.be] INFO: Scrape type for SL57288: 0
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: BT92464
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: RK43455
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK43455%27 HTTP/1.1" 200 None
2026-03-29 08:37:14 [auto1.be] INFO: Scrape type for RK43455: 0
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: KG93945
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: FB93927
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FB93927%27 HTTP/1.1" 200 None
2026-03-29 08:37:14 [auto1.be] INFO: Scrape type for FB93927: 0
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: SV46049
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV46049%27 HTTP/1.1" 200 None
2026-03-29 08:37:14 [auto1.be] INFO: Scrape type for SV46049: 0
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: WV65314
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV65314%27 HTTP/1.1" 200 None
2026-03-29 08:37:14 [auto1.be] INFO: Scrape type for WV65314: 0
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: FM81572
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM81572%27 HTTP/1.1" 200 None
2026-03-29 08:37:14 [auto1.be] INFO: Scrape type for FM81572: 0
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: HJ19751
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: MW50956
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW50956%27 HTTP/1.1" 200 None
2026-03-29 08:37:14 [auto1.be] INFO: Scrape type for MW50956: 0
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: JJ70860
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: DN28044
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DN28044%27 HTTP/1.1" 200 None
2026-03-29 08:37:14 [auto1.be] INFO: Scrape type for DN28044: 0
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: WG38275
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG38275%27 HTTP/1.1" 200 None
2026-03-29 08:37:14 [auto1.be] INFO: Scrape type for WG38275: 0
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: NC08569
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC08569%27 HTTP/1.1" 200 None
2026-03-29 08:37:14 [auto1.be] INFO: Scrape type for NC08569: 0
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: JR09444
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: CF30779
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF30779%27 HTTP/1.1" 200 None
2026-03-29 08:37:14 [auto1.be] INFO: Scrape type for CF30779: 0
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: WT53046
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT53046%27 HTTP/1.1" 200 None
2026-03-29 08:37:14 [auto1.be] INFO: Scrape type for WT53046: 0
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: DR48094
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DR48094%27 HTTP/1.1" 200 None
2026-03-29 08:37:14 [auto1.be] INFO: Scrape type for DR48094: 0
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: JZ34939
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ34939%27 HTTP/1.1" 200 None
2026-03-29 08:37:14 [auto1.be] INFO: Scrape type for JZ34939: 0
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: TX04561
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX04561%27 HTTP/1.1" 200 None
2026-03-29 08:37:14 [auto1.be] INFO: Scrape type for TX04561: 0
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: ET82729
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: BC33060
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC33060%27 HTTP/1.1" 200 None
2026-03-29 08:37:14 [auto1.be] INFO: Scrape type for BC33060: 0
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: HL00392
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: EP00364
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP00364%27 HTTP/1.1" 200 None
2026-03-29 08:37:14 [auto1.be] INFO: Scrape type for EP00364: 0
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: AU29077
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: FL05782
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: HB59214
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB59214%27 HTTP/1.1" 200 None
2026-03-29 08:37:14 [auto1.be] INFO: Scrape type for HB59214: 0
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: SX95001
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX95001%27 HTTP/1.1" 200 None
2026-03-29 08:37:14 [auto1.be] INFO: Scrape type for SX95001: 0
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: UY27001
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: UR33188
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR33188%27 HTTP/1.1" 200 None
2026-03-29 08:37:14 [auto1.be] INFO: Scrape type for UR33188: 0
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: CM21252
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: SU85893
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: DT20121
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: VM76060
2026-03-29 08:37:14 [auto1.be] INFO: Found listing with ID: FJ57746
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ57746%27 HTTP/1.1" 200 None
2026-03-29 08:37:14 [auto1.be] INFO: Scrape type for FJ57746: 0
2026-03-29 08:37:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:37:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:37:16 [auto1.be] INFO: Channel: 24h | Page: 28 | totalHits: 1252 | hits on page: 40
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: KZ05274
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ05274%27 HTTP/1.1" 200 None
2026-03-29 08:37:16 [auto1.be] INFO: Scrape type for KZ05274: 0
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: TJ00131
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: VY36246
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: MJ04907
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: YG03175
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: HK87235
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK87235%27 HTTP/1.1" 200 None
2026-03-29 08:37:16 [auto1.be] INFO: Scrape type for HK87235: 0
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: UG65181
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: KT35610
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: CD22470
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD22470%27 HTTP/1.1" 200 None
2026-03-29 08:37:16 [auto1.be] INFO: Scrape type for CD22470: 0
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: SJ05954
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ05954%27 HTTP/1.1" 200 None
2026-03-29 08:37:16 [auto1.be] INFO: Scrape type for SJ05954: 0
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: GH80996
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: ZY24236
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: FV90992
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV90992%27 HTTP/1.1" 200 None
2026-03-29 08:37:16 [auto1.be] INFO: Scrape type for FV90992: 0
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: PG48700
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PG48700%27 HTTP/1.1" 200 None
2026-03-29 08:37:16 [auto1.be] INFO: Scrape type for PG48700: 0
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: ZZ74713
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: XD67660
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: DT55223
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: EL95031
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: DC62563
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC62563%27 HTTP/1.1" 200 None
2026-03-29 08:37:16 [auto1.be] INFO: Scrape type for DC62563: 0
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: UX01518
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: ZP95092
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP95092%27 HTTP/1.1" 200 None
2026-03-29 08:37:16 [auto1.be] INFO: Scrape type for ZP95092: 0
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: ZR35447
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR35447%27 HTTP/1.1" 200 None
2026-03-29 08:37:16 [auto1.be] INFO: Scrape type for ZR35447: 0
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: EK14732
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: CA54828
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA54828%27 HTTP/1.1" 200 None
2026-03-29 08:37:16 [auto1.be] INFO: Scrape type for CA54828: 0
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: UR02836
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: XK01311
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: FW70524
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW70524%27 HTTP/1.1" 200 None
2026-03-29 08:37:16 [auto1.be] INFO: Scrape type for FW70524: 0
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: ED41371
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: VX51166
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: BD29807
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: NZ74768
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ74768%27 HTTP/1.1" 200 None
2026-03-29 08:37:16 [auto1.be] INFO: Scrape type for NZ74768: 0
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: AC55620
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AC55620%27 HTTP/1.1" 200 None
2026-03-29 08:37:16 [auto1.be] INFO: Scrape type for AC55620: 0
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: ZJ26009
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: LR36013
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: YZ92764
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YZ92764%27 HTTP/1.1" 200 None
2026-03-29 08:37:16 [auto1.be] INFO: Scrape type for YZ92764: 0
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: ZZ63767
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ63767%27 HTTP/1.1" 200 None
2026-03-29 08:37:16 [auto1.be] INFO: Scrape type for ZZ63767: 0
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: VW23905
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW23905%27 HTTP/1.1" 200 None
2026-03-29 08:37:16 [auto1.be] INFO: Scrape type for VW23905: 0
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: BZ70123
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ70123%27 HTTP/1.1" 200 None
2026-03-29 08:37:16 [auto1.be] INFO: Scrape type for BZ70123: 0
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: TX50404
2026-03-29 08:37:16 [auto1.be] INFO: Found listing with ID: XC95069
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC95069%27 HTTP/1.1" 200 None
2026-03-29 08:37:16 [auto1.be] INFO: Scrape type for XC95069: 0
2026-03-29 08:37:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:37:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:37:17 [auto1.be] INFO: Channel: 24h | Page: 29 | totalHits: 1252 | hits on page: 40
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: BS70441
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS70441%27 HTTP/1.1" 200 None
2026-03-29 08:37:17 [auto1.be] INFO: Scrape type for BS70441: 0
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: GM14941
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM14941%27 HTTP/1.1" 200 None
2026-03-29 08:37:17 [auto1.be] INFO: Scrape type for GM14941: 0
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: SY87797
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY87797%27 HTTP/1.1" 200 None
2026-03-29 08:37:17 [auto1.be] INFO: Scrape type for SY87797: 0
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: WV78161
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV78161%27 HTTP/1.1" 200 None
2026-03-29 08:37:17 [auto1.be] INFO: Scrape type for WV78161: 0
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: ZV95387
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZV95387%27 HTTP/1.1" 200 None
2026-03-29 08:37:17 [auto1.be] INFO: Scrape type for ZV95387: 0
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: HR69689
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: KB40459
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KB40459%27 HTTP/1.1" 200 None
2026-03-29 08:37:17 [auto1.be] INFO: Scrape type for KB40459: 0
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: FC15884
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: KX73156
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: ZZ39097
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ39097%27 HTTP/1.1" 200 None
2026-03-29 08:37:17 [auto1.be] INFO: Scrape type for ZZ39097: 0
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: SZ00073
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: SC10935
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC10935%27 HTTP/1.1" 200 None
2026-03-29 08:37:17 [auto1.be] INFO: Scrape type for SC10935: 0
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: BU18930
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU18930%27 HTTP/1.1" 200 None
2026-03-29 08:37:17 [auto1.be] INFO: Scrape type for BU18930: 0
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: CA73486
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: NU74968
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: WX14373
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: YK61845
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK61845%27 HTTP/1.1" 200 None
2026-03-29 08:37:17 [auto1.be] INFO: Scrape type for YK61845: 0
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: CN37182
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN37182%27 HTTP/1.1" 200 None
2026-03-29 08:37:17 [auto1.be] INFO: Scrape type for CN37182: 0
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: EK79460
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK79460%27 HTTP/1.1" 200 None
2026-03-29 08:37:17 [auto1.be] INFO: Scrape type for EK79460: 0
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: SW60531
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: KE51169
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE51169%27 HTTP/1.1" 200 None
2026-03-29 08:37:17 [auto1.be] INFO: Scrape type for KE51169: 0
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: JJ51820
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: KH65741
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: CV58665
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: NE94103
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: RC51689
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: XS76018
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS76018%27 HTTP/1.1" 200 None
2026-03-29 08:37:17 [auto1.be] INFO: Scrape type for XS76018: 0
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: UY92003
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY92003%27 HTTP/1.1" 200 None
2026-03-29 08:37:17 [auto1.be] INFO: Scrape type for UY92003: 0
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: NV64774
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV64774%27 HTTP/1.1" 200 None
2026-03-29 08:37:17 [auto1.be] INFO: Scrape type for NV64774: 0
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: KB41449
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: ET88330
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET88330%27 HTTP/1.1" 200 None
2026-03-29 08:37:17 [auto1.be] INFO: Scrape type for ET88330: 0
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: KT00341
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT00341%27 HTTP/1.1" 200 None
2026-03-29 08:37:17 [auto1.be] INFO: Scrape type for KT00341: 0
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: YH90615
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH90615%27 HTTP/1.1" 200 None
2026-03-29 08:37:17 [auto1.be] INFO: Scrape type for YH90615: 0
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: CU35051
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU35051%27 HTTP/1.1" 200 None
2026-03-29 08:37:17 [auto1.be] INFO: Scrape type for CU35051: 0
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: JU94491
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: PK02246
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK02246%27 HTTP/1.1" 200 None
2026-03-29 08:37:17 [auto1.be] INFO: Scrape type for PK02246: 0
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: PU93740
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: LY17098
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY17098%27 HTTP/1.1" 200 None
2026-03-29 08:37:17 [auto1.be] INFO: Scrape type for LY17098: 0
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: FC78029
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC78029%27 HTTP/1.1" 200 None
2026-03-29 08:37:17 [auto1.be] INFO: Scrape type for FC78029: 0
2026-03-29 08:37:17 [auto1.be] INFO: Found listing with ID: EH00335
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EH00335%27 HTTP/1.1" 200 None
2026-03-29 08:37:17 [auto1.be] INFO: Scrape type for EH00335: 0
2026-03-29 08:37:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:37:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:37:18 [auto1.be] INFO: Channel: 24h | Page: 30 | totalHits: 1252 | hits on page: 40
2026-03-29 08:37:18 [auto1.be] INFO: Found listing with ID: WH49963
2026-03-29 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH49963%27 HTTP/1.1" 200 None
2026-03-29 08:37:18 [auto1.be] INFO: Scrape type for WH49963: 0
2026-03-29 08:37:18 [auto1.be] INFO: Found listing with ID: XG70738
2026-03-29 08:37:18 [auto1.be] INFO: Found listing with ID: KL53758
2026-03-29 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KL53758%27 HTTP/1.1" 200 None
2026-03-29 08:37:18 [auto1.be] INFO: Scrape type for KL53758: 0
2026-03-29 08:37:18 [auto1.be] INFO: Found listing with ID: GV92885
2026-03-29 08:37:18 [auto1.be] INFO: Found listing with ID: RA73981
2026-03-29 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA73981%27 HTTP/1.1" 200 None
2026-03-29 08:37:18 [auto1.be] INFO: Scrape type for RA73981: 0
2026-03-29 08:37:18 [auto1.be] INFO: Found listing with ID: EJ96142
2026-03-29 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ96142%27 HTTP/1.1" 200 None
2026-03-29 08:37:18 [auto1.be] INFO: Scrape type for EJ96142: 0
2026-03-29 08:37:18 [auto1.be] INFO: Found listing with ID: HE39793
2026-03-29 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE39793%27 HTTP/1.1" 200 None
2026-03-29 08:37:18 [auto1.be] INFO: Scrape type for HE39793: 0
2026-03-29 08:37:18 [auto1.be] INFO: Found listing with ID: DD83263
2026-03-29 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD83263%27 HTTP/1.1" 200 None
2026-03-29 08:37:18 [auto1.be] INFO: Scrape type for DD83263: 0
2026-03-29 08:37:18 [auto1.be] INFO: Found listing with ID: DV83163
2026-03-29 08:37:18 [auto1.be] INFO: Found listing with ID: SW21472
2026-03-29 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW21472%27 HTTP/1.1" 200 None
2026-03-29 08:37:18 [auto1.be] INFO: Scrape type for SW21472: 0
2026-03-29 08:37:18 [auto1.be] INFO: Found listing with ID: AF15006
2026-03-29 08:37:18 [auto1.be] INFO: Found listing with ID: JY19882
2026-03-29 08:37:18 [auto1.be] INFO: Found listing with ID: EY57880
2026-03-29 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EY57880%27 HTTP/1.1" 200 None
2026-03-29 08:37:18 [auto1.be] INFO: Scrape type for EY57880: 0
2026-03-29 08:37:18 [auto1.be] INFO: Found listing with ID: JZ80953
2026-03-29 08:37:18 [auto1.be] INFO: Found listing with ID: TL44110
2026-03-29 08:37:18 [auto1.be] INFO: Found listing with ID: ZN56944
2026-03-29 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN56944%27 HTTP/1.1" 200 None
2026-03-29 08:37:18 [auto1.be] INFO: Scrape type for ZN56944: 0
2026-03-29 08:37:18 [auto1.be] INFO: Found listing with ID: FC31614
2026-03-29 08:37:18 [auto1.be] INFO: Found listing with ID: HX50025
2026-03-29 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX50025%27 HTTP/1.1" 200 None
2026-03-29 08:37:18 [auto1.be] INFO: Scrape type for HX50025: 0
2026-03-29 08:37:18 [auto1.be] INFO: Found listing with ID: DH53723
2026-03-29 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH53723%27 HTTP/1.1" 200 None
2026-03-29 08:37:18 [auto1.be] INFO: Scrape type for DH53723: 0
2026-03-29 08:37:18 [auto1.be] INFO: Found listing with ID: CU06988
2026-03-29 08:37:18 [auto1.be] INFO: Found listing with ID: RD62823
2026-03-29 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD62823%27 HTTP/1.1" 200 None
2026-03-29 08:37:18 [auto1.be] INFO: Scrape type for RD62823: 0
2026-03-29 08:37:18 [auto1.be] INFO: Found listing with ID: KH04328
2026-03-29 08:37:18 [auto1.be] INFO: Found listing with ID: GN32494
2026-03-29 08:37:18 [auto1.be] INFO: Found listing with ID: ZG72967
2026-03-29 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG72967%27 HTTP/1.1" 200 None
2026-03-29 08:37:18 [auto1.be] INFO: Scrape type for ZG72967: 0
2026-03-29 08:37:18 [auto1.be] INFO: Found listing with ID: LA84805
2026-03-29 08:37:18 [auto1.be] INFO: Found listing with ID: UH00217
2026-03-29 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UH00217%27 HTTP/1.1" 200 None
2026-03-29 08:37:19 [auto1.be] INFO: Scrape type for UH00217: 0
2026-03-29 08:37:19 [auto1.be] INFO: Found listing with ID: RX31058
2026-03-29 08:37:19 [auto1.be] INFO: Found listing with ID: BB55914
2026-03-29 08:37:19 [auto1.be] INFO: Found listing with ID: JY01361
2026-03-29 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY01361%27 HTTP/1.1" 200 None
2026-03-29 08:37:19 [auto1.be] INFO: Scrape type for JY01361: 0
2026-03-29 08:37:19 [auto1.be] INFO: Found listing with ID: EU75132
2026-03-29 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EU75132%27 HTTP/1.1" 200 None
2026-03-29 08:37:19 [auto1.be] INFO: Scrape type for EU75132: 0
2026-03-29 08:37:19 [auto1.be] INFO: Found listing with ID: KC67497
2026-03-29 08:37:19 [auto1.be] INFO: Found listing with ID: FK09845
2026-03-29 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK09845%27 HTTP/1.1" 200 None
2026-03-29 08:37:19 [auto1.be] INFO: Scrape type for FK09845: 0
2026-03-29 08:37:19 [auto1.be] INFO: Found listing with ID: EB31921
2026-03-29 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB31921%27 HTTP/1.1" 200 None
2026-03-29 08:37:19 [auto1.be] INFO: Scrape type for EB31921: 0
2026-03-29 08:37:19 [auto1.be] INFO: Found listing with ID: DJ63605
2026-03-29 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ63605%27 HTTP/1.1" 200 None
2026-03-29 08:37:19 [auto1.be] INFO: Scrape type for DJ63605: 0
2026-03-29 08:37:19 [auto1.be] INFO: Found listing with ID: US61346
2026-03-29 08:37:19 [auto1.be] INFO: Found listing with ID: SY12350
2026-03-29 08:37:19 [auto1.be] INFO: Found listing with ID: ST29091
2026-03-29 08:37:19 [auto1.be] INFO: Found listing with ID: TV57254
2026-03-29 08:37:19 [auto1.be] INFO: Found listing with ID: TC61218
2026-03-29 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC61218%27 HTTP/1.1" 200 None
2026-03-29 08:37:19 [auto1.be] INFO: Scrape type for TC61218: 0
2026-03-29 08:37:19 [auto1.be] INFO: Found listing with ID: PP72448
2026-03-29 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PP72448%27 HTTP/1.1" 200 None
2026-03-29 08:37:19 [auto1.be] INFO: Scrape type for PP72448: 0
2026-03-29 08:37:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:37:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:37:20 [auto1.be] INFO: Channel: 24h | Page: 31 | totalHits: 1252 | hits on page: 40
2026-03-29 08:37:20 [auto1.be] INFO: Found listing with ID: EV21741
2026-03-29 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV21741%27 HTTP/1.1" 200 None
2026-03-29 08:37:20 [auto1.be] INFO: Scrape type for EV21741: 0
2026-03-29 08:37:20 [auto1.be] INFO: Found listing with ID: RF01360
2026-03-29 08:37:20 [auto1.be] INFO: Found listing with ID: UU14069
2026-03-29 08:37:20 [auto1.be] INFO: Found listing with ID: BZ95673
2026-03-29 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ95673%27 HTTP/1.1" 200 None
2026-03-29 08:37:20 [auto1.be] INFO: Scrape type for BZ95673: 0
2026-03-29 08:37:20 [auto1.be] INFO: Found listing with ID: AG16412
2026-03-29 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG16412%27 HTTP/1.1" 200 None
2026-03-29 08:37:20 [auto1.be] INFO: Scrape type for AG16412: 0
2026-03-29 08:37:20 [auto1.be] INFO: Found listing with ID: TM16327
2026-03-29 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM16327%27 HTTP/1.1" 200 None
2026-03-29 08:37:20 [auto1.be] INFO: Scrape type for TM16327: 0
2026-03-29 08:37:20 [auto1.be] INFO: Found listing with ID: UC18604
2026-03-29 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC18604%27 HTTP/1.1" 200 None
2026-03-29 08:37:20 [auto1.be] INFO: Scrape type for UC18604: 0
2026-03-29 08:37:20 [auto1.be] INFO: Found listing with ID: TF70513
2026-03-29 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF70513%27 HTTP/1.1" 200 None
2026-03-29 08:37:20 [auto1.be] INFO: Scrape type for TF70513: 2
2026-03-29 08:37:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b3b949e-44a0-59d0-a8b1-c64894673dc1 with identifier: TF70513
2026-03-29 08:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b3b949e-44a0-59d0-a8b1-c64894673dc1 with scrape type 2
2026-03-29 08:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b3b949e-44a0-59d0-a8b1-c64894673dc1 with scrape type 2
2026-03-29 08:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9b3b949e-44a0-59d0-a8b1-c64894673dc1, identifier: TF70513
2026-03-29 08:37:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9b3b949e-44a0-59d0-a8b1-c64894673dc1 with identifier: TF70513
2026-03-29 08:37:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9b3b949e-44a0-59d0-a8b1-c64894673dc1 with identifier: TF70513
2026-03-29 08:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9b3b949e-44a0-59d0-a8b1-c64894673dc1 with identifier: TF70513 to the API
2026-03-29 08:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:08:48Z',
'fuel_type': 'diesel',
'id': '9b3b949e-44a0-59d0-a8b1-c64894673dc1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF70513',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 281912,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-25',
'seller_name': None,
'title': 'Audi A6 2.0 TDI Ultra',
'transmission': 'automatic',
'trim': 'Ultra',
'year': 2015}
2026-03-29 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF70513%27 HTTP/1.1" 200 None
2026-03-29 08:37:20 [auto1.be] INFO: Saving data for TF70513: {'auction_closing_time': 1774883328.0, 'created_time': 1774686941.957169, 'last_price_update_time': 1774773440.905802}
2026-03-29 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TF70513') HTTP/1.1" 204 0
2026-03-29 08:37:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:37:21 [auto1.be] INFO: Found listing with ID: ZD95004
2026-03-29 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZD95004%27 HTTP/1.1" 200 None
2026-03-29 08:37:21 [auto1.be] INFO: Scrape type for ZD95004: 2
2026-03-29 08:37:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289 with identifier: ZD95004
2026-03-29 08:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289 with scrape type 2
2026-03-29 08:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289 with scrape type 2
2026-03-29 08:37:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289, identifier: ZD95004
2026-03-29 08:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289 with identifier: ZD95004
2026-03-29 08:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289 with identifier: ZD95004
2026-03-29 08:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289 with identifier: ZD95004 to the API
2026-03-29 08:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:34:04Z',
'fuel_type': 'diesel',
'id': '3d2d86d1-d7da-5fd4-b70f-8cdc28dca289',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD95004',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 109596,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-13',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 CDI Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2009}
2026-03-29 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZD95004%27 HTTP/1.1" 200 None
2026-03-29 08:37:21 [auto1.be] INFO: Saving data for ZD95004: {'auction_closing_time': 1774884844.0, 'created_time': 1774686946.518636, 'last_price_update_time': 1774773441.418083}
2026-03-29 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZD95004') HTTP/1.1" 204 0
2026-03-29 08:37:21 [auto1.be] INFO: Found listing with ID: ES25967
2026-03-29 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES25967%27 HTTP/1.1" 200 None
2026-03-29 08:37:21 [auto1.be] INFO: Scrape type for ES25967: 2
2026-03-29 08:37:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9d3289d-eb7b-5545-b43e-8b22e2c78374 with identifier: ES25967
2026-03-29 08:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9d3289d-eb7b-5545-b43e-8b22e2c78374 with scrape type 2
2026-03-29 08:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9d3289d-eb7b-5545-b43e-8b22e2c78374 with scrape type 2
2026-03-29 08:37:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b9d3289d-eb7b-5545-b43e-8b22e2c78374, identifier: ES25967
2026-03-29 08:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b9d3289d-eb7b-5545-b43e-8b22e2c78374 with identifier: ES25967
2026-03-29 08:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b9d3289d-eb7b-5545-b43e-8b22e2c78374 with identifier: ES25967
2026-03-29 08:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b9d3289d-eb7b-5545-b43e-8b22e2c78374 with identifier: ES25967 to the API
2026-03-29 08:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:06:00Z',
'fuel_type': 'petrol',
'id': 'b9d3289d-eb7b-5545-b43e-8b22e2c78374',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES25967',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 140598,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-10-25',
'seller_name': None,
'title': 'Peugeot 308 1.6 Sport Plus',
'transmission': 'manual',
'trim': 'Sport Plus',
'year': 2007}
2026-03-29 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES25967%27 HTTP/1.1" 200 None
2026-03-29 08:37:21 [auto1.be] INFO: Saving data for ES25967: {'auction_closing_time': 1774883160.0, 'created_time': 1774557498.524283, 'last_price_update_time': 1774773441.788934}
2026-03-29 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ES25967') HTTP/1.1" 204 0
2026-03-29 08:37:21 [auto1.be] INFO: Found listing with ID: PC01829
2026-03-29 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC01829%27 HTTP/1.1" 200 None
2026-03-29 08:37:21 [auto1.be] INFO: Scrape type for PC01829: 2
2026-03-29 08:37:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f5fb589-9951-5f71-991b-a5e438cec510 with identifier: PC01829
2026-03-29 08:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f5fb589-9951-5f71-991b-a5e438cec510 with scrape type 2
2026-03-29 08:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f5fb589-9951-5f71-991b-a5e438cec510 with scrape type 2
2026-03-29 08:37:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0f5fb589-9951-5f71-991b-a5e438cec510, identifier: PC01829
2026-03-29 08:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0f5fb589-9951-5f71-991b-a5e438cec510 with identifier: PC01829
2026-03-29 08:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0f5fb589-9951-5f71-991b-a5e438cec510 with identifier: PC01829
2026-03-29 08:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0f5fb589-9951-5f71-991b-a5e438cec510 with identifier: PC01829 to the API
2026-03-29 08:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:37:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:50:11Z',
'fuel_type': 'diesel',
'id': '0f5fb589-9951-5f71-991b-a5e438cec510',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC01829',
'listing': 'auction',
'make': 'Seat',
'model': 'Cordoba',
'odometer': 133342,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-04-21',
'seller_name': None,
'title': 'Seat Cordoba 1.4 TDI Reference',
'transmission': 'manual',
'trim': 'Reference',
'year': 2008}
2026-03-29 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC01829%27 HTTP/1.1" 200 None
2026-03-29 08:37:22 [auto1.be] INFO: Saving data for PC01829: {'auction_closing_time': 1774885811.0, 'created_time': 1774686939.100127, 'last_price_update_time': 1774773442.17388}
2026-03-29 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PC01829') HTTP/1.1" 204 0
2026-03-29 08:37:22 [auto1.be] INFO: Found listing with ID: RW32127
2026-03-29 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW32127%27 HTTP/1.1" 200 None
2026-03-29 08:37:22 [auto1.be] INFO: Scrape type for RW32127: 2
2026-03-29 08:37:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ebf1fc3-07be-5c12-9255-977e9814527d with identifier: RW32127
2026-03-29 08:37:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ebf1fc3-07be-5c12-9255-977e9814527d with scrape type 2
2026-03-29 08:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ebf1fc3-07be-5c12-9255-977e9814527d with scrape type 2
2026-03-29 08:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9ebf1fc3-07be-5c12-9255-977e9814527d, identifier: RW32127
2026-03-29 08:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9ebf1fc3-07be-5c12-9255-977e9814527d with identifier: RW32127
2026-03-29 08:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9ebf1fc3-07be-5c12-9255-977e9814527d with identifier: RW32127
2026-03-29 08:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9ebf1fc3-07be-5c12-9255-977e9814527d with identifier: RW32127 to the API
2026-03-29 08:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:37:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:55:44Z',
'fuel_type': 'diesel',
'id': '9ebf1fc3-07be-5c12-9255-977e9814527d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW32127',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 436555,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-19',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 CDI T BlueEfficiency Elegance',
'transmission': 'manual',
'trim': 'T BlueEfficiency Elegance',
'year': 2012}
2026-03-29 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW32127%27 HTTP/1.1" 200 None
2026-03-29 08:37:22 [auto1.be] INFO: Saving data for RW32127: {'auction_closing_time': 1774886144.0, 'created_time': 1774686926.891323, 'last_price_update_time': 1774773442.560556}
2026-03-29 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RW32127') HTTP/1.1" 204 0
2026-03-29 08:37:22 [auto1.be] INFO: Found listing with ID: CE27208
2026-03-29 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE27208%27 HTTP/1.1" 200 None
2026-03-29 08:37:22 [auto1.be] INFO: Scrape type for CE27208: 2
2026-03-29 08:37:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31345bdc-1875-5eb2-93ff-11d119f18053 with identifier: CE27208
2026-03-29 08:37:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31345bdc-1875-5eb2-93ff-11d119f18053 with scrape type 2
2026-03-29 08:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31345bdc-1875-5eb2-93ff-11d119f18053 with scrape type 2
2026-03-29 08:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 31345bdc-1875-5eb2-93ff-11d119f18053, identifier: CE27208
2026-03-29 08:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 31345bdc-1875-5eb2-93ff-11d119f18053 with identifier: CE27208
2026-03-29 08:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 31345bdc-1875-5eb2-93ff-11d119f18053 with identifier: CE27208
2026-03-29 08:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 31345bdc-1875-5eb2-93ff-11d119f18053 with identifier: CE27208 to the API
2026-03-29 08:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:37:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:16:01Z',
'fuel_type': 'petrol',
'id': '31345bdc-1875-5eb2-93ff-11d119f18053',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE27208',
'listing': 'auction',
'make': 'Renault',
'model': 'Captur',
'odometer': 8364,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-28',
'seller_name': None,
'title': 'Renault Captur 0.9 Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2019}
2026-03-29 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE27208%27 HTTP/1.1" 200 None
2026-03-29 08:37:23 [auto1.be] INFO: Saving data for CE27208: {'auction_closing_time': 1774883761.0, 'created_time': 1774686941.360472, 'last_price_update_time': 1774773443.013959}
2026-03-29 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CE27208') HTTP/1.1" 204 0
2026-03-29 08:37:23 [auto1.be] INFO: Found listing with ID: XG78459
2026-03-29 08:37:23 [auto1.be] INFO: Found listing with ID: CG81228
2026-03-29 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG81228%27 HTTP/1.1" 200 None
2026-03-29 08:37:23 [auto1.be] INFO: Scrape type for CG81228: 2
2026-03-29 08:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 373d6282-31c7-562e-b795-e7d228f92fa1 with identifier: CG81228
2026-03-29 08:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 373d6282-31c7-562e-b795-e7d228f92fa1 with scrape type 2
2026-03-29 08:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 373d6282-31c7-562e-b795-e7d228f92fa1 with scrape type 2
2026-03-29 08:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 373d6282-31c7-562e-b795-e7d228f92fa1, identifier: CG81228
2026-03-29 08:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 373d6282-31c7-562e-b795-e7d228f92fa1 with identifier: CG81228
2026-03-29 08:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 373d6282-31c7-562e-b795-e7d228f92fa1 with identifier: CG81228
2026-03-29 08:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 373d6282-31c7-562e-b795-e7d228f92fa1 with identifier: CG81228 to the API
2026-03-29 08:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:23:59Z',
'fuel_type': 'diesel',
'id': '373d6282-31c7-562e-b795-e7d228f92fa1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG81228',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 257054,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-12-04',
'seller_name': None,
'title': 'Skoda Octavia 1.6 TDI GreenLine',
'transmission': 'manual',
'trim': 'GreenLine',
'year': 2011}
2026-03-29 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG81228%27 HTTP/1.1" 200 None
2026-03-29 08:37:23 [auto1.be] INFO: Saving data for CG81228: {'auction_closing_time': 1774884239.0, 'created_time': 1774686936.80688, 'last_price_update_time': 1774773443.38166}
2026-03-29 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CG81228') HTTP/1.1" 204 0
2026-03-29 08:37:23 [auto1.be] INFO: Found listing with ID: RC25321
2026-03-29 08:37:23 [auto1.be] INFO: Found listing with ID: YZ86935
2026-03-29 08:37:23 [auto1.be] INFO: Found listing with ID: XB72565
2026-03-29 08:37:23 [auto1.be] INFO: Found listing with ID: WN54122
2026-03-29 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN54122%27 HTTP/1.1" 200 None
2026-03-29 08:37:23 [auto1.be] INFO: Scrape type for WN54122: 2
2026-03-29 08:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f56cb8fa-524f-5248-8e48-8957f14682fa with identifier: WN54122
2026-03-29 08:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f56cb8fa-524f-5248-8e48-8957f14682fa with scrape type 2
2026-03-29 08:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f56cb8fa-524f-5248-8e48-8957f14682fa with scrape type 2
2026-03-29 08:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f56cb8fa-524f-5248-8e48-8957f14682fa, identifier: WN54122
2026-03-29 08:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f56cb8fa-524f-5248-8e48-8957f14682fa with identifier: WN54122
2026-03-29 08:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f56cb8fa-524f-5248-8e48-8957f14682fa with identifier: WN54122
2026-03-29 08:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f56cb8fa-524f-5248-8e48-8957f14682fa with identifier: WN54122 to the API
2026-03-29 08:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:28:36Z',
'fuel_type': 'diesel',
'id': 'f56cb8fa-524f-5248-8e48-8957f14682fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN54122',
'listing': 'auction',
'make': 'Volvo',
'model': 'V50',
'odometer': 295205,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-18',
'seller_name': None,
'title': 'Volvo V50 1.6 DRIVe',
'transmission': 'manual',
'trim': '',
'year': 2011}
2026-03-29 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN54122%27 HTTP/1.1" 200 None
2026-03-29 08:37:23 [auto1.be] INFO: Saving data for WN54122: {'auction_closing_time': 1774884516.0, 'created_time': 1774686936.04424, 'last_price_update_time': 1774773443.756199}
2026-03-29 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WN54122') HTTP/1.1" 204 0
2026-03-29 08:37:23 [auto1.be] INFO: Found listing with ID: WM28184
2026-03-29 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM28184%27 HTTP/1.1" 200 None
2026-03-29 08:37:23 [auto1.be] INFO: Scrape type for WM28184: 2
2026-03-29 08:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70e25ca2-9a89-529b-8fd6-fac12f04e25f with identifier: WM28184
2026-03-29 08:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70e25ca2-9a89-529b-8fd6-fac12f04e25f with scrape type 2
2026-03-29 08:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70e25ca2-9a89-529b-8fd6-fac12f04e25f with scrape type 2
2026-03-29 08:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 70e25ca2-9a89-529b-8fd6-fac12f04e25f, identifier: WM28184
2026-03-29 08:37:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 70e25ca2-9a89-529b-8fd6-fac12f04e25f with identifier: WM28184
2026-03-29 08:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 70e25ca2-9a89-529b-8fd6-fac12f04e25f with identifier: WM28184
2026-03-29 08:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 70e25ca2-9a89-529b-8fd6-fac12f04e25f with identifier: WM28184 to the API
2026-03-29 08:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:01:25Z',
'fuel_type': 'petrol',
'id': '70e25ca2-9a89-529b-8fd6-fac12f04e25f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM28184',
'listing': 'auction',
'make': 'Renault',
'model': 'Grand Scenic',
'odometer': 201750,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-19',
'seller_name': None,
'title': 'Renault Grand Scenic 1.3 TCe BOSE-Edition',
'transmission': 'manual',
'trim': 'BOSE-Edition',
'year': 2018}
2026-03-29 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM28184%27 HTTP/1.1" 200 None
2026-03-29 08:37:24 [auto1.be] INFO: Saving data for WM28184: {'auction_closing_time': 1774882885.0, 'created_time': 1774384578.475275, 'last_price_update_time': 1774773444.228789}
2026-03-29 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WM28184') HTTP/1.1" 204 0
2026-03-29 08:37:24 [auto1.be] INFO: Found listing with ID: UA48921
2026-03-29 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA48921%27 HTTP/1.1" 200 None
2026-03-29 08:37:24 [auto1.be] INFO: Scrape type for UA48921: 2
2026-03-29 08:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2a20b8a-8294-554b-9300-021f075da908 with identifier: UA48921
2026-03-29 08:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2a20b8a-8294-554b-9300-021f075da908 with scrape type 2
2026-03-29 08:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2a20b8a-8294-554b-9300-021f075da908 with scrape type 2
2026-03-29 08:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b2a20b8a-8294-554b-9300-021f075da908, identifier: UA48921
2026-03-29 08:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b2a20b8a-8294-554b-9300-021f075da908 with identifier: UA48921
2026-03-29 08:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b2a20b8a-8294-554b-9300-021f075da908 with identifier: UA48921
2026-03-29 08:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b2a20b8a-8294-554b-9300-021f075da908 with identifier: UA48921 to the API
2026-03-29 08:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:56:58Z',
'fuel_type': 'petrol',
'id': 'b2a20b8a-8294-554b-9300-021f075da908',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA48921',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 76342,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-26',
'seller_name': None,
'title': 'Smart fortwo 1.0 Micro Hybrid Drive pulse',
'transmission': 'automatic',
'trim': 'Micro Hybrid Drive pulse',
'year': 2013}
2026-03-29 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA48921%27 HTTP/1.1" 200 None
2026-03-29 08:37:24 [auto1.be] INFO: Saving data for UA48921: {'auction_closing_time': 1774886218.0, 'created_time': 1774686928.061024, 'last_price_update_time': 1774773444.642061}
2026-03-29 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UA48921') HTTP/1.1" 204 0
2026-03-29 08:37:24 [auto1.be] INFO: Found listing with ID: PV46198
2026-03-29 08:37:24 [auto1.be] INFO: Found listing with ID: LE69336
2026-03-29 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE69336%27 HTTP/1.1" 200 None
2026-03-29 08:37:24 [auto1.be] INFO: Scrape type for LE69336: 2
2026-03-29 08:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d24c770-d34a-5cfb-9daa-86d53d2b05a9 with identifier: LE69336
2026-03-29 08:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d24c770-d34a-5cfb-9daa-86d53d2b05a9 with scrape type 2
2026-03-29 08:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d24c770-d34a-5cfb-9daa-86d53d2b05a9 with scrape type 2
2026-03-29 08:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3d24c770-d34a-5cfb-9daa-86d53d2b05a9, identifier: LE69336
2026-03-29 08:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3d24c770-d34a-5cfb-9daa-86d53d2b05a9 with identifier: LE69336
2026-03-29 08:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3d24c770-d34a-5cfb-9daa-86d53d2b05a9 with identifier: LE69336
2026-03-29 08:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3d24c770-d34a-5cfb-9daa-86d53d2b05a9 with identifier: LE69336 to the API
2026-03-29 08:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:37:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:39:40Z',
'fuel_type': 'diesel',
'id': '3d24c770-d34a-5cfb-9daa-86d53d2b05a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE69336',
'listing': 'auction',
'make': 'Audi',
'model': 'A7 Sportback',
'odometer': 378167,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-01',
'seller_name': None,
'title': 'Audi A7 Sportback 3.0 V6 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-29 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE69336%27 HTTP/1.1" 200 None
2026-03-29 08:37:25 [auto1.be] INFO: Saving data for LE69336: {'auction_closing_time': 1774885180.0, 'created_time': 1773920168.94634, 'last_price_update_time': 1774773445.039803}
2026-03-29 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LE69336') HTTP/1.1" 204 0
2026-03-29 08:37:25 [auto1.be] INFO: Channel: 24h | Page: 32 | totalHits: 1252 | hits on page: 12
2026-03-29 08:37:25 [auto1.be] INFO: Found listing with ID: RY49845
2026-03-29 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY49845%27 HTTP/1.1" 200 None
2026-03-29 08:37:25 [auto1.be] INFO: Scrape type for RY49845: 2
2026-03-29 08:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 683c5982-2d40-5e4c-8362-4eea5e187da1 with identifier: RY49845
2026-03-29 08:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 683c5982-2d40-5e4c-8362-4eea5e187da1 with scrape type 2
2026-03-29 08:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 683c5982-2d40-5e4c-8362-4eea5e187da1 with scrape type 2
2026-03-29 08:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 683c5982-2d40-5e4c-8362-4eea5e187da1, identifier: RY49845
2026-03-29 08:37:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 683c5982-2d40-5e4c-8362-4eea5e187da1 with identifier: RY49845
2026-03-29 08:37:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 683c5982-2d40-5e4c-8362-4eea5e187da1 with identifier: RY49845
2026-03-29 08:37:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 683c5982-2d40-5e4c-8362-4eea5e187da1 with identifier: RY49845 to the API
2026-03-29 08:37:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:37:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:37:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:17:55Z',
'fuel_type': 'petrol',
'id': '683c5982-2d40-5e4c-8362-4eea5e187da1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY49845',
'listing': 'auction',
'make': 'BMW',
'model': '4er',
'odometer': 60888,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-25',
'seller_name': None,
'title': 'BMW 4er 420i Gran Coupé xDrive M Sport',
'transmission': 'automatic',
'trim': 'xDrive M Sport',
'year': 2018}
2026-03-29 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY49845%27 HTTP/1.1" 200 None
2026-03-29 08:37:25 [auto1.be] INFO: Saving data for RY49845: {'auction_closing_time': 1774883875.0, 'created_time': 1774686929.340394, 'last_price_update_time': 1774773445.40679}
2026-03-29 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RY49845') HTTP/1.1" 204 0
2026-03-29 08:37:25 [auto1.be] INFO: Found listing with ID: GF35922
2026-03-29 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF35922%27 HTTP/1.1" 200 None
2026-03-29 08:37:25 [auto1.be] INFO: Scrape type for GF35922: 0
2026-03-29 08:37:25 [auto1.be] INFO: Found listing with ID: BR73229
2026-03-29 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR73229%27 HTTP/1.1" 200 None
2026-03-29 08:37:25 [auto1.be] INFO: Scrape type for BR73229: 2
2026-03-29 08:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbb3668b-8a1a-528d-abd1-d0317422561b with identifier: BR73229
2026-03-29 08:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbb3668b-8a1a-528d-abd1-d0317422561b with scrape type 2
2026-03-29 08:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbb3668b-8a1a-528d-abd1-d0317422561b with scrape type 2
2026-03-29 08:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cbb3668b-8a1a-528d-abd1-d0317422561b, identifier: BR73229
2026-03-29 08:37:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:37:25 [auto1.be] INFO: Found listing with ID: ZT87936
2026-03-29 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZT87936%27 HTTP/1.1" 200 None
2026-03-29 08:37:25 [auto1.be] INFO: Scrape type for ZT87936: 2
2026-03-29 08:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 595b3383-415b-59b6-b010-7045f09ab499 with identifier: ZT87936
2026-03-29 08:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 595b3383-415b-59b6-b010-7045f09ab499 with scrape type 2
2026-03-29 08:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 595b3383-415b-59b6-b010-7045f09ab499 with scrape type 2
2026-03-29 08:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 595b3383-415b-59b6-b010-7045f09ab499, identifier: ZT87936
2026-03-29 08:37:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cbb3668b-8a1a-528d-abd1-d0317422561b with identifier: BR73229
2026-03-29 08:37:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cbb3668b-8a1a-528d-abd1-d0317422561b with identifier: BR73229
2026-03-29 08:37:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cbb3668b-8a1a-528d-abd1-d0317422561b with identifier: BR73229 to the API
2026-03-29 08:37:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:37:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:37:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:19:16Z',
'fuel_type': 'diesel',
'id': 'cbb3668b-8a1a-528d-abd1-d0317422561b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR73229',
'listing': 'auction',
'make': 'Audi',
'model': 'Q2',
'odometer': 123260,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-25',
'seller_name': None,
'title': 'Audi Q2 35 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2021}
2026-03-29 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR73229%27 HTTP/1.1" 200 None
2026-03-29 08:37:25 [auto1.be] INFO: Saving data for BR73229: {'auction_closing_time': 1774883956.0, 'created_time': 1774686940.420679, 'last_price_update_time': 1774773445.917376}
2026-03-29 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BR73229') HTTP/1.1" 204 0
2026-03-29 08:37:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 595b3383-415b-59b6-b010-7045f09ab499 with identifier: ZT87936
2026-03-29 08:37:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 595b3383-415b-59b6-b010-7045f09ab499 with identifier: ZT87936
2026-03-29 08:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 595b3383-415b-59b6-b010-7045f09ab499 with identifier: ZT87936 to the API
2026-03-29 08:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:18:15Z',
'fuel_type': 'petrol',
'id': '595b3383-415b-59b6-b010-7045f09ab499',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT87936',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 210001,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-27',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Highline BlueMotion Tech',
'year': 2014}
2026-03-29 08:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZT87936%27 HTTP/1.1" 200 None
2026-03-29 08:37:26 [auto1.be] INFO: Saving data for ZT87936: {'auction_closing_time': 1774883895.0, 'created_time': 1774686947.18161, 'last_price_update_time': 1774773446.217085}
2026-03-29 08:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZT87936') HTTP/1.1" 204 0
2026-03-29 08:37:26 [auto1.be] INFO: Found listing with ID: PV20794
2026-03-29 08:37:26 [auto1.be] INFO: Found listing with ID: BB63081
2026-03-29 08:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB63081%27 HTTP/1.1" 200 None
2026-03-29 08:37:26 [auto1.be] INFO: Scrape type for BB63081: 2
2026-03-29 08:37:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee474fd8-a289-5202-9ddb-cc5aac801ba1 with identifier: BB63081
2026-03-29 08:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee474fd8-a289-5202-9ddb-cc5aac801ba1 with scrape type 2
2026-03-29 08:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee474fd8-a289-5202-9ddb-cc5aac801ba1 with scrape type 2
2026-03-29 08:37:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ee474fd8-a289-5202-9ddb-cc5aac801ba1, identifier: BB63081
2026-03-29 08:37:26 [auto1.be] INFO: Found listing with ID: VZ26828
2026-03-29 08:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ26828%27 HTTP/1.1" 200 None
2026-03-29 08:37:26 [auto1.be] INFO: Scrape type for VZ26828: 2
2026-03-29 08:37:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7854656e-d739-5aba-aa3a-86968c28e4be with identifier: VZ26828
2026-03-29 08:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7854656e-d739-5aba-aa3a-86968c28e4be with scrape type 2
2026-03-29 08:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7854656e-d739-5aba-aa3a-86968c28e4be with scrape type 2
2026-03-29 08:37:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7854656e-d739-5aba-aa3a-86968c28e4be, identifier: VZ26828
2026-03-29 08:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ee474fd8-a289-5202-9ddb-cc5aac801ba1 with identifier: BB63081
2026-03-29 08:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ee474fd8-a289-5202-9ddb-cc5aac801ba1 with identifier: BB63081
2026-03-29 08:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ee474fd8-a289-5202-9ddb-cc5aac801ba1 with identifier: BB63081 to the API
2026-03-29 08:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:58:00Z',
'fuel_type': 'diesel',
'id': 'ee474fd8-a289-5202-9ddb-cc5aac801ba1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB63081',
'listing': 'auction',
'make': 'Renault',
'model': 'Talisman',
'odometer': 85505,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-28',
'seller_name': None,
'title': 'Renault Talisman 1.6 dCi Energy Intens',
'transmission': 'automatic',
'trim': 'Intens',
'year': 2017}
2026-03-29 08:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB63081%27 HTTP/1.1" 200 None
2026-03-29 08:37:26 [auto1.be] INFO: Saving data for BB63081: {'auction_closing_time': 1774886280.0, 'created_time': 1774686940.089522, 'last_price_update_time': 1774773446.685037}
2026-03-29 08:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BB63081') HTTP/1.1" 204 0
2026-03-29 08:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7854656e-d739-5aba-aa3a-86968c28e4be with identifier: VZ26828
2026-03-29 08:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7854656e-d739-5aba-aa3a-86968c28e4be with identifier: VZ26828
2026-03-29 08:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7854656e-d739-5aba-aa3a-86968c28e4be with identifier: VZ26828 to the API
2026-03-29 08:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:37:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:21:48Z',
'fuel_type': 'diesel',
'id': '7854656e-d739-5aba-aa3a-86968c28e4be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ26828',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Transporter',
'odometer': 250776,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-29',
'seller_name': None,
'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten',
'transmission': 'automatic',
'trim': 'Kasten',
'year': 2017}
2026-03-29 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ26828%27 HTTP/1.1" 200 None
2026-03-29 08:37:27 [auto1.be] INFO: Saving data for VZ26828: {'auction_closing_time': 1774884108.0, 'created_time': 1774686945.543288, 'last_price_update_time': 1774773447.03881}
2026-03-29 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VZ26828') HTTP/1.1" 204 0
2026-03-29 08:37:27 [auto1.be] INFO: Found listing with ID: SD89253
2026-03-29 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD89253%27 HTTP/1.1" 200 None
2026-03-29 08:37:27 [auto1.be] INFO: Scrape type for SD89253: 2
2026-03-29 08:37:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a5f59a8-f8ff-5e75-a341-3cc401653c6e with identifier: SD89253
2026-03-29 08:37:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a5f59a8-f8ff-5e75-a341-3cc401653c6e with scrape type 2
2026-03-29 08:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a5f59a8-f8ff-5e75-a341-3cc401653c6e with scrape type 2
2026-03-29 08:37:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8a5f59a8-f8ff-5e75-a341-3cc401653c6e, identifier: SD89253
2026-03-29 08:37:27 [auto1.be] INFO: Found listing with ID: RU30240
2026-03-29 08:37:27 [auto1.be] INFO: Found listing with ID: KR16689
2026-03-29 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KR16689%27 HTTP/1.1" 200 None
2026-03-29 08:37:27 [auto1.be] INFO: Scrape type for KR16689: 2
2026-03-29 08:37:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 964e5527-b132-5e5b-82b9-2780fb02e37f with identifier: KR16689
2026-03-29 08:37:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 964e5527-b132-5e5b-82b9-2780fb02e37f with scrape type 2
2026-03-29 08:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 964e5527-b132-5e5b-82b9-2780fb02e37f with scrape type 2
2026-03-29 08:37:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 964e5527-b132-5e5b-82b9-2780fb02e37f, identifier: KR16689
2026-03-29 08:37:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8a5f59a8-f8ff-5e75-a341-3cc401653c6e with identifier: SD89253
2026-03-29 08:37:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8a5f59a8-f8ff-5e75-a341-3cc401653c6e with identifier: SD89253
2026-03-29 08:37:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8a5f59a8-f8ff-5e75-a341-3cc401653c6e with identifier: SD89253 to the API
2026-03-29 08:37:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:37:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:37:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 255,
'expiration_date': '2026-03-30T15:30:24Z',
'fuel_type': 'petrol',
'id': '8a5f59a8-f8ff-5e75-a341-3cc401653c6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD89253',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC90',
'odometer': 132264,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-12',
'seller_name': None,
'title': 'Volvo XC90 2.0 T5 Momentum AWD',
'transmission': 'automatic',
'trim': 'Momentum AWD',
'year': 2017}
2026-03-29 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD89253%27 HTTP/1.1" 200 None
2026-03-29 08:37:27 [auto1.be] INFO: Saving data for SD89253: {'auction_closing_time': 1774884624.0, 'created_time': 1773995750.214786, 'last_price_update_time': 1774773447.538657}
2026-03-29 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SD89253') HTTP/1.1" 204 0
2026-03-29 08:37:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 964e5527-b132-5e5b-82b9-2780fb02e37f with identifier: KR16689
2026-03-29 08:37:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 964e5527-b132-5e5b-82b9-2780fb02e37f with identifier: KR16689
2026-03-29 08:37:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 964e5527-b132-5e5b-82b9-2780fb02e37f with identifier: KR16689 to the API
2026-03-29 08:37:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:37:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:37:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 117,
'expiration_date': '2026-03-30T15:53:52Z',
'fuel_type': 'petrol',
'id': '964e5527-b132-5e5b-82b9-2780fb02e37f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR16689',
'listing': 'auction',
'make': 'Nissan',
'model': 'Juke',
'odometer': 62290,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-02',
'seller_name': None,
'title': 'Nissan Juke 1.6 Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2012}
2026-03-29 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KR16689%27 HTTP/1.1" 200 None
2026-03-29 08:37:27 [auto1.be] INFO: Saving data for KR16689: {'auction_closing_time': 1774886032.0, 'created_time': 1774686932.349448, 'last_price_update_time': 1774773447.81854}
2026-03-29 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KR16689') HTTP/1.1" 204 0
2026-03-29 08:37:27 [auto1.be] INFO: Found listing with ID: SJ57770
2026-03-29 08:37:27 [auto1.be] INFO: Found listing with ID: XR93319
2026-03-29 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR93319%27 HTTP/1.1" 200 None
2026-03-29 08:37:27 [auto1.be] INFO: Scrape type for XR93319: 2
2026-03-29 08:37:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b62383b5-6176-5c42-be88-764430464d31 with identifier: XR93319
2026-03-29 08:37:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b62383b5-6176-5c42-be88-764430464d31 with scrape type 2
2026-03-29 08:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b62383b5-6176-5c42-be88-764430464d31 with scrape type 2
2026-03-29 08:37:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b62383b5-6176-5c42-be88-764430464d31, identifier: XR93319
2026-03-29 08:37:27 [auto1.be] INFO: Found listing with ID: YV20290
2026-03-29 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV20290%27 HTTP/1.1" 200 None
2026-03-29 08:37:27 [auto1.be] INFO: Scrape type for YV20290: 2
2026-03-29 08:37:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dce43ba4-977e-5060-b67e-9faba728d3a9 with identifier: YV20290
2026-03-29 08:37:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dce43ba4-977e-5060-b67e-9faba728d3a9 with scrape type 2
2026-03-29 08:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dce43ba4-977e-5060-b67e-9faba728d3a9 with scrape type 2
2026-03-29 08:37:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dce43ba4-977e-5060-b67e-9faba728d3a9, identifier: YV20290
2026-03-29 08:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b62383b5-6176-5c42-be88-764430464d31 with identifier: XR93319
2026-03-29 08:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b62383b5-6176-5c42-be88-764430464d31 with identifier: XR93319
2026-03-29 08:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b62383b5-6176-5c42-be88-764430464d31 with identifier: XR93319 to the API
2026-03-29 08:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:34:18Z',
'fuel_type': 'petrol',
'id': 'b62383b5-6176-5c42-be88-764430464d31',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR93319',
'listing': 'auction',
'make': 'Renault',
'model': 'Captur',
'odometer': 53451,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-21',
'seller_name': None,
'title': 'Renault Captur 0.9 Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2016}
2026-03-29 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR93319%27 HTTP/1.1" 200 None
2026-03-29 08:37:28 [auto1.be] INFO: Saving data for XR93319: {'auction_closing_time': 1774884858.0, 'created_time': 1774686934.420746, 'last_price_update_time': 1774773448.290177}
2026-03-29 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XR93319') HTTP/1.1" 204 0
2026-03-29 08:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dce43ba4-977e-5060-b67e-9faba728d3a9 with identifier: YV20290
2026-03-29 08:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dce43ba4-977e-5060-b67e-9faba728d3a9 with identifier: YV20290
2026-03-29 08:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dce43ba4-977e-5060-b67e-9faba728d3a9 with identifier: YV20290 to the API
2026-03-29 08:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:24:19Z',
'fuel_type': 'diesel',
'id': 'dce43ba4-977e-5060-b67e-9faba728d3a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV20290',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Grand Spacetourer',
'odometer': 169718,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-06',
'seller_name': None,
'title': 'Citroen C4 Grand Spacetourer 1.5 Blue-HDi Business +',
'transmission': 'manual',
'trim': 'Business +',
'year': 2019}
2026-03-29 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV20290%27 HTTP/1.1" 200 None
2026-03-29 08:37:28 [auto1.be] INFO: Saving data for YV20290: {'auction_closing_time': 1774884259.0, 'created_time': 1774686935.285926, 'last_price_update_time': 1774773448.558115}
2026-03-29 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YV20290') HTTP/1.1" 204 0
2026-03-29 08:37:28 [auto1.be] INFO: Found listing with ID: AB98915
2026-03-29 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB98915%27 HTTP/1.1" 200 None
2026-03-29 08:37:28 [auto1.be] INFO: Scrape type for AB98915: 0
2026-03-29 08:37:28 [auto1.be] INFO: Found listing with ID: AB83336
2026-03-29 08:37:28 [auto1.be] INFO: Found listing with ID: MR34349
2026-03-29 08:37:28 [auto1.be] INFO: Found listing with ID: XL09418
2026-03-29 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL09418%27 HTTP/1.1" 200 None
2026-03-29 08:37:28 [auto1.be] INFO: Scrape type for XL09418: 0
2026-03-29 08:37:28 [auto1.be] INFO: Found listing with ID: UW48636
2026-03-29 08:37:28 [auto1.be] INFO: Found listing with ID: XX22473
2026-03-29 08:37:28 [auto1.be] INFO: Found listing with ID: LK52725
2026-03-29 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK52725%27 HTTP/1.1" 200 None
2026-03-29 08:37:28 [auto1.be] INFO: Scrape type for LK52725: 2
2026-03-29 08:37:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c709fee6-adc9-56e0-acc0-7dbae4bf1e83 with identifier: LK52725
2026-03-29 08:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c709fee6-adc9-56e0-acc0-7dbae4bf1e83 with scrape type 2
2026-03-29 08:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c709fee6-adc9-56e0-acc0-7dbae4bf1e83 with scrape type 2
2026-03-29 08:37:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c709fee6-adc9-56e0-acc0-7dbae4bf1e83, identifier: LK52725
2026-03-29 08:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c709fee6-adc9-56e0-acc0-7dbae4bf1e83 with identifier: LK52725
2026-03-29 08:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c709fee6-adc9-56e0-acc0-7dbae4bf1e83 with identifier: LK52725
2026-03-29 08:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c709fee6-adc9-56e0-acc0-7dbae4bf1e83 with identifier: LK52725 to the API
2026-03-29 08:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:00:02Z',
'fuel_type': 'petrol',
'id': 'c709fee6-adc9-56e0-acc0-7dbae4bf1e83',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK52725',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka',
'odometer': 71003,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-05',
'seller_name': None,
'title': 'Opel Mokka 1.4 Turbo Innovation ecoFlex 4x4',
'transmission': 'manual',
'trim': 'Innovation ecoFlex 4x4',
'year': 2013}
2026-03-29 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK52725%27 HTTP/1.1" 200 None
2026-03-29 08:37:28 [auto1.be] INFO: Saving data for LK52725: {'auction_closing_time': 1774882802.0, 'created_time': 1774686934.060481, 'last_price_update_time': 1774773448.992047}
2026-03-29 08:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LK52725') HTTP/1.1" 204 0
2026-03-29 08:37:29 [auto1.be] INFO: Found listing with ID: TS84713
2026-03-29 08:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS84713%27 HTTP/1.1" 200 None
2026-03-29 08:37:29 [auto1.be] INFO: Scrape type for TS84713: 2
2026-03-29 08:37:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5305e02-626b-571c-9d4c-427af525642d with identifier: TS84713
2026-03-29 08:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5305e02-626b-571c-9d4c-427af525642d with scrape type 2
2026-03-29 08:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5305e02-626b-571c-9d4c-427af525642d with scrape type 2
2026-03-29 08:37:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e5305e02-626b-571c-9d4c-427af525642d, identifier: TS84713
2026-03-29 08:37:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e5305e02-626b-571c-9d4c-427af525642d with identifier: TS84713
2026-03-29 08:37:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e5305e02-626b-571c-9d4c-427af525642d with identifier: TS84713
2026-03-29 08:37:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e5305e02-626b-571c-9d4c-427af525642d with identifier: TS84713 to the API
2026-03-29 08:37:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:37:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:37:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:33:12Z',
'fuel_type': 'petrol',
'id': 'e5305e02-626b-571c-9d4c-427af525642d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS84713',
'listing': 'auction',
'make': 'Toyota',
'model': 'Aygo',
'odometer': 164241,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-08-31',
'seller_name': None,
'title': 'Toyota Aygo 1.0',
'transmission': 'manual',
'trim': '',
'year': 2008}
2026-03-29 08:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS84713%27 HTTP/1.1" 200 None
2026-03-29 08:37:29 [auto1.be] INFO: Saving data for TS84713: {'auction_closing_time': 1774884792.0, 'created_time': 1774686953.952962, 'last_price_update_time': 1774773449.445986}
2026-03-29 08:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TS84713') HTTP/1.1" 204 0
2026-03-29 08:37:29 [auto1.be] INFO: Found listing with ID: HY97997
2026-03-29 08:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY97997%27 HTTP/1.1" 200 None
2026-03-29 08:37:29 [auto1.be] INFO: Scrape type for HY97997: 2
2026-03-29 08:37:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e07c09c-348e-5621-9b4c-da3fc758ab99 with identifier: HY97997
2026-03-29 08:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e07c09c-348e-5621-9b4c-da3fc758ab99 with scrape type 2
2026-03-29 08:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e07c09c-348e-5621-9b4c-da3fc758ab99 with scrape type 2
2026-03-29 08:37:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4e07c09c-348e-5621-9b4c-da3fc758ab99, identifier: HY97997
2026-03-29 08:37:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4e07c09c-348e-5621-9b4c-da3fc758ab99 with identifier: HY97997
2026-03-29 08:37:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4e07c09c-348e-5621-9b4c-da3fc758ab99 with identifier: HY97997
2026-03-29 08:37:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4e07c09c-348e-5621-9b4c-da3fc758ab99 with identifier: HY97997 to the API
2026-03-29 08:37:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:37:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:37:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:40:51Z',
'fuel_type': 'diesel',
'id': '4e07c09c-348e-5621-9b4c-da3fc758ab99',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY97997',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 178955,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-07',
'seller_name': None,
'title': 'Peugeot 2008 1.5 Blue-HDi Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2020}
2026-03-29 08:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY97997%27 HTTP/1.1" 200 None
2026-03-29 08:37:29 [auto1.be] INFO: Saving data for HY97997: {'auction_closing_time': 1774885251.0, 'created_time': 1774686938.06072, 'last_price_update_time': 1774773449.809609}
2026-03-29 08:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HY97997') HTTP/1.1" 204 0
2026-03-29 08:37:29 [auto1.be] INFO: Found listing with ID: YA99172
2026-03-29 08:37:29 [auto1.be] INFO: Found listing with ID: PD03709
2026-03-29 08:37:29 [auto1.be] INFO: Found listing with ID: ZU52155
2026-03-29 08:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU52155%27 HTTP/1.1" 200 None
2026-03-29 08:37:29 [auto1.be] INFO: Scrape type for ZU52155: 2
2026-03-29 08:37:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2f34d93-eaf8-5527-b8e0-3b3f9b29f198 with identifier: ZU52155
2026-03-29 08:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2f34d93-eaf8-5527-b8e0-3b3f9b29f198 with scrape type 2
2026-03-29 08:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2f34d93-eaf8-5527-b8e0-3b3f9b29f198 with scrape type 2
2026-03-29 08:37:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e2f34d93-eaf8-5527-b8e0-3b3f9b29f198, identifier: ZU52155
2026-03-29 08:37:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e2f34d93-eaf8-5527-b8e0-3b3f9b29f198 with identifier: ZU52155
2026-03-29 08:37:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e2f34d93-eaf8-5527-b8e0-3b3f9b29f198 with identifier: ZU52155
2026-03-29 08:37:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e2f34d93-eaf8-5527-b8e0-3b3f9b29f198 with identifier: ZU52155 to the API
2026-03-29 08:37:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:37:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:22:58Z',
'fuel_type': 'diesel',
'id': 'e2f34d93-eaf8-5527-b8e0-3b3f9b29f198',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU52155',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 184666,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-02-07',
'seller_name': None,
'title': 'BMW X3 xDrive 18d Edition Exclusive',
'transmission': 'manual',
'trim': 'Edition Exclusive',
'year': 2010}
2026-03-29 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU52155%27 HTTP/1.1" 200 None
2026-03-29 08:37:30 [auto1.be] INFO: Saving data for ZU52155: {'auction_closing_time': 1774884178.0, 'created_time': 1774039028.863284, 'last_price_update_time': 1774773450.187287}
2026-03-29 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZU52155') HTTP/1.1" 204 0
2026-03-29 08:37:30 [auto1.be] INFO: Found listing with ID: HJ47401
2026-03-29 08:37:30 [auto1.be] INFO: Found listing with ID: FY94559
2026-03-29 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY94559%27 HTTP/1.1" 200 None
2026-03-29 08:37:30 [auto1.be] INFO: Scrape type for FY94559: 2
2026-03-29 08:37:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 603692b3-5c67-5f24-ac09-e0b8e7e230f6 with identifier: FY94559
2026-03-29 08:37:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 603692b3-5c67-5f24-ac09-e0b8e7e230f6 with scrape type 2
2026-03-29 08:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 603692b3-5c67-5f24-ac09-e0b8e7e230f6 with scrape type 2
2026-03-29 08:37:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 603692b3-5c67-5f24-ac09-e0b8e7e230f6, identifier: FY94559
2026-03-29 08:37:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 603692b3-5c67-5f24-ac09-e0b8e7e230f6 with identifier: FY94559
2026-03-29 08:37:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 603692b3-5c67-5f24-ac09-e0b8e7e230f6 with identifier: FY94559
2026-03-29 08:37:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 603692b3-5c67-5f24-ac09-e0b8e7e230f6 with identifier: FY94559 to the API
2026-03-29 08:37:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:37:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:37:57Z',
'fuel_type': 'petrol',
'id': '603692b3-5c67-5f24-ac09-e0b8e7e230f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY94559',
'listing': 'auction',
'make': 'Renault',
'model': 'Twingo',
'odometer': 86319,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-08',
'seller_name': None,
'title': 'Renault Twingo 1.0 SCe Energy Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2017}
2026-03-29 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY94559%27 HTTP/1.1" 200 None
2026-03-29 08:37:30 [auto1.be] INFO: Saving data for FY94559: {'auction_closing_time': 1774885077.0, 'created_time': 1773953032.544082, 'last_price_update_time': 1774773450.55419}
2026-03-29 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FY94559') HTTP/1.1" 204 0
2026-03-29 08:37:30 [auto1.be] INFO: Found listing with ID: WY04920
2026-03-29 08:37:30 [auto1.be] INFO: Found listing with ID: PG64643
2026-03-29 08:37:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:37:30 [auto1.be] INFO: Channel: 24h | Page: 33 | totalHits: 1252 | hits on page: 0
2026-03-29 08:37:30 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-29 08:37:30 [auto1.be] INFO: auto1.be Batch config: batch 2/2
2026-03-29 08:37:30 [auto1.be] INFO: auto1.be Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 4, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 5}
2026-03-29 08:37:30 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (146 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.be/task_26_2026-03-29T08_35_00.jl
2026-03-29 08:37:30 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 268489,
'downloader/request_count': 115,
'downloader/request_method_count/GET': 80,
'downloader/request_method_count/POST': 35,
'downloader/response_bytes': 8269631,
'downloader/response_count': 115,
'downloader/response_status_count/200': 115,
'dupefilter/filtered': 7,
'elapsed_time_seconds': 144.091517,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 29, 8, 37, 30, 762132, tzinfo=datetime.timezone.utc),
'item_scraped_count': 146,
'log_count/DEBUG': 3262,
'log_count/INFO': 3580,
'memusage/max': 172535808,
'memusage/startup': 149667840,
'photo_download_count': 10,
'request_depth_max': 36,
'response_received_count': 105,
'scheduler/dequeued': 115,
'scheduler/dequeued/memory': 115,
'scheduler/enqueued': 115,
'scheduler/enqueued/memory': 115,
'scrape_type/batch_skipped': 656,
'scrape_type/new': 34,
'scrape_type/price_update': 112,
'scrape_type/skipped': 483,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 105,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 4.175612083192739,
'scrapy-zyte-api/mean_response_seconds': 4.2421001021484175,
'scrapy-zyte-api/processed': 105,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 105,
'scrapy-zyte-api/request_args/experimental.requestCookies': 104,
'scrapy-zyte-api/request_args/experimental.responseCookies': 105,
'scrapy-zyte-api/request_args/httpRequestBody': 35,
'scrapy-zyte-api/request_args/httpRequestMethod': 35,
'scrapy-zyte-api/request_args/httpResponseBody': 105,
'scrapy-zyte-api/request_args/httpResponseHeaders': 105,
'scrapy-zyte-api/request_args/sessionContext': 105,
'scrapy-zyte-api/request_args/url': 105,
'scrapy-zyte-api/status_codes/200': 105,
'scrapy-zyte-api/success': 105,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'source/items_encountered': 1292,
'source/total_available': 1252,
'start_time': datetime.datetime(2026, 3, 29, 8, 35, 6, 670615, tzinfo=datetime.timezone.utc)}
2026-03-29 08:37:30 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-29 08:37:30 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f77abfaa1d0>
2026-03-29 08:37:30 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f77abfaa510>