2026-03-29 08:30:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-29 08:30:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-29 08:30:06 [auto1.be] INFO: Batch mode enabled: batch 1/2
2026-03-29 08:30:06 [auto1.be] INFO: Starting spider auto1.be
2026-03-29 08:30:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-29 08:30:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-29 08:30:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-29 08:30:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-29 08:30:06 [scrapy.extensions.telnet] INFO: Telnet Password: 3dba8ae102fb7743
2026-03-29 08:30:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-29 08:30:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.be/task_25_2026-03-29T08_30_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-29 08:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 08:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 08:30:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-29 08:30:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-29 08:30:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-29 08:30:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-29 08:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 08:30:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-29 08:30:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-29 08:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-29 08:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-29 08:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-29 08:30:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-29 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-29 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-29 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-29 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-29 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-29 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-29 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-29 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-29 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-29 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-29 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-29 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-29 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-29 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-29 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-29 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-29 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-29 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-29 08:30:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-29 08:30:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-29 08:30:06 [scrapy.core.engine] INFO: Spider opened
2026-03-29 08:30:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-29 08:30:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-29 08:30:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 143MiB
2026-03-29 08:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-29 08:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-29 08:30:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:30:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-29 08:30:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:30:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-29 08:30:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:30:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-29 08:30:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:30:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-29 08:30:16 [auto1.be] INFO: Channel: 24h | Page: 0 | totalHits: 1252 | hits on page: 40
2026-03-29 08:30:16 [auto1.be] INFO: Found listing with ID: SW43031
2026-03-29 08:30:16 [auto1.be] INFO: Found listing with ID: KH45960
2026-03-29 08:30:16 [auto1.be] INFO: Found listing with ID: VR58028
2026-03-29 08:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VR58028%27 HTTP/1.1" 200 None
2026-03-29 08:30:16 [auto1.be] INFO: Scrape type for VR58028: 1
2026-03-29 08:30:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:30:16 [auto1.be] INFO: Found listing with ID: EX99169
2026-03-29 08:30:16 [auto1.be] INFO: Found listing with ID: ES45973
2026-03-29 08:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES45973%27 HTTP/1.1" 200 None
2026-03-29 08:30:16 [auto1.be] INFO: Scrape type for ES45973: 2
2026-03-29 08:30:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9eaf71d-903c-5953-a628-6a5d0acabb4e with identifier: ES45973
2026-03-29 08:30:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9eaf71d-903c-5953-a628-6a5d0acabb4e with scrape type 2
2026-03-29 08:30:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9eaf71d-903c-5953-a628-6a5d0acabb4e with scrape type 2
2026-03-29 08:30:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b9eaf71d-903c-5953-a628-6a5d0acabb4e, identifier: ES45973
2026-03-29 08:30:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b9eaf71d-903c-5953-a628-6a5d0acabb4e with identifier: ES45973
2026-03-29 08:30:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 08:30:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-29 08:30:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 08:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 08:30:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 08:30:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-29 08:30:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 08:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 08:30:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b9eaf71d-903c-5953-a628-6a5d0acabb4e with identifier: ES45973
2026-03-29 08:30:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b9eaf71d-903c-5953-a628-6a5d0acabb4e with identifier: ES45973 to the API
2026-03-29 08:30:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:30:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:30:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:24:08Z',
 'fuel_type': 'diesel',
 'id': 'b9eaf71d-903c-5953-a628-6a5d0acabb4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES45973',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 222297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-11',
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.6 HDi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2012}
2026-03-29 08:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES45973%27 HTTP/1.1" 200 None
2026-03-29 08:30:17 [auto1.be] INFO: Saving data for ES45973: {'auction_closing_time': 1774884248.0, 'created_time': 1774557129.590198, 'last_price_update_time': 1774773017.353404}
2026-03-29 08:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ES45973') HTTP/1.1" 204 0
2026-03-29 08:30:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:30:17 [auto1.be] INFO: Found listing with ID: DL06250
2026-03-29 08:30:17 [auto1.be] INFO: Found listing with ID: AM39981
2026-03-29 08:30:17 [auto1.be] INFO: Found listing with ID: NJ87931
2026-03-29 08:30:17 [auto1.be] INFO: Found listing with ID: RS13546
2026-03-29 08:30:17 [auto1.be] INFO: Found listing with ID: MB50362
2026-03-29 08:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB50362%27 HTTP/1.1" 200 None
2026-03-29 08:30:17 [auto1.be] INFO: Scrape type for MB50362: 1
2026-03-29 08:30:17 [auto1.be] INFO: Found listing with ID: BR08123
2026-03-29 08:30:17 [auto1.be] INFO: Found listing with ID: MR13936
2026-03-29 08:30:17 [auto1.be] INFO: Found listing with ID: VB51630
2026-03-29 08:30:17 [auto1.be] INFO: Found listing with ID: AD75254
2026-03-29 08:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD75254%27 HTTP/1.1" 200 None
2026-03-29 08:30:17 [auto1.be] INFO: Scrape type for AD75254: 2
2026-03-29 08:30:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 178b732b-b486-509b-836d-ef86c5a63d15 with identifier: AD75254
2026-03-29 08:30:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 178b732b-b486-509b-836d-ef86c5a63d15 with scrape type 2
2026-03-29 08:30:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 178b732b-b486-509b-836d-ef86c5a63d15 with scrape type 2
2026-03-29 08:30:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 178b732b-b486-509b-836d-ef86c5a63d15, identifier: AD75254
2026-03-29 08:30:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 178b732b-b486-509b-836d-ef86c5a63d15 with identifier: AD75254
2026-03-29 08:30:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 08:30:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-29 08:30:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 08:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 08:30:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 08:30:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-29 08:30:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 08:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 08:30:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 178b732b-b486-509b-836d-ef86c5a63d15 with identifier: AD75254
2026-03-29 08:30:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 178b732b-b486-509b-836d-ef86c5a63d15 with identifier: AD75254 to the API
2026-03-29 08:30:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:30:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:30:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:01:20Z',
 'fuel_type': 'petrol',
 'id': '178b732b-b486-509b-836d-ef86c5a63d15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD75254',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C2',
 'odometer': 93037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-03-31',
 'seller_name': None,
 'title': 'Citroen C2 1.1 SX',
 'transmission': 'manual',
 'trim': 'SX',
 'year': 2005}
2026-03-29 08:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD75254%27 HTTP/1.1" 200 None
2026-03-29 08:30:18 [auto1.be] INFO: Saving data for AD75254: {'auction_closing_time': 1774882880.0, 'created_time': 1774557118.60337, 'last_price_update_time': 1774773018.957205}
2026-03-29 08:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AD75254') HTTP/1.1" 204 0
2026-03-29 08:30:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:30:19 [auto1.be] INFO: Found listing with ID: KM93600
2026-03-29 08:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM93600%27 HTTP/1.1" 200 None
2026-03-29 08:30:19 [auto1.be] INFO: Scrape type for KM93600: 2
2026-03-29 08:30:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70ba890e-ae1d-5456-868e-0a257b86508f with identifier: KM93600
2026-03-29 08:30:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70ba890e-ae1d-5456-868e-0a257b86508f with scrape type 2
2026-03-29 08:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70ba890e-ae1d-5456-868e-0a257b86508f with scrape type 2
2026-03-29 08:30:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 70ba890e-ae1d-5456-868e-0a257b86508f, identifier: KM93600
2026-03-29 08:30:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 70ba890e-ae1d-5456-868e-0a257b86508f with identifier: KM93600
2026-03-29 08:30:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 08:30:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-29 08:30:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 08:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 08:30:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 70ba890e-ae1d-5456-868e-0a257b86508f with identifier: KM93600
2026-03-29 08:30:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 70ba890e-ae1d-5456-868e-0a257b86508f with identifier: KM93600 to the API
2026-03-29 08:30:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:30:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:30:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:45:33Z',
 'fuel_type': 'petrol',
 'id': '70ba890e-ae1d-5456-868e-0a257b86508f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM93600',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Logan MCV',
 'odometer': 244431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-15',
 'seller_name': None,
 'title': 'Dacia Logan MCV 0.9 TCe Laureate',
 'transmission': 'manual',
 'trim': 'Laureate',
 'year': 2014}
2026-03-29 08:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM93600%27 HTTP/1.1" 200 None
2026-03-29 08:30:19 [auto1.be] INFO: Saving data for KM93600: {'auction_closing_time': 1774885533.0, 'created_time': 1774125092.705644, 'last_price_update_time': 1774773019.688153}
2026-03-29 08:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KM93600') HTTP/1.1" 204 0
2026-03-29 08:30:19 [auto1.be] INFO: Found listing with ID: JZ74663
2026-03-29 08:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ74663%27 HTTP/1.1" 200 None
2026-03-29 08:30:19 [auto1.be] INFO: Scrape type for JZ74663: 2
2026-03-29 08:30:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bc2a57f-adf4-537b-ab62-750353b75ae5 with identifier: JZ74663
2026-03-29 08:30:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bc2a57f-adf4-537b-ab62-750353b75ae5 with scrape type 2
2026-03-29 08:30:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bc2a57f-adf4-537b-ab62-750353b75ae5 with scrape type 2
2026-03-29 08:30:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1bc2a57f-adf4-537b-ab62-750353b75ae5, identifier: JZ74663
2026-03-29 08:30:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1bc2a57f-adf4-537b-ab62-750353b75ae5 with identifier: JZ74663
2026-03-29 08:30:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1bc2a57f-adf4-537b-ab62-750353b75ae5 with identifier: JZ74663
2026-03-29 08:30:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1bc2a57f-adf4-537b-ab62-750353b75ae5 with identifier: JZ74663 to the API
2026-03-29 08:30:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:30:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:30:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:49:22Z',
 'fuel_type': 'petrol',
 'id': '1bc2a57f-adf4-537b-ab62-750353b75ae5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ74663',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 159587,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-19',
 'seller_name': None,
 'title': 'Dacia Sandero 1.2 Ambiance',
 'transmission': 'manual',
 'trim': 'Ambiance',
 'year': 2011}
2026-03-29 08:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ74663%27 HTTP/1.1" 200 None
2026-03-29 08:30:20 [auto1.be] INFO: Saving data for JZ74663: {'auction_closing_time': 1774885762.0, 'created_time': 1774557154.34689, 'last_price_update_time': 1774773020.149174}
2026-03-29 08:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JZ74663') HTTP/1.1" 204 0
2026-03-29 08:30:20 [auto1.be] INFO: Found listing with ID: JW28444
2026-03-29 08:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW28444%27 HTTP/1.1" 200 None
2026-03-29 08:30:20 [auto1.be] INFO: Scrape type for JW28444: 2
2026-03-29 08:30:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fd07124-f44e-5898-aece-38964db9001a with identifier: JW28444
2026-03-29 08:30:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fd07124-f44e-5898-aece-38964db9001a with scrape type 2
2026-03-29 08:30:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fd07124-f44e-5898-aece-38964db9001a with scrape type 2
2026-03-29 08:30:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7fd07124-f44e-5898-aece-38964db9001a, identifier: JW28444
2026-03-29 08:30:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7fd07124-f44e-5898-aece-38964db9001a with identifier: JW28444
2026-03-29 08:30:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 08:30:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-29 08:30:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 08:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 08:30:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7fd07124-f44e-5898-aece-38964db9001a with identifier: JW28444
2026-03-29 08:30:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7fd07124-f44e-5898-aece-38964db9001a with identifier: JW28444 to the API
2026-03-29 08:30:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:30:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:30:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:38:19Z',
 'fuel_type': 'diesel',
 'id': '7fd07124-f44e-5898-aece-38964db9001a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW28444',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 245383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-03',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2009}
2026-03-29 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW28444%27 HTTP/1.1" 200 None
2026-03-29 08:30:21 [auto1.be] INFO: Saving data for JW28444: {'auction_closing_time': 1774885099.0, 'created_time': 1773138258.256078, 'last_price_update_time': 1774773021.352306}
2026-03-29 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JW28444') HTTP/1.1" 204 0
2026-03-29 08:30:21 [auto1.be] INFO: Found listing with ID: ST41989
2026-03-29 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST41989%27 HTTP/1.1" 200 None
2026-03-29 08:30:21 [auto1.be] INFO: Scrape type for ST41989: 1
2026-03-29 08:30:21 [auto1.be] INFO: Found listing with ID: SB58546
2026-03-29 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB58546%27 HTTP/1.1" 200 None
2026-03-29 08:30:21 [auto1.be] INFO: Scrape type for SB58546: 1
2026-03-29 08:30:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:30:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:30:21 [auto1.be] INFO: Found listing with ID: ZN33988
2026-03-29 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN33988%27 HTTP/1.1" 200 None
2026-03-29 08:30:21 [auto1.be] INFO: Scrape type for ZN33988: 1
2026-03-29 08:30:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:30:21 [auto1.be] INFO: Found listing with ID: WV98137
2026-03-29 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV98137%27 HTTP/1.1" 200 None
2026-03-29 08:30:21 [auto1.be] INFO: Scrape type for WV98137: 2
2026-03-29 08:30:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86440280-a356-5fff-8029-b8a24b1d7f49 with identifier: WV98137
2026-03-29 08:30:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86440280-a356-5fff-8029-b8a24b1d7f49 with scrape type 2
2026-03-29 08:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86440280-a356-5fff-8029-b8a24b1d7f49 with scrape type 2
2026-03-29 08:30:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 86440280-a356-5fff-8029-b8a24b1d7f49, identifier: WV98137
2026-03-29 08:30:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 86440280-a356-5fff-8029-b8a24b1d7f49 with identifier: WV98137
2026-03-29 08:30:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 86440280-a356-5fff-8029-b8a24b1d7f49 with identifier: WV98137
2026-03-29 08:30:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 86440280-a356-5fff-8029-b8a24b1d7f49 with identifier: WV98137 to the API
2026-03-29 08:30:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:30:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:30:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 40,
 'expiration_date': '2026-03-30T15:18:09Z',
 'fuel_type': 'diesel',
 'id': '86440280-a356-5fff-8029-b8a24b1d7f49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV98137',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 115035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-22',
 'seller_name': None,
 'title': 'Smart fortwo 0.8 CDI Basis passion',
 'transmission': 'automatic',
 'trim': 'Basis passion',
 'year': 2006}
2026-03-29 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV98137%27 HTTP/1.1" 200 None
2026-03-29 08:30:21 [auto1.be] INFO: Saving data for WV98137: {'auction_closing_time': 1774883889.0, 'created_time': 1773347655.760948, 'last_price_update_time': 1774773021.982757}
2026-03-29 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WV98137') HTTP/1.1" 204 0
2026-03-29 08:30:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:30:22 [auto1.be] INFO: Found listing with ID: WM98444
2026-03-29 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM98444%27 HTTP/1.1" 200 None
2026-03-29 08:30:22 [auto1.be] INFO: Scrape type for WM98444: 1
2026-03-29 08:30:22 [auto1.be] INFO: Channel: 24h | Page: 1 | totalHits: 1252 | hits on page: 40
2026-03-29 08:30:22 [auto1.be] INFO: Found listing with ID: YL67549
2026-03-29 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL67549%27 HTTP/1.1" 200 None
2026-03-29 08:30:22 [auto1.be] INFO: Scrape type for YL67549: 2
2026-03-29 08:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 871fb17f-43c0-51df-83fe-8fd9f9a98293 with identifier: YL67549
2026-03-29 08:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 871fb17f-43c0-51df-83fe-8fd9f9a98293 with scrape type 2
2026-03-29 08:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 871fb17f-43c0-51df-83fe-8fd9f9a98293 with scrape type 2
2026-03-29 08:30:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 871fb17f-43c0-51df-83fe-8fd9f9a98293, identifier: YL67549
2026-03-29 08:30:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:30:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 871fb17f-43c0-51df-83fe-8fd9f9a98293 with identifier: YL67549
2026-03-29 08:30:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 08:30:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-29 08:30:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 08:30:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 871fb17f-43c0-51df-83fe-8fd9f9a98293 with identifier: YL67549
2026-03-29 08:30:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 871fb17f-43c0-51df-83fe-8fd9f9a98293 with identifier: YL67549 to the API
2026-03-29 08:30:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:30:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:30:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:56:56Z',
 'fuel_type': 'petrol',
 'id': '871fb17f-43c0-51df-83fe-8fd9f9a98293',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL67549',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 214666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-29',
 'seller_name': None,
 'title': 'Fiat Punto 1.2 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2012}
2026-03-29 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL67549%27 HTTP/1.1" 200 None
2026-03-29 08:30:22 [auto1.be] INFO: Saving data for YL67549: {'auction_closing_time': 1774886216.0, 'created_time': 1774643569.947744, 'last_price_update_time': 1774773022.556373}
2026-03-29 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YL67549') HTTP/1.1" 204 0
2026-03-29 08:30:22 [auto1.be] INFO: Found listing with ID: SW43031
2026-03-29 08:30:22 [auto1.be] INFO: Found listing with ID: KH45960
2026-03-29 08:30:22 [auto1.be] INFO: Found listing with ID: VR58028
2026-03-29 08:30:22 [auto1.be] INFO: Found listing with ID: RJ01486
2026-03-29 08:30:22 [auto1.be] INFO: Found listing with ID: WP77155
2026-03-29 08:30:22 [auto1.be] INFO: Found listing with ID: CY85383
2026-03-29 08:30:22 [auto1.be] INFO: Found listing with ID: MK20841
2026-03-29 08:30:22 [auto1.be] INFO: Found listing with ID: NE45749
2026-03-29 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE45749%27 HTTP/1.1" 200 None
2026-03-29 08:30:22 [auto1.be] INFO: Scrape type for NE45749: 1
2026-03-29 08:30:22 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/VR58028/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-29 08:30:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:30:22 [auto1.be] INFO: Found listing with ID: EX99169
2026-03-29 08:30:22 [auto1.be] INFO: Found listing with ID: ES45973
2026-03-29 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES45973%27 HTTP/1.1" 200 None
2026-03-29 08:30:22 [auto1.be] INFO: Scrape type for ES45973: 0
2026-03-29 08:30:22 [auto1.be] INFO: Found listing with ID: DL06250
2026-03-29 08:30:22 [auto1.be] INFO: Found listing with ID: AM39981
2026-03-29 08:30:22 [auto1.be] INFO: Found listing with ID: NJ87931
2026-03-29 08:30:22 [auto1.be] INFO: Found listing with ID: RS13546
2026-03-29 08:30:22 [auto1.be] INFO: Found listing with ID: MB50362
2026-03-29 08:30:22 [auto1.be] INFO: Found listing with ID: VP73114
2026-03-29 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP73114%27 HTTP/1.1" 200 None
2026-03-29 08:30:22 [auto1.be] INFO: Scrape type for VP73114: 2
2026-03-29 08:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39c332e4-ce8d-57bf-9435-f66638edd52e with identifier: VP73114
2026-03-29 08:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39c332e4-ce8d-57bf-9435-f66638edd52e with scrape type 2
2026-03-29 08:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39c332e4-ce8d-57bf-9435-f66638edd52e with scrape type 2
2026-03-29 08:30:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 39c332e4-ce8d-57bf-9435-f66638edd52e, identifier: VP73114
2026-03-29 08:30:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VR58028/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:30:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MB50362/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:30:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:30:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 39c332e4-ce8d-57bf-9435-f66638edd52e with identifier: VP73114
2026-03-29 08:30:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 39c332e4-ce8d-57bf-9435-f66638edd52e with identifier: VP73114
2026-03-29 08:30:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 39c332e4-ce8d-57bf-9435-f66638edd52e with identifier: VP73114 to the API
2026-03-29 08:30:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:30:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:30:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:13:19Z',
 'fuel_type': 'diesel',
 'id': '39c332e4-ce8d-57bf-9435-f66638edd52e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP73114',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Avensis',
 'odometer': 403007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-10',
 'seller_name': None,
 'title': 'Toyota Avensis 2.0 D-4D',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-29 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP73114%27 HTTP/1.1" 200 None
2026-03-29 08:30:24 [auto1.be] INFO: Saving data for VP73114: {'auction_closing_time': 1774883599.0, 'created_time': 1774125108.714113, 'last_price_update_time': 1774773024.036215}
2026-03-29 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VP73114') HTTP/1.1" 204 0
2026-03-29 08:30:24 [auto1.be] INFO: Found listing with ID: BR08123
2026-03-29 08:30:24 [auto1.be] INFO: Found listing with ID: MR13936
2026-03-29 08:30:24 [auto1.be] INFO: Found listing with ID: VB51630
2026-03-29 08:30:24 [auto1.be] INFO: Found listing with ID: AD75254
2026-03-29 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD75254%27 HTTP/1.1" 200 None
2026-03-29 08:30:24 [auto1.be] INFO: Scrape type for AD75254: 0
2026-03-29 08:30:24 [auto1.be] INFO: Found listing with ID: KM93600
2026-03-29 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM93600%27 HTTP/1.1" 200 None
2026-03-29 08:30:24 [auto1.be] INFO: Scrape type for KM93600: 0
2026-03-29 08:30:24 [auto1.be] INFO: Found listing with ID: JZ74663
2026-03-29 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ74663%27 HTTP/1.1" 200 None
2026-03-29 08:30:24 [auto1.be] INFO: Scrape type for JZ74663: 0
2026-03-29 08:30:24 [auto1.be] INFO: Found listing with ID: JW28444
2026-03-29 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW28444%27 HTTP/1.1" 200 None
2026-03-29 08:30:24 [auto1.be] INFO: Scrape type for JW28444: 0
2026-03-29 08:30:24 [auto1.be] INFO: Found listing with ID: ST41989
2026-03-29 08:30:24 [auto1.be] INFO: Found listing with ID: GB22067
2026-03-29 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB22067%27 HTTP/1.1" 200 None
2026-03-29 08:30:24 [auto1.be] INFO: Scrape type for GB22067: 2
2026-03-29 08:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efb1b23b-941d-515f-804f-64ee546d9ae3 with identifier: GB22067
2026-03-29 08:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efb1b23b-941d-515f-804f-64ee546d9ae3 with scrape type 2
2026-03-29 08:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efb1b23b-941d-515f-804f-64ee546d9ae3 with scrape type 2
2026-03-29 08:30:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: efb1b23b-941d-515f-804f-64ee546d9ae3, identifier: GB22067
2026-03-29 08:30:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: efb1b23b-941d-515f-804f-64ee546d9ae3 with identifier: GB22067
2026-03-29 08:30:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: efb1b23b-941d-515f-804f-64ee546d9ae3 with identifier: GB22067
2026-03-29 08:30:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: efb1b23b-941d-515f-804f-64ee546d9ae3 with identifier: GB22067 to the API
2026-03-29 08:30:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:30:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:30:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:56:25Z',
 'fuel_type': 'petrol',
 'id': 'efb1b23b-941d-515f-804f-64ee546d9ae3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB22067',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 41896,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-27',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2021}
2026-03-29 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB22067%27 HTTP/1.1" 200 None
2026-03-29 08:30:24 [auto1.be] INFO: Saving data for GB22067: {'auction_closing_time': 1774886185.0, 'created_time': 1773137055.794892, 'last_price_update_time': 1774773024.803369}
2026-03-29 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GB22067') HTTP/1.1" 204 0
2026-03-29 08:30:24 [auto1.be] INFO: Found listing with ID: SB58546
2026-03-29 08:30:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ST41989/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:30:24 [auto1.be] INFO: Found listing with ID: XS85102
2026-03-29 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS85102%27 HTTP/1.1" 200 None
2026-03-29 08:30:24 [auto1.be] INFO: Scrape type for XS85102: 2
2026-03-29 08:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f29606f-b248-5c6b-a0ae-b4cbd130d88b with identifier: XS85102
2026-03-29 08:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f29606f-b248-5c6b-a0ae-b4cbd130d88b with scrape type 2
2026-03-29 08:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f29606f-b248-5c6b-a0ae-b4cbd130d88b with scrape type 2
2026-03-29 08:30:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2f29606f-b248-5c6b-a0ae-b4cbd130d88b, identifier: XS85102
2026-03-29 08:30:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2f29606f-b248-5c6b-a0ae-b4cbd130d88b with identifier: XS85102
2026-03-29 08:30:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2f29606f-b248-5c6b-a0ae-b4cbd130d88b with identifier: XS85102
2026-03-29 08:30:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2f29606f-b248-5c6b-a0ae-b4cbd130d88b with identifier: XS85102 to the API
2026-03-29 08:30:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:30:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:30:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:44:04Z',
 'fuel_type': 'petrol',
 'id': '2f29606f-b248-5c6b-a0ae-b4cbd130d88b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS85102',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Xsara Picasso',
 'odometer': 150978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-06-18',
 'seller_name': None,
 'title': 'Citroen Xsara Picasso 1.6 Chrono',
 'transmission': 'manual',
 'trim': 'Chrono',
 'year': 2003}
2026-03-29 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS85102%27 HTTP/1.1" 200 None
2026-03-29 08:30:25 [auto1.be] INFO: Saving data for XS85102: {'auction_closing_time': 1774885444.0, 'created_time': 1773131822.568748, 'last_price_update_time': 1774773025.342593}
2026-03-29 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XS85102') HTTP/1.1" 204 0
2026-03-29 08:30:25 [auto1.be] INFO: Found listing with ID: ZN33988
2026-03-29 08:30:25 [auto1.be] INFO: Found listing with ID: RX06086
2026-03-29 08:30:25 [auto1.be] INFO: Found listing with ID: BJ49980
2026-03-29 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ49980%27 HTTP/1.1" 200 None
2026-03-29 08:30:25 [auto1.be] INFO: Scrape type for BJ49980: 1
2026-03-29 08:30:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:30:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:30:25 [auto1.be] INFO: Found listing with ID: WV98137
2026-03-29 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV98137%27 HTTP/1.1" 200 None
2026-03-29 08:30:25 [auto1.be] INFO: Scrape type for WV98137: 0
2026-03-29 08:30:25 [auto1.be] INFO: Found listing with ID: WM98444
2026-03-29 08:30:25 [auto1.be] INFO: Found listing with ID: PE70540
2026-03-29 08:30:25 [auto1.be] INFO: Found listing with ID: ZZ18378
2026-03-29 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ18378%27 HTTP/1.1" 200 None
2026-03-29 08:30:25 [auto1.be] INFO: Scrape type for ZZ18378: 2
2026-03-29 08:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43944d2b-23cd-51d4-9a39-fc0d26fe588b with identifier: ZZ18378
2026-03-29 08:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43944d2b-23cd-51d4-9a39-fc0d26fe588b with scrape type 2
2026-03-29 08:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43944d2b-23cd-51d4-9a39-fc0d26fe588b with scrape type 2
2026-03-29 08:30:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 43944d2b-23cd-51d4-9a39-fc0d26fe588b, identifier: ZZ18378
2026-03-29 08:30:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:30:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 43944d2b-23cd-51d4-9a39-fc0d26fe588b with identifier: ZZ18378
2026-03-29 08:30:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 43944d2b-23cd-51d4-9a39-fc0d26fe588b with identifier: ZZ18378
2026-03-29 08:30:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 43944d2b-23cd-51d4-9a39-fc0d26fe588b with identifier: ZZ18378 to the API
2026-03-29 08:30:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:30:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:30:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:12:55Z',
 'fuel_type': 'diesel',
 'id': '43944d2b-23cd-51d4-9a39-fc0d26fe588b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ18378',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 243465,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-15',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2016}
2026-03-29 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ18378%27 HTTP/1.1" 200 None
2026-03-29 08:30:26 [auto1.be] INFO: Saving data for ZZ18378: {'auction_closing_time': 1774883575.0, 'created_time': 1774471035.016727, 'last_price_update_time': 1774773026.735802}
2026-03-29 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZZ18378') HTTP/1.1" 204 0
2026-03-29 08:30:26 [auto1.be] INFO: Found listing with ID: YL67549
2026-03-29 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL67549%27 HTTP/1.1" 200 None
2026-03-29 08:30:26 [auto1.be] INFO: Scrape type for YL67549: 0
2026-03-29 08:30:26 [auto1.be] INFO: Found listing with ID: RJ01486
2026-03-29 08:30:26 [auto1.be] INFO: Found listing with ID: WP77155
2026-03-29 08:30:26 [auto1.be] INFO: Found listing with ID: CY85383
2026-03-29 08:30:26 [auto1.be] INFO: Found listing with ID: MK20841
2026-03-29 08:30:26 [auto1.be] INFO: Found listing with ID: NE45749
2026-03-29 08:30:26 [auto1.be] INFO: Found listing with ID: GN69495
2026-03-29 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN69495%27 HTTP/1.1" 200 None
2026-03-29 08:30:26 [auto1.be] INFO: Scrape type for GN69495: 1
2026-03-29 08:30:26 [auto1.be] INFO: Found listing with ID: VP73114
2026-03-29 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP73114%27 HTTP/1.1" 200 None
2026-03-29 08:30:26 [auto1.be] INFO: Scrape type for VP73114: 0
2026-03-29 08:30:26 [auto1.be] INFO: Found listing with ID: GB22067
2026-03-29 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB22067%27 HTTP/1.1" 200 None
2026-03-29 08:30:26 [auto1.be] INFO: Scrape type for GB22067: 0
2026-03-29 08:30:26 [auto1.be] INFO: Found listing with ID: XS85102
2026-03-29 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS85102%27 HTTP/1.1" 200 None
2026-03-29 08:30:26 [auto1.be] INFO: Scrape type for XS85102: 0
2026-03-29 08:30:26 [auto1.be] INFO: Found listing with ID: RX06086
2026-03-29 08:30:26 [auto1.be] INFO: Found listing with ID: BJ49980
2026-03-29 08:30:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZN33988/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:30:26 [auto1.be] INFO: Found listing with ID: XD29708
2026-03-29 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD29708%27 HTTP/1.1" 200 None
2026-03-29 08:30:26 [auto1.be] INFO: Scrape type for XD29708: 1
2026-03-29 08:30:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:30:26 [auto1.be] INFO: Found listing with ID: PE70540
2026-03-29 08:30:26 [auto1.be] INFO: Found listing with ID: ZZ18378
2026-03-29 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ18378%27 HTTP/1.1" 200 None
2026-03-29 08:30:26 [auto1.be] INFO: Scrape type for ZZ18378: 0
2026-03-29 08:30:26 [auto1.be] INFO: Found listing with ID: GN69495
2026-03-29 08:30:26 [auto1.be] INFO: Found listing with ID: SK35491
2026-03-29 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK35491%27 HTTP/1.1" 200 None
2026-03-29 08:30:26 [auto1.be] INFO: Scrape type for SK35491: 1
2026-03-29 08:30:26 [auto1.be] INFO: Found listing with ID: XD29708
2026-03-29 08:30:26 [auto1.be] INFO: Found listing with ID: KT58942
2026-03-29 08:30:26 [auto1.be] INFO: Found listing with ID: UY87343
2026-03-29 08:30:26 [auto1.be] INFO: Found listing with ID: SK35491
2026-03-29 08:30:26 [auto1.be] INFO: Found listing with ID: KT58942
2026-03-29 08:30:26 [auto1.be] INFO: Found listing with ID: UY87343
2026-03-29 08:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WM98444/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:30:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BJ49980/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:30:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:31:06 [scrapy.extensions.logstats] INFO: Crawled 11 pages (at 11 pages/min), scraped 11 items (at 11 items/min)
2026-03-29 08:31:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 158MiB
2026-03-29 08:32:06 [scrapy.extensions.logstats] INFO: Crawled 11 pages (at 0 pages/min), scraped 11 items (at 0 items/min)
2026-03-29 08:32:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 158MiB
2026-03-29 08:32:31 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.794(s), this was the 1st time calling it.
2026-03-29 08:32:31 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.2850949330288195 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 08:32:33 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.540(s), this was the 1st time calling it.
2026-03-29 08:32:33 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.159034573573304 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 08:32:33 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.676(s), this was the 1st time calling it.
2026-03-29 08:32:33 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.13533610603395 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 08:32:35 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.930(s), this was the 1st time calling it.
2026-03-29 08:32:35 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.8392229987330238 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 08:32:35 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.931(s), this was the 1st time calling it.
2026-03-29 08:32:35 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.819681976119252 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 08:32:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 08:32:37 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.416(s), this was the 1st time calling it.
2026-03-29 08:32:37 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.5928381765093675 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 08:32:37 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.488(s), this was the 1st time calling it.
2026-03-29 08:32:37 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.284215347139257 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 08:32:37 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.210(s), this was the 1st time calling it.
2026-03-29 08:32:37 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.030254306149943 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 08:32:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 08:32:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 08:32:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 08:32:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 08:32:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 08:32:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 08:32:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-29 08:33:06 [scrapy.extensions.logstats] INFO: Crawled 11 pages (at 0 pages/min), scraped 11 items (at 0 items/min)
2026-03-29 08:33:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 158MiB
2026-03-29 08:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SB58546/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:33:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:33:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SK35491/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:33:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:33:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZN33988> (referer: https://www.auto1.com/v1/car-details-view/ZN33988/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:33:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:33:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49298cd1-b064-5d4f-b5c5-a80950cfcd56 with identifier: ZN33988
2026-03-29 08:33:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49298cd1-b064-5d4f-b5c5-a80950cfcd56 with scrape type 1
2026-03-29 08:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 49298cd1-b064-5d4f-b5c5-a80950cfcd56
2026-03-29 08:33:48 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxsourcingstorageprod.table.core.windows.net
2026-03-29 08:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F52%252Fd7523d64ba6d6eddbde1351e6a2e344a%252Fpa%252FZN33988_5f74e9ebc9350ba33aeffbd1d2abb170.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/52/d7523d64ba6d6eddbde1351e6a2e344a/pa/ZN33988_5f74e9ebc9350ba33aeffbd1d2abb170.jpg already downloaded
2026-03-29 08:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F52%252Fd7523d64ba6d6eddbde1351e6a2e344a%252Fpa%252FZN33988_eca8f6e026ef4308ef3a7aa088da3ccd.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/52/d7523d64ba6d6eddbde1351e6a2e344a/pa/ZN33988_eca8f6e026ef4308ef3a7aa088da3ccd.jpg already downloaded
2026-03-29 08:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F52%252Fd7523d64ba6d6eddbde1351e6a2e344a%252Fpa%252FZN33988_e2877224fa265c5d4c1acfb6eadc6658.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/52/d7523d64ba6d6eddbde1351e6a2e344a/pa/ZN33988_e2877224fa265c5d4c1acfb6eadc6658.jpg already downloaded
2026-03-29 08:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F52%252Fd7523d64ba6d6eddbde1351e6a2e344a%252Fpa%252FZN33988_dcc6f01797f92ac22e18369698211750.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/52/d7523d64ba6d6eddbde1351e6a2e344a/pa/ZN33988_dcc6f01797f92ac22e18369698211750.jpg already downloaded
2026-03-29 08:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F52%252Fd7523d64ba6d6eddbde1351e6a2e344a%252Fpa%252FZN33988_727e1d25b3a443f88180a8f25364b7d7.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/52/d7523d64ba6d6eddbde1351e6a2e344a/pa/ZN33988_727e1d25b3a443f88180a8f25364b7d7.jpg already downloaded
2026-03-29 08:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F52%252Fd7523d64ba6d6eddbde1351e6a2e344a%252Fpa%252FZN33988_8fde9083903829ef9d9f47613e4c4c68.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/52/d7523d64ba6d6eddbde1351e6a2e344a/pa/ZN33988_8fde9083903829ef9d9f47613e4c4c68.jpg already downloaded
2026-03-29 08:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F52%252Fd7523d64ba6d6eddbde1351e6a2e344a%252Fpa%252FZN33988_800b2b5514ebaeafe537d59551dd1563.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/52/d7523d64ba6d6eddbde1351e6a2e344a/pa/ZN33988_800b2b5514ebaeafe537d59551dd1563.jpg already downloaded
2026-03-29 08:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F52%252Fd7523d64ba6d6eddbde1351e6a2e344a%252Fpa%252FZN33988_85501b0d31493cef30cee952b885b8a5.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/52/d7523d64ba6d6eddbde1351e6a2e344a/pa/ZN33988_85501b0d31493cef30cee952b885b8a5.jpg already downloaded
2026-03-29 08:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F52%252Fd7523d64ba6d6eddbde1351e6a2e344a%252Fpa%252FZN33988_8e9057cb78c997f90a09e0237a0de081.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/52/d7523d64ba6d6eddbde1351e6a2e344a/pa/ZN33988_8e9057cb78c997f90a09e0237a0de081.jpg already downloaded
2026-03-29 08:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252F52%252Fd7523d64ba6d6eddbde1351e6a2e344a%252Fpa%252FZN33988_de8a3beacb61e3e2634bef39acf665b2.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/52/d7523d64ba6d6eddbde1351e6a2e344a/pa/ZN33988_de8a3beacb61e3e2634bef39acf665b2.jpg already downloaded
2026-03-29 08:33:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 49298cd1-b064-5d4f-b5c5-a80950cfcd56, identifier: ZN33988
2026-03-29 08:33:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 49298cd1-b064-5d4f-b5c5-a80950cfcd56 with identifier: ZN33988
2026-03-29 08:33:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 49298cd1-b064-5d4f-b5c5-a80950cfcd56 with identifier: ZN33988
2026-03-29 08:33:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 49298cd1-b064-5d4f-b5c5-a80950cfcd56 with identifier: ZN33988 to the API
2026-03-29 08:33:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:33:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:33:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZN33988>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:19:00Z',
 'fuel_type': 'petrol',
 'id': '49298cd1-b064-5d4f-b5c5-a80950cfcd56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN33988',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 130409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgd7/52/d7523d64ba6d6eddbde1351e6a2e344a/pa/ZN33988_5f74e9ebc9350ba33aeffbd1d2abb170.jpg',
                'https://img-pa.auto1.com/imgd7/52/d7523d64ba6d6eddbde1351e6a2e344a/pa/ZN33988_eca8f6e026ef4308ef3a7aa088da3ccd.jpg',
                'https://img-pa.auto1.com/imgd7/52/d7523d64ba6d6eddbde1351e6a2e344a/pa/ZN33988_e2877224fa265c5d4c1acfb6eadc6658.jpg',
                'https://img-pa.auto1.com/imgd7/52/d7523d64ba6d6eddbde1351e6a2e344a/pa/ZN33988_dcc6f01797f92ac22e18369698211750.jpg',
                'https://img-pa.auto1.com/imgd7/52/d7523d64ba6d6eddbde1351e6a2e344a/pa/ZN33988_727e1d25b3a443f88180a8f25364b7d7.jpg',
                'https://img-pa.auto1.com/imgd7/52/d7523d64ba6d6eddbde1351e6a2e344a/pa/ZN33988_8fde9083903829ef9d9f47613e4c4c68.jpg',
                'https://img-pa.auto1.com/imgd7/52/d7523d64ba6d6eddbde1351e6a2e344a/pa/ZN33988_800b2b5514ebaeafe537d59551dd1563.jpg',
                'https://img-pa.auto1.com/imgd7/52/d7523d64ba6d6eddbde1351e6a2e344a/pa/ZN33988_85501b0d31493cef30cee952b885b8a5.jpg',
                'https://img-pa.auto1.com/imgd7/52/d7523d64ba6d6eddbde1351e6a2e344a/pa/ZN33988_8e9057cb78c997f90a09e0237a0de081.jpg',
                'https://img-pa.auto1.com/imgd7/52/d7523d64ba6d6eddbde1351e6a2e344a/pa/ZN33988_de8a3beacb61e3e2634bef39acf665b2.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49298cd1-b064-5d4f-b5c5-a80950cfcd56/49298cd1-b064-5d4f-b5c5-a80950cfcd56_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/52/d7523d64ba6d6eddbde1351e6a2e344a/pa/ZN33988_5f74e9ebc9350ba33aeffbd1d2abb170.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49298cd1-b064-5d4f-b5c5-a80950cfcd56/49298cd1-b064-5d4f-b5c5-a80950cfcd56_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/52/d7523d64ba6d6eddbde1351e6a2e344a/pa/ZN33988_eca8f6e026ef4308ef3a7aa088da3ccd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49298cd1-b064-5d4f-b5c5-a80950cfcd56/49298cd1-b064-5d4f-b5c5-a80950cfcd56_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/52/d7523d64ba6d6eddbde1351e6a2e344a/pa/ZN33988_e2877224fa265c5d4c1acfb6eadc6658.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49298cd1-b064-5d4f-b5c5-a80950cfcd56/49298cd1-b064-5d4f-b5c5-a80950cfcd56_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/52/d7523d64ba6d6eddbde1351e6a2e344a/pa/ZN33988_dcc6f01797f92ac22e18369698211750.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49298cd1-b064-5d4f-b5c5-a80950cfcd56/49298cd1-b064-5d4f-b5c5-a80950cfcd56_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/52/d7523d64ba6d6eddbde1351e6a2e344a/pa/ZN33988_727e1d25b3a443f88180a8f25364b7d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49298cd1-b064-5d4f-b5c5-a80950cfcd56/49298cd1-b064-5d4f-b5c5-a80950cfcd56_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/52/d7523d64ba6d6eddbde1351e6a2e344a/pa/ZN33988_8fde9083903829ef9d9f47613e4c4c68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49298cd1-b064-5d4f-b5c5-a80950cfcd56/49298cd1-b064-5d4f-b5c5-a80950cfcd56_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/52/d7523d64ba6d6eddbde1351e6a2e344a/pa/ZN33988_800b2b5514ebaeafe537d59551dd1563.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49298cd1-b064-5d4f-b5c5-a80950cfcd56/49298cd1-b064-5d4f-b5c5-a80950cfcd56_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/52/d7523d64ba6d6eddbde1351e6a2e344a/pa/ZN33988_85501b0d31493cef30cee952b885b8a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49298cd1-b064-5d4f-b5c5-a80950cfcd56/49298cd1-b064-5d4f-b5c5-a80950cfcd56_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/52/d7523d64ba6d6eddbde1351e6a2e344a/pa/ZN33988_8e9057cb78c997f90a09e0237a0de081.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49298cd1-b064-5d4f-b5c5-a80950cfcd56/49298cd1-b064-5d4f-b5c5-a80950cfcd56_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/52/d7523d64ba6d6eddbde1351e6a2e344a/pa/ZN33988_de8a3beacb61e3e2634bef39acf665b2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-24',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Nissan X-Trail 1.6 360',
 'transmission': 'manual',
 'trim': '360',
 'year': 2017}
2026-03-29 08:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN33988%27 HTTP/1.1" 200 None
2026-03-29 08:33:49 [auto1.be] INFO: Saving data for ZN33988: {'created_time': 1774773229.182064, 'last_price_update_time': 1774773229.182076, 'auction_closing_time': 1774883940.0}
2026-03-29 08:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZN33988') HTTP/1.1" 204 0
2026-03-29 08:33:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GN69495/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:33:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:33:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BJ49980> (referer: https://www.auto1.com/v1/car-details-view/BJ49980/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:33:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:33:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28b52c4e-8788-5011-8692-cbd27fb7c047 with identifier: BJ49980
2026-03-29 08:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28b52c4e-8788-5011-8692-cbd27fb7c047 with scrape type 1
2026-03-29 08:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 28b52c4e-8788-5011-8692-cbd27fb7c047
2026-03-29 08:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fb9%252Ffbb964edcb1983c08d68d46c6f22fb66%252Fpa%252FBJ49980_a28229f53e7c3ad381c6465adb43c4d8.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/b9/fbb964edcb1983c08d68d46c6f22fb66/pa/BJ49980_a28229f53e7c3ad381c6465adb43c4d8.jpg already downloaded
2026-03-29 08:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fb9%252Ffbb964edcb1983c08d68d46c6f22fb66%252Fpa%252FBJ49980_ffacfe89825cee5fbf1bc770fea7cabd.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/b9/fbb964edcb1983c08d68d46c6f22fb66/pa/BJ49980_ffacfe89825cee5fbf1bc770fea7cabd.jpg already downloaded
2026-03-29 08:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fb9%252Ffbb964edcb1983c08d68d46c6f22fb66%252Fpa%252FBJ49980_1354cc9333b8f08519017e153bd6211e.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/b9/fbb964edcb1983c08d68d46c6f22fb66/pa/BJ49980_1354cc9333b8f08519017e153bd6211e.jpg already downloaded
2026-03-29 08:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fb9%252Ffbb964edcb1983c08d68d46c6f22fb66%252Fpa%252FBJ49980_03caa46c22acd338e8a95a59b183aea4.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/b9/fbb964edcb1983c08d68d46c6f22fb66/pa/BJ49980_03caa46c22acd338e8a95a59b183aea4.jpg already downloaded
2026-03-29 08:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fb9%252Ffbb964edcb1983c08d68d46c6f22fb66%252Fpa%252FBJ49980_651a48645f5c7dcb5d95b8a31062301c.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/b9/fbb964edcb1983c08d68d46c6f22fb66/pa/BJ49980_651a48645f5c7dcb5d95b8a31062301c.jpg already downloaded
2026-03-29 08:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fb9%252Ffbb964edcb1983c08d68d46c6f22fb66%252Fpa%252FBJ49980_b05f589005f8c7d7ac56bfc00cb61340.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/b9/fbb964edcb1983c08d68d46c6f22fb66/pa/BJ49980_b05f589005f8c7d7ac56bfc00cb61340.jpg already downloaded
2026-03-29 08:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fb9%252Ffbb964edcb1983c08d68d46c6f22fb66%252Fpa%252FBJ49980_474df106d537b77938290c78d749cf04.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/b9/fbb964edcb1983c08d68d46c6f22fb66/pa/BJ49980_474df106d537b77938290c78d749cf04.jpg already downloaded
2026-03-29 08:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fb9%252Ffbb964edcb1983c08d68d46c6f22fb66%252Fpa%252FBJ49980_f9b97b977135ae4f08ef767cf94c351a.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/b9/fbb964edcb1983c08d68d46c6f22fb66/pa/BJ49980_f9b97b977135ae4f08ef767cf94c351a.jpg already downloaded
2026-03-29 08:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fb9%252Ffbb964edcb1983c08d68d46c6f22fb66%252Fpa%252FBJ49980_2c9dc59cca889c21dbe107dabfbaa0b8.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/b9/fbb964edcb1983c08d68d46c6f22fb66/pa/BJ49980_2c9dc59cca889c21dbe107dabfbaa0b8.jpg already downloaded
2026-03-29 08:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252Fb9%252Ffbb964edcb1983c08d68d46c6f22fb66%252Fpa%252FBJ49980_501b492054e2bc93d498279648b53cad.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/b9/fbb964edcb1983c08d68d46c6f22fb66/pa/BJ49980_501b492054e2bc93d498279648b53cad.jpg already downloaded
2026-03-29 08:33:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 28b52c4e-8788-5011-8692-cbd27fb7c047, identifier: BJ49980
2026-03-29 08:33:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 28b52c4e-8788-5011-8692-cbd27fb7c047 with identifier: BJ49980
2026-03-29 08:33:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 28b52c4e-8788-5011-8692-cbd27fb7c047 with identifier: BJ49980
2026-03-29 08:33:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 28b52c4e-8788-5011-8692-cbd27fb7c047 with identifier: BJ49980 to the API
2026-03-29 08:33:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:33:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:33:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BJ49980>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:57:22Z',
 'fuel_type': 'diesel',
 'id': '28b52c4e-8788-5011-8692-cbd27fb7c047',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ49980',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 230805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgfb/b9/fbb964edcb1983c08d68d46c6f22fb66/pa/BJ49980_a28229f53e7c3ad381c6465adb43c4d8.jpg',
                'https://img-pa.auto1.com/imgfb/b9/fbb964edcb1983c08d68d46c6f22fb66/pa/BJ49980_ffacfe89825cee5fbf1bc770fea7cabd.jpg',
                'https://img-pa.auto1.com/imgfb/b9/fbb964edcb1983c08d68d46c6f22fb66/pa/BJ49980_1354cc9333b8f08519017e153bd6211e.jpg',
                'https://img-pa.auto1.com/imgfb/b9/fbb964edcb1983c08d68d46c6f22fb66/pa/BJ49980_03caa46c22acd338e8a95a59b183aea4.jpg',
                'https://img-pa.auto1.com/imgfb/b9/fbb964edcb1983c08d68d46c6f22fb66/pa/BJ49980_651a48645f5c7dcb5d95b8a31062301c.jpg',
                'https://img-pa.auto1.com/imgfb/b9/fbb964edcb1983c08d68d46c6f22fb66/pa/BJ49980_b05f589005f8c7d7ac56bfc00cb61340.jpg',
                'https://img-pa.auto1.com/imgfb/b9/fbb964edcb1983c08d68d46c6f22fb66/pa/BJ49980_474df106d537b77938290c78d749cf04.jpg',
                'https://img-pa.auto1.com/imgfb/b9/fbb964edcb1983c08d68d46c6f22fb66/pa/BJ49980_f9b97b977135ae4f08ef767cf94c351a.jpg',
                'https://img-pa.auto1.com/imgfb/b9/fbb964edcb1983c08d68d46c6f22fb66/pa/BJ49980_2c9dc59cca889c21dbe107dabfbaa0b8.jpg',
                'https://img-pa.auto1.com/imgfb/b9/fbb964edcb1983c08d68d46c6f22fb66/pa/BJ49980_501b492054e2bc93d498279648b53cad.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b52c4e-8788-5011-8692-cbd27fb7c047/28b52c4e-8788-5011-8692-cbd27fb7c047_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/b9/fbb964edcb1983c08d68d46c6f22fb66/pa/BJ49980_a28229f53e7c3ad381c6465adb43c4d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b52c4e-8788-5011-8692-cbd27fb7c047/28b52c4e-8788-5011-8692-cbd27fb7c047_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/b9/fbb964edcb1983c08d68d46c6f22fb66/pa/BJ49980_ffacfe89825cee5fbf1bc770fea7cabd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b52c4e-8788-5011-8692-cbd27fb7c047/28b52c4e-8788-5011-8692-cbd27fb7c047_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/b9/fbb964edcb1983c08d68d46c6f22fb66/pa/BJ49980_1354cc9333b8f08519017e153bd6211e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b52c4e-8788-5011-8692-cbd27fb7c047/28b52c4e-8788-5011-8692-cbd27fb7c047_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/b9/fbb964edcb1983c08d68d46c6f22fb66/pa/BJ49980_03caa46c22acd338e8a95a59b183aea4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b52c4e-8788-5011-8692-cbd27fb7c047/28b52c4e-8788-5011-8692-cbd27fb7c047_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/b9/fbb964edcb1983c08d68d46c6f22fb66/pa/BJ49980_651a48645f5c7dcb5d95b8a31062301c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b52c4e-8788-5011-8692-cbd27fb7c047/28b52c4e-8788-5011-8692-cbd27fb7c047_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/b9/fbb964edcb1983c08d68d46c6f22fb66/pa/BJ49980_b05f589005f8c7d7ac56bfc00cb61340.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b52c4e-8788-5011-8692-cbd27fb7c047/28b52c4e-8788-5011-8692-cbd27fb7c047_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/b9/fbb964edcb1983c08d68d46c6f22fb66/pa/BJ49980_474df106d537b77938290c78d749cf04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b52c4e-8788-5011-8692-cbd27fb7c047/28b52c4e-8788-5011-8692-cbd27fb7c047_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63157,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/b9/fbb964edcb1983c08d68d46c6f22fb66/pa/BJ49980_f9b97b977135ae4f08ef767cf94c351a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b52c4e-8788-5011-8692-cbd27fb7c047/28b52c4e-8788-5011-8692-cbd27fb7c047_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66389,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/b9/fbb964edcb1983c08d68d46c6f22fb66/pa/BJ49980_2c9dc59cca889c21dbe107dabfbaa0b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28b52c4e-8788-5011-8692-cbd27fb7c047/28b52c4e-8788-5011-8692-cbd27fb7c047_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/b9/fbb964edcb1983c08d68d46c6f22fb66/pa/BJ49980_501b492054e2bc93d498279648b53cad.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 Inscription 2WD',
 'transmission': 'automatic',
 'trim': 'Inscription 2WD',
 'year': 2017}
2026-03-29 08:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ49980%27 HTTP/1.1" 200 None
2026-03-29 08:33:53 [auto1.be] INFO: Saving data for BJ49980: {'created_time': 1774773233.998929, 'last_price_update_time': 1774773233.99894, 'auction_closing_time': 1774886242.0}
2026-03-29 08:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BJ49980') HTTP/1.1" 204 0
2026-03-29 08:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WM98444> (referer: https://www.auto1.com/v1/car-details-view/WM98444/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:33:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:33:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b777af9e-1d94-5fa1-8911-0d7ce4165688 with identifier: WM98444
2026-03-29 08:33:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b777af9e-1d94-5fa1-8911-0d7ce4165688 with scrape type 1
2026-03-29 08:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b777af9e-1d94-5fa1-8911-0d7ce4165688
2026-03-29 08:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F79%252F5079cc29052f058206eb4bd0df44f0b9%252Fpa%252FWM98444_a80b2c7b30244727b153baeeb0c319af.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/79/5079cc29052f058206eb4bd0df44f0b9/pa/WM98444_a80b2c7b30244727b153baeeb0c319af.jpg already downloaded
2026-03-29 08:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F79%252F5079cc29052f058206eb4bd0df44f0b9%252Fpa%252FWM98444_eedde768dacf5188dd45d2968124c7bb.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/79/5079cc29052f058206eb4bd0df44f0b9/pa/WM98444_eedde768dacf5188dd45d2968124c7bb.jpg already downloaded
2026-03-29 08:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F79%252F5079cc29052f058206eb4bd0df44f0b9%252Fpa%252FWM98444_c4e5d1a09246c3f9a133a059f0c5fdf2.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/79/5079cc29052f058206eb4bd0df44f0b9/pa/WM98444_c4e5d1a09246c3f9a133a059f0c5fdf2.jpg already downloaded
2026-03-29 08:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F79%252F5079cc29052f058206eb4bd0df44f0b9%252Fpa%252FWM98444_db0838b8ceb1da0f3f427b91e4cae27e.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/79/5079cc29052f058206eb4bd0df44f0b9/pa/WM98444_db0838b8ceb1da0f3f427b91e4cae27e.jpg already downloaded
2026-03-29 08:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F79%252F5079cc29052f058206eb4bd0df44f0b9%252Fpa%252FWM98444_3934d8e0907dd510c006a92edc056fea.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/79/5079cc29052f058206eb4bd0df44f0b9/pa/WM98444_3934d8e0907dd510c006a92edc056fea.jpg already downloaded
2026-03-29 08:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F79%252F5079cc29052f058206eb4bd0df44f0b9%252Fpa%252FWM98444_394a6afe729565fa27011b06084b22a4.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/79/5079cc29052f058206eb4bd0df44f0b9/pa/WM98444_394a6afe729565fa27011b06084b22a4.jpg already downloaded
2026-03-29 08:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F79%252F5079cc29052f058206eb4bd0df44f0b9%252Fpa%252FWM98444_a63496d08b62e50a2427dfe132ac9918.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/79/5079cc29052f058206eb4bd0df44f0b9/pa/WM98444_a63496d08b62e50a2427dfe132ac9918.jpg already downloaded
2026-03-29 08:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F79%252F5079cc29052f058206eb4bd0df44f0b9%252Fpa%252FWM98444_16b48be6d33dcdd384662d9cd969717e.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/79/5079cc29052f058206eb4bd0df44f0b9/pa/WM98444_16b48be6d33dcdd384662d9cd969717e.jpg already downloaded
2026-03-29 08:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F79%252F5079cc29052f058206eb4bd0df44f0b9%252Fpa%252FWM98444_45d45efa202d993ee46ad604948f2ccb.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/79/5079cc29052f058206eb4bd0df44f0b9/pa/WM98444_45d45efa202d993ee46ad604948f2ccb.jpg already downloaded
2026-03-29 08:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F79%252F5079cc29052f058206eb4bd0df44f0b9%252Fpa%252FWM98444_900769f25923ea7bcdcc9d65b7f83532.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/79/5079cc29052f058206eb4bd0df44f0b9/pa/WM98444_900769f25923ea7bcdcc9d65b7f83532.jpg already downloaded
2026-03-29 08:33:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b777af9e-1d94-5fa1-8911-0d7ce4165688, identifier: WM98444
2026-03-29 08:33:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b777af9e-1d94-5fa1-8911-0d7ce4165688 with identifier: WM98444
2026-03-29 08:33:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 08:33:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-29 08:33:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 08:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 08:33:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b777af9e-1d94-5fa1-8911-0d7ce4165688 with identifier: WM98444
2026-03-29 08:33:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b777af9e-1d94-5fa1-8911-0d7ce4165688 with identifier: WM98444 to the API
2026-03-29 08:33:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:33:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:33:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WM98444>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 326,
 'expiration_date': '2026-03-30T15:21:17Z',
 'fuel_type': 'hybrid',
 'id': 'b777af9e-1d94-5fa1-8911-0d7ce4165688',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM98444',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': '7er',
 'odometer': 167413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img50/79/5079cc29052f058206eb4bd0df44f0b9/pa/WM98444_a80b2c7b30244727b153baeeb0c319af.jpg',
                'https://img-pa.auto1.com/img50/79/5079cc29052f058206eb4bd0df44f0b9/pa/WM98444_eedde768dacf5188dd45d2968124c7bb.jpg',
                'https://img-pa.auto1.com/img50/79/5079cc29052f058206eb4bd0df44f0b9/pa/WM98444_c4e5d1a09246c3f9a133a059f0c5fdf2.jpg',
                'https://img-pa.auto1.com/img50/79/5079cc29052f058206eb4bd0df44f0b9/pa/WM98444_db0838b8ceb1da0f3f427b91e4cae27e.jpg',
                'https://img-pa.auto1.com/img50/79/5079cc29052f058206eb4bd0df44f0b9/pa/WM98444_3934d8e0907dd510c006a92edc056fea.jpg',
                'https://img-pa.auto1.com/img50/79/5079cc29052f058206eb4bd0df44f0b9/pa/WM98444_394a6afe729565fa27011b06084b22a4.jpg',
                'https://img-pa.auto1.com/img50/79/5079cc29052f058206eb4bd0df44f0b9/pa/WM98444_a63496d08b62e50a2427dfe132ac9918.jpg',
                'https://img-pa.auto1.com/img50/79/5079cc29052f058206eb4bd0df44f0b9/pa/WM98444_16b48be6d33dcdd384662d9cd969717e.jpg',
                'https://img-pa.auto1.com/img50/79/5079cc29052f058206eb4bd0df44f0b9/pa/WM98444_45d45efa202d993ee46ad604948f2ccb.jpg',
                'https://img-pa.auto1.com/img50/79/5079cc29052f058206eb4bd0df44f0b9/pa/WM98444_900769f25923ea7bcdcc9d65b7f83532.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b777af9e-1d94-5fa1-8911-0d7ce4165688/b777af9e-1d94-5fa1-8911-0d7ce4165688_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/79/5079cc29052f058206eb4bd0df44f0b9/pa/WM98444_a80b2c7b30244727b153baeeb0c319af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b777af9e-1d94-5fa1-8911-0d7ce4165688/b777af9e-1d94-5fa1-8911-0d7ce4165688_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/79/5079cc29052f058206eb4bd0df44f0b9/pa/WM98444_eedde768dacf5188dd45d2968124c7bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b777af9e-1d94-5fa1-8911-0d7ce4165688/b777af9e-1d94-5fa1-8911-0d7ce4165688_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/79/5079cc29052f058206eb4bd0df44f0b9/pa/WM98444_c4e5d1a09246c3f9a133a059f0c5fdf2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b777af9e-1d94-5fa1-8911-0d7ce4165688/b777af9e-1d94-5fa1-8911-0d7ce4165688_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64224,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/79/5079cc29052f058206eb4bd0df44f0b9/pa/WM98444_db0838b8ceb1da0f3f427b91e4cae27e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b777af9e-1d94-5fa1-8911-0d7ce4165688/b777af9e-1d94-5fa1-8911-0d7ce4165688_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/79/5079cc29052f058206eb4bd0df44f0b9/pa/WM98444_3934d8e0907dd510c006a92edc056fea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b777af9e-1d94-5fa1-8911-0d7ce4165688/b777af9e-1d94-5fa1-8911-0d7ce4165688_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67794,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/79/5079cc29052f058206eb4bd0df44f0b9/pa/WM98444_394a6afe729565fa27011b06084b22a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b777af9e-1d94-5fa1-8911-0d7ce4165688/b777af9e-1d94-5fa1-8911-0d7ce4165688_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/79/5079cc29052f058206eb4bd0df44f0b9/pa/WM98444_a63496d08b62e50a2427dfe132ac9918.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b777af9e-1d94-5fa1-8911-0d7ce4165688/b777af9e-1d94-5fa1-8911-0d7ce4165688_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/79/5079cc29052f058206eb4bd0df44f0b9/pa/WM98444_16b48be6d33dcdd384662d9cd969717e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b777af9e-1d94-5fa1-8911-0d7ce4165688/b777af9e-1d94-5fa1-8911-0d7ce4165688_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65313,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/79/5079cc29052f058206eb4bd0df44f0b9/pa/WM98444_45d45efa202d993ee46ad604948f2ccb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b777af9e-1d94-5fa1-8911-0d7ce4165688/b777af9e-1d94-5fa1-8911-0d7ce4165688_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/79/5079cc29052f058206eb4bd0df44f0b9/pa/WM98444_900769f25923ea7bcdcc9d65b7f83532.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 7er 740e L xDrive',
 'transmission': 'automatic',
 'trim': 'L xDrive',
 'year': 2017}
2026-03-29 08:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM98444%27 HTTP/1.1" 200 None
2026-03-29 08:33:58 [auto1.be] INFO: Saving data for WM98444: {'created_time': 1774773238.25281, 'last_price_update_time': 1774773238.252821, 'auction_closing_time': 1774884077.0}
2026-03-29 08:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WM98444') HTTP/1.1" 204 0
2026-03-29 08:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SB58546> (referer: https://www.auto1.com/v1/car-details-view/SB58546/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:33:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:33:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdd0bbec-aa45-5144-8f45-295b194dd54b with identifier: SB58546
2026-03-29 08:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdd0bbec-aa45-5144-8f45-295b194dd54b with scrape type 1
2026-03-29 08:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fdd0bbec-aa45-5144-8f45-295b194dd54b
2026-03-29 08:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb3%252F5eb363b499260c0f710d10e664755bb3%252Fpa%252FSB58546_6f43d2bee5db8770894893c0967ef26a.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b3/5eb363b499260c0f710d10e664755bb3/pa/SB58546_6f43d2bee5db8770894893c0967ef26a.jpg already downloaded
2026-03-29 08:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb3%252F5eb363b499260c0f710d10e664755bb3%252Fpa%252FSB58546_20eaf6f4641b7272099465bc9776e9f7.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b3/5eb363b499260c0f710d10e664755bb3/pa/SB58546_20eaf6f4641b7272099465bc9776e9f7.jpg already downloaded
2026-03-29 08:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb3%252F5eb363b499260c0f710d10e664755bb3%252Fpa%252FSB58546_831af6fdac64c10ee736c817febfc677.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b3/5eb363b499260c0f710d10e664755bb3/pa/SB58546_831af6fdac64c10ee736c817febfc677.jpg already downloaded
2026-03-29 08:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb3%252F5eb363b499260c0f710d10e664755bb3%252Fpa%252FSB58546_efa9456b89cd0a08dfc978e4dec406cd.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b3/5eb363b499260c0f710d10e664755bb3/pa/SB58546_efa9456b89cd0a08dfc978e4dec406cd.jpg already downloaded
2026-03-29 08:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb3%252F5eb363b499260c0f710d10e664755bb3%252Fpa%252FSB58546_4017adf592849bb1b8bc3f8dfcc5f4a2.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b3/5eb363b499260c0f710d10e664755bb3/pa/SB58546_4017adf592849bb1b8bc3f8dfcc5f4a2.jpg already downloaded
2026-03-29 08:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb3%252F5eb363b499260c0f710d10e664755bb3%252Fpa%252FSB58546_0550e819f821b1305ec1f78eb781f92c.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b3/5eb363b499260c0f710d10e664755bb3/pa/SB58546_0550e819f821b1305ec1f78eb781f92c.jpg already downloaded
2026-03-29 08:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb3%252F5eb363b499260c0f710d10e664755bb3%252Fpa%252FSB58546_ae458330c61b611427acf35ff00f8632.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b3/5eb363b499260c0f710d10e664755bb3/pa/SB58546_ae458330c61b611427acf35ff00f8632.jpg already downloaded
2026-03-29 08:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb3%252F5eb363b499260c0f710d10e664755bb3%252Fpa%252FSB58546_cf53772afc297e7c3a64792ed415ae64.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b3/5eb363b499260c0f710d10e664755bb3/pa/SB58546_cf53772afc297e7c3a64792ed415ae64.jpg already downloaded
2026-03-29 08:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb3%252F5eb363b499260c0f710d10e664755bb3%252Fpa%252FSB58546_e5785477cbd946acbe42c498be3b62cd.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b3/5eb363b499260c0f710d10e664755bb3/pa/SB58546_e5785477cbd946acbe42c498be3b62cd.jpg already downloaded
2026-03-29 08:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fb3%252F5eb363b499260c0f710d10e664755bb3%252Fpa%252FSB58546_7427e575ddbe7973285037729f5fe9ce.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/b3/5eb363b499260c0f710d10e664755bb3/pa/SB58546_7427e575ddbe7973285037729f5fe9ce.jpg already downloaded
2026-03-29 08:33:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fdd0bbec-aa45-5144-8f45-295b194dd54b, identifier: SB58546
2026-03-29 08:33:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fdd0bbec-aa45-5144-8f45-295b194dd54b with identifier: SB58546
2026-03-29 08:33:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fdd0bbec-aa45-5144-8f45-295b194dd54b with identifier: SB58546
2026-03-29 08:33:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fdd0bbec-aa45-5144-8f45-295b194dd54b with identifier: SB58546 to the API
2026-03-29 08:33:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:33:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:33:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SB58546>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:04:22Z',
 'fuel_type': 'diesel',
 'id': 'fdd0bbec-aa45-5144-8f45-295b194dd54b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB58546',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 125128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img5e/b3/5eb363b499260c0f710d10e664755bb3/pa/SB58546_6f43d2bee5db8770894893c0967ef26a.jpg',
                'https://img-pa.auto1.com/img5e/b3/5eb363b499260c0f710d10e664755bb3/pa/SB58546_20eaf6f4641b7272099465bc9776e9f7.jpg',
                'https://img-pa.auto1.com/img5e/b3/5eb363b499260c0f710d10e664755bb3/pa/SB58546_831af6fdac64c10ee736c817febfc677.jpg',
                'https://img-pa.auto1.com/img5e/b3/5eb363b499260c0f710d10e664755bb3/pa/SB58546_efa9456b89cd0a08dfc978e4dec406cd.jpg',
                'https://img-pa.auto1.com/img5e/b3/5eb363b499260c0f710d10e664755bb3/pa/SB58546_4017adf592849bb1b8bc3f8dfcc5f4a2.jpg',
                'https://img-pa.auto1.com/img5e/b3/5eb363b499260c0f710d10e664755bb3/pa/SB58546_0550e819f821b1305ec1f78eb781f92c.jpg',
                'https://img-pa.auto1.com/img5e/b3/5eb363b499260c0f710d10e664755bb3/pa/SB58546_ae458330c61b611427acf35ff00f8632.jpg',
                'https://img-pa.auto1.com/img5e/b3/5eb363b499260c0f710d10e664755bb3/pa/SB58546_cf53772afc297e7c3a64792ed415ae64.jpg',
                'https://img-pa.auto1.com/img5e/b3/5eb363b499260c0f710d10e664755bb3/pa/SB58546_e5785477cbd946acbe42c498be3b62cd.jpg',
                'https://img-pa.auto1.com/img5e/b3/5eb363b499260c0f710d10e664755bb3/pa/SB58546_7427e575ddbe7973285037729f5fe9ce.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdd0bbec-aa45-5144-8f45-295b194dd54b/fdd0bbec-aa45-5144-8f45-295b194dd54b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b3/5eb363b499260c0f710d10e664755bb3/pa/SB58546_6f43d2bee5db8770894893c0967ef26a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdd0bbec-aa45-5144-8f45-295b194dd54b/fdd0bbec-aa45-5144-8f45-295b194dd54b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b3/5eb363b499260c0f710d10e664755bb3/pa/SB58546_20eaf6f4641b7272099465bc9776e9f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdd0bbec-aa45-5144-8f45-295b194dd54b/fdd0bbec-aa45-5144-8f45-295b194dd54b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b3/5eb363b499260c0f710d10e664755bb3/pa/SB58546_831af6fdac64c10ee736c817febfc677.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdd0bbec-aa45-5144-8f45-295b194dd54b/fdd0bbec-aa45-5144-8f45-295b194dd54b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b3/5eb363b499260c0f710d10e664755bb3/pa/SB58546_efa9456b89cd0a08dfc978e4dec406cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdd0bbec-aa45-5144-8f45-295b194dd54b/fdd0bbec-aa45-5144-8f45-295b194dd54b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b3/5eb363b499260c0f710d10e664755bb3/pa/SB58546_4017adf592849bb1b8bc3f8dfcc5f4a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdd0bbec-aa45-5144-8f45-295b194dd54b/fdd0bbec-aa45-5144-8f45-295b194dd54b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b3/5eb363b499260c0f710d10e664755bb3/pa/SB58546_0550e819f821b1305ec1f78eb781f92c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdd0bbec-aa45-5144-8f45-295b194dd54b/fdd0bbec-aa45-5144-8f45-295b194dd54b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b3/5eb363b499260c0f710d10e664755bb3/pa/SB58546_ae458330c61b611427acf35ff00f8632.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdd0bbec-aa45-5144-8f45-295b194dd54b/fdd0bbec-aa45-5144-8f45-295b194dd54b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b3/5eb363b499260c0f710d10e664755bb3/pa/SB58546_cf53772afc297e7c3a64792ed415ae64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdd0bbec-aa45-5144-8f45-295b194dd54b/fdd0bbec-aa45-5144-8f45-295b194dd54b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b3/5eb363b499260c0f710d10e664755bb3/pa/SB58546_e5785477cbd946acbe42c498be3b62cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdd0bbec-aa45-5144-8f45-295b194dd54b/fdd0bbec-aa45-5144-8f45-295b194dd54b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63467,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/b3/5eb363b499260c0f710d10e664755bb3/pa/SB58546_7427e575ddbe7973285037729f5fe9ce.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-29 08:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB58546%27 HTTP/1.1" 200 None
2026-03-29 08:33:58 [auto1.be] INFO: Saving data for SB58546: {'created_time': 1774773238.996802, 'last_price_update_time': 1774773238.996812, 'auction_closing_time': 1774883062.0}
2026-03-29 08:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SB58546') HTTP/1.1" 204 0
2026-03-29 08:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SK35491> (referer: https://www.auto1.com/v1/car-details-view/SK35491/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:34:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b537895-131b-5167-bc4c-b25fab66a524 with identifier: SK35491
2026-03-29 08:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b537895-131b-5167-bc4c-b25fab66a524 with scrape type 1
2026-03-29 08:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b537895-131b-5167-bc4c-b25fab66a524
2026-03-29 08:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F06%252F4906c763acf71d837b57797619520e5c%252Fpa%252FSK35491_3fe18e4c55ec965eab10dd4b3decb2a1.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/06/4906c763acf71d837b57797619520e5c/pa/SK35491_3fe18e4c55ec965eab10dd4b3decb2a1.jpg already downloaded
2026-03-29 08:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F06%252F4906c763acf71d837b57797619520e5c%252Fpa%252FSK35491_7f5b5c44e53042c5b8cde6ec4466e379.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/06/4906c763acf71d837b57797619520e5c/pa/SK35491_7f5b5c44e53042c5b8cde6ec4466e379.jpg already downloaded
2026-03-29 08:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F06%252F4906c763acf71d837b57797619520e5c%252Fpa%252FSK35491_cf8ac1b31c116583522135a1d0b48e25.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/06/4906c763acf71d837b57797619520e5c/pa/SK35491_cf8ac1b31c116583522135a1d0b48e25.jpg already downloaded
2026-03-29 08:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F06%252F4906c763acf71d837b57797619520e5c%252Fpa%252FSK35491_271a19e7fb86a3e71ece964c973a4c6a.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/06/4906c763acf71d837b57797619520e5c/pa/SK35491_271a19e7fb86a3e71ece964c973a4c6a.jpg already downloaded
2026-03-29 08:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F06%252F4906c763acf71d837b57797619520e5c%252Fpa%252FSK35491_9bb24ecac1589e512dcd9e7dc65be9a9.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/06/4906c763acf71d837b57797619520e5c/pa/SK35491_9bb24ecac1589e512dcd9e7dc65be9a9.jpg already downloaded
2026-03-29 08:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F06%252F4906c763acf71d837b57797619520e5c%252Fpa%252FSK35491_9541af518c52692577c18edb66931eda.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/06/4906c763acf71d837b57797619520e5c/pa/SK35491_9541af518c52692577c18edb66931eda.jpg already downloaded
2026-03-29 08:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F06%252F4906c763acf71d837b57797619520e5c%252Fpa%252FSK35491_b1af28ad04e935a30227cb2336164ad1.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/06/4906c763acf71d837b57797619520e5c/pa/SK35491_b1af28ad04e935a30227cb2336164ad1.jpg already downloaded
2026-03-29 08:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F06%252F4906c763acf71d837b57797619520e5c%252Fpa%252FSK35491_3cc489b70484396830bf377cffde7cdd.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/06/4906c763acf71d837b57797619520e5c/pa/SK35491_3cc489b70484396830bf377cffde7cdd.jpg already downloaded
2026-03-29 08:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F06%252F4906c763acf71d837b57797619520e5c%252Fpa%252FSK35491_8bd157a4552709b63c4e5bae1736d1fd.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/06/4906c763acf71d837b57797619520e5c/pa/SK35491_8bd157a4552709b63c4e5bae1736d1fd.jpg already downloaded
2026-03-29 08:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252F06%252F4906c763acf71d837b57797619520e5c%252Fpa%252FSK35491_31547c33f58a44eda4e56f7fb89951fe.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/06/4906c763acf71d837b57797619520e5c/pa/SK35491_31547c33f58a44eda4e56f7fb89951fe.jpg already downloaded
2026-03-29 08:34:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9b537895-131b-5167-bc4c-b25fab66a524, identifier: SK35491
2026-03-29 08:34:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9b537895-131b-5167-bc4c-b25fab66a524 with identifier: SK35491
2026-03-29 08:34:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9b537895-131b-5167-bc4c-b25fab66a524 with identifier: SK35491
2026-03-29 08:34:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9b537895-131b-5167-bc4c-b25fab66a524 with identifier: SK35491 to the API
2026-03-29 08:34:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:34:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:34:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SK35491>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': 'Taxi',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '1.9L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:38:24Z',
 'fuel_type': 'diesel',
 'id': '9b537895-131b-5167-bc4c-b25fab66a524',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK35491',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'Vito Tourer',
 'odometer': 499766,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img49/06/4906c763acf71d837b57797619520e5c/pa/SK35491_3fe18e4c55ec965eab10dd4b3decb2a1.jpg',
                'https://img-pa.auto1.com/img49/06/4906c763acf71d837b57797619520e5c/pa/SK35491_7f5b5c44e53042c5b8cde6ec4466e379.jpg',
                'https://img-pa.auto1.com/img49/06/4906c763acf71d837b57797619520e5c/pa/SK35491_cf8ac1b31c116583522135a1d0b48e25.jpg',
                'https://img-pa.auto1.com/img49/06/4906c763acf71d837b57797619520e5c/pa/SK35491_271a19e7fb86a3e71ece964c973a4c6a.jpg',
                'https://img-pa.auto1.com/img49/06/4906c763acf71d837b57797619520e5c/pa/SK35491_9bb24ecac1589e512dcd9e7dc65be9a9.jpg',
                'https://img-pa.auto1.com/img49/06/4906c763acf71d837b57797619520e5c/pa/SK35491_9541af518c52692577c18edb66931eda.jpg',
                'https://img-pa.auto1.com/img49/06/4906c763acf71d837b57797619520e5c/pa/SK35491_b1af28ad04e935a30227cb2336164ad1.jpg',
                'https://img-pa.auto1.com/img49/06/4906c763acf71d837b57797619520e5c/pa/SK35491_3cc489b70484396830bf377cffde7cdd.jpg',
                'https://img-pa.auto1.com/img49/06/4906c763acf71d837b57797619520e5c/pa/SK35491_8bd157a4552709b63c4e5bae1736d1fd.jpg',
                'https://img-pa.auto1.com/img49/06/4906c763acf71d837b57797619520e5c/pa/SK35491_31547c33f58a44eda4e56f7fb89951fe.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b537895-131b-5167-bc4c-b25fab66a524/9b537895-131b-5167-bc4c-b25fab66a524_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/06/4906c763acf71d837b57797619520e5c/pa/SK35491_3fe18e4c55ec965eab10dd4b3decb2a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b537895-131b-5167-bc4c-b25fab66a524/9b537895-131b-5167-bc4c-b25fab66a524_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/06/4906c763acf71d837b57797619520e5c/pa/SK35491_7f5b5c44e53042c5b8cde6ec4466e379.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b537895-131b-5167-bc4c-b25fab66a524/9b537895-131b-5167-bc4c-b25fab66a524_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/06/4906c763acf71d837b57797619520e5c/pa/SK35491_cf8ac1b31c116583522135a1d0b48e25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b537895-131b-5167-bc4c-b25fab66a524/9b537895-131b-5167-bc4c-b25fab66a524_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54367,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/06/4906c763acf71d837b57797619520e5c/pa/SK35491_271a19e7fb86a3e71ece964c973a4c6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b537895-131b-5167-bc4c-b25fab66a524/9b537895-131b-5167-bc4c-b25fab66a524_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/06/4906c763acf71d837b57797619520e5c/pa/SK35491_9bb24ecac1589e512dcd9e7dc65be9a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b537895-131b-5167-bc4c-b25fab66a524/9b537895-131b-5167-bc4c-b25fab66a524_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/06/4906c763acf71d837b57797619520e5c/pa/SK35491_9541af518c52692577c18edb66931eda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b537895-131b-5167-bc4c-b25fab66a524/9b537895-131b-5167-bc4c-b25fab66a524_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/06/4906c763acf71d837b57797619520e5c/pa/SK35491_b1af28ad04e935a30227cb2336164ad1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b537895-131b-5167-bc4c-b25fab66a524/9b537895-131b-5167-bc4c-b25fab66a524_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/06/4906c763acf71d837b57797619520e5c/pa/SK35491_3cc489b70484396830bf377cffde7cdd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b537895-131b-5167-bc4c-b25fab66a524/9b537895-131b-5167-bc4c-b25fab66a524_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69423,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/06/4906c763acf71d837b57797619520e5c/pa/SK35491_8bd157a4552709b63c4e5bae1736d1fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b537895-131b-5167-bc4c-b25fab66a524/9b537895-131b-5167-bc4c-b25fab66a524_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40640,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/06/4906c763acf71d837b57797619520e5c/pa/SK35491_31547c33f58a44eda4e56f7fb89951fe.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-28',
 'seats_number': 9,
 'seller_name': None,
 'title': 'Mercedes-Benz Vito Tourer 119 CDI Select lang',
 'transmission': 'automatic',
 'trim': 'Select lang',
 'year': 2021}
2026-03-29 08:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK35491%27 HTTP/1.1" 200 None
2026-03-29 08:34:00 [auto1.be] INFO: Saving data for SK35491: {'created_time': 1774773240.821191, 'last_price_update_time': 1774773240.821204, 'auction_closing_time': 1774885104.0}
2026-03-29 08:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SK35491') HTTP/1.1" 204 0
2026-03-29 08:34:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GN69495> (referer: https://www.auto1.com/v1/car-details-view/GN69495/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:34:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96a74937-ba7e-5b83-a458-8f94fe764bdd with identifier: GN69495
2026-03-29 08:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96a74937-ba7e-5b83-a458-8f94fe764bdd with scrape type 1
2026-03-29 08:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 96a74937-ba7e-5b83-a458-8f94fe764bdd
2026-03-29 08:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F7e%252Fd17e4b1b28c557c990fcd9e87bc6687d%252Fpa%252FGN69495_0ae8e2f2718ff2af24018413e8e56337.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/7e/d17e4b1b28c557c990fcd9e87bc6687d/pa/GN69495_0ae8e2f2718ff2af24018413e8e56337.jpg already downloaded
2026-03-29 08:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F7e%252Fd17e4b1b28c557c990fcd9e87bc6687d%252Fpa%252FGN69495_8a2c8aaf4f75df4a74491aed8ca4ab44.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/7e/d17e4b1b28c557c990fcd9e87bc6687d/pa/GN69495_8a2c8aaf4f75df4a74491aed8ca4ab44.jpg already downloaded
2026-03-29 08:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F7e%252Fd17e4b1b28c557c990fcd9e87bc6687d%252Fpa%252FGN69495_989cc03c1802b590d922a8099c089473.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/7e/d17e4b1b28c557c990fcd9e87bc6687d/pa/GN69495_989cc03c1802b590d922a8099c089473.jpg already downloaded
2026-03-29 08:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F7e%252Fd17e4b1b28c557c990fcd9e87bc6687d%252Fpa%252FGN69495_f935a9e4e5ca65e97a7300b53b39786f.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/7e/d17e4b1b28c557c990fcd9e87bc6687d/pa/GN69495_f935a9e4e5ca65e97a7300b53b39786f.jpg already downloaded
2026-03-29 08:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F7e%252Fd17e4b1b28c557c990fcd9e87bc6687d%252Fpa%252FGN69495_5c2581e739e8b62fadc281ee85113be7.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/7e/d17e4b1b28c557c990fcd9e87bc6687d/pa/GN69495_5c2581e739e8b62fadc281ee85113be7.jpg already downloaded
2026-03-29 08:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F7e%252Fd17e4b1b28c557c990fcd9e87bc6687d%252Fpa%252FGN69495_2207bc9f9ed555490d48d722c49c2036.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/7e/d17e4b1b28c557c990fcd9e87bc6687d/pa/GN69495_2207bc9f9ed555490d48d722c49c2036.jpg already downloaded
2026-03-29 08:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F7e%252Fd17e4b1b28c557c990fcd9e87bc6687d%252Fpa%252FGN69495_a8ea5a6d5cdf334c0a44078dc0196368.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/7e/d17e4b1b28c557c990fcd9e87bc6687d/pa/GN69495_a8ea5a6d5cdf334c0a44078dc0196368.jpg already downloaded
2026-03-29 08:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F7e%252Fd17e4b1b28c557c990fcd9e87bc6687d%252Fpa%252FGN69495_f915a7af69e97c67bbbfa53ae778cbee.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/7e/d17e4b1b28c557c990fcd9e87bc6687d/pa/GN69495_f915a7af69e97c67bbbfa53ae778cbee.jpg already downloaded
2026-03-29 08:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F7e%252Fd17e4b1b28c557c990fcd9e87bc6687d%252Fpa%252FGN69495_6675ecfeb727d63b2518814e2dc8c56a.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/7e/d17e4b1b28c557c990fcd9e87bc6687d/pa/GN69495_6675ecfeb727d63b2518814e2dc8c56a.jpg already downloaded
2026-03-29 08:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F7e%252Fd17e4b1b28c557c990fcd9e87bc6687d%252Fpa%252FGN69495_a6320415e5b191eac561306bc5c4d1e4.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/7e/d17e4b1b28c557c990fcd9e87bc6687d/pa/GN69495_a6320415e5b191eac561306bc5c4d1e4.jpg already downloaded
2026-03-29 08:34:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 96a74937-ba7e-5b83-a458-8f94fe764bdd, identifier: GN69495
2026-03-29 08:34:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 96a74937-ba7e-5b83-a458-8f94fe764bdd with identifier: GN69495
2026-03-29 08:34:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 96a74937-ba7e-5b83-a458-8f94fe764bdd with identifier: GN69495
2026-03-29 08:34:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 96a74937-ba7e-5b83-a458-8f94fe764bdd with identifier: GN69495 to the API
2026-03-29 08:34:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:34:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:34:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GN69495>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:57:04Z',
 'fuel_type': 'diesel',
 'id': '96a74937-ba7e-5b83-a458-8f94fe764bdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN69495',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'Tourneo Connect',
 'odometer': 122869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgd1/7e/d17e4b1b28c557c990fcd9e87bc6687d/pa/GN69495_0ae8e2f2718ff2af24018413e8e56337.jpg',
                'https://img-pa.auto1.com/imgd1/7e/d17e4b1b28c557c990fcd9e87bc6687d/pa/GN69495_8a2c8aaf4f75df4a74491aed8ca4ab44.jpg',
                'https://img-pa.auto1.com/imgd1/7e/d17e4b1b28c557c990fcd9e87bc6687d/pa/GN69495_989cc03c1802b590d922a8099c089473.jpg',
                'https://img-pa.auto1.com/imgd1/7e/d17e4b1b28c557c990fcd9e87bc6687d/pa/GN69495_f935a9e4e5ca65e97a7300b53b39786f.jpg',
                'https://img-pa.auto1.com/imgd1/7e/d17e4b1b28c557c990fcd9e87bc6687d/pa/GN69495_5c2581e739e8b62fadc281ee85113be7.jpg',
                'https://img-pa.auto1.com/imgd1/7e/d17e4b1b28c557c990fcd9e87bc6687d/pa/GN69495_2207bc9f9ed555490d48d722c49c2036.jpg',
                'https://img-pa.auto1.com/imgd1/7e/d17e4b1b28c557c990fcd9e87bc6687d/pa/GN69495_a8ea5a6d5cdf334c0a44078dc0196368.jpg',
                'https://img-pa.auto1.com/imgd1/7e/d17e4b1b28c557c990fcd9e87bc6687d/pa/GN69495_f915a7af69e97c67bbbfa53ae778cbee.jpg',
                'https://img-pa.auto1.com/imgd1/7e/d17e4b1b28c557c990fcd9e87bc6687d/pa/GN69495_6675ecfeb727d63b2518814e2dc8c56a.jpg',
                'https://img-pa.auto1.com/imgd1/7e/d17e4b1b28c557c990fcd9e87bc6687d/pa/GN69495_a6320415e5b191eac561306bc5c4d1e4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a74937-ba7e-5b83-a458-8f94fe764bdd/96a74937-ba7e-5b83-a458-8f94fe764bdd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77362,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/7e/d17e4b1b28c557c990fcd9e87bc6687d/pa/GN69495_0ae8e2f2718ff2af24018413e8e56337.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a74937-ba7e-5b83-a458-8f94fe764bdd/96a74937-ba7e-5b83-a458-8f94fe764bdd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/7e/d17e4b1b28c557c990fcd9e87bc6687d/pa/GN69495_8a2c8aaf4f75df4a74491aed8ca4ab44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a74937-ba7e-5b83-a458-8f94fe764bdd/96a74937-ba7e-5b83-a458-8f94fe764bdd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/7e/d17e4b1b28c557c990fcd9e87bc6687d/pa/GN69495_989cc03c1802b590d922a8099c089473.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a74937-ba7e-5b83-a458-8f94fe764bdd/96a74937-ba7e-5b83-a458-8f94fe764bdd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67832,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/7e/d17e4b1b28c557c990fcd9e87bc6687d/pa/GN69495_f935a9e4e5ca65e97a7300b53b39786f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a74937-ba7e-5b83-a458-8f94fe764bdd/96a74937-ba7e-5b83-a458-8f94fe764bdd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52121,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/7e/d17e4b1b28c557c990fcd9e87bc6687d/pa/GN69495_5c2581e739e8b62fadc281ee85113be7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a74937-ba7e-5b83-a458-8f94fe764bdd/96a74937-ba7e-5b83-a458-8f94fe764bdd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/7e/d17e4b1b28c557c990fcd9e87bc6687d/pa/GN69495_2207bc9f9ed555490d48d722c49c2036.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a74937-ba7e-5b83-a458-8f94fe764bdd/96a74937-ba7e-5b83-a458-8f94fe764bdd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/7e/d17e4b1b28c557c990fcd9e87bc6687d/pa/GN69495_a8ea5a6d5cdf334c0a44078dc0196368.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a74937-ba7e-5b83-a458-8f94fe764bdd/96a74937-ba7e-5b83-a458-8f94fe764bdd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/7e/d17e4b1b28c557c990fcd9e87bc6687d/pa/GN69495_f915a7af69e97c67bbbfa53ae778cbee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a74937-ba7e-5b83-a458-8f94fe764bdd/96a74937-ba7e-5b83-a458-8f94fe764bdd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/7e/d17e4b1b28c557c990fcd9e87bc6687d/pa/GN69495_6675ecfeb727d63b2518814e2dc8c56a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a74937-ba7e-5b83-a458-8f94fe764bdd/96a74937-ba7e-5b83-a458-8f94fe764bdd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57005,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/7e/d17e4b1b28c557c990fcd9e87bc6687d/pa/GN69495_a6320415e5b191eac561306bc5c4d1e4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Tourneo Connect 1.5 EcoBlue TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2019}
2026-03-29 08:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN69495%27 HTTP/1.1" 200 None
2026-03-29 08:34:01 [auto1.be] INFO: Saving data for GN69495: {'created_time': 1774773241.545887, 'last_price_update_time': 1774773241.545896, 'auction_closing_time': 1774886224.0}
2026-03-29 08:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GN69495') HTTP/1.1" 204 0
2026-03-29 08:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MB50362> (referer: https://www.auto1.com/v1/car-details-view/MB50362/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:34:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ee7d5c7-cff2-5eb2-9713-c32980a867c4 with identifier: MB50362
2026-03-29 08:34:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ee7d5c7-cff2-5eb2-9713-c32980a867c4 with scrape type 1
2026-03-29 08:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2ee7d5c7-cff2-5eb2-9713-c32980a867c4
2026-03-29 08:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F0a%252Ff00a4c682cfd8e815bda70e029cb629c%252Fpa%252FMB50362_6c643875c0a85d837d9d74ec97cbf9b8.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/0a/f00a4c682cfd8e815bda70e029cb629c/pa/MB50362_6c643875c0a85d837d9d74ec97cbf9b8.jpg already downloaded
2026-03-29 08:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F0a%252Ff00a4c682cfd8e815bda70e029cb629c%252Fpa%252FMB50362_eb10993724a6b76e25493ba94f7cd506.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/0a/f00a4c682cfd8e815bda70e029cb629c/pa/MB50362_eb10993724a6b76e25493ba94f7cd506.jpg already downloaded
2026-03-29 08:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F0a%252Ff00a4c682cfd8e815bda70e029cb629c%252Fpa%252FMB50362_e459121cfb6b7888a3f03180cfeb1e93.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/0a/f00a4c682cfd8e815bda70e029cb629c/pa/MB50362_e459121cfb6b7888a3f03180cfeb1e93.jpg already downloaded
2026-03-29 08:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F0a%252Ff00a4c682cfd8e815bda70e029cb629c%252Fpa%252FMB50362_0c335b0e14552b5113ba20e849049c95.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/0a/f00a4c682cfd8e815bda70e029cb629c/pa/MB50362_0c335b0e14552b5113ba20e849049c95.jpg already downloaded
2026-03-29 08:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F0a%252Ff00a4c682cfd8e815bda70e029cb629c%252Fpa%252FMB50362_3ed7ad2dcc4702ecf57bba23201a8f93.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/0a/f00a4c682cfd8e815bda70e029cb629c/pa/MB50362_3ed7ad2dcc4702ecf57bba23201a8f93.jpg already downloaded
2026-03-29 08:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F0a%252Ff00a4c682cfd8e815bda70e029cb629c%252Fpa%252FMB50362_068e2570a20b7c2ab928ecf9bbf9e055.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/0a/f00a4c682cfd8e815bda70e029cb629c/pa/MB50362_068e2570a20b7c2ab928ecf9bbf9e055.jpg already downloaded
2026-03-29 08:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F0a%252Ff00a4c682cfd8e815bda70e029cb629c%252Fpa%252FMB50362_56f6d3f2d5da6ec5710c93befd35109e.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/0a/f00a4c682cfd8e815bda70e029cb629c/pa/MB50362_56f6d3f2d5da6ec5710c93befd35109e.jpg already downloaded
2026-03-29 08:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F0a%252Ff00a4c682cfd8e815bda70e029cb629c%252Fpa%252FMB50362_d96ed6b1f7adff5040b8cc2a3c739326.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/0a/f00a4c682cfd8e815bda70e029cb629c/pa/MB50362_d96ed6b1f7adff5040b8cc2a3c739326.jpg already downloaded
2026-03-29 08:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F0a%252Ff00a4c682cfd8e815bda70e029cb629c%252Fpa%252FMB50362_60f61bd26a876a271ebba09402a801c2.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/0a/f00a4c682cfd8e815bda70e029cb629c/pa/MB50362_60f61bd26a876a271ebba09402a801c2.jpg already downloaded
2026-03-29 08:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F0a%252Ff00a4c682cfd8e815bda70e029cb629c%252Fpa%252FMB50362_7851b83bf8350b7a491cd59f80fe1ed7.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/0a/f00a4c682cfd8e815bda70e029cb629c/pa/MB50362_7851b83bf8350b7a491cd59f80fe1ed7.jpg already downloaded
2026-03-29 08:34:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2ee7d5c7-cff2-5eb2-9713-c32980a867c4, identifier: MB50362
2026-03-29 08:34:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2ee7d5c7-cff2-5eb2-9713-c32980a867c4 with identifier: MB50362
2026-03-29 08:34:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2ee7d5c7-cff2-5eb2-9713-c32980a867c4 with identifier: MB50362
2026-03-29 08:34:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2ee7d5c7-cff2-5eb2-9713-c32980a867c4 with identifier: MB50362 to the API
2026-03-29 08:34:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:34:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:34:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MB50362>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:10:13Z',
 'fuel_type': 'diesel',
 'id': '2ee7d5c7-cff2-5eb2-9713-c32980a867c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB50362',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 130099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgf0/0a/f00a4c682cfd8e815bda70e029cb629c/pa/MB50362_6c643875c0a85d837d9d74ec97cbf9b8.jpg',
                'https://img-pa.auto1.com/imgf0/0a/f00a4c682cfd8e815bda70e029cb629c/pa/MB50362_eb10993724a6b76e25493ba94f7cd506.jpg',
                'https://img-pa.auto1.com/imgf0/0a/f00a4c682cfd8e815bda70e029cb629c/pa/MB50362_e459121cfb6b7888a3f03180cfeb1e93.jpg',
                'https://img-pa.auto1.com/imgf0/0a/f00a4c682cfd8e815bda70e029cb629c/pa/MB50362_0c335b0e14552b5113ba20e849049c95.jpg',
                'https://img-pa.auto1.com/imgf0/0a/f00a4c682cfd8e815bda70e029cb629c/pa/MB50362_3ed7ad2dcc4702ecf57bba23201a8f93.jpg',
                'https://img-pa.auto1.com/imgf0/0a/f00a4c682cfd8e815bda70e029cb629c/pa/MB50362_068e2570a20b7c2ab928ecf9bbf9e055.jpg',
                'https://img-pa.auto1.com/imgf0/0a/f00a4c682cfd8e815bda70e029cb629c/pa/MB50362_56f6d3f2d5da6ec5710c93befd35109e.jpg',
                'https://img-pa.auto1.com/imgf0/0a/f00a4c682cfd8e815bda70e029cb629c/pa/MB50362_d96ed6b1f7adff5040b8cc2a3c739326.jpg',
                'https://img-pa.auto1.com/imgf0/0a/f00a4c682cfd8e815bda70e029cb629c/pa/MB50362_60f61bd26a876a271ebba09402a801c2.jpg',
                'https://img-pa.auto1.com/imgf0/0a/f00a4c682cfd8e815bda70e029cb629c/pa/MB50362_7851b83bf8350b7a491cd59f80fe1ed7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ee7d5c7-cff2-5eb2-9713-c32980a867c4/2ee7d5c7-cff2-5eb2-9713-c32980a867c4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/0a/f00a4c682cfd8e815bda70e029cb629c/pa/MB50362_6c643875c0a85d837d9d74ec97cbf9b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ee7d5c7-cff2-5eb2-9713-c32980a867c4/2ee7d5c7-cff2-5eb2-9713-c32980a867c4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/0a/f00a4c682cfd8e815bda70e029cb629c/pa/MB50362_eb10993724a6b76e25493ba94f7cd506.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ee7d5c7-cff2-5eb2-9713-c32980a867c4/2ee7d5c7-cff2-5eb2-9713-c32980a867c4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100229,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/0a/f00a4c682cfd8e815bda70e029cb629c/pa/MB50362_e459121cfb6b7888a3f03180cfeb1e93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ee7d5c7-cff2-5eb2-9713-c32980a867c4/2ee7d5c7-cff2-5eb2-9713-c32980a867c4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/0a/f00a4c682cfd8e815bda70e029cb629c/pa/MB50362_0c335b0e14552b5113ba20e849049c95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ee7d5c7-cff2-5eb2-9713-c32980a867c4/2ee7d5c7-cff2-5eb2-9713-c32980a867c4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/0a/f00a4c682cfd8e815bda70e029cb629c/pa/MB50362_3ed7ad2dcc4702ecf57bba23201a8f93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ee7d5c7-cff2-5eb2-9713-c32980a867c4/2ee7d5c7-cff2-5eb2-9713-c32980a867c4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/0a/f00a4c682cfd8e815bda70e029cb629c/pa/MB50362_068e2570a20b7c2ab928ecf9bbf9e055.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ee7d5c7-cff2-5eb2-9713-c32980a867c4/2ee7d5c7-cff2-5eb2-9713-c32980a867c4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/0a/f00a4c682cfd8e815bda70e029cb629c/pa/MB50362_56f6d3f2d5da6ec5710c93befd35109e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ee7d5c7-cff2-5eb2-9713-c32980a867c4/2ee7d5c7-cff2-5eb2-9713-c32980a867c4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/0a/f00a4c682cfd8e815bda70e029cb629c/pa/MB50362_d96ed6b1f7adff5040b8cc2a3c739326.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ee7d5c7-cff2-5eb2-9713-c32980a867c4/2ee7d5c7-cff2-5eb2-9713-c32980a867c4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/0a/f00a4c682cfd8e815bda70e029cb629c/pa/MB50362_60f61bd26a876a271ebba09402a801c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ee7d5c7-cff2-5eb2-9713-c32980a867c4/2ee7d5c7-cff2-5eb2-9713-c32980a867c4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/0a/f00a4c682cfd8e815bda70e029cb629c/pa/MB50362_7851b83bf8350b7a491cd59f80fe1ed7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2020}
2026-03-29 08:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB50362%27 HTTP/1.1" 200 None
2026-03-29 08:34:07 [auto1.be] INFO: Saving data for MB50362: {'created_time': 1774773247.278138, 'last_price_update_time': 1774773247.27815, 'auction_closing_time': 1774883413.0}
2026-03-29 08:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MB50362') HTTP/1.1" 204 0
2026-03-29 08:34:07 [scrapy.extensions.logstats] INFO: Crawled 21 pages (at 10 pages/min), scraped 18 items (at 7 items/min)
2026-03-29 08:34:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 158MiB
2026-03-29 08:34:48 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 263.050(s), this was the 2nd time calling it.
2026-03-29 08:34:48 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.676515621459415 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 08:34:50 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 267.756(s), this was the 2nd time calling it.
2026-03-29 08:34:50 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.968854698513921 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 08:34:50 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 267.892(s), this was the 2nd time calling it.
2026-03-29 08:34:50 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.248309841526961 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 08:34:54 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 266.425(s), this was the 2nd time calling it.
2026-03-29 08:34:54 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.2722938025645165 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 08:34:54 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 267.633(s), this was the 2nd time calling it.
2026-03-29 08:34:54 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.33132074441707 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-29 08:34:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-29 08:34:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VR58028> (referer: https://www.auto1.com/v1/car-details-view/VR58028/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:34:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf912a50-820d-5ba2-91dc-af58d9f2e9f1 with identifier: VR58028
2026-03-29 08:34:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf912a50-820d-5ba2-91dc-af58d9f2e9f1 with scrape type 1
2026-03-29 08:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bf912a50-820d-5ba2-91dc-af58d9f2e9f1
2026-03-29 08:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fd8%252F17d88a96fbadfe88f9df5a3e37c9e351%252Fpa%252FVR58028_950112e5b92ca135a7f7dc9b9e2e50ff.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/d8/17d88a96fbadfe88f9df5a3e37c9e351/pa/VR58028_950112e5b92ca135a7f7dc9b9e2e50ff.jpg already downloaded
2026-03-29 08:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fd8%252F17d88a96fbadfe88f9df5a3e37c9e351%252Fpa%252FVR58028_7ecef605ab6d8aff4cbcc9c81280d366.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/d8/17d88a96fbadfe88f9df5a3e37c9e351/pa/VR58028_7ecef605ab6d8aff4cbcc9c81280d366.jpg already downloaded
2026-03-29 08:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fd8%252F17d88a96fbadfe88f9df5a3e37c9e351%252Fpa%252FVR58028_5f2e7bf715ed9390b66ab3494edad087.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/d8/17d88a96fbadfe88f9df5a3e37c9e351/pa/VR58028_5f2e7bf715ed9390b66ab3494edad087.jpg already downloaded
2026-03-29 08:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fd8%252F17d88a96fbadfe88f9df5a3e37c9e351%252Fpa%252FVR58028_b63af33182c33aa57694a0a885810739.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/d8/17d88a96fbadfe88f9df5a3e37c9e351/pa/VR58028_b63af33182c33aa57694a0a885810739.jpg already downloaded
2026-03-29 08:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fd8%252F17d88a96fbadfe88f9df5a3e37c9e351%252Fpa%252FVR58028_535567bf3bb37e8ed1014e56f6ac66d9.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/d8/17d88a96fbadfe88f9df5a3e37c9e351/pa/VR58028_535567bf3bb37e8ed1014e56f6ac66d9.jpg already downloaded
2026-03-29 08:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fd8%252F17d88a96fbadfe88f9df5a3e37c9e351%252Fpa%252FVR58028_4b15112f30ddb0d85fa63c4a13a41e46.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/d8/17d88a96fbadfe88f9df5a3e37c9e351/pa/VR58028_4b15112f30ddb0d85fa63c4a13a41e46.jpg already downloaded
2026-03-29 08:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fd8%252F17d88a96fbadfe88f9df5a3e37c9e351%252Fpa%252FVR58028_80444f9fa7a10a41284f0db792d38062.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/d8/17d88a96fbadfe88f9df5a3e37c9e351/pa/VR58028_80444f9fa7a10a41284f0db792d38062.jpg already downloaded
2026-03-29 08:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fd8%252F17d88a96fbadfe88f9df5a3e37c9e351%252Fpa%252FVR58028_930f3782a1fcacf2f8d3c3a78ed21d6d.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/d8/17d88a96fbadfe88f9df5a3e37c9e351/pa/VR58028_930f3782a1fcacf2f8d3c3a78ed21d6d.jpg already downloaded
2026-03-29 08:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fd8%252F17d88a96fbadfe88f9df5a3e37c9e351%252Fpa%252FVR58028_6632168d8c1731902d6b5e6cd39701ae.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/d8/17d88a96fbadfe88f9df5a3e37c9e351/pa/VR58028_6632168d8c1731902d6b5e6cd39701ae.jpg already downloaded
2026-03-29 08:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252Fd8%252F17d88a96fbadfe88f9df5a3e37c9e351%252Fpa%252FVR58028_82fbe66bb9395ffdd16a1265477b3e8b.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/d8/17d88a96fbadfe88f9df5a3e37c9e351/pa/VR58028_82fbe66bb9395ffdd16a1265477b3e8b.jpg already downloaded
2026-03-29 08:34:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bf912a50-820d-5ba2-91dc-af58d9f2e9f1, identifier: VR58028
2026-03-29 08:34:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bf912a50-820d-5ba2-91dc-af58d9f2e9f1 with identifier: VR58028
2026-03-29 08:34:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bf912a50-820d-5ba2-91dc-af58d9f2e9f1 with identifier: VR58028
2026-03-29 08:34:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bf912a50-820d-5ba2-91dc-af58d9f2e9f1 with identifier: VR58028 to the API
2026-03-29 08:34:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:34:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:34:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VR58028>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.6L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:33:52Z',
 'fuel_type': 'petrol',
 'id': 'bf912a50-820d-5ba2-91dc-af58d9f2e9f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR58028',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 75297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img17/d8/17d88a96fbadfe88f9df5a3e37c9e351/pa/VR58028_950112e5b92ca135a7f7dc9b9e2e50ff.jpg',
                'https://img-pa.auto1.com/img17/d8/17d88a96fbadfe88f9df5a3e37c9e351/pa/VR58028_7ecef605ab6d8aff4cbcc9c81280d366.jpg',
                'https://img-pa.auto1.com/img17/d8/17d88a96fbadfe88f9df5a3e37c9e351/pa/VR58028_5f2e7bf715ed9390b66ab3494edad087.jpg',
                'https://img-pa.auto1.com/img17/d8/17d88a96fbadfe88f9df5a3e37c9e351/pa/VR58028_b63af33182c33aa57694a0a885810739.jpg',
                'https://img-pa.auto1.com/img17/d8/17d88a96fbadfe88f9df5a3e37c9e351/pa/VR58028_535567bf3bb37e8ed1014e56f6ac66d9.jpg',
                'https://img-pa.auto1.com/img17/d8/17d88a96fbadfe88f9df5a3e37c9e351/pa/VR58028_4b15112f30ddb0d85fa63c4a13a41e46.jpg',
                'https://img-pa.auto1.com/img17/d8/17d88a96fbadfe88f9df5a3e37c9e351/pa/VR58028_80444f9fa7a10a41284f0db792d38062.jpg',
                'https://img-pa.auto1.com/img17/d8/17d88a96fbadfe88f9df5a3e37c9e351/pa/VR58028_930f3782a1fcacf2f8d3c3a78ed21d6d.jpg',
                'https://img-pa.auto1.com/img17/d8/17d88a96fbadfe88f9df5a3e37c9e351/pa/VR58028_6632168d8c1731902d6b5e6cd39701ae.jpg',
                'https://img-pa.auto1.com/img17/d8/17d88a96fbadfe88f9df5a3e37c9e351/pa/VR58028_82fbe66bb9395ffdd16a1265477b3e8b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf912a50-820d-5ba2-91dc-af58d9f2e9f1/bf912a50-820d-5ba2-91dc-af58d9f2e9f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/d8/17d88a96fbadfe88f9df5a3e37c9e351/pa/VR58028_950112e5b92ca135a7f7dc9b9e2e50ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf912a50-820d-5ba2-91dc-af58d9f2e9f1/bf912a50-820d-5ba2-91dc-af58d9f2e9f1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/d8/17d88a96fbadfe88f9df5a3e37c9e351/pa/VR58028_7ecef605ab6d8aff4cbcc9c81280d366.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf912a50-820d-5ba2-91dc-af58d9f2e9f1/bf912a50-820d-5ba2-91dc-af58d9f2e9f1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/d8/17d88a96fbadfe88f9df5a3e37c9e351/pa/VR58028_5f2e7bf715ed9390b66ab3494edad087.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf912a50-820d-5ba2-91dc-af58d9f2e9f1/bf912a50-820d-5ba2-91dc-af58d9f2e9f1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56773,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/d8/17d88a96fbadfe88f9df5a3e37c9e351/pa/VR58028_b63af33182c33aa57694a0a885810739.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf912a50-820d-5ba2-91dc-af58d9f2e9f1/bf912a50-820d-5ba2-91dc-af58d9f2e9f1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/d8/17d88a96fbadfe88f9df5a3e37c9e351/pa/VR58028_535567bf3bb37e8ed1014e56f6ac66d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf912a50-820d-5ba2-91dc-af58d9f2e9f1/bf912a50-820d-5ba2-91dc-af58d9f2e9f1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/d8/17d88a96fbadfe88f9df5a3e37c9e351/pa/VR58028_4b15112f30ddb0d85fa63c4a13a41e46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf912a50-820d-5ba2-91dc-af58d9f2e9f1/bf912a50-820d-5ba2-91dc-af58d9f2e9f1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/d8/17d88a96fbadfe88f9df5a3e37c9e351/pa/VR58028_80444f9fa7a10a41284f0db792d38062.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf912a50-820d-5ba2-91dc-af58d9f2e9f1/bf912a50-820d-5ba2-91dc-af58d9f2e9f1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/d8/17d88a96fbadfe88f9df5a3e37c9e351/pa/VR58028_930f3782a1fcacf2f8d3c3a78ed21d6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf912a50-820d-5ba2-91dc-af58d9f2e9f1/bf912a50-820d-5ba2-91dc-af58d9f2e9f1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/d8/17d88a96fbadfe88f9df5a3e37c9e351/pa/VR58028_6632168d8c1731902d6b5e6cd39701ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf912a50-820d-5ba2-91dc-af58d9f2e9f1/bf912a50-820d-5ba2-91dc-af58d9f2e9f1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/d8/17d88a96fbadfe88f9df5a3e37c9e351/pa/VR58028_82fbe66bb9395ffdd16a1265477b3e8b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 AMG Line',
 'transmission': 'manual',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-29 08:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VR58028%27 HTTP/1.1" 200 None
2026-03-29 08:34:58 [auto1.be] INFO: Saving data for VR58028: {'created_time': 1774773298.339036, 'last_price_update_time': 1774773298.339046, 'auction_closing_time': 1774884832.0}
2026-03-29 08:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VR58028') HTTP/1.1" 204 0
2026-03-29 08:34:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-29 08:34:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-29 08:34:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:34:59 [auto1.be] INFO: Channel: 24h | Page: 2 | totalHits: 1252 | hits on page: 40
2026-03-29 08:34:59 [auto1.be] INFO: Found listing with ID: MH83966
2026-03-29 08:34:59 [auto1.be] INFO: Found listing with ID: DE26055
2026-03-29 08:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE26055%27 HTTP/1.1" 200 None
2026-03-29 08:34:59 [auto1.be] INFO: Scrape type for DE26055: 1
2026-03-29 08:34:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:34:59 [auto1.be] INFO: Found listing with ID: AD76625
2026-03-29 08:34:59 [auto1.be] INFO: Found listing with ID: ET26989
2026-03-29 08:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET26989%27 HTTP/1.1" 200 None
2026-03-29 08:34:59 [auto1.be] INFO: Scrape type for ET26989: 1
2026-03-29 08:34:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:34:59 [auto1.be] INFO: Found listing with ID: PF75414
2026-03-29 08:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF75414%27 HTTP/1.1" 200 None
2026-03-29 08:34:59 [auto1.be] INFO: Scrape type for PF75414: 1
2026-03-29 08:34:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:34:59 [auto1.be] INFO: Found listing with ID: WZ74297
2026-03-29 08:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WZ74297%27 HTTP/1.1" 200 None
2026-03-29 08:34:59 [auto1.be] INFO: Scrape type for WZ74297: 1
2026-03-29 08:34:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:34:59 [auto1.be] INFO: Found listing with ID: KR32592
2026-03-29 08:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KR32592%27 HTTP/1.1" 200 None
2026-03-29 08:34:59 [auto1.be] INFO: Scrape type for KR32592: 2
2026-03-29 08:34:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 703f2f46-f56c-59ff-96af-31a1c1f2ea69 with identifier: KR32592
2026-03-29 08:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 703f2f46-f56c-59ff-96af-31a1c1f2ea69 with scrape type 2
2026-03-29 08:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 703f2f46-f56c-59ff-96af-31a1c1f2ea69 with scrape type 2
2026-03-29 08:34:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 703f2f46-f56c-59ff-96af-31a1c1f2ea69, identifier: KR32592
2026-03-29 08:34:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 703f2f46-f56c-59ff-96af-31a1c1f2ea69 with identifier: KR32592
2026-03-29 08:34:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 703f2f46-f56c-59ff-96af-31a1c1f2ea69 with identifier: KR32592
2026-03-29 08:34:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 703f2f46-f56c-59ff-96af-31a1c1f2ea69 with identifier: KR32592 to the API
2026-03-29 08:34:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:25:33Z',
 'fuel_type': 'diesel',
 'id': '703f2f46-f56c-59ff-96af-31a1c1f2ea69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR32592',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 191574,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-05',
 'seller_name': None,
 'title': 'Opel Meriva 1.3 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2008}
2026-03-29 08:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KR32592%27 HTTP/1.1" 200 None
2026-03-29 08:35:00 [auto1.be] INFO: Saving data for KR32592: {'auction_closing_time': 1774884333.0, 'created_time': 1773834369.162697, 'last_price_update_time': 1774773300.234688}
2026-03-29 08:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KR32592') HTTP/1.1" 204 0
2026-03-29 08:35:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:00 [auto1.be] INFO: Found listing with ID: WU68692
2026-03-29 08:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU68692%27 HTTP/1.1" 200 None
2026-03-29 08:35:00 [auto1.be] INFO: Scrape type for WU68692: 2
2026-03-29 08:35:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6815ca9d-4068-5b1e-bccc-ae236f2d2599 with identifier: WU68692
2026-03-29 08:35:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6815ca9d-4068-5b1e-bccc-ae236f2d2599 with scrape type 2
2026-03-29 08:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6815ca9d-4068-5b1e-bccc-ae236f2d2599 with scrape type 2
2026-03-29 08:35:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6815ca9d-4068-5b1e-bccc-ae236f2d2599, identifier: WU68692
2026-03-29 08:35:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6815ca9d-4068-5b1e-bccc-ae236f2d2599 with identifier: WU68692
2026-03-29 08:35:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6815ca9d-4068-5b1e-bccc-ae236f2d2599 with identifier: WU68692
2026-03-29 08:35:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6815ca9d-4068-5b1e-bccc-ae236f2d2599 with identifier: WU68692 to the API
2026-03-29 08:35:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:47:13Z',
 'fuel_type': 'petrol',
 'id': '6815ca9d-4068-5b1e-bccc-ae236f2d2599',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU68692',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Alto',
 'odometer': 236106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-10',
 'seller_name': None,
 'title': 'Suzuki Alto 1.0 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2010}
2026-03-29 08:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU68692%27 HTTP/1.1" 200 None
2026-03-29 08:35:00 [auto1.be] INFO: Saving data for WU68692: {'auction_closing_time': 1774885633.0, 'created_time': 1773866553.713628, 'last_price_update_time': 1774773300.655501}
2026-03-29 08:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WU68692') HTTP/1.1" 204 0
2026-03-29 08:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NE45749/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:00 [auto1.be] INFO: Found listing with ID: HX23250
2026-03-29 08:35:00 [auto1.be] INFO: Found listing with ID: DH89229
2026-03-29 08:35:00 [auto1.be] INFO: Found listing with ID: UZ99297
2026-03-29 08:35:00 [auto1.be] INFO: Found listing with ID: DZ79289
2026-03-29 08:35:00 [auto1.be] INFO: Found listing with ID: DX83468
2026-03-29 08:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DX83468%27 HTTP/1.1" 200 None
2026-03-29 08:35:00 [auto1.be] INFO: Scrape type for DX83468: 2
2026-03-29 08:35:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f8c4335-1e3a-59bc-adee-722b26e208c9 with identifier: DX83468
2026-03-29 08:35:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f8c4335-1e3a-59bc-adee-722b26e208c9 with scrape type 2
2026-03-29 08:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f8c4335-1e3a-59bc-adee-722b26e208c9 with scrape type 2
2026-03-29 08:35:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1f8c4335-1e3a-59bc-adee-722b26e208c9, identifier: DX83468
2026-03-29 08:35:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1f8c4335-1e3a-59bc-adee-722b26e208c9 with identifier: DX83468
2026-03-29 08:35:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1f8c4335-1e3a-59bc-adee-722b26e208c9 with identifier: DX83468
2026-03-29 08:35:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1f8c4335-1e3a-59bc-adee-722b26e208c9 with identifier: DX83468 to the API
2026-03-29 08:35:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:49:18Z',
 'fuel_type': 'diesel',
 'id': '1f8c4335-1e3a-59bc-adee-722b26e208c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX83468',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Tigra',
 'odometer': 181964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-07',
 'seller_name': None,
 'title': 'Opel Tigra 1.3 CDTI Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2007}
2026-03-29 08:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DX83468%27 HTTP/1.1" 200 None
2026-03-29 08:35:01 [auto1.be] INFO: Saving data for DX83468: {'auction_closing_time': 1774885758.0, 'created_time': 1774557159.699622, 'last_price_update_time': 1774773301.07981}
2026-03-29 08:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DX83468') HTTP/1.1" 204 0
2026-03-29 08:35:01 [auto1.be] INFO: Found listing with ID: EP64027
2026-03-29 08:35:01 [auto1.be] INFO: Found listing with ID: ZY04103
2026-03-29 08:35:01 [auto1.be] INFO: Found listing with ID: UR96395
2026-03-29 08:35:01 [auto1.be] INFO: Found listing with ID: SD20873
2026-03-29 08:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD20873%27 HTTP/1.1" 200 None
2026-03-29 08:35:01 [auto1.be] INFO: Scrape type for SD20873: 2
2026-03-29 08:35:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a377605a-c058-5b4f-99e8-896e420b40df with identifier: SD20873
2026-03-29 08:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a377605a-c058-5b4f-99e8-896e420b40df with scrape type 2
2026-03-29 08:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a377605a-c058-5b4f-99e8-896e420b40df with scrape type 2
2026-03-29 08:35:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a377605a-c058-5b4f-99e8-896e420b40df, identifier: SD20873
2026-03-29 08:35:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a377605a-c058-5b4f-99e8-896e420b40df with identifier: SD20873
2026-03-29 08:35:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a377605a-c058-5b4f-99e8-896e420b40df with identifier: SD20873
2026-03-29 08:35:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a377605a-c058-5b4f-99e8-896e420b40df with identifier: SD20873 to the API
2026-03-29 08:35:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:22:22Z',
 'fuel_type': 'diesel',
 'id': 'a377605a-c058-5b4f-99e8-896e420b40df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD20873',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 144987,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-03-16',
 'seller_name': None,
 'title': 'Opel Zafira 2.0 DTI Basis',
 'transmission': 'automatic',
 'trim': 'Basis',
 'year': 2003}
2026-03-29 08:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD20873%27 HTTP/1.1" 200 None
2026-03-29 08:35:01 [auto1.be] INFO: Saving data for SD20873: {'auction_closing_time': 1774884142.0, 'created_time': 1774470971.15276, 'last_price_update_time': 1774773301.641171}
2026-03-29 08:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SD20873') HTTP/1.1" 204 0
2026-03-29 08:35:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-29 08:35:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-03-29 08:35:01 [auto1.be] INFO: Found listing with ID: EN78807
2026-03-29 08:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN78807%27 HTTP/1.1" 200 None
2026-03-29 08:35:01 [auto1.be] INFO: Scrape type for EN78807: 1
2026-03-29 08:35:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:01 [auto1.be] INFO: Found listing with ID: PZ32696
2026-03-29 08:35:01 [auto1.be] INFO: Found listing with ID: SD10160
2026-03-29 08:35:01 [auto1.be] INFO: Found listing with ID: YA34487
2026-03-29 08:35:01 [auto1.be] INFO: Found listing with ID: RC41327
2026-03-29 08:35:01 [auto1.be] INFO: Found listing with ID: BL31735
2026-03-29 08:35:01 [auto1.be] INFO: Found listing with ID: PJ34917
2026-03-29 08:35:01 [auto1.be] INFO: Found listing with ID: TM16461
2026-03-29 08:35:01 [auto1.be] INFO: Found listing with ID: PC06950
2026-03-29 08:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC06950%27 HTTP/1.1" 200 None
2026-03-29 08:35:01 [auto1.be] INFO: Scrape type for PC06950: 2
2026-03-29 08:35:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 648b6b51-4eac-5af1-9292-9a719642bc7d with identifier: PC06950
2026-03-29 08:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 648b6b51-4eac-5af1-9292-9a719642bc7d with scrape type 2
2026-03-29 08:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 648b6b51-4eac-5af1-9292-9a719642bc7d with scrape type 2
2026-03-29 08:35:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 648b6b51-4eac-5af1-9292-9a719642bc7d, identifier: PC06950
2026-03-29 08:35:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 648b6b51-4eac-5af1-9292-9a719642bc7d with identifier: PC06950
2026-03-29 08:35:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 648b6b51-4eac-5af1-9292-9a719642bc7d with identifier: PC06950
2026-03-29 08:35:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 648b6b51-4eac-5af1-9292-9a719642bc7d with identifier: PC06950 to the API
2026-03-29 08:35:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 55,
 'expiration_date': '2026-03-30T15:32:41Z',
 'fuel_type': 'petrol',
 'id': '648b6b51-4eac-5af1-9292-9a719642bc7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC06950',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Seicento',
 'odometer': 69680,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-12-16',
 'seller_name': None,
 'title': 'Fiat Seicento 1.1 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2002}
2026-03-29 08:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC06950%27 HTTP/1.1" 200 None
2026-03-29 08:35:02 [auto1.be] INFO: Saving data for PC06950: {'auction_closing_time': 1774884761.0, 'created_time': 1774643596.097313, 'last_price_update_time': 1774773302.139333}
2026-03-29 08:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PC06950') HTTP/1.1" 204 0
2026-03-29 08:35:02 [auto1.be] INFO: Found listing with ID: JN34238
2026-03-29 08:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JN34238%27 HTTP/1.1" 200 None
2026-03-29 08:35:02 [auto1.be] INFO: Scrape type for JN34238: 2
2026-03-29 08:35:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a16dee46-3c6b-5250-b941-c1842c6f1538 with identifier: JN34238
2026-03-29 08:35:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a16dee46-3c6b-5250-b941-c1842c6f1538 with scrape type 2
2026-03-29 08:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a16dee46-3c6b-5250-b941-c1842c6f1538 with scrape type 2
2026-03-29 08:35:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a16dee46-3c6b-5250-b941-c1842c6f1538, identifier: JN34238
2026-03-29 08:35:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a16dee46-3c6b-5250-b941-c1842c6f1538 with identifier: JN34238
2026-03-29 08:35:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a16dee46-3c6b-5250-b941-c1842c6f1538 with identifier: JN34238
2026-03-29 08:35:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a16dee46-3c6b-5250-b941-c1842c6f1538 with identifier: JN34238 to the API
2026-03-29 08:35:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:45:18Z',
 'fuel_type': 'diesel',
 'id': 'a16dee46-3c6b-5250-b941-c1842c6f1538',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN34238',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 252589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-09',
 'seller_name': None,
 'title': 'Opel Astra 1.7 CDTI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-03-29 08:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JN34238%27 HTTP/1.1" 200 None
2026-03-29 08:35:02 [auto1.be] INFO: Saving data for JN34238: {'auction_closing_time': 1774885518.0, 'created_time': 1773237973.441181, 'last_price_update_time': 1774773302.638954}
2026-03-29 08:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JN34238') HTTP/1.1" 204 0
2026-03-29 08:35:02 [auto1.be] INFO: Found listing with ID: KD33371
2026-03-29 08:35:02 [auto1.be] INFO: Found listing with ID: ZM02853
2026-03-29 08:35:02 [auto1.be] INFO: Found listing with ID: ZC87174
2026-03-29 08:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC87174%27 HTTP/1.1" 200 None
2026-03-29 08:35:02 [auto1.be] INFO: Scrape type for ZC87174: 2
2026-03-29 08:35:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1da2ecfb-0357-5a49-a64a-3f5fff6d28b4 with identifier: ZC87174
2026-03-29 08:35:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1da2ecfb-0357-5a49-a64a-3f5fff6d28b4 with scrape type 2
2026-03-29 08:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1da2ecfb-0357-5a49-a64a-3f5fff6d28b4 with scrape type 2
2026-03-29 08:35:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1da2ecfb-0357-5a49-a64a-3f5fff6d28b4, identifier: ZC87174
2026-03-29 08:35:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1da2ecfb-0357-5a49-a64a-3f5fff6d28b4 with identifier: ZC87174
2026-03-29 08:35:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1da2ecfb-0357-5a49-a64a-3f5fff6d28b4 with identifier: ZC87174
2026-03-29 08:35:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1da2ecfb-0357-5a49-a64a-3f5fff6d28b4 with identifier: ZC87174 to the API
2026-03-29 08:35:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:20:48Z',
 'fuel_type': 'diesel',
 'id': '1da2ecfb-0357-5a49-a64a-3f5fff6d28b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC87174',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 199523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-22',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.9 dCi Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2010}
2026-03-29 08:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC87174%27 HTTP/1.1" 200 None
2026-03-29 08:35:03 [auto1.be] INFO: Saving data for ZC87174: {'auction_closing_time': 1774884048.0, 'created_time': 1773301759.801402, 'last_price_update_time': 1774773303.047887}
2026-03-29 08:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZC87174') HTTP/1.1" 204 0
2026-03-29 08:35:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DE26055/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:03 [auto1.be] INFO: Found listing with ID: ZP04877
2026-03-29 08:35:03 [auto1.be] INFO: Found listing with ID: BY53413
2026-03-29 08:35:03 [auto1.be] INFO: Found listing with ID: GZ17047
2026-03-29 08:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GZ17047%27 HTTP/1.1" 200 None
2026-03-29 08:35:03 [auto1.be] INFO: Scrape type for GZ17047: 1
2026-03-29 08:35:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PF75414/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ET26989/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WZ74297/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:03 [auto1.be] INFO: Found listing with ID: TN87621
2026-03-29 08:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TN87621%27 HTTP/1.1" 200 None
2026-03-29 08:35:03 [auto1.be] INFO: Scrape type for TN87621: 2
2026-03-29 08:35:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58fa2b00-9f22-5a04-aa15-7dfc862916ba with identifier: TN87621
2026-03-29 08:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58fa2b00-9f22-5a04-aa15-7dfc862916ba with scrape type 2
2026-03-29 08:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58fa2b00-9f22-5a04-aa15-7dfc862916ba with scrape type 2
2026-03-29 08:35:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 58fa2b00-9f22-5a04-aa15-7dfc862916ba, identifier: TN87621
2026-03-29 08:35:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 58fa2b00-9f22-5a04-aa15-7dfc862916ba with identifier: TN87621
2026-03-29 08:35:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 58fa2b00-9f22-5a04-aa15-7dfc862916ba with identifier: TN87621
2026-03-29 08:35:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 58fa2b00-9f22-5a04-aa15-7dfc862916ba with identifier: TN87621 to the API
2026-03-29 08:35:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:40:46Z',
 'fuel_type': 'diesel',
 'id': '58fa2b00-9f22-5a04-aa15-7dfc862916ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN87621',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 245165,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-10',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d BlueTEC AMG Line',
 'transmission': 'automatic',
 'trim': 'BlueTEC AMG Line',
 'year': 2015}
2026-03-29 08:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TN87621%27 HTTP/1.1" 200 None
2026-03-29 08:35:03 [auto1.be] INFO: Saving data for TN87621: {'auction_closing_time': 1774885246.0, 'created_time': 1773693392.714576, 'last_price_update_time': 1774773303.535816}
2026-03-29 08:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TN87621') HTTP/1.1" 204 0
2026-03-29 08:35:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:03 [auto1.be] INFO: Found listing with ID: LY35485
2026-03-29 08:35:03 [auto1.be] INFO: Found listing with ID: DP17314
2026-03-29 08:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP17314%27 HTTP/1.1" 200 None
2026-03-29 08:35:03 [auto1.be] INFO: Scrape type for DP17314: 1
2026-03-29 08:35:03 [auto1.be] INFO: Channel: 24h | Page: 3 | totalHits: 1252 | hits on page: 40
2026-03-29 08:35:03 [auto1.be] INFO: Found listing with ID: KU68109
2026-03-29 08:35:03 [auto1.be] INFO: Found listing with ID: WT61211
2026-03-29 08:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT61211%27 HTTP/1.1" 200 None
2026-03-29 08:35:03 [auto1.be] INFO: Scrape type for WT61211: 2
2026-03-29 08:35:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30daaf8d-606c-5ac5-8040-d105e29dfbfc with identifier: WT61211
2026-03-29 08:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30daaf8d-606c-5ac5-8040-d105e29dfbfc with scrape type 2
2026-03-29 08:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30daaf8d-606c-5ac5-8040-d105e29dfbfc with scrape type 2
2026-03-29 08:35:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 30daaf8d-606c-5ac5-8040-d105e29dfbfc, identifier: WT61211
2026-03-29 08:35:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 30daaf8d-606c-5ac5-8040-d105e29dfbfc with identifier: WT61211
2026-03-29 08:35:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 30daaf8d-606c-5ac5-8040-d105e29dfbfc with identifier: WT61211
2026-03-29 08:35:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 30daaf8d-606c-5ac5-8040-d105e29dfbfc with identifier: WT61211 to the API
2026-03-29 08:35:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:11:57Z',
 'fuel_type': 'diesel',
 'id': '30daaf8d-606c-5ac5-8040-d105e29dfbfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT61211',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 173096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-19',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-29 08:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT61211%27 HTTP/1.1" 200 None
2026-03-29 08:35:04 [auto1.be] INFO: Saving data for WT61211: {'auction_closing_time': 1774883517.0, 'created_time': 1773301688.620937, 'last_price_update_time': 1774773304.021393}
2026-03-29 08:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WT61211') HTTP/1.1" 204 0
2026-03-29 08:35:04 [auto1.be] INFO: Found listing with ID: PH78267
2026-03-29 08:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH78267%27 HTTP/1.1" 200 None
2026-03-29 08:35:04 [auto1.be] INFO: Scrape type for PH78267: 2
2026-03-29 08:35:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4694cb80-4835-5f89-beaf-7a86c80e548b with identifier: PH78267
2026-03-29 08:35:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4694cb80-4835-5f89-beaf-7a86c80e548b with scrape type 2
2026-03-29 08:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4694cb80-4835-5f89-beaf-7a86c80e548b with scrape type 2
2026-03-29 08:35:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4694cb80-4835-5f89-beaf-7a86c80e548b, identifier: PH78267
2026-03-29 08:35:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:04 [auto1.be] INFO: Found listing with ID: RG41014
2026-03-29 08:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RG41014%27 HTTP/1.1" 200 None
2026-03-29 08:35:04 [auto1.be] INFO: Scrape type for RG41014: 1
2026-03-29 08:35:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4694cb80-4835-5f89-beaf-7a86c80e548b with identifier: PH78267
2026-03-29 08:35:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4694cb80-4835-5f89-beaf-7a86c80e548b with identifier: PH78267
2026-03-29 08:35:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4694cb80-4835-5f89-beaf-7a86c80e548b with identifier: PH78267 to the API
2026-03-29 08:35:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:29:45Z',
 'fuel_type': 'diesel',
 'id': '4694cb80-4835-5f89-beaf-7a86c80e548b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH78267',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Epica',
 'odometer': 235028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-26',
 'seller_name': None,
 'title': 'Chevrolet Epica 2.0 Diesel LT',
 'transmission': 'manual',
 'trim': 'LT',
 'year': 2009}
2026-03-29 08:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH78267%27 HTTP/1.1" 200 None
2026-03-29 08:35:04 [auto1.be] INFO: Saving data for PH78267: {'auction_closing_time': 1774884585.0, 'created_time': 1773134610.20965, 'last_price_update_time': 1774773304.653762}
2026-03-29 08:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PH78267') HTTP/1.1" 204 0
2026-03-29 08:35:04 [auto1.be] INFO: Found listing with ID: GA47341
2026-03-29 08:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GA47341%27 HTTP/1.1" 200 None
2026-03-29 08:35:04 [auto1.be] INFO: Scrape type for GA47341: 2
2026-03-29 08:35:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a27f0fab-3eed-589d-aa11-12ad59d32e4b with identifier: GA47341
2026-03-29 08:35:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a27f0fab-3eed-589d-aa11-12ad59d32e4b with scrape type 2
2026-03-29 08:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a27f0fab-3eed-589d-aa11-12ad59d32e4b with scrape type 2
2026-03-29 08:35:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a27f0fab-3eed-589d-aa11-12ad59d32e4b, identifier: GA47341
2026-03-29 08:35:04 [auto1.be] INFO: Found listing with ID: VL25326
2026-03-29 08:35:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a27f0fab-3eed-589d-aa11-12ad59d32e4b with identifier: GA47341
2026-03-29 08:35:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a27f0fab-3eed-589d-aa11-12ad59d32e4b with identifier: GA47341
2026-03-29 08:35:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a27f0fab-3eed-589d-aa11-12ad59d32e4b with identifier: GA47341 to the API
2026-03-29 08:35:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:10:55Z',
 'fuel_type': 'petrol',
 'id': 'a27f0fab-3eed-589d-aa11-12ad59d32e4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA47341',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Laguna',
 'odometer': 120755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-04',
 'seller_name': None,
 'title': 'Renault Laguna 1.6 Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2007}
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GA47341%27 HTTP/1.1" 200 None
2026-03-29 08:35:05 [auto1.be] INFO: Saving data for GA47341: {'auction_closing_time': 1774883455.0, 'created_time': 1773434262.121472, 'last_price_update_time': 1774773305.108288}
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GA47341') HTTP/1.1" 204 0
2026-03-29 08:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NE45749> (referer: https://www.auto1.com/v1/car-details-view/NE45749/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ST41989> (referer: https://www.auto1.com/v1/car-details-view/ST41989/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:05 [auto1.be] INFO: Found listing with ID: NL54460
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NL54460%27 HTTP/1.1" 200 None
2026-03-29 08:35:05 [auto1.be] INFO: Scrape type for NL54460: 2
2026-03-29 08:35:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8029a219-edc3-5dfa-a882-0238d604fcb2 with identifier: NL54460
2026-03-29 08:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8029a219-edc3-5dfa-a882-0238d604fcb2 with scrape type 2
2026-03-29 08:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8029a219-edc3-5dfa-a882-0238d604fcb2 with scrape type 2
2026-03-29 08:35:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8029a219-edc3-5dfa-a882-0238d604fcb2, identifier: NL54460
2026-03-29 08:35:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XD29708/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8029a219-edc3-5dfa-a882-0238d604fcb2 with identifier: NL54460
2026-03-29 08:35:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8029a219-edc3-5dfa-a882-0238d604fcb2 with identifier: NL54460
2026-03-29 08:35:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8029a219-edc3-5dfa-a882-0238d604fcb2 with identifier: NL54460 to the API
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:18:10Z',
 'fuel_type': 'diesel',
 'id': '8029a219-edc3-5dfa-a882-0238d604fcb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL54460',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 136920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-13',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBlue TDCi Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2020}
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NL54460%27 HTTP/1.1" 200 None
2026-03-29 08:35:05 [auto1.be] INFO: Saving data for NL54460: {'auction_closing_time': 1774883890.0, 'created_time': 1774557097.104965, 'last_price_update_time': 1774773305.579391}
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NL54460') HTTP/1.1" 204 0
2026-03-29 08:35:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:05 [auto1.be] INFO: Found listing with ID: RE30310
2026-03-29 08:35:05 [auto1.be] INFO: Found listing with ID: MM05603
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MM05603%27 HTTP/1.1" 200 None
2026-03-29 08:35:05 [auto1.be] INFO: Scrape type for MM05603: 1
2026-03-29 08:35:05 [auto1.be] INFO: Found listing with ID: MT15926
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MT15926%27 HTTP/1.1" 200 None
2026-03-29 08:35:05 [auto1.be] INFO: Scrape type for MT15926: 2
2026-03-29 08:35:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f50dee16-e552-5d9f-b7a5-69f6c1512996 with identifier: MT15926
2026-03-29 08:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f50dee16-e552-5d9f-b7a5-69f6c1512996 with scrape type 2
2026-03-29 08:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f50dee16-e552-5d9f-b7a5-69f6c1512996 with scrape type 2
2026-03-29 08:35:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f50dee16-e552-5d9f-b7a5-69f6c1512996, identifier: MT15926
2026-03-29 08:35:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af5fb942-e948-5db9-b12d-a17eac615578 with identifier: NE45749
2026-03-29 08:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af5fb942-e948-5db9-b12d-a17eac615578 with scrape type 1
2026-03-29 08:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item af5fb942-e948-5db9-b12d-a17eac615578
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fa5%252F9aa5986ab73697592048c130ecfb98d1%252Fpa%252FNE45749_41f21e0a9c6e521a459ddaae6c031997.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/a5/9aa5986ab73697592048c130ecfb98d1/pa/NE45749_41f21e0a9c6e521a459ddaae6c031997.jpg already downloaded
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fa5%252F9aa5986ab73697592048c130ecfb98d1%252Fpa%252FNE45749_24dffe17f7dfb79c829c9cb0106f8bb7.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/a5/9aa5986ab73697592048c130ecfb98d1/pa/NE45749_24dffe17f7dfb79c829c9cb0106f8bb7.jpg already downloaded
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fa5%252F9aa5986ab73697592048c130ecfb98d1%252Fpa%252FNE45749_0af876003c0005c80b215c39bb12a2d4.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/a5/9aa5986ab73697592048c130ecfb98d1/pa/NE45749_0af876003c0005c80b215c39bb12a2d4.jpg already downloaded
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fa5%252F9aa5986ab73697592048c130ecfb98d1%252Fpa%252FNE45749_a3bd55943c5132c2a9699e02b84827d2.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/a5/9aa5986ab73697592048c130ecfb98d1/pa/NE45749_a3bd55943c5132c2a9699e02b84827d2.jpg already downloaded
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fa5%252F9aa5986ab73697592048c130ecfb98d1%252Fpa%252FNE45749_4439d6cb1f1897ba7e34425d1f213fa7.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/a5/9aa5986ab73697592048c130ecfb98d1/pa/NE45749_4439d6cb1f1897ba7e34425d1f213fa7.jpg already downloaded
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fa5%252F9aa5986ab73697592048c130ecfb98d1%252Fpa%252FNE45749_65c42a9df6b67f0e2f31bcd9fdceec4f.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/a5/9aa5986ab73697592048c130ecfb98d1/pa/NE45749_65c42a9df6b67f0e2f31bcd9fdceec4f.jpg already downloaded
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fa5%252F9aa5986ab73697592048c130ecfb98d1%252Fpa%252FNE45749_eafffe6a48b0d0f37c1c14fdabd2fd2f.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/a5/9aa5986ab73697592048c130ecfb98d1/pa/NE45749_eafffe6a48b0d0f37c1c14fdabd2fd2f.jpg already downloaded
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fa5%252F9aa5986ab73697592048c130ecfb98d1%252Fpa%252FNE45749_efc19dddced750894220039f5efcf07c.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/a5/9aa5986ab73697592048c130ecfb98d1/pa/NE45749_efc19dddced750894220039f5efcf07c.jpg already downloaded
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fa5%252F9aa5986ab73697592048c130ecfb98d1%252Fpa%252FNE45749_45b88d9e18421fbe0bb28980c2a5299d.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/a5/9aa5986ab73697592048c130ecfb98d1/pa/NE45749_45b88d9e18421fbe0bb28980c2a5299d.jpg already downloaded
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252Fa5%252F9aa5986ab73697592048c130ecfb98d1%252Fpa%252FNE45749_103a618feacb6900d892f7eb017d3995.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/a5/9aa5986ab73697592048c130ecfb98d1/pa/NE45749_103a618feacb6900d892f7eb017d3995.jpg already downloaded
2026-03-29 08:35:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: af5fb942-e948-5db9-b12d-a17eac615578, identifier: NE45749
2026-03-29 08:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 443175be-9a03-5576-987a-6e7e3228f843 with identifier: ST41989
2026-03-29 08:35:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 443175be-9a03-5576-987a-6e7e3228f843 with scrape type 1
2026-03-29 08:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 443175be-9a03-5576-987a-6e7e3228f843
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fcf%252Fa9cf95612a194388d0b9a48f04041cda%252Fpa%252FST41989_ac88143f9c612526aeedc7339f4fe76c.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/cf/a9cf95612a194388d0b9a48f04041cda/pa/ST41989_ac88143f9c612526aeedc7339f4fe76c.jpg already downloaded
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fcf%252Fa9cf95612a194388d0b9a48f04041cda%252Fpa%252FST41989_8b5aa6bc28701409bf079dba9719f768.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/cf/a9cf95612a194388d0b9a48f04041cda/pa/ST41989_8b5aa6bc28701409bf079dba9719f768.jpg already downloaded
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fcf%252Fa9cf95612a194388d0b9a48f04041cda%252Fpa%252FST41989_e29c5a8a316b0fb86302879bb5a259aa.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/cf/a9cf95612a194388d0b9a48f04041cda/pa/ST41989_e29c5a8a316b0fb86302879bb5a259aa.jpg already downloaded
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fcf%252Fa9cf95612a194388d0b9a48f04041cda%252Fpa%252FST41989_e1ac965c13e27cb651d69805e17c64c1.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/cf/a9cf95612a194388d0b9a48f04041cda/pa/ST41989_e1ac965c13e27cb651d69805e17c64c1.jpg already downloaded
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fcf%252Fa9cf95612a194388d0b9a48f04041cda%252Fpa%252FST41989_fdbe750cde60acca893a22e6d2182c64.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/cf/a9cf95612a194388d0b9a48f04041cda/pa/ST41989_fdbe750cde60acca893a22e6d2182c64.jpg already downloaded
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fcf%252Fa9cf95612a194388d0b9a48f04041cda%252Fpa%252FST41989_a1b44458a8e683cf4f16e114bf957552.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/cf/a9cf95612a194388d0b9a48f04041cda/pa/ST41989_a1b44458a8e683cf4f16e114bf957552.jpg already downloaded
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fcf%252Fa9cf95612a194388d0b9a48f04041cda%252Fpa%252FST41989_d8ccba12d7e797f663bc4f03cbf13de8.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/cf/a9cf95612a194388d0b9a48f04041cda/pa/ST41989_d8ccba12d7e797f663bc4f03cbf13de8.jpg already downloaded
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fcf%252Fa9cf95612a194388d0b9a48f04041cda%252Fpa%252FST41989_f5119e9d20d697697f02e934985d26e3.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/cf/a9cf95612a194388d0b9a48f04041cda/pa/ST41989_f5119e9d20d697697f02e934985d26e3.jpg already downloaded
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fcf%252Fa9cf95612a194388d0b9a48f04041cda%252Fpa%252FST41989_9ed1df8764eb46a8fd5dfb1f7ef28abd.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/cf/a9cf95612a194388d0b9a48f04041cda/pa/ST41989_9ed1df8764eb46a8fd5dfb1f7ef28abd.jpg already downloaded
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fcf%252Fa9cf95612a194388d0b9a48f04041cda%252Fpa%252FST41989_fdeeb13a9d1db47a6b6172585e243bb5.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/cf/a9cf95612a194388d0b9a48f04041cda/pa/ST41989_fdeeb13a9d1db47a6b6172585e243bb5.jpg already downloaded
2026-03-29 08:35:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 443175be-9a03-5576-987a-6e7e3228f843, identifier: ST41989
2026-03-29 08:35:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f50dee16-e552-5d9f-b7a5-69f6c1512996 with identifier: MT15926
2026-03-29 08:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f50dee16-e552-5d9f-b7a5-69f6c1512996 with identifier: MT15926
2026-03-29 08:35:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f50dee16-e552-5d9f-b7a5-69f6c1512996 with identifier: MT15926 to the API
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:41:39Z',
 'fuel_type': 'diesel',
 'id': 'f50dee16-e552-5d9f-b7a5-69f6c1512996',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT15926',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-02',
 'seller_name': None,
 'title': 'BMW 5er 520d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MT15926%27 HTTP/1.1" 200 None
2026-03-29 08:35:06 [auto1.be] INFO: Saving data for MT15926: {'auction_closing_time': 1774885299.0, 'created_time': 1774557187.930898, 'last_price_update_time': 1774773306.68837}
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MT15926') HTTP/1.1" 204 0
2026-03-29 08:35:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: af5fb942-e948-5db9-b12d-a17eac615578 with identifier: NE45749
2026-03-29 08:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: af5fb942-e948-5db9-b12d-a17eac615578 with identifier: NE45749
2026-03-29 08:35:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: af5fb942-e948-5db9-b12d-a17eac615578 with identifier: NE45749 to the API
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NE45749>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 250,
 'expiration_date': '2026-03-30T15:46:28Z',
 'fuel_type': 'petrol',
 'id': 'af5fb942-e948-5db9-b12d-a17eac615578',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE45749',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 79682,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img9a/a5/9aa5986ab73697592048c130ecfb98d1/pa/NE45749_41f21e0a9c6e521a459ddaae6c031997.jpg',
                'https://img-pa.auto1.com/img9a/a5/9aa5986ab73697592048c130ecfb98d1/pa/NE45749_24dffe17f7dfb79c829c9cb0106f8bb7.jpg',
                'https://img-pa.auto1.com/img9a/a5/9aa5986ab73697592048c130ecfb98d1/pa/NE45749_0af876003c0005c80b215c39bb12a2d4.jpg',
                'https://img-pa.auto1.com/img9a/a5/9aa5986ab73697592048c130ecfb98d1/pa/NE45749_a3bd55943c5132c2a9699e02b84827d2.jpg',
                'https://img-pa.auto1.com/img9a/a5/9aa5986ab73697592048c130ecfb98d1/pa/NE45749_4439d6cb1f1897ba7e34425d1f213fa7.jpg',
                'https://img-pa.auto1.com/img9a/a5/9aa5986ab73697592048c130ecfb98d1/pa/NE45749_65c42a9df6b67f0e2f31bcd9fdceec4f.jpg',
                'https://img-pa.auto1.com/img9a/a5/9aa5986ab73697592048c130ecfb98d1/pa/NE45749_eafffe6a48b0d0f37c1c14fdabd2fd2f.jpg',
                'https://img-pa.auto1.com/img9a/a5/9aa5986ab73697592048c130ecfb98d1/pa/NE45749_efc19dddced750894220039f5efcf07c.jpg',
                'https://img-pa.auto1.com/img9a/a5/9aa5986ab73697592048c130ecfb98d1/pa/NE45749_45b88d9e18421fbe0bb28980c2a5299d.jpg',
                'https://img-pa.auto1.com/img9a/a5/9aa5986ab73697592048c130ecfb98d1/pa/NE45749_103a618feacb6900d892f7eb017d3995.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5fb942-e948-5db9-b12d-a17eac615578/af5fb942-e948-5db9-b12d-a17eac615578_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/a5/9aa5986ab73697592048c130ecfb98d1/pa/NE45749_41f21e0a9c6e521a459ddaae6c031997.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5fb942-e948-5db9-b12d-a17eac615578/af5fb942-e948-5db9-b12d-a17eac615578_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/a5/9aa5986ab73697592048c130ecfb98d1/pa/NE45749_24dffe17f7dfb79c829c9cb0106f8bb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5fb942-e948-5db9-b12d-a17eac615578/af5fb942-e948-5db9-b12d-a17eac615578_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127319,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/a5/9aa5986ab73697592048c130ecfb98d1/pa/NE45749_0af876003c0005c80b215c39bb12a2d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5fb942-e948-5db9-b12d-a17eac615578/af5fb942-e948-5db9-b12d-a17eac615578_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/a5/9aa5986ab73697592048c130ecfb98d1/pa/NE45749_a3bd55943c5132c2a9699e02b84827d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5fb942-e948-5db9-b12d-a17eac615578/af5fb942-e948-5db9-b12d-a17eac615578_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/a5/9aa5986ab73697592048c130ecfb98d1/pa/NE45749_4439d6cb1f1897ba7e34425d1f213fa7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5fb942-e948-5db9-b12d-a17eac615578/af5fb942-e948-5db9-b12d-a17eac615578_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132005,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/a5/9aa5986ab73697592048c130ecfb98d1/pa/NE45749_65c42a9df6b67f0e2f31bcd9fdceec4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5fb942-e948-5db9-b12d-a17eac615578/af5fb942-e948-5db9-b12d-a17eac615578_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/a5/9aa5986ab73697592048c130ecfb98d1/pa/NE45749_eafffe6a48b0d0f37c1c14fdabd2fd2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5fb942-e948-5db9-b12d-a17eac615578/af5fb942-e948-5db9-b12d-a17eac615578_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/a5/9aa5986ab73697592048c130ecfb98d1/pa/NE45749_efc19dddced750894220039f5efcf07c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5fb942-e948-5db9-b12d-a17eac615578/af5fb942-e948-5db9-b12d-a17eac615578_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/a5/9aa5986ab73697592048c130ecfb98d1/pa/NE45749_45b88d9e18421fbe0bb28980c2a5299d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af5fb942-e948-5db9-b12d-a17eac615578/af5fb942-e948-5db9-b12d-a17eac615578_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/a5/9aa5986ab73697592048c130ecfb98d1/pa/NE45749_103a618feacb6900d892f7eb017d3995.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 2.0 EcoBoost ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2017}
2026-03-29 08:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE45749%27 HTTP/1.1" 200 None
2026-03-29 08:35:07 [auto1.be] INFO: Saving data for NE45749: {'created_time': 1774773307.07252, 'last_price_update_time': 1774773307.072531, 'auction_closing_time': 1774885588.0}
2026-03-29 08:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NE45749') HTTP/1.1" 204 0
2026-03-29 08:35:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 443175be-9a03-5576-987a-6e7e3228f843 with identifier: ST41989
2026-03-29 08:35:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 443175be-9a03-5576-987a-6e7e3228f843 with identifier: ST41989
2026-03-29 08:35:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 443175be-9a03-5576-987a-6e7e3228f843 with identifier: ST41989 to the API
2026-03-29 08:35:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ST41989>
{'auction_title': '',
 'c_o_2_emission_value': 78,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '3.0L',
 'engine_horse_power': 442,
 'expiration_date': '2026-03-30T15:00:37Z',
 'fuel_type': 'hybrid',
 'id': '443175be-9a03-5576-987a-6e7e3228f843',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST41989',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 140699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imga9/cf/a9cf95612a194388d0b9a48f04041cda/pa/ST41989_ac88143f9c612526aeedc7339f4fe76c.jpg',
                'https://img-pa.auto1.com/imga9/cf/a9cf95612a194388d0b9a48f04041cda/pa/ST41989_8b5aa6bc28701409bf079dba9719f768.jpg',
                'https://img-pa.auto1.com/imga9/cf/a9cf95612a194388d0b9a48f04041cda/pa/ST41989_e29c5a8a316b0fb86302879bb5a259aa.jpg',
                'https://img-pa.auto1.com/imga9/cf/a9cf95612a194388d0b9a48f04041cda/pa/ST41989_e1ac965c13e27cb651d69805e17c64c1.jpg',
                'https://img-pa.auto1.com/imga9/cf/a9cf95612a194388d0b9a48f04041cda/pa/ST41989_fdbe750cde60acca893a22e6d2182c64.jpg',
                'https://img-pa.auto1.com/imga9/cf/a9cf95612a194388d0b9a48f04041cda/pa/ST41989_a1b44458a8e683cf4f16e114bf957552.jpg',
                'https://img-pa.auto1.com/imga9/cf/a9cf95612a194388d0b9a48f04041cda/pa/ST41989_d8ccba12d7e797f663bc4f03cbf13de8.jpg',
                'https://img-pa.auto1.com/imga9/cf/a9cf95612a194388d0b9a48f04041cda/pa/ST41989_f5119e9d20d697697f02e934985d26e3.jpg',
                'https://img-pa.auto1.com/imga9/cf/a9cf95612a194388d0b9a48f04041cda/pa/ST41989_9ed1df8764eb46a8fd5dfb1f7ef28abd.jpg',
                'https://img-pa.auto1.com/imga9/cf/a9cf95612a194388d0b9a48f04041cda/pa/ST41989_fdeeb13a9d1db47a6b6172585e243bb5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_443175be-9a03-5576-987a-6e7e3228f843/443175be-9a03-5576-987a-6e7e3228f843_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/cf/a9cf95612a194388d0b9a48f04041cda/pa/ST41989_ac88143f9c612526aeedc7339f4fe76c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_443175be-9a03-5576-987a-6e7e3228f843/443175be-9a03-5576-987a-6e7e3228f843_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/cf/a9cf95612a194388d0b9a48f04041cda/pa/ST41989_8b5aa6bc28701409bf079dba9719f768.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_443175be-9a03-5576-987a-6e7e3228f843/443175be-9a03-5576-987a-6e7e3228f843_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/cf/a9cf95612a194388d0b9a48f04041cda/pa/ST41989_e29c5a8a316b0fb86302879bb5a259aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_443175be-9a03-5576-987a-6e7e3228f843/443175be-9a03-5576-987a-6e7e3228f843_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/cf/a9cf95612a194388d0b9a48f04041cda/pa/ST41989_e1ac965c13e27cb651d69805e17c64c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_443175be-9a03-5576-987a-6e7e3228f843/443175be-9a03-5576-987a-6e7e3228f843_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/cf/a9cf95612a194388d0b9a48f04041cda/pa/ST41989_fdbe750cde60acca893a22e6d2182c64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_443175be-9a03-5576-987a-6e7e3228f843/443175be-9a03-5576-987a-6e7e3228f843_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/cf/a9cf95612a194388d0b9a48f04041cda/pa/ST41989_a1b44458a8e683cf4f16e114bf957552.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_443175be-9a03-5576-987a-6e7e3228f843/443175be-9a03-5576-987a-6e7e3228f843_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/cf/a9cf95612a194388d0b9a48f04041cda/pa/ST41989_d8ccba12d7e797f663bc4f03cbf13de8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_443175be-9a03-5576-987a-6e7e3228f843/443175be-9a03-5576-987a-6e7e3228f843_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75843,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/cf/a9cf95612a194388d0b9a48f04041cda/pa/ST41989_f5119e9d20d697697f02e934985d26e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_443175be-9a03-5576-987a-6e7e3228f843/443175be-9a03-5576-987a-6e7e3228f843_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/cf/a9cf95612a194388d0b9a48f04041cda/pa/ST41989_9ed1df8764eb46a8fd5dfb1f7ef28abd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_443175be-9a03-5576-987a-6e7e3228f843/443175be-9a03-5576-987a-6e7e3228f843_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60771,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/cf/a9cf95612a194388d0b9a48f04041cda/pa/ST41989_fdeeb13a9d1db47a6b6172585e243bb5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 500e 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2017}
2026-03-29 08:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST41989%27 HTTP/1.1" 200 None
2026-03-29 08:35:07 [auto1.be] INFO: Saving data for ST41989: {'created_time': 1774773307.880272, 'last_price_update_time': 1774773307.880282, 'auction_closing_time': 1774882837.0}
2026-03-29 08:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ST41989') HTTP/1.1" 204 0
2026-03-29 08:35:07 [scrapy.extensions.logstats] INFO: Crawled 32 pages (at 11 pages/min), scraped 34 items (at 16 items/min)
2026-03-29 08:35:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 161MiB
2026-03-29 08:35:07 [auto1.be] INFO: Found listing with ID: RR05667
2026-03-29 08:35:07 [auto1.be] INFO: Found listing with ID: RA52713
2026-03-29 08:35:07 [auto1.be] INFO: Found listing with ID: XY08671
2026-03-29 08:35:07 [auto1.be] INFO: Found listing with ID: GB86339
2026-03-29 08:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB86339%27 HTTP/1.1" 200 None
2026-03-29 08:35:07 [auto1.be] INFO: Scrape type for GB86339: 2
2026-03-29 08:35:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95a1edc5-c4b8-5ff7-8144-fc66491c6a91 with identifier: GB86339
2026-03-29 08:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95a1edc5-c4b8-5ff7-8144-fc66491c6a91 with scrape type 2
2026-03-29 08:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95a1edc5-c4b8-5ff7-8144-fc66491c6a91 with scrape type 2
2026-03-29 08:35:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 95a1edc5-c4b8-5ff7-8144-fc66491c6a91, identifier: GB86339
2026-03-29 08:35:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 95a1edc5-c4b8-5ff7-8144-fc66491c6a91 with identifier: GB86339
2026-03-29 08:35:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 95a1edc5-c4b8-5ff7-8144-fc66491c6a91 with identifier: GB86339
2026-03-29 08:35:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 95a1edc5-c4b8-5ff7-8144-fc66491c6a91 with identifier: GB86339 to the API
2026-03-29 08:35:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:47:26Z',
 'fuel_type': 'petrol',
 'id': '95a1edc5-c4b8-5ff7-8144-fc66491c6a91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB86339',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 14968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-16',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TFSI S Line',
 'transmission': 'automatic',
 'trim': 'S Line',
 'year': 2023}
2026-03-29 08:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB86339%27 HTTP/1.1" 200 None
2026-03-29 08:35:08 [auto1.be] INFO: Saving data for GB86339: {'auction_closing_time': 1774885646.0, 'created_time': 1773225257.711828, 'last_price_update_time': 1774773308.350057}
2026-03-29 08:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GB86339') HTTP/1.1" 204 0
2026-03-29 08:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WZ74297> (referer: https://www.auto1.com/v1/car-details-view/WZ74297/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ET26989> (referer: https://www.auto1.com/v1/car-details-view/ET26989/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PF75414> (referer: https://www.auto1.com/v1/car-details-view/PF75414/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EN78807/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:08 [auto1.be] INFO: Found listing with ID: PW41553
2026-03-29 08:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PW41553%27 HTTP/1.1" 200 None
2026-03-29 08:35:08 [auto1.be] INFO: Scrape type for PW41553: 2
2026-03-29 08:35:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75e10d93-bd83-539a-8855-fccf46f4fef0 with identifier: PW41553
2026-03-29 08:35:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75e10d93-bd83-539a-8855-fccf46f4fef0 with scrape type 2
2026-03-29 08:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75e10d93-bd83-539a-8855-fccf46f4fef0 with scrape type 2
2026-03-29 08:35:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 75e10d93-bd83-539a-8855-fccf46f4fef0, identifier: PW41553
2026-03-29 08:35:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ17047/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 75e10d93-bd83-539a-8855-fccf46f4fef0 with identifier: PW41553
2026-03-29 08:35:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 75e10d93-bd83-539a-8855-fccf46f4fef0 with identifier: PW41553
2026-03-29 08:35:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 75e10d93-bd83-539a-8855-fccf46f4fef0 with identifier: PW41553 to the API
2026-03-29 08:35:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:20:40Z',
 'fuel_type': 'petrol',
 'id': '75e10d93-bd83-539a-8855-fccf46f4fef0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW41553',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 17493,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-15',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Advantage 2WD',
 'transmission': 'manual',
 'trim': 'Advantage 2WD',
 'year': 2023}
2026-03-29 08:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PW41553%27 HTTP/1.1" 200 None
2026-03-29 08:35:08 [auto1.be] INFO: Saving data for PW41553: {'auction_closing_time': 1774884040.0, 'created_time': 1773132023.837801, 'last_price_update_time': 1774773308.883909}
2026-03-29 08:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PW41553') HTTP/1.1" 204 0
2026-03-29 08:35:08 [auto1.be] INFO: Found listing with ID: FF69776
2026-03-29 08:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF69776%27 HTTP/1.1" 200 None
2026-03-29 08:35:08 [auto1.be] INFO: Scrape type for FF69776: 2
2026-03-29 08:35:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f01f9a6-2504-51a9-9159-c4055b50959b with identifier: FF69776
2026-03-29 08:35:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f01f9a6-2504-51a9-9159-c4055b50959b with scrape type 2
2026-03-29 08:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f01f9a6-2504-51a9-9159-c4055b50959b with scrape type 2
2026-03-29 08:35:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8f01f9a6-2504-51a9-9159-c4055b50959b, identifier: FF69776
2026-03-29 08:35:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8f01f9a6-2504-51a9-9159-c4055b50959b with identifier: FF69776
2026-03-29 08:35:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8f01f9a6-2504-51a9-9159-c4055b50959b with identifier: FF69776
2026-03-29 08:35:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8f01f9a6-2504-51a9-9159-c4055b50959b with identifier: FF69776 to the API
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:33:15Z',
 'fuel_type': 'diesel',
 'id': '8f01f9a6-2504-51a9-9159-c4055b50959b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF69776',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 86505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-27',
 'seller_name': None,
 'title': 'Jaguar E-Pace D180 R-Dynamic AWD',
 'transmission': 'automatic',
 'trim': 'R-Dynamic AWD',
 'year': 2020}
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF69776%27 HTTP/1.1" 200 None
2026-03-29 08:35:09 [auto1.be] INFO: Saving data for FF69776: {'auction_closing_time': 1774884795.0, 'created_time': 1773132813.305858, 'last_price_update_time': 1774773309.407689}
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FF69776') HTTP/1.1" 204 0
2026-03-29 08:35:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcb03575-7c48-51bf-b4a6-185707101d75 with identifier: WZ74297
2026-03-29 08:35:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcb03575-7c48-51bf-b4a6-185707101d75 with scrape type 1
2026-03-29 08:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dcb03575-7c48-51bf-b4a6-185707101d75
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd4%252F9fd42fad1377680c0a7ec43e305c91a7%252Fpa%252FWZ74297_4a066d90e546275e70a745df9a60006e.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d4/9fd42fad1377680c0a7ec43e305c91a7/pa/WZ74297_4a066d90e546275e70a745df9a60006e.jpg already downloaded
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd4%252F9fd42fad1377680c0a7ec43e305c91a7%252Fpa%252FWZ74297_b7c5d44bdeaaa4ab9a852a60972f7ba7.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d4/9fd42fad1377680c0a7ec43e305c91a7/pa/WZ74297_b7c5d44bdeaaa4ab9a852a60972f7ba7.jpg already downloaded
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd4%252F9fd42fad1377680c0a7ec43e305c91a7%252Fpa%252FWZ74297_d75641a15f222aa647bbf28301edc60e.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d4/9fd42fad1377680c0a7ec43e305c91a7/pa/WZ74297_d75641a15f222aa647bbf28301edc60e.jpg already downloaded
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd4%252F9fd42fad1377680c0a7ec43e305c91a7%252Fpa%252FWZ74297_a367ce27920f6d53abb7b911035edc16.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d4/9fd42fad1377680c0a7ec43e305c91a7/pa/WZ74297_a367ce27920f6d53abb7b911035edc16.jpg already downloaded
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd4%252F9fd42fad1377680c0a7ec43e305c91a7%252Fpa%252FWZ74297_2b8023fbbfaaf30676daae5a847d380f.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d4/9fd42fad1377680c0a7ec43e305c91a7/pa/WZ74297_2b8023fbbfaaf30676daae5a847d380f.jpg already downloaded
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd4%252F9fd42fad1377680c0a7ec43e305c91a7%252Fpa%252FWZ74297_91ebc513d8dfc817335a9dfe254ddf61.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d4/9fd42fad1377680c0a7ec43e305c91a7/pa/WZ74297_91ebc513d8dfc817335a9dfe254ddf61.jpg already downloaded
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd4%252F9fd42fad1377680c0a7ec43e305c91a7%252Fpa%252FWZ74297_9b1441f46a9c95cb3f52ee04c874043a.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d4/9fd42fad1377680c0a7ec43e305c91a7/pa/WZ74297_9b1441f46a9c95cb3f52ee04c874043a.jpg already downloaded
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd4%252F9fd42fad1377680c0a7ec43e305c91a7%252Fpa%252FWZ74297_3d9242d1cb9aac7a0e4db74a1010d7ef.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d4/9fd42fad1377680c0a7ec43e305c91a7/pa/WZ74297_3d9242d1cb9aac7a0e4db74a1010d7ef.jpg already downloaded
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd4%252F9fd42fad1377680c0a7ec43e305c91a7%252Fpa%252FWZ74297_aa0ee5c0e2b02002cbdf47c276d6a89e.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d4/9fd42fad1377680c0a7ec43e305c91a7/pa/WZ74297_aa0ee5c0e2b02002cbdf47c276d6a89e.jpg already downloaded
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fd4%252F9fd42fad1377680c0a7ec43e305c91a7%252Fpa%252FWZ74297_6dd6e46710c830f2b1eabe285e11ebfc.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/d4/9fd42fad1377680c0a7ec43e305c91a7/pa/WZ74297_6dd6e46710c830f2b1eabe285e11ebfc.jpg already downloaded
2026-03-29 08:35:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dcb03575-7c48-51bf-b4a6-185707101d75, identifier: WZ74297
2026-03-29 08:35:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d6c1b19-1140-598b-b706-2d1daf1b729e with identifier: ET26989
2026-03-29 08:35:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d6c1b19-1140-598b-b706-2d1daf1b729e with scrape type 1
2026-03-29 08:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9d6c1b19-1140-598b-b706-2d1daf1b729e
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F1f%252F791f389ce765a999531f68b8f212c68d%252Fpa%252FET26989_d6a587c124849d105e9a006aceff32e6.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/1f/791f389ce765a999531f68b8f212c68d/pa/ET26989_d6a587c124849d105e9a006aceff32e6.jpg already downloaded
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F1f%252F791f389ce765a999531f68b8f212c68d%252Fpa%252FET26989_0eea71ca820067ed53eab6306f99cda4.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/1f/791f389ce765a999531f68b8f212c68d/pa/ET26989_0eea71ca820067ed53eab6306f99cda4.jpg already downloaded
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F1f%252F791f389ce765a999531f68b8f212c68d%252Fpa%252FET26989_0cb2ee29b76ba3488067010fc763d393.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/1f/791f389ce765a999531f68b8f212c68d/pa/ET26989_0cb2ee29b76ba3488067010fc763d393.jpg already downloaded
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F1f%252F791f389ce765a999531f68b8f212c68d%252Fpa%252FET26989_a271b8621efa80580d2557df391d36fa.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/1f/791f389ce765a999531f68b8f212c68d/pa/ET26989_a271b8621efa80580d2557df391d36fa.jpg already downloaded
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F1f%252F791f389ce765a999531f68b8f212c68d%252Fpa%252FET26989_ae8f2d2f6b71cdcb3ecb8e5f540c1bf9.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/1f/791f389ce765a999531f68b8f212c68d/pa/ET26989_ae8f2d2f6b71cdcb3ecb8e5f540c1bf9.jpg already downloaded
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F1f%252F791f389ce765a999531f68b8f212c68d%252Fpa%252FET26989_ea8ec63da10befe270ccc993c7ecbbc3.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/1f/791f389ce765a999531f68b8f212c68d/pa/ET26989_ea8ec63da10befe270ccc993c7ecbbc3.jpg already downloaded
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F1f%252F791f389ce765a999531f68b8f212c68d%252Fpa%252FET26989_7296d82ce05956d6c776ce4121f450a4.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/1f/791f389ce765a999531f68b8f212c68d/pa/ET26989_7296d82ce05956d6c776ce4121f450a4.jpg already downloaded
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F1f%252F791f389ce765a999531f68b8f212c68d%252Fpa%252FET26989_e262fa1978e680875a7737e172a184a5.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/1f/791f389ce765a999531f68b8f212c68d/pa/ET26989_e262fa1978e680875a7737e172a184a5.jpg already downloaded
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F1f%252F791f389ce765a999531f68b8f212c68d%252Fpa%252FET26989_f97205e73042192aa4e37f25d4dd7f15.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/1f/791f389ce765a999531f68b8f212c68d/pa/ET26989_f97205e73042192aa4e37f25d4dd7f15.jpg already downloaded
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg79%252F1f%252F791f389ce765a999531f68b8f212c68d%252Fpa%252FET26989_79513d69627092899c34b1d12c181eb3.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/1f/791f389ce765a999531f68b8f212c68d/pa/ET26989_79513d69627092899c34b1d12c181eb3.jpg already downloaded
2026-03-29 08:35:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9d6c1b19-1140-598b-b706-2d1daf1b729e, identifier: ET26989
2026-03-29 08:35:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4 with identifier: PF75414
2026-03-29 08:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4 with scrape type 1
2026-03-29 08:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4
2026-03-29 08:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ff9%252Fb0f9a853bc8448f611cd61866bd20f28%252Fpa%252FPF75414_880ca1d84c05af550c2bc2f6421052f6.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/f9/b0f9a853bc8448f611cd61866bd20f28/pa/PF75414_880ca1d84c05af550c2bc2f6421052f6.jpg already downloaded
2026-03-29 08:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ff9%252Fb0f9a853bc8448f611cd61866bd20f28%252Fpa%252FPF75414_398ac4b58b6a84b2023799ec9f777f33.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/f9/b0f9a853bc8448f611cd61866bd20f28/pa/PF75414_398ac4b58b6a84b2023799ec9f777f33.jpg already downloaded
2026-03-29 08:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ff9%252Fb0f9a853bc8448f611cd61866bd20f28%252Fpa%252FPF75414_f14c873a93de607484e63d32bc62fc77.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/f9/b0f9a853bc8448f611cd61866bd20f28/pa/PF75414_f14c873a93de607484e63d32bc62fc77.jpg already downloaded
2026-03-29 08:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ff9%252Fb0f9a853bc8448f611cd61866bd20f28%252Fpa%252FPF75414_01b98fc9f1509522853b30195adedafe.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/f9/b0f9a853bc8448f611cd61866bd20f28/pa/PF75414_01b98fc9f1509522853b30195adedafe.jpg already downloaded
2026-03-29 08:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ff9%252Fb0f9a853bc8448f611cd61866bd20f28%252Fpa%252FPF75414_aa5ccadb510921724b9a278664add2c6.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/f9/b0f9a853bc8448f611cd61866bd20f28/pa/PF75414_aa5ccadb510921724b9a278664add2c6.jpg already downloaded
2026-03-29 08:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ff9%252Fb0f9a853bc8448f611cd61866bd20f28%252Fpa%252FPF75414_323a1b4001bdd2aedc22fd615f3eec68.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/f9/b0f9a853bc8448f611cd61866bd20f28/pa/PF75414_323a1b4001bdd2aedc22fd615f3eec68.jpg already downloaded
2026-03-29 08:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ff9%252Fb0f9a853bc8448f611cd61866bd20f28%252Fpa%252FPF75414_085a4506005dbfce8a70ccef90f1e5c2.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/f9/b0f9a853bc8448f611cd61866bd20f28/pa/PF75414_085a4506005dbfce8a70ccef90f1e5c2.jpg already downloaded
2026-03-29 08:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ff9%252Fb0f9a853bc8448f611cd61866bd20f28%252Fpa%252FPF75414_9d7e594a308a84c5c63b589238e8dc8b.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/f9/b0f9a853bc8448f611cd61866bd20f28/pa/PF75414_9d7e594a308a84c5c63b589238e8dc8b.jpg already downloaded
2026-03-29 08:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ff9%252Fb0f9a853bc8448f611cd61866bd20f28%252Fpa%252FPF75414_88414fe50651e38b1c0d3f87fdb913ea.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/f9/b0f9a853bc8448f611cd61866bd20f28/pa/PF75414_88414fe50651e38b1c0d3f87fdb913ea.jpg already downloaded
2026-03-29 08:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Ff9%252Fb0f9a853bc8448f611cd61866bd20f28%252Fpa%252FPF75414_f4a3b5c72955769b978080960bbcfd43.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/f9/b0f9a853bc8448f611cd61866bd20f28/pa/PF75414_f4a3b5c72955769b978080960bbcfd43.jpg already downloaded
2026-03-29 08:35:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4, identifier: PF75414
2026-03-29 08:35:10 [auto1.be] INFO: Found listing with ID: BY20726
2026-03-29 08:35:10 [auto1.be] INFO: Found listing with ID: YH64614
2026-03-29 08:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH64614%27 HTTP/1.1" 200 None
2026-03-29 08:35:10 [auto1.be] INFO: Scrape type for YH64614: 2
2026-03-29 08:35:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28fd5560-64b4-5cff-9cfa-22115130cecc with identifier: YH64614
2026-03-29 08:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28fd5560-64b4-5cff-9cfa-22115130cecc with scrape type 2
2026-03-29 08:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28fd5560-64b4-5cff-9cfa-22115130cecc with scrape type 2
2026-03-29 08:35:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 28fd5560-64b4-5cff-9cfa-22115130cecc, identifier: YH64614
2026-03-29 08:35:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dcb03575-7c48-51bf-b4a6-185707101d75 with identifier: WZ74297
2026-03-29 08:35:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dcb03575-7c48-51bf-b4a6-185707101d75 with identifier: WZ74297
2026-03-29 08:35:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dcb03575-7c48-51bf-b4a6-185707101d75 with identifier: WZ74297 to the API
2026-03-29 08:35:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WZ74297>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:00:02Z',
 'fuel_type': 'petrol',
 'id': 'dcb03575-7c48-51bf-b4a6-185707101d75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ74297',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 102275,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img9f/d4/9fd42fad1377680c0a7ec43e305c91a7/pa/WZ74297_4a066d90e546275e70a745df9a60006e.jpg',
                'https://img-pa.auto1.com/img9f/d4/9fd42fad1377680c0a7ec43e305c91a7/pa/WZ74297_b7c5d44bdeaaa4ab9a852a60972f7ba7.jpg',
                'https://img-pa.auto1.com/img9f/d4/9fd42fad1377680c0a7ec43e305c91a7/pa/WZ74297_d75641a15f222aa647bbf28301edc60e.jpg',
                'https://img-pa.auto1.com/img9f/d4/9fd42fad1377680c0a7ec43e305c91a7/pa/WZ74297_a367ce27920f6d53abb7b911035edc16.jpg',
                'https://img-pa.auto1.com/img9f/d4/9fd42fad1377680c0a7ec43e305c91a7/pa/WZ74297_2b8023fbbfaaf30676daae5a847d380f.jpg',
                'https://img-pa.auto1.com/img9f/d4/9fd42fad1377680c0a7ec43e305c91a7/pa/WZ74297_91ebc513d8dfc817335a9dfe254ddf61.jpg',
                'https://img-pa.auto1.com/img9f/d4/9fd42fad1377680c0a7ec43e305c91a7/pa/WZ74297_9b1441f46a9c95cb3f52ee04c874043a.jpg',
                'https://img-pa.auto1.com/img9f/d4/9fd42fad1377680c0a7ec43e305c91a7/pa/WZ74297_3d9242d1cb9aac7a0e4db74a1010d7ef.jpg',
                'https://img-pa.auto1.com/img9f/d4/9fd42fad1377680c0a7ec43e305c91a7/pa/WZ74297_aa0ee5c0e2b02002cbdf47c276d6a89e.jpg',
                'https://img-pa.auto1.com/img9f/d4/9fd42fad1377680c0a7ec43e305c91a7/pa/WZ74297_6dd6e46710c830f2b1eabe285e11ebfc.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb03575-7c48-51bf-b4a6-185707101d75/dcb03575-7c48-51bf-b4a6-185707101d75_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d4/9fd42fad1377680c0a7ec43e305c91a7/pa/WZ74297_4a066d90e546275e70a745df9a60006e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb03575-7c48-51bf-b4a6-185707101d75/dcb03575-7c48-51bf-b4a6-185707101d75_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d4/9fd42fad1377680c0a7ec43e305c91a7/pa/WZ74297_b7c5d44bdeaaa4ab9a852a60972f7ba7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb03575-7c48-51bf-b4a6-185707101d75/dcb03575-7c48-51bf-b4a6-185707101d75_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95832,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d4/9fd42fad1377680c0a7ec43e305c91a7/pa/WZ74297_d75641a15f222aa647bbf28301edc60e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb03575-7c48-51bf-b4a6-185707101d75/dcb03575-7c48-51bf-b4a6-185707101d75_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95832,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d4/9fd42fad1377680c0a7ec43e305c91a7/pa/WZ74297_a367ce27920f6d53abb7b911035edc16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb03575-7c48-51bf-b4a6-185707101d75/dcb03575-7c48-51bf-b4a6-185707101d75_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d4/9fd42fad1377680c0a7ec43e305c91a7/pa/WZ74297_2b8023fbbfaaf30676daae5a847d380f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb03575-7c48-51bf-b4a6-185707101d75/dcb03575-7c48-51bf-b4a6-185707101d75_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d4/9fd42fad1377680c0a7ec43e305c91a7/pa/WZ74297_91ebc513d8dfc817335a9dfe254ddf61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb03575-7c48-51bf-b4a6-185707101d75/dcb03575-7c48-51bf-b4a6-185707101d75_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d4/9fd42fad1377680c0a7ec43e305c91a7/pa/WZ74297_9b1441f46a9c95cb3f52ee04c874043a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb03575-7c48-51bf-b4a6-185707101d75/dcb03575-7c48-51bf-b4a6-185707101d75_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77467,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d4/9fd42fad1377680c0a7ec43e305c91a7/pa/WZ74297_3d9242d1cb9aac7a0e4db74a1010d7ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb03575-7c48-51bf-b4a6-185707101d75/dcb03575-7c48-51bf-b4a6-185707101d75_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d4/9fd42fad1377680c0a7ec43e305c91a7/pa/WZ74297_aa0ee5c0e2b02002cbdf47c276d6a89e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dcb03575-7c48-51bf-b4a6-185707101d75/dcb03575-7c48-51bf-b4a6-185707101d75_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/d4/9fd42fad1377680c0a7ec43e305c91a7/pa/WZ74297_6dd6e46710c830f2b1eabe285e11ebfc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Micra 1.0 IG-T Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2019}
2026-03-29 08:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WZ74297%27 HTTP/1.1" 200 None
2026-03-29 08:35:10 [auto1.be] INFO: Saving data for WZ74297: {'created_time': 1774773310.773222, 'last_price_update_time': 1774773310.773232, 'auction_closing_time': 1774882802.0}
2026-03-29 08:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WZ74297') HTTP/1.1" 204 0
2026-03-29 08:35:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9d6c1b19-1140-598b-b706-2d1daf1b729e with identifier: ET26989
2026-03-29 08:35:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9d6c1b19-1140-598b-b706-2d1daf1b729e with identifier: ET26989
2026-03-29 08:35:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9d6c1b19-1140-598b-b706-2d1daf1b729e with identifier: ET26989 to the API
2026-03-29 08:35:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ET26989>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6C',
 'engine': '2.1L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:45:57Z',
 'fuel_type': 'diesel',
 'id': '9d6c1b19-1140-598b-b706-2d1daf1b729e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET26989',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 117110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img79/1f/791f389ce765a999531f68b8f212c68d/pa/ET26989_d6a587c124849d105e9a006aceff32e6.jpg',
                'https://img-pa.auto1.com/img79/1f/791f389ce765a999531f68b8f212c68d/pa/ET26989_0eea71ca820067ed53eab6306f99cda4.jpg',
                'https://img-pa.auto1.com/img79/1f/791f389ce765a999531f68b8f212c68d/pa/ET26989_0cb2ee29b76ba3488067010fc763d393.jpg',
                'https://img-pa.auto1.com/img79/1f/791f389ce765a999531f68b8f212c68d/pa/ET26989_a271b8621efa80580d2557df391d36fa.jpg',
                'https://img-pa.auto1.com/img79/1f/791f389ce765a999531f68b8f212c68d/pa/ET26989_ae8f2d2f6b71cdcb3ecb8e5f540c1bf9.jpg',
                'https://img-pa.auto1.com/img79/1f/791f389ce765a999531f68b8f212c68d/pa/ET26989_ea8ec63da10befe270ccc993c7ecbbc3.jpg',
                'https://img-pa.auto1.com/img79/1f/791f389ce765a999531f68b8f212c68d/pa/ET26989_7296d82ce05956d6c776ce4121f450a4.jpg',
                'https://img-pa.auto1.com/img79/1f/791f389ce765a999531f68b8f212c68d/pa/ET26989_e262fa1978e680875a7737e172a184a5.jpg',
                'https://img-pa.auto1.com/img79/1f/791f389ce765a999531f68b8f212c68d/pa/ET26989_f97205e73042192aa4e37f25d4dd7f15.jpg',
                'https://img-pa.auto1.com/img79/1f/791f389ce765a999531f68b8f212c68d/pa/ET26989_79513d69627092899c34b1d12c181eb3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d6c1b19-1140-598b-b706-2d1daf1b729e/9d6c1b19-1140-598b-b706-2d1daf1b729e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/1f/791f389ce765a999531f68b8f212c68d/pa/ET26989_d6a587c124849d105e9a006aceff32e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d6c1b19-1140-598b-b706-2d1daf1b729e/9d6c1b19-1140-598b-b706-2d1daf1b729e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/1f/791f389ce765a999531f68b8f212c68d/pa/ET26989_0eea71ca820067ed53eab6306f99cda4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d6c1b19-1140-598b-b706-2d1daf1b729e/9d6c1b19-1140-598b-b706-2d1daf1b729e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55913,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/1f/791f389ce765a999531f68b8f212c68d/pa/ET26989_0cb2ee29b76ba3488067010fc763d393.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d6c1b19-1140-598b-b706-2d1daf1b729e/9d6c1b19-1140-598b-b706-2d1daf1b729e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/1f/791f389ce765a999531f68b8f212c68d/pa/ET26989_a271b8621efa80580d2557df391d36fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d6c1b19-1140-598b-b706-2d1daf1b729e/9d6c1b19-1140-598b-b706-2d1daf1b729e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/1f/791f389ce765a999531f68b8f212c68d/pa/ET26989_ae8f2d2f6b71cdcb3ecb8e5f540c1bf9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d6c1b19-1140-598b-b706-2d1daf1b729e/9d6c1b19-1140-598b-b706-2d1daf1b729e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/1f/791f389ce765a999531f68b8f212c68d/pa/ET26989_ea8ec63da10befe270ccc993c7ecbbc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d6c1b19-1140-598b-b706-2d1daf1b729e/9d6c1b19-1140-598b-b706-2d1daf1b729e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/1f/791f389ce765a999531f68b8f212c68d/pa/ET26989_7296d82ce05956d6c776ce4121f450a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d6c1b19-1140-598b-b706-2d1daf1b729e/9d6c1b19-1140-598b-b706-2d1daf1b729e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/1f/791f389ce765a999531f68b8f212c68d/pa/ET26989_e262fa1978e680875a7737e172a184a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d6c1b19-1140-598b-b706-2d1daf1b729e/9d6c1b19-1140-598b-b706-2d1daf1b729e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/1f/791f389ce765a999531f68b8f212c68d/pa/ET26989_f97205e73042192aa4e37f25d4dd7f15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d6c1b19-1140-598b-b706-2d1daf1b729e/9d6c1b19-1140-598b-b706-2d1daf1b729e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img79/1f/791f389ce765a999531f68b8f212c68d/pa/ET26989_79513d69627092899c34b1d12c181eb3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-29 08:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET26989%27 HTTP/1.1" 200 None
2026-03-29 08:35:11 [auto1.be] INFO: Saving data for ET26989: {'created_time': 1774773311.128468, 'last_price_update_time': 1774773311.128478, 'auction_closing_time': 1774885557.0}
2026-03-29 08:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ET26989') HTTP/1.1" 204 0
2026-03-29 08:35:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4 with identifier: PF75414
2026-03-29 08:35:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4 with identifier: PF75414
2026-03-29 08:35:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4 with identifier: PF75414 to the API
2026-03-29 08:35:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PF75414>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:45:02Z',
 'fuel_type': 'petrol',
 'id': '060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF75414',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 52972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgb0/f9/b0f9a853bc8448f611cd61866bd20f28/pa/PF75414_880ca1d84c05af550c2bc2f6421052f6.jpg',
                'https://img-pa.auto1.com/imgb0/f9/b0f9a853bc8448f611cd61866bd20f28/pa/PF75414_398ac4b58b6a84b2023799ec9f777f33.jpg',
                'https://img-pa.auto1.com/imgb0/f9/b0f9a853bc8448f611cd61866bd20f28/pa/PF75414_f14c873a93de607484e63d32bc62fc77.jpg',
                'https://img-pa.auto1.com/imgb0/f9/b0f9a853bc8448f611cd61866bd20f28/pa/PF75414_01b98fc9f1509522853b30195adedafe.jpg',
                'https://img-pa.auto1.com/imgb0/f9/b0f9a853bc8448f611cd61866bd20f28/pa/PF75414_aa5ccadb510921724b9a278664add2c6.jpg',
                'https://img-pa.auto1.com/imgb0/f9/b0f9a853bc8448f611cd61866bd20f28/pa/PF75414_323a1b4001bdd2aedc22fd615f3eec68.jpg',
                'https://img-pa.auto1.com/imgb0/f9/b0f9a853bc8448f611cd61866bd20f28/pa/PF75414_085a4506005dbfce8a70ccef90f1e5c2.jpg',
                'https://img-pa.auto1.com/imgb0/f9/b0f9a853bc8448f611cd61866bd20f28/pa/PF75414_9d7e594a308a84c5c63b589238e8dc8b.jpg',
                'https://img-pa.auto1.com/imgb0/f9/b0f9a853bc8448f611cd61866bd20f28/pa/PF75414_88414fe50651e38b1c0d3f87fdb913ea.jpg',
                'https://img-pa.auto1.com/imgb0/f9/b0f9a853bc8448f611cd61866bd20f28/pa/PF75414_f4a3b5c72955769b978080960bbcfd43.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4/060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/f9/b0f9a853bc8448f611cd61866bd20f28/pa/PF75414_880ca1d84c05af550c2bc2f6421052f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4/060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/f9/b0f9a853bc8448f611cd61866bd20f28/pa/PF75414_398ac4b58b6a84b2023799ec9f777f33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4/060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/f9/b0f9a853bc8448f611cd61866bd20f28/pa/PF75414_f14c873a93de607484e63d32bc62fc77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4/060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/f9/b0f9a853bc8448f611cd61866bd20f28/pa/PF75414_01b98fc9f1509522853b30195adedafe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4/060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/f9/b0f9a853bc8448f611cd61866bd20f28/pa/PF75414_aa5ccadb510921724b9a278664add2c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4/060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/f9/b0f9a853bc8448f611cd61866bd20f28/pa/PF75414_323a1b4001bdd2aedc22fd615f3eec68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4/060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/f9/b0f9a853bc8448f611cd61866bd20f28/pa/PF75414_085a4506005dbfce8a70ccef90f1e5c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4/060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/f9/b0f9a853bc8448f611cd61866bd20f28/pa/PF75414_9d7e594a308a84c5c63b589238e8dc8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4/060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/f9/b0f9a853bc8448f611cd61866bd20f28/pa/PF75414_88414fe50651e38b1c0d3f87fdb913ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4/060f0efb-2c90-5a4d-aaa9-2dd657ee7fc4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/f9/b0f9a853bc8448f611cd61866bd20f28/pa/PF75414_f4a3b5c72955769b978080960bbcfd43.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-15',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 1.2 PureTech Roadtrip',
 'transmission': 'automatic',
 'trim': 'Roadtrip',
 'year': 2022}
2026-03-29 08:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF75414%27 HTTP/1.1" 200 None
2026-03-29 08:35:11 [auto1.be] INFO: Saving data for PF75414: {'created_time': 1774773311.464008, 'last_price_update_time': 1774773311.46402, 'auction_closing_time': 1774885502.0}
2026-03-29 08:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PF75414') HTTP/1.1" 204 0
2026-03-29 08:35:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 28fd5560-64b4-5cff-9cfa-22115130cecc with identifier: YH64614
2026-03-29 08:35:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 28fd5560-64b4-5cff-9cfa-22115130cecc with identifier: YH64614
2026-03-29 08:35:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 28fd5560-64b4-5cff-9cfa-22115130cecc with identifier: YH64614 to the API
2026-03-29 08:35:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:25:55Z',
 'fuel_type': 'diesel',
 'id': '28fd5560-64b4-5cff-9cfa-22115130cecc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH64614',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 91179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-19',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-29 08:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH64614%27 HTTP/1.1" 200 None
2026-03-29 08:35:12 [auto1.be] INFO: Saving data for YH64614: {'auction_closing_time': 1774884355.0, 'created_time': 1773132221.331095, 'last_price_update_time': 1774773312.243974}
2026-03-29 08:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YH64614') HTTP/1.1" 204 0
2026-03-29 08:35:12 [auto1.be] INFO: Found listing with ID: KF56069
2026-03-29 08:35:12 [auto1.be] INFO: Found listing with ID: BT87712
2026-03-29 08:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT87712%27 HTTP/1.1" 200 None
2026-03-29 08:35:12 [auto1.be] INFO: Scrape type for BT87712: 2
2026-03-29 08:35:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4feaf73-53d6-5efa-a018-230e3e36b8b5 with identifier: BT87712
2026-03-29 08:35:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4feaf73-53d6-5efa-a018-230e3e36b8b5 with scrape type 2
2026-03-29 08:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4feaf73-53d6-5efa-a018-230e3e36b8b5 with scrape type 2
2026-03-29 08:35:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e4feaf73-53d6-5efa-a018-230e3e36b8b5, identifier: BT87712
2026-03-29 08:35:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e4feaf73-53d6-5efa-a018-230e3e36b8b5 with identifier: BT87712
2026-03-29 08:35:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e4feaf73-53d6-5efa-a018-230e3e36b8b5 with identifier: BT87712
2026-03-29 08:35:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e4feaf73-53d6-5efa-a018-230e3e36b8b5 with identifier: BT87712 to the API
2026-03-29 08:35:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:35:59Z',
 'fuel_type': 'diesel',
 'id': 'e4feaf73-53d6-5efa-a018-230e3e36b8b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT87712',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 236633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-29',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2015}
2026-03-29 08:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT87712%27 HTTP/1.1" 200 None
2026-03-29 08:35:12 [auto1.be] INFO: Saving data for BT87712: {'auction_closing_time': 1774884959.0, 'created_time': 1773301844.868209, 'last_price_update_time': 1774773312.693612}
2026-03-29 08:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BT87712') HTTP/1.1" 204 0
2026-03-29 08:35:12 [auto1.be] INFO: Found listing with ID: BV02466
2026-03-29 08:35:12 [auto1.be] INFO: Found listing with ID: SY52065
2026-03-29 08:35:12 [auto1.be] INFO: Found listing with ID: NG60197
2026-03-29 08:35:12 [auto1.be] INFO: Found listing with ID: NC51382
2026-03-29 08:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC51382%27 HTTP/1.1" 200 None
2026-03-29 08:35:12 [auto1.be] INFO: Scrape type for NC51382: 2
2026-03-29 08:35:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23f18fee-f091-5ed3-a700-32a7889884b5 with identifier: NC51382
2026-03-29 08:35:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23f18fee-f091-5ed3-a700-32a7889884b5 with scrape type 2
2026-03-29 08:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23f18fee-f091-5ed3-a700-32a7889884b5 with scrape type 2
2026-03-29 08:35:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 23f18fee-f091-5ed3-a700-32a7889884b5, identifier: NC51382
2026-03-29 08:35:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 23f18fee-f091-5ed3-a700-32a7889884b5 with identifier: NC51382
2026-03-29 08:35:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 08:35:12 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-29 08:35:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 08:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 08:35:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 23f18fee-f091-5ed3-a700-32a7889884b5 with identifier: NC51382
2026-03-29 08:35:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 23f18fee-f091-5ed3-a700-32a7889884b5 with identifier: NC51382 to the API
2026-03-29 08:35:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 141,
 'expiration_date': '2026-03-30T15:01:39Z',
 'fuel_type': 'hybrid',
 'id': '23f18fee-f091-5ed3-a700-32a7889884b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC51382',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 61733,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-21',
 'seller_name': None,
 'title': 'Hyundai Kona 1.6 Hybrid Style 2WD',
 'transmission': 'automatic',
 'trim': 'Style 2WD',
 'year': 2020}
2026-03-29 08:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC51382%27 HTTP/1.1" 200 None
2026-03-29 08:35:13 [auto1.be] INFO: Saving data for NC51382: {'auction_closing_time': 1774882899.0, 'created_time': 1773133887.637821, 'last_price_update_time': 1774773313.26654}
2026-03-29 08:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NC51382') HTTP/1.1" 204 0
2026-03-29 08:35:13 [auto1.be] INFO: Found listing with ID: JU27695
2026-03-29 08:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU27695%27 HTTP/1.1" 200 None
2026-03-29 08:35:13 [auto1.be] INFO: Scrape type for JU27695: 2
2026-03-29 08:35:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 885710b9-2165-5825-879e-5964b9e758b8 with identifier: JU27695
2026-03-29 08:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 885710b9-2165-5825-879e-5964b9e758b8 with scrape type 2
2026-03-29 08:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 885710b9-2165-5825-879e-5964b9e758b8 with scrape type 2
2026-03-29 08:35:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 885710b9-2165-5825-879e-5964b9e758b8, identifier: JU27695
2026-03-29 08:35:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 885710b9-2165-5825-879e-5964b9e758b8 with identifier: JU27695
2026-03-29 08:35:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 885710b9-2165-5825-879e-5964b9e758b8 with identifier: JU27695
2026-03-29 08:35:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 885710b9-2165-5825-879e-5964b9e758b8 with identifier: JU27695 to the API
2026-03-29 08:35:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:35:49Z',
 'fuel_type': 'diesel',
 'id': '885710b9-2165-5825-879e-5964b9e758b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU27695',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 231724,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-12',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI DPF Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2015}
2026-03-29 08:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU27695%27 HTTP/1.1" 200 None
2026-03-29 08:35:13 [auto1.be] INFO: Saving data for JU27695: {'auction_closing_time': 1774884949.0, 'created_time': 1773132941.63354, 'last_price_update_time': 1774773313.694905}
2026-03-29 08:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JU27695') HTTP/1.1" 204 0
2026-03-29 08:35:13 [auto1.be] INFO: Found listing with ID: XU40393
2026-03-29 08:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU40393%27 HTTP/1.1" 200 None
2026-03-29 08:35:13 [auto1.be] INFO: Scrape type for XU40393: 2
2026-03-29 08:35:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac89b154-77ed-54a0-ad45-c771c34bd66c with identifier: XU40393
2026-03-29 08:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac89b154-77ed-54a0-ad45-c771c34bd66c with scrape type 2
2026-03-29 08:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac89b154-77ed-54a0-ad45-c771c34bd66c with scrape type 2
2026-03-29 08:35:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ac89b154-77ed-54a0-ad45-c771c34bd66c, identifier: XU40393
2026-03-29 08:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ac89b154-77ed-54a0-ad45-c771c34bd66c with identifier: XU40393
2026-03-29 08:35:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ac89b154-77ed-54a0-ad45-c771c34bd66c with identifier: XU40393
2026-03-29 08:35:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ac89b154-77ed-54a0-ad45-c771c34bd66c with identifier: XU40393 to the API
2026-03-29 08:35:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:00:59Z',
 'fuel_type': 'petrol',
 'id': 'ac89b154-77ed-54a0-ad45-c771c34bd66c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU40393',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 83337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-27',
 'seller_name': None,
 'title': 'Jeep Compass 1.4 M-Air Longitude FWD',
 'transmission': 'manual',
 'trim': 'Longitude FWD',
 'year': 2020}
2026-03-29 08:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU40393%27 HTTP/1.1" 200 None
2026-03-29 08:35:14 [auto1.be] INFO: Saving data for XU40393: {'auction_closing_time': 1774882859.0, 'created_time': 1774298144.853249, 'last_price_update_time': 1774773314.206011}
2026-03-29 08:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XU40393') HTTP/1.1" 204 0
2026-03-29 08:35:14 [auto1.be] INFO: Found listing with ID: YR77899
2026-03-29 08:35:14 [auto1.be] INFO: Found listing with ID: FH50113
2026-03-29 08:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH50113%27 HTTP/1.1" 200 None
2026-03-29 08:35:14 [auto1.be] INFO: Scrape type for FH50113: 2
2026-03-29 08:35:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61e45de4-37f4-506a-974d-f4c70084e437 with identifier: FH50113
2026-03-29 08:35:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61e45de4-37f4-506a-974d-f4c70084e437 with scrape type 2
2026-03-29 08:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61e45de4-37f4-506a-974d-f4c70084e437 with scrape type 2
2026-03-29 08:35:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 61e45de4-37f4-506a-974d-f4c70084e437, identifier: FH50113
2026-03-29 08:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MM05603/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DE26055> (referer: https://www.auto1.com/v1/car-details-view/DE26055/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RG41014/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 61e45de4-37f4-506a-974d-f4c70084e437 with identifier: FH50113
2026-03-29 08:35:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 61e45de4-37f4-506a-974d-f4c70084e437 with identifier: FH50113
2026-03-29 08:35:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 61e45de4-37f4-506a-974d-f4c70084e437 with identifier: FH50113 to the API
2026-03-29 08:35:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 181,
 'expiration_date': '2026-03-30T15:51:06Z',
 'fuel_type': 'petrol',
 'id': '61e45de4-37f4-506a-974d-f4c70084e437',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH50113',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 65446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-30',
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.6 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2019}
2026-03-29 08:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH50113%27 HTTP/1.1" 200 None
2026-03-29 08:35:14 [auto1.be] INFO: Saving data for FH50113: {'auction_closing_time': 1774885866.0, 'created_time': 1773133772.464527, 'last_price_update_time': 1774773314.641546}
2026-03-29 08:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FH50113') HTTP/1.1" 204 0
2026-03-29 08:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XD29708> (referer: https://www.auto1.com/v1/car-details-view/XD29708/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:14 [auto1.be] INFO: Found listing with ID: YU69949
2026-03-29 08:35:14 [auto1.be] INFO: Found listing with ID: VM31149
2026-03-29 08:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM31149%27 HTTP/1.1" 200 None
2026-03-29 08:35:14 [auto1.be] INFO: Scrape type for VM31149: 2
2026-03-29 08:35:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2db8937-57de-5fe8-b9c5-ee869f0aec3f with identifier: VM31149
2026-03-29 08:35:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2db8937-57de-5fe8-b9c5-ee869f0aec3f with scrape type 2
2026-03-29 08:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2db8937-57de-5fe8-b9c5-ee869f0aec3f with scrape type 2
2026-03-29 08:35:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a2db8937-57de-5fe8-b9c5-ee869f0aec3f, identifier: VM31149
2026-03-29 08:35:14 [auto1.be] INFO: Channel: 24h | Page: 4 | totalHits: 1252 | hits on page: 40
2026-03-29 08:35:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a2db8937-57de-5fe8-b9c5-ee869f0aec3f with identifier: VM31149
2026-03-29 08:35:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a2db8937-57de-5fe8-b9c5-ee869f0aec3f with identifier: VM31149
2026-03-29 08:35:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a2db8937-57de-5fe8-b9c5-ee869f0aec3f with identifier: VM31149 to the API
2026-03-29 08:35:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:57:26Z',
 'fuel_type': 'petrol',
 'id': 'a2db8937-57de-5fe8-b9c5-ee869f0aec3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM31149',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 52659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-22',
 'seller_name': None,
 'title': 'Suzuki Swift 1.3 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2008}
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM31149%27 HTTP/1.1" 200 None
2026-03-29 08:35:15 [auto1.be] INFO: Saving data for VM31149: {'auction_closing_time': 1774886246.0, 'created_time': 1773137257.010958, 'last_price_update_time': 1774773315.092937}
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VM31149') HTTP/1.1" 204 0
2026-03-29 08:35:15 [auto1.be] INFO: Found listing with ID: JC67757
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC67757%27 HTTP/1.1" 200 None
2026-03-29 08:35:15 [auto1.be] INFO: Scrape type for JC67757: 2
2026-03-29 08:35:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1a3ef2a-7981-5f7f-bfd8-b5e6a927e1b7 with identifier: JC67757
2026-03-29 08:35:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1a3ef2a-7981-5f7f-bfd8-b5e6a927e1b7 with scrape type 2
2026-03-29 08:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1a3ef2a-7981-5f7f-bfd8-b5e6a927e1b7 with scrape type 2
2026-03-29 08:35:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e1a3ef2a-7981-5f7f-bfd8-b5e6a927e1b7, identifier: JC67757
2026-03-29 08:35:15 [auto1.be] INFO: Found listing with ID: TG30379
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TG30379%27 HTTP/1.1" 200 None
2026-03-29 08:35:15 [auto1.be] INFO: Scrape type for TG30379: 2
2026-03-29 08:35:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa3d86b2-2ccb-5bea-b032-780e3f253e78 with identifier: TG30379
2026-03-29 08:35:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa3d86b2-2ccb-5bea-b032-780e3f253e78 with scrape type 2
2026-03-29 08:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa3d86b2-2ccb-5bea-b032-780e3f253e78 with scrape type 2
2026-03-29 08:35:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fa3d86b2-2ccb-5bea-b032-780e3f253e78, identifier: TG30379
2026-03-29 08:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DP17314/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73524b7c-84a3-5c68-b1ec-ec391af4acdb with identifier: DE26055
2026-03-29 08:35:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73524b7c-84a3-5c68-b1ec-ec391af4acdb with scrape type 1
2026-03-29 08:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 73524b7c-84a3-5c68-b1ec-ec391af4acdb
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F58%252F07585e84ff386be9467d54f1c1ab8af5%252Fpa%252FDE26055_abe0347d1db5711cf7ea9f6525e64cc6.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/58/07585e84ff386be9467d54f1c1ab8af5/pa/DE26055_abe0347d1db5711cf7ea9f6525e64cc6.jpg already downloaded
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F58%252F07585e84ff386be9467d54f1c1ab8af5%252Fpa%252FDE26055_ad72a909f1347529d108005f585e5552.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/58/07585e84ff386be9467d54f1c1ab8af5/pa/DE26055_ad72a909f1347529d108005f585e5552.jpg already downloaded
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F58%252F07585e84ff386be9467d54f1c1ab8af5%252Fpa%252FDE26055_1778ebb3647065c29633f54d730183bd.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/58/07585e84ff386be9467d54f1c1ab8af5/pa/DE26055_1778ebb3647065c29633f54d730183bd.jpg already downloaded
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F58%252F07585e84ff386be9467d54f1c1ab8af5%252Fpa%252FDE26055_6f27540b50eaccaf402113ada65f7cfc.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/58/07585e84ff386be9467d54f1c1ab8af5/pa/DE26055_6f27540b50eaccaf402113ada65f7cfc.jpg already downloaded
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F58%252F07585e84ff386be9467d54f1c1ab8af5%252Fpa%252FDE26055_902c1a97e16a401c421a67790de9dee3.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/58/07585e84ff386be9467d54f1c1ab8af5/pa/DE26055_902c1a97e16a401c421a67790de9dee3.jpg already downloaded
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F58%252F07585e84ff386be9467d54f1c1ab8af5%252Fpa%252FDE26055_133be936f09caba52933303884837aef.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/58/07585e84ff386be9467d54f1c1ab8af5/pa/DE26055_133be936f09caba52933303884837aef.jpg already downloaded
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F58%252F07585e84ff386be9467d54f1c1ab8af5%252Fpa%252FDE26055_3319abeb842e1962db25c6354cc6b732.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/58/07585e84ff386be9467d54f1c1ab8af5/pa/DE26055_3319abeb842e1962db25c6354cc6b732.jpg already downloaded
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F58%252F07585e84ff386be9467d54f1c1ab8af5%252Fpa%252FDE26055_153d834e89645708e0d9612dd441f4b0.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/58/07585e84ff386be9467d54f1c1ab8af5/pa/DE26055_153d834e89645708e0d9612dd441f4b0.jpg already downloaded
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F58%252F07585e84ff386be9467d54f1c1ab8af5%252Fpa%252FDE26055_d559734add4bcedf23dba0cef08efaa9.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/58/07585e84ff386be9467d54f1c1ab8af5/pa/DE26055_d559734add4bcedf23dba0cef08efaa9.jpg already downloaded
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252F58%252F07585e84ff386be9467d54f1c1ab8af5%252Fpa%252FDE26055_63ac2d876f609590c77e5ac596f8cee6.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/58/07585e84ff386be9467d54f1c1ab8af5/pa/DE26055_63ac2d876f609590c77e5ac596f8cee6.jpg already downloaded
2026-03-29 08:35:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 73524b7c-84a3-5c68-b1ec-ec391af4acdb, identifier: DE26055
2026-03-29 08:35:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e1a3ef2a-7981-5f7f-bfd8-b5e6a927e1b7 with identifier: JC67757
2026-03-29 08:35:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e1a3ef2a-7981-5f7f-bfd8-b5e6a927e1b7 with identifier: JC67757
2026-03-29 08:35:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e1a3ef2a-7981-5f7f-bfd8-b5e6a927e1b7 with identifier: JC67757 to the API
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:13:35Z',
 'fuel_type': 'diesel',
 'id': 'e1a3ef2a-7981-5f7f-bfd8-b5e6a927e1b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC67757',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 88121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-20',
 'seller_name': None,
 'title': 'Peugeot 5008 1.5 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2022}
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC67757%27 HTTP/1.1" 200 None
2026-03-29 08:35:15 [auto1.be] INFO: Saving data for JC67757: {'auction_closing_time': 1774883615.0, 'created_time': 1773349266.991987, 'last_price_update_time': 1774773315.916291}
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JC67757') HTTP/1.1" 204 0
2026-03-29 08:35:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fa3d86b2-2ccb-5bea-b032-780e3f253e78 with identifier: TG30379
2026-03-29 08:35:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fa3d86b2-2ccb-5bea-b032-780e3f253e78 with identifier: TG30379
2026-03-29 08:35:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fa3d86b2-2ccb-5bea-b032-780e3f253e78 with identifier: TG30379 to the API
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:40:10Z',
 'fuel_type': 'diesel',
 'id': 'fa3d86b2-2ccb-5bea-b032-780e3f253e78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG30379',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 208607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-30',
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 313 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TG30379%27 HTTP/1.1" 200 None
2026-03-29 08:35:16 [auto1.be] INFO: Saving data for TG30379: {'auction_closing_time': 1774885210.0, 'created_time': 1773132090.618136, 'last_price_update_time': 1774773316.254651}
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TG30379') HTTP/1.1" 204 0
2026-03-29 08:35:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 73524b7c-84a3-5c68-b1ec-ec391af4acdb with identifier: DE26055
2026-03-29 08:35:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 73524b7c-84a3-5c68-b1ec-ec391af4acdb with identifier: DE26055
2026-03-29 08:35:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 73524b7c-84a3-5c68-b1ec-ec391af4acdb with identifier: DE26055 to the API
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DE26055>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:23:15Z',
 'fuel_type': 'diesel',
 'id': '73524b7c-84a3-5c68-b1ec-ec391af4acdb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE26055',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 81926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img07/58/07585e84ff386be9467d54f1c1ab8af5/pa/DE26055_abe0347d1db5711cf7ea9f6525e64cc6.jpg',
                'https://img-pa.auto1.com/img07/58/07585e84ff386be9467d54f1c1ab8af5/pa/DE26055_ad72a909f1347529d108005f585e5552.jpg',
                'https://img-pa.auto1.com/img07/58/07585e84ff386be9467d54f1c1ab8af5/pa/DE26055_1778ebb3647065c29633f54d730183bd.jpg',
                'https://img-pa.auto1.com/img07/58/07585e84ff386be9467d54f1c1ab8af5/pa/DE26055_6f27540b50eaccaf402113ada65f7cfc.jpg',
                'https://img-pa.auto1.com/img07/58/07585e84ff386be9467d54f1c1ab8af5/pa/DE26055_902c1a97e16a401c421a67790de9dee3.jpg',
                'https://img-pa.auto1.com/img07/58/07585e84ff386be9467d54f1c1ab8af5/pa/DE26055_133be936f09caba52933303884837aef.jpg',
                'https://img-pa.auto1.com/img07/58/07585e84ff386be9467d54f1c1ab8af5/pa/DE26055_3319abeb842e1962db25c6354cc6b732.jpg',
                'https://img-pa.auto1.com/img07/58/07585e84ff386be9467d54f1c1ab8af5/pa/DE26055_153d834e89645708e0d9612dd441f4b0.jpg',
                'https://img-pa.auto1.com/img07/58/07585e84ff386be9467d54f1c1ab8af5/pa/DE26055_d559734add4bcedf23dba0cef08efaa9.jpg',
                'https://img-pa.auto1.com/img07/58/07585e84ff386be9467d54f1c1ab8af5/pa/DE26055_63ac2d876f609590c77e5ac596f8cee6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73524b7c-84a3-5c68-b1ec-ec391af4acdb/73524b7c-84a3-5c68-b1ec-ec391af4acdb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/58/07585e84ff386be9467d54f1c1ab8af5/pa/DE26055_abe0347d1db5711cf7ea9f6525e64cc6.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73524b7c-84a3-5c68-b1ec-ec391af4acdb/73524b7c-84a3-5c68-b1ec-ec391af4acdb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/58/07585e84ff386be9467d54f1c1ab8af5/pa/DE26055_ad72a909f1347529d108005f585e5552.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73524b7c-84a3-5c68-b1ec-ec391af4acdb/73524b7c-84a3-5c68-b1ec-ec391af4acdb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115666,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/58/07585e84ff386be9467d54f1c1ab8af5/pa/DE26055_1778ebb3647065c29633f54d730183bd.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73524b7c-84a3-5c68-b1ec-ec391af4acdb/73524b7c-84a3-5c68-b1ec-ec391af4acdb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/58/07585e84ff386be9467d54f1c1ab8af5/pa/DE26055_6f27540b50eaccaf402113ada65f7cfc.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73524b7c-84a3-5c68-b1ec-ec391af4acdb/73524b7c-84a3-5c68-b1ec-ec391af4acdb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/58/07585e84ff386be9467d54f1c1ab8af5/pa/DE26055_902c1a97e16a401c421a67790de9dee3.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73524b7c-84a3-5c68-b1ec-ec391af4acdb/73524b7c-84a3-5c68-b1ec-ec391af4acdb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/58/07585e84ff386be9467d54f1c1ab8af5/pa/DE26055_133be936f09caba52933303884837aef.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73524b7c-84a3-5c68-b1ec-ec391af4acdb/73524b7c-84a3-5c68-b1ec-ec391af4acdb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/58/07585e84ff386be9467d54f1c1ab8af5/pa/DE26055_3319abeb842e1962db25c6354cc6b732.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73524b7c-84a3-5c68-b1ec-ec391af4acdb/73524b7c-84a3-5c68-b1ec-ec391af4acdb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112740,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/58/07585e84ff386be9467d54f1c1ab8af5/pa/DE26055_153d834e89645708e0d9612dd441f4b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73524b7c-84a3-5c68-b1ec-ec391af4acdb/73524b7c-84a3-5c68-b1ec-ec391af4acdb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/58/07585e84ff386be9467d54f1c1ab8af5/pa/DE26055_d559734add4bcedf23dba0cef08efaa9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73524b7c-84a3-5c68-b1ec-ec391af4acdb/73524b7c-84a3-5c68-b1ec-ec391af4acdb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/58/07585e84ff386be9467d54f1c1ab8af5/pa/DE26055_63ac2d876f609590c77e5ac596f8cee6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Active Pack',
 'transmission': 'automatic',
 'trim': 'Active Pack',
 'year': 2023}
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE26055%27 HTTP/1.1" 200 None
2026-03-29 08:35:16 [auto1.be] INFO: Saving data for DE26055: {'created_time': 1774773316.675539, 'last_price_update_time': 1774773316.675547, 'auction_closing_time': 1774884195.0}
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DE26055') HTTP/1.1" 204 0
2026-03-29 08:35:16 [auto1.be] INFO: Found listing with ID: UA36767
2026-03-29 08:35:16 [auto1.be] INFO: Found listing with ID: VE25219
2026-03-29 08:35:16 [auto1.be] INFO: Found listing with ID: WA86347
2026-03-29 08:35:16 [auto1.be] INFO: Found listing with ID: PS31946
2026-03-29 08:35:16 [auto1.be] INFO: Found listing with ID: DY35896
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY35896%27 HTTP/1.1" 200 None
2026-03-29 08:35:16 [auto1.be] INFO: Scrape type for DY35896: 1
2026-03-29 08:35:16 [auto1.be] INFO: Found listing with ID: MX26890
2026-03-29 08:35:16 [auto1.be] INFO: Found listing with ID: DB21184
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB21184%27 HTTP/1.1" 200 None
2026-03-29 08:35:16 [auto1.be] INFO: Scrape type for DB21184: 2
2026-03-29 08:35:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 810a8a59-f990-5c63-bb42-8f748f7ec3d9 with identifier: DB21184
2026-03-29 08:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 810a8a59-f990-5c63-bb42-8f748f7ec3d9 with scrape type 2
2026-03-29 08:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 810a8a59-f990-5c63-bb42-8f748f7ec3d9 with scrape type 2
2026-03-29 08:35:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 810a8a59-f990-5c63-bb42-8f748f7ec3d9, identifier: DB21184
2026-03-29 08:35:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d69e4286-3d5c-56bc-8be5-eacf2bd1ef65 with identifier: XD29708
2026-03-29 08:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d69e4286-3d5c-56bc-8be5-eacf2bd1ef65 with scrape type 1
2026-03-29 08:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d69e4286-3d5c-56bc-8be5-eacf2bd1ef65
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F73%252F3b73d7f9c8d1ad81e2bd1a79b62a7df8%252Fpa%252FXD29708_ad50741f97825a8a349c051eedbb011f.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/73/3b73d7f9c8d1ad81e2bd1a79b62a7df8/pa/XD29708_ad50741f97825a8a349c051eedbb011f.jpg already downloaded
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F73%252F3b73d7f9c8d1ad81e2bd1a79b62a7df8%252Fpa%252FXD29708_2d6fb438bea8b10119cf6c84f2cc9121.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/73/3b73d7f9c8d1ad81e2bd1a79b62a7df8/pa/XD29708_2d6fb438bea8b10119cf6c84f2cc9121.jpg already downloaded
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F73%252F3b73d7f9c8d1ad81e2bd1a79b62a7df8%252Fpa%252FXD29708_7799ea134112c11f04dec97300500c55.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/73/3b73d7f9c8d1ad81e2bd1a79b62a7df8/pa/XD29708_7799ea134112c11f04dec97300500c55.jpg already downloaded
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F73%252F3b73d7f9c8d1ad81e2bd1a79b62a7df8%252Fpa%252FXD29708_5d93c2597b3c69f71b8d466a69ac196a.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/73/3b73d7f9c8d1ad81e2bd1a79b62a7df8/pa/XD29708_5d93c2597b3c69f71b8d466a69ac196a.jpg already downloaded
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F73%252F3b73d7f9c8d1ad81e2bd1a79b62a7df8%252Fpa%252FXD29708_6765a099b30077b776034db7cda8c0e1.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/73/3b73d7f9c8d1ad81e2bd1a79b62a7df8/pa/XD29708_6765a099b30077b776034db7cda8c0e1.jpg already downloaded
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F73%252F3b73d7f9c8d1ad81e2bd1a79b62a7df8%252Fpa%252FXD29708_12683173f5785c31018bf6f987e81cb0.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/73/3b73d7f9c8d1ad81e2bd1a79b62a7df8/pa/XD29708_12683173f5785c31018bf6f987e81cb0.jpg already downloaded
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F73%252F3b73d7f9c8d1ad81e2bd1a79b62a7df8%252Fpa%252FXD29708_dc54c6377f84dc77e8c4d1f1c8a199ed.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/73/3b73d7f9c8d1ad81e2bd1a79b62a7df8/pa/XD29708_dc54c6377f84dc77e8c4d1f1c8a199ed.jpg already downloaded
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F73%252F3b73d7f9c8d1ad81e2bd1a79b62a7df8%252Fpa%252FXD29708_4d0ec7e93139397cb5ad3ad3c448ab5c.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/73/3b73d7f9c8d1ad81e2bd1a79b62a7df8/pa/XD29708_4d0ec7e93139397cb5ad3ad3c448ab5c.jpg already downloaded
2026-03-29 08:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F73%252F3b73d7f9c8d1ad81e2bd1a79b62a7df8%252Fpa%252FXD29708_3fa08ebcbffb2b5d3167bc984b20bd1c.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/73/3b73d7f9c8d1ad81e2bd1a79b62a7df8/pa/XD29708_3fa08ebcbffb2b5d3167bc984b20bd1c.jpg already downloaded
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F73%252F3b73d7f9c8d1ad81e2bd1a79b62a7df8%252Fpa%252FXD29708_62262c7e09bcd9615d2b97b6e87aa7ff.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/73/3b73d7f9c8d1ad81e2bd1a79b62a7df8/pa/XD29708_62262c7e09bcd9615d2b97b6e87aa7ff.jpg already downloaded
2026-03-29 08:35:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d69e4286-3d5c-56bc-8be5-eacf2bd1ef65, identifier: XD29708
2026-03-29 08:35:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 810a8a59-f990-5c63-bb42-8f748f7ec3d9 with identifier: DB21184
2026-03-29 08:35:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 810a8a59-f990-5c63-bb42-8f748f7ec3d9 with identifier: DB21184
2026-03-29 08:35:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 810a8a59-f990-5c63-bb42-8f748f7ec3d9 with identifier: DB21184 to the API
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:30:16Z',
 'fuel_type': 'diesel',
 'id': '810a8a59-f990-5c63-bb42-8f748f7ec3d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB21184',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 145380,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-05',
 'seller_name': None,
 'title': 'BMW X2 sDrive 16d Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2019}
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB21184%27 HTTP/1.1" 200 None
2026-03-29 08:35:17 [auto1.be] INFO: Saving data for DB21184: {'auction_closing_time': 1774884616.0, 'created_time': 1773137053.882676, 'last_price_update_time': 1774773317.42062}
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DB21184') HTTP/1.1" 204 0
2026-03-29 08:35:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EN78807> (referer: https://www.auto1.com/v1/car-details-view/EN78807/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d69e4286-3d5c-56bc-8be5-eacf2bd1ef65 with identifier: XD29708
2026-03-29 08:35:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d69e4286-3d5c-56bc-8be5-eacf2bd1ef65 with identifier: XD29708
2026-03-29 08:35:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d69e4286-3d5c-56bc-8be5-eacf2bd1ef65 with identifier: XD29708 to the API
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XD29708>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D',
 'engine': '1.9L',
 'engine_horse_power': 306,
 'expiration_date': '2026-03-30T15:47:09Z',
 'fuel_type': 'hybrid',
 'id': 'd69e4286-3d5c-56bc-8be5-eacf2bd1ef65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD29708',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 49130,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img3b/73/3b73d7f9c8d1ad81e2bd1a79b62a7df8/pa/XD29708_ad50741f97825a8a349c051eedbb011f.jpg',
                'https://img-pa.auto1.com/img3b/73/3b73d7f9c8d1ad81e2bd1a79b62a7df8/pa/XD29708_2d6fb438bea8b10119cf6c84f2cc9121.jpg',
                'https://img-pa.auto1.com/img3b/73/3b73d7f9c8d1ad81e2bd1a79b62a7df8/pa/XD29708_7799ea134112c11f04dec97300500c55.jpg',
                'https://img-pa.auto1.com/img3b/73/3b73d7f9c8d1ad81e2bd1a79b62a7df8/pa/XD29708_5d93c2597b3c69f71b8d466a69ac196a.jpg',
                'https://img-pa.auto1.com/img3b/73/3b73d7f9c8d1ad81e2bd1a79b62a7df8/pa/XD29708_6765a099b30077b776034db7cda8c0e1.jpg',
                'https://img-pa.auto1.com/img3b/73/3b73d7f9c8d1ad81e2bd1a79b62a7df8/pa/XD29708_12683173f5785c31018bf6f987e81cb0.jpg',
                'https://img-pa.auto1.com/img3b/73/3b73d7f9c8d1ad81e2bd1a79b62a7df8/pa/XD29708_dc54c6377f84dc77e8c4d1f1c8a199ed.jpg',
                'https://img-pa.auto1.com/img3b/73/3b73d7f9c8d1ad81e2bd1a79b62a7df8/pa/XD29708_4d0ec7e93139397cb5ad3ad3c448ab5c.jpg',
                'https://img-pa.auto1.com/img3b/73/3b73d7f9c8d1ad81e2bd1a79b62a7df8/pa/XD29708_3fa08ebcbffb2b5d3167bc984b20bd1c.jpg',
                'https://img-pa.auto1.com/img3b/73/3b73d7f9c8d1ad81e2bd1a79b62a7df8/pa/XD29708_62262c7e09bcd9615d2b97b6e87aa7ff.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d69e4286-3d5c-56bc-8be5-eacf2bd1ef65/d69e4286-3d5c-56bc-8be5-eacf2bd1ef65_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/73/3b73d7f9c8d1ad81e2bd1a79b62a7df8/pa/XD29708_ad50741f97825a8a349c051eedbb011f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d69e4286-3d5c-56bc-8be5-eacf2bd1ef65/d69e4286-3d5c-56bc-8be5-eacf2bd1ef65_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81365,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/73/3b73d7f9c8d1ad81e2bd1a79b62a7df8/pa/XD29708_2d6fb438bea8b10119cf6c84f2cc9121.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d69e4286-3d5c-56bc-8be5-eacf2bd1ef65/d69e4286-3d5c-56bc-8be5-eacf2bd1ef65_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/73/3b73d7f9c8d1ad81e2bd1a79b62a7df8/pa/XD29708_7799ea134112c11f04dec97300500c55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d69e4286-3d5c-56bc-8be5-eacf2bd1ef65/d69e4286-3d5c-56bc-8be5-eacf2bd1ef65_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/73/3b73d7f9c8d1ad81e2bd1a79b62a7df8/pa/XD29708_5d93c2597b3c69f71b8d466a69ac196a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d69e4286-3d5c-56bc-8be5-eacf2bd1ef65/d69e4286-3d5c-56bc-8be5-eacf2bd1ef65_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/73/3b73d7f9c8d1ad81e2bd1a79b62a7df8/pa/XD29708_6765a099b30077b776034db7cda8c0e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d69e4286-3d5c-56bc-8be5-eacf2bd1ef65/d69e4286-3d5c-56bc-8be5-eacf2bd1ef65_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/73/3b73d7f9c8d1ad81e2bd1a79b62a7df8/pa/XD29708_12683173f5785c31018bf6f987e81cb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d69e4286-3d5c-56bc-8be5-eacf2bd1ef65/d69e4286-3d5c-56bc-8be5-eacf2bd1ef65_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68831,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/73/3b73d7f9c8d1ad81e2bd1a79b62a7df8/pa/XD29708_dc54c6377f84dc77e8c4d1f1c8a199ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d69e4286-3d5c-56bc-8be5-eacf2bd1ef65/d69e4286-3d5c-56bc-8be5-eacf2bd1ef65_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/73/3b73d7f9c8d1ad81e2bd1a79b62a7df8/pa/XD29708_4d0ec7e93139397cb5ad3ad3c448ab5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d69e4286-3d5c-56bc-8be5-eacf2bd1ef65/d69e4286-3d5c-56bc-8be5-eacf2bd1ef65_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/73/3b73d7f9c8d1ad81e2bd1a79b62a7df8/pa/XD29708_3fa08ebcbffb2b5d3167bc984b20bd1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d69e4286-3d5c-56bc-8be5-eacf2bd1ef65/d69e4286-3d5c-56bc-8be5-eacf2bd1ef65_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/73/3b73d7f9c8d1ad81e2bd1a79b62a7df8/pa/XD29708_62262c7e09bcd9615d2b97b6e87aa7ff.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300de AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD29708%27 HTTP/1.1" 200 None
2026-03-29 08:35:17 [auto1.be] INFO: Saving data for XD29708: {'created_time': 1774773317.838464, 'last_price_update_time': 1774773317.838473, 'auction_closing_time': 1774885629.0}
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XD29708') HTTP/1.1" 204 0
2026-03-29 08:35:17 [auto1.be] INFO: Found listing with ID: KZ95632
2026-03-29 08:35:17 [auto1.be] INFO: Found listing with ID: VM01272
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM01272%27 HTTP/1.1" 200 None
2026-03-29 08:35:17 [auto1.be] INFO: Scrape type for VM01272: 1
2026-03-29 08:35:17 [auto1.be] INFO: Found listing with ID: ZX91910
2026-03-29 08:35:17 [auto1.be] INFO: Found listing with ID: LU53556
2026-03-29 08:35:17 [auto1.be] INFO: Found listing with ID: TT03576
2026-03-29 08:35:17 [auto1.be] INFO: Found listing with ID: BD95571
2026-03-29 08:35:17 [auto1.be] INFO: Found listing with ID: EA40127
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA40127%27 HTTP/1.1" 200 None
2026-03-29 08:35:17 [auto1.be] INFO: Scrape type for EA40127: 1
2026-03-29 08:35:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ17047> (referer: https://www.auto1.com/v1/car-details-view/GZ17047/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:17 [auto1.be] INFO: Found listing with ID: KL42374
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KL42374%27 HTTP/1.1" 200 None
2026-03-29 08:35:17 [auto1.be] INFO: Scrape type for KL42374: 2
2026-03-29 08:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50 with identifier: KL42374
2026-03-29 08:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50 with scrape type 2
2026-03-29 08:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50 with scrape type 2
2026-03-29 08:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50, identifier: KL42374
2026-03-29 08:35:18 [auto1.be] INFO: Found listing with ID: TC19196
2026-03-29 08:35:18 [auto1.be] INFO: Found listing with ID: DF78239
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF78239%27 HTTP/1.1" 200 None
2026-03-29 08:35:18 [auto1.be] INFO: Scrape type for DF78239: 1
2026-03-29 08:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50 with identifier: KL42374
2026-03-29 08:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50 with identifier: KL42374
2026-03-29 08:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50 with identifier: KL42374 to the API
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 275,
 'expiration_date': '2026-03-30T15:16:09Z',
 'fuel_type': 'diesel',
 'id': 'ff21de76-5e2a-5dd3-9fc7-0b83e1b94c50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL42374',
 'listing': 'auction',
 'make': 'Maserati',
 'model': 'Ghibli',
 'odometer': 126833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-01',
 'seller_name': None,
 'title': 'Maserati Ghibli 3.0 V6 Diesel Gran Sport',
 'transmission': 'automatic',
 'trim': 'Gran Sport',
 'year': 2018}
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KL42374%27 HTTP/1.1" 200 None
2026-03-29 08:35:18 [auto1.be] INFO: Saving data for KL42374: {'auction_closing_time': 1774883769.0, 'created_time': 1774643456.198216, 'last_price_update_time': 1774773318.350399}
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KL42374') HTTP/1.1" 204 0
2026-03-29 08:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1552eff-f68b-5399-a228-70d5fa5e2bbd with identifier: EN78807
2026-03-29 08:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1552eff-f68b-5399-a228-70d5fa5e2bbd with scrape type 1
2026-03-29 08:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d1552eff-f68b-5399-a228-70d5fa5e2bbd
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F97%252Fba978822f5e2c3882131f821b89b7a10%252Fpa%252FEN78807_27acee8d87a6afd0a7ef19fd1e2d5671.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/97/ba978822f5e2c3882131f821b89b7a10/pa/EN78807_27acee8d87a6afd0a7ef19fd1e2d5671.jpg already downloaded
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F97%252Fba978822f5e2c3882131f821b89b7a10%252Fpa%252FEN78807_7197d4b4622b285c92de82c6b7699941.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/97/ba978822f5e2c3882131f821b89b7a10/pa/EN78807_7197d4b4622b285c92de82c6b7699941.jpg already downloaded
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F97%252Fba978822f5e2c3882131f821b89b7a10%252Fpa%252FEN78807_57575f1ec3b095d8bd20acbb2a93e631.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/97/ba978822f5e2c3882131f821b89b7a10/pa/EN78807_57575f1ec3b095d8bd20acbb2a93e631.jpg already downloaded
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F97%252Fba978822f5e2c3882131f821b89b7a10%252Fpa%252FEN78807_a601847cf24d0dfd97fc8c8913b3ca22.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/97/ba978822f5e2c3882131f821b89b7a10/pa/EN78807_a601847cf24d0dfd97fc8c8913b3ca22.jpg already downloaded
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F97%252Fba978822f5e2c3882131f821b89b7a10%252Fpa%252FEN78807_f37a5c0b5a3372fae957017e167eeb23.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/97/ba978822f5e2c3882131f821b89b7a10/pa/EN78807_f37a5c0b5a3372fae957017e167eeb23.jpg already downloaded
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F97%252Fba978822f5e2c3882131f821b89b7a10%252Fpa%252FEN78807_f71e4374fcfab7b0f9296a43fe6534d4.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/97/ba978822f5e2c3882131f821b89b7a10/pa/EN78807_f71e4374fcfab7b0f9296a43fe6534d4.jpg already downloaded
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F97%252Fba978822f5e2c3882131f821b89b7a10%252Fpa%252FEN78807_bf203a0f79558ab6e2dbf750b57375f9.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/97/ba978822f5e2c3882131f821b89b7a10/pa/EN78807_bf203a0f79558ab6e2dbf750b57375f9.jpg already downloaded
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F97%252Fba978822f5e2c3882131f821b89b7a10%252Fpa%252FEN78807_a911e5c4e69c45dcdd795d609378ab84.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/97/ba978822f5e2c3882131f821b89b7a10/pa/EN78807_a911e5c4e69c45dcdd795d609378ab84.jpg already downloaded
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F97%252Fba978822f5e2c3882131f821b89b7a10%252Fpa%252FEN78807_f2a6206354305ceebada0d19dce0c56f.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/97/ba978822f5e2c3882131f821b89b7a10/pa/EN78807_f2a6206354305ceebada0d19dce0c56f.jpg already downloaded
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F97%252Fba978822f5e2c3882131f821b89b7a10%252Fpa%252FEN78807_c62aa2cfd3f53783e31de16a1a9904e7.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/97/ba978822f5e2c3882131f821b89b7a10/pa/EN78807_c62aa2cfd3f53783e31de16a1a9904e7.jpg already downloaded
2026-03-29 08:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d1552eff-f68b-5399-a228-70d5fa5e2bbd, identifier: EN78807
2026-03-29 08:35:18 [auto1.be] INFO: Found listing with ID: UF75491
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF75491%27 HTTP/1.1" 200 None
2026-03-29 08:35:18 [auto1.be] INFO: Scrape type for UF75491: 2
2026-03-29 08:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31d5c763-c727-54ba-a535-c23725c647f6 with identifier: UF75491
2026-03-29 08:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31d5c763-c727-54ba-a535-c23725c647f6 with scrape type 2
2026-03-29 08:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31d5c763-c727-54ba-a535-c23725c647f6 with scrape type 2
2026-03-29 08:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 31d5c763-c727-54ba-a535-c23725c647f6, identifier: UF75491
2026-03-29 08:35:18 [auto1.be] INFO: Found listing with ID: CM14446
2026-03-29 08:35:18 [auto1.be] INFO: Found listing with ID: VE29498
2026-03-29 08:35:18 [auto1.be] INFO: Found listing with ID: BE62996
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BE62996%27 HTTP/1.1" 200 None
2026-03-29 08:35:18 [auto1.be] INFO: Scrape type for BE62996: 2
2026-03-29 08:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4eae0644-0fc4-5599-9021-d8350facc148 with identifier: BE62996
2026-03-29 08:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4eae0644-0fc4-5599-9021-d8350facc148 with scrape type 2
2026-03-29 08:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4eae0644-0fc4-5599-9021-d8350facc148 with scrape type 2
2026-03-29 08:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4eae0644-0fc4-5599-9021-d8350facc148, identifier: BE62996
2026-03-29 08:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d1552eff-f68b-5399-a228-70d5fa5e2bbd with identifier: EN78807
2026-03-29 08:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d1552eff-f68b-5399-a228-70d5fa5e2bbd with identifier: EN78807
2026-03-29 08:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d1552eff-f68b-5399-a228-70d5fa5e2bbd with identifier: EN78807 to the API
2026-03-29 08:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EN78807>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6B',
 'engine': '1.2L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:24:45Z',
 'fuel_type': 'petrol',
 'id': 'd1552eff-f68b-5399-a228-70d5fa5e2bbd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN78807',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 99041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgba/97/ba978822f5e2c3882131f821b89b7a10/pa/EN78807_27acee8d87a6afd0a7ef19fd1e2d5671.jpg',
                'https://img-pa.auto1.com/imgba/97/ba978822f5e2c3882131f821b89b7a10/pa/EN78807_7197d4b4622b285c92de82c6b7699941.jpg',
                'https://img-pa.auto1.com/imgba/97/ba978822f5e2c3882131f821b89b7a10/pa/EN78807_57575f1ec3b095d8bd20acbb2a93e631.jpg',
                'https://img-pa.auto1.com/imgba/97/ba978822f5e2c3882131f821b89b7a10/pa/EN78807_a601847cf24d0dfd97fc8c8913b3ca22.jpg',
                'https://img-pa.auto1.com/imgba/97/ba978822f5e2c3882131f821b89b7a10/pa/EN78807_f37a5c0b5a3372fae957017e167eeb23.jpg',
                'https://img-pa.auto1.com/imgba/97/ba978822f5e2c3882131f821b89b7a10/pa/EN78807_f71e4374fcfab7b0f9296a43fe6534d4.jpg',
                'https://img-pa.auto1.com/imgba/97/ba978822f5e2c3882131f821b89b7a10/pa/EN78807_bf203a0f79558ab6e2dbf750b57375f9.jpg',
                'https://img-pa.auto1.com/imgba/97/ba978822f5e2c3882131f821b89b7a10/pa/EN78807_a911e5c4e69c45dcdd795d609378ab84.jpg',
                'https://img-pa.auto1.com/imgba/97/ba978822f5e2c3882131f821b89b7a10/pa/EN78807_f2a6206354305ceebada0d19dce0c56f.jpg',
                'https://img-pa.auto1.com/imgba/97/ba978822f5e2c3882131f821b89b7a10/pa/EN78807_c62aa2cfd3f53783e31de16a1a9904e7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1552eff-f68b-5399-a228-70d5fa5e2bbd/d1552eff-f68b-5399-a228-70d5fa5e2bbd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/97/ba978822f5e2c3882131f821b89b7a10/pa/EN78807_27acee8d87a6afd0a7ef19fd1e2d5671.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1552eff-f68b-5399-a228-70d5fa5e2bbd/d1552eff-f68b-5399-a228-70d5fa5e2bbd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/97/ba978822f5e2c3882131f821b89b7a10/pa/EN78807_7197d4b4622b285c92de82c6b7699941.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1552eff-f68b-5399-a228-70d5fa5e2bbd/d1552eff-f68b-5399-a228-70d5fa5e2bbd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/97/ba978822f5e2c3882131f821b89b7a10/pa/EN78807_57575f1ec3b095d8bd20acbb2a93e631.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1552eff-f68b-5399-a228-70d5fa5e2bbd/d1552eff-f68b-5399-a228-70d5fa5e2bbd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68644,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/97/ba978822f5e2c3882131f821b89b7a10/pa/EN78807_a601847cf24d0dfd97fc8c8913b3ca22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1552eff-f68b-5399-a228-70d5fa5e2bbd/d1552eff-f68b-5399-a228-70d5fa5e2bbd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/97/ba978822f5e2c3882131f821b89b7a10/pa/EN78807_f37a5c0b5a3372fae957017e167eeb23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1552eff-f68b-5399-a228-70d5fa5e2bbd/d1552eff-f68b-5399-a228-70d5fa5e2bbd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/97/ba978822f5e2c3882131f821b89b7a10/pa/EN78807_f71e4374fcfab7b0f9296a43fe6534d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1552eff-f68b-5399-a228-70d5fa5e2bbd/d1552eff-f68b-5399-a228-70d5fa5e2bbd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/97/ba978822f5e2c3882131f821b89b7a10/pa/EN78807_bf203a0f79558ab6e2dbf750b57375f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1552eff-f68b-5399-a228-70d5fa5e2bbd/d1552eff-f68b-5399-a228-70d5fa5e2bbd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76754,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/97/ba978822f5e2c3882131f821b89b7a10/pa/EN78807_a911e5c4e69c45dcdd795d609378ab84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1552eff-f68b-5399-a228-70d5fa5e2bbd/d1552eff-f68b-5399-a228-70d5fa5e2bbd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/97/ba978822f5e2c3882131f821b89b7a10/pa/EN78807_f2a6206354305ceebada0d19dce0c56f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1552eff-f68b-5399-a228-70d5fa5e2bbd/d1552eff-f68b-5399-a228-70d5fa5e2bbd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/97/ba978822f5e2c3882131f821b89b7a10/pa/EN78807_c62aa2cfd3f53783e31de16a1a9904e7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-17',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-29 08:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN78807%27 HTTP/1.1" 200 None
2026-03-29 08:35:19 [auto1.be] INFO: Saving data for EN78807: {'created_time': 1774773319.368262, 'last_price_update_time': 1774773319.368274, 'auction_closing_time': 1774884285.0}
2026-03-29 08:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EN78807') HTTP/1.1" 204 0
2026-03-29 08:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 31d5c763-c727-54ba-a535-c23725c647f6 with identifier: UF75491
2026-03-29 08:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 31d5c763-c727-54ba-a535-c23725c647f6 with identifier: UF75491
2026-03-29 08:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 31d5c763-c727-54ba-a535-c23725c647f6 with identifier: UF75491 to the API
2026-03-29 08:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:56:47Z',
 'fuel_type': 'diesel',
 'id': '31d5c763-c727-54ba-a535-c23725c647f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF75491',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 212924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-23',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2012}
2026-03-29 08:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF75491%27 HTTP/1.1" 200 None
2026-03-29 08:35:19 [auto1.be] INFO: Saving data for UF75491: {'auction_closing_time': 1774886207.0, 'created_time': 1773133264.509273, 'last_price_update_time': 1774773319.766079}
2026-03-29 08:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UF75491') HTTP/1.1" 204 0
2026-03-29 08:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4eae0644-0fc4-5599-9021-d8350facc148 with identifier: BE62996
2026-03-29 08:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4eae0644-0fc4-5599-9021-d8350facc148 with identifier: BE62996
2026-03-29 08:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4eae0644-0fc4-5599-9021-d8350facc148 with identifier: BE62996 to the API
2026-03-29 08:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:26:40Z',
 'fuel_type': 'petrol',
 'id': '4eae0644-0fc4-5599-9021-d8350facc148',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE62996',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 86259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-30',
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2019}
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BE62996%27 HTTP/1.1" 200 None
2026-03-29 08:35:20 [auto1.be] INFO: Saving data for BE62996: {'auction_closing_time': 1774884400.0, 'created_time': 1773224103.990911, 'last_price_update_time': 1774773320.098668}
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BE62996') HTTP/1.1" 204 0
2026-03-29 08:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07dc1ade-6431-5648-9305-f3d9cca346f9 with identifier: GZ17047
2026-03-29 08:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07dc1ade-6431-5648-9305-f3d9cca346f9 with scrape type 1
2026-03-29 08:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 07dc1ade-6431-5648-9305-f3d9cca346f9
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F21%252Fd621ca7e6d4f6cc2be92b3c11913ac3a%252Fpa%252FGZ17047_7f7cbfd77ff3c24a2f435eba3e8c6b4a.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/21/d621ca7e6d4f6cc2be92b3c11913ac3a/pa/GZ17047_7f7cbfd77ff3c24a2f435eba3e8c6b4a.jpg already downloaded
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F21%252Fd621ca7e6d4f6cc2be92b3c11913ac3a%252Fpa%252FGZ17047_1a5335ffc15da5920a2d3b635fb1a72b.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/21/d621ca7e6d4f6cc2be92b3c11913ac3a/pa/GZ17047_1a5335ffc15da5920a2d3b635fb1a72b.jpg already downloaded
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F21%252Fd621ca7e6d4f6cc2be92b3c11913ac3a%252Fpa%252FGZ17047_cd24243b54e1d2d421dc141319c453bc.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/21/d621ca7e6d4f6cc2be92b3c11913ac3a/pa/GZ17047_cd24243b54e1d2d421dc141319c453bc.jpg already downloaded
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F21%252Fd621ca7e6d4f6cc2be92b3c11913ac3a%252Fpa%252FGZ17047_4df48e353da935fbfae6c796dd8b14d5.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/21/d621ca7e6d4f6cc2be92b3c11913ac3a/pa/GZ17047_4df48e353da935fbfae6c796dd8b14d5.jpg already downloaded
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F21%252Fd621ca7e6d4f6cc2be92b3c11913ac3a%252Fpa%252FGZ17047_87dadea18f3594b21f34f9caf5f8ed73.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/21/d621ca7e6d4f6cc2be92b3c11913ac3a/pa/GZ17047_87dadea18f3594b21f34f9caf5f8ed73.jpg already downloaded
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F21%252Fd621ca7e6d4f6cc2be92b3c11913ac3a%252Fpa%252FGZ17047_2a12880b6673dcf3ddd3ade0a8ce83d8.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/21/d621ca7e6d4f6cc2be92b3c11913ac3a/pa/GZ17047_2a12880b6673dcf3ddd3ade0a8ce83d8.jpg already downloaded
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F21%252Fd621ca7e6d4f6cc2be92b3c11913ac3a%252Fpa%252FGZ17047_ee91985f170ff1ba0afb24a4e1ecde6d.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/21/d621ca7e6d4f6cc2be92b3c11913ac3a/pa/GZ17047_ee91985f170ff1ba0afb24a4e1ecde6d.jpg already downloaded
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F21%252Fd621ca7e6d4f6cc2be92b3c11913ac3a%252Fpa%252FGZ17047_3b369a20559481e3131e693419fb279e.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/21/d621ca7e6d4f6cc2be92b3c11913ac3a/pa/GZ17047_3b369a20559481e3131e693419fb279e.jpg already downloaded
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F21%252Fd621ca7e6d4f6cc2be92b3c11913ac3a%252Fpa%252FGZ17047_623c405388cbe558e8750062ac58f83e.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/21/d621ca7e6d4f6cc2be92b3c11913ac3a/pa/GZ17047_623c405388cbe558e8750062ac58f83e.jpg already downloaded
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F21%252Fd621ca7e6d4f6cc2be92b3c11913ac3a%252Fpa%252FGZ17047_190cf9ba6ec7c893feab5826501d6b39.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/21/d621ca7e6d4f6cc2be92b3c11913ac3a/pa/GZ17047_190cf9ba6ec7c893feab5826501d6b39.jpg already downloaded
2026-03-29 08:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 07dc1ade-6431-5648-9305-f3d9cca346f9, identifier: GZ17047
2026-03-29 08:35:20 [auto1.be] INFO: Found listing with ID: ZP25114
2026-03-29 08:35:20 [auto1.be] INFO: Found listing with ID: FP22064
2026-03-29 08:35:20 [auto1.be] INFO: Found listing with ID: EL71552
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL71552%27 HTTP/1.1" 200 None
2026-03-29 08:35:20 [auto1.be] INFO: Scrape type for EL71552: 2
2026-03-29 08:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d749a67-a5b3-5c03-8979-33e82d662694 with identifier: EL71552
2026-03-29 08:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d749a67-a5b3-5c03-8979-33e82d662694 with scrape type 2
2026-03-29 08:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d749a67-a5b3-5c03-8979-33e82d662694 with scrape type 2
2026-03-29 08:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0d749a67-a5b3-5c03-8979-33e82d662694, identifier: EL71552
2026-03-29 08:35:20 [auto1.be] INFO: Found listing with ID: AM49333
2026-03-29 08:35:20 [auto1.be] INFO: Found listing with ID: EL91929
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL91929%27 HTTP/1.1" 200 None
2026-03-29 08:35:20 [auto1.be] INFO: Scrape type for EL91929: 2
2026-03-29 08:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 078a1d43-c79b-5739-8d43-253a90eb93db with identifier: EL91929
2026-03-29 08:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 078a1d43-c79b-5739-8d43-253a90eb93db with scrape type 2
2026-03-29 08:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 078a1d43-c79b-5739-8d43-253a90eb93db with scrape type 2
2026-03-29 08:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 078a1d43-c79b-5739-8d43-253a90eb93db, identifier: EL91929
2026-03-29 08:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 07dc1ade-6431-5648-9305-f3d9cca346f9 with identifier: GZ17047
2026-03-29 08:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 07dc1ade-6431-5648-9305-f3d9cca346f9 with identifier: GZ17047
2026-03-29 08:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 07dc1ade-6431-5648-9305-f3d9cca346f9 with identifier: GZ17047 to the API
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GZ17047>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:37:42Z',
 'fuel_type': 'petrol',
 'id': '07dc1ade-6431-5648-9305-f3d9cca346f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ17047',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 99044,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgd6/21/d621ca7e6d4f6cc2be92b3c11913ac3a/pa/GZ17047_7f7cbfd77ff3c24a2f435eba3e8c6b4a.jpg',
                'https://img-pa.auto1.com/imgd6/21/d621ca7e6d4f6cc2be92b3c11913ac3a/pa/GZ17047_1a5335ffc15da5920a2d3b635fb1a72b.jpg',
                'https://img-pa.auto1.com/imgd6/21/d621ca7e6d4f6cc2be92b3c11913ac3a/pa/GZ17047_cd24243b54e1d2d421dc141319c453bc.jpg',
                'https://img-pa.auto1.com/imgd6/21/d621ca7e6d4f6cc2be92b3c11913ac3a/pa/GZ17047_4df48e353da935fbfae6c796dd8b14d5.jpg',
                'https://img-pa.auto1.com/imgd6/21/d621ca7e6d4f6cc2be92b3c11913ac3a/pa/GZ17047_87dadea18f3594b21f34f9caf5f8ed73.jpg',
                'https://img-pa.auto1.com/imgd6/21/d621ca7e6d4f6cc2be92b3c11913ac3a/pa/GZ17047_2a12880b6673dcf3ddd3ade0a8ce83d8.jpg',
                'https://img-pa.auto1.com/imgd6/21/d621ca7e6d4f6cc2be92b3c11913ac3a/pa/GZ17047_ee91985f170ff1ba0afb24a4e1ecde6d.jpg',
                'https://img-pa.auto1.com/imgd6/21/d621ca7e6d4f6cc2be92b3c11913ac3a/pa/GZ17047_3b369a20559481e3131e693419fb279e.jpg',
                'https://img-pa.auto1.com/imgd6/21/d621ca7e6d4f6cc2be92b3c11913ac3a/pa/GZ17047_623c405388cbe558e8750062ac58f83e.jpg',
                'https://img-pa.auto1.com/imgd6/21/d621ca7e6d4f6cc2be92b3c11913ac3a/pa/GZ17047_190cf9ba6ec7c893feab5826501d6b39.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07dc1ade-6431-5648-9305-f3d9cca346f9/07dc1ade-6431-5648-9305-f3d9cca346f9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/21/d621ca7e6d4f6cc2be92b3c11913ac3a/pa/GZ17047_7f7cbfd77ff3c24a2f435eba3e8c6b4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07dc1ade-6431-5648-9305-f3d9cca346f9/07dc1ade-6431-5648-9305-f3d9cca346f9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/21/d621ca7e6d4f6cc2be92b3c11913ac3a/pa/GZ17047_1a5335ffc15da5920a2d3b635fb1a72b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07dc1ade-6431-5648-9305-f3d9cca346f9/07dc1ade-6431-5648-9305-f3d9cca346f9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/21/d621ca7e6d4f6cc2be92b3c11913ac3a/pa/GZ17047_cd24243b54e1d2d421dc141319c453bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07dc1ade-6431-5648-9305-f3d9cca346f9/07dc1ade-6431-5648-9305-f3d9cca346f9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/21/d621ca7e6d4f6cc2be92b3c11913ac3a/pa/GZ17047_4df48e353da935fbfae6c796dd8b14d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07dc1ade-6431-5648-9305-f3d9cca346f9/07dc1ade-6431-5648-9305-f3d9cca346f9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/21/d621ca7e6d4f6cc2be92b3c11913ac3a/pa/GZ17047_87dadea18f3594b21f34f9caf5f8ed73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07dc1ade-6431-5648-9305-f3d9cca346f9/07dc1ade-6431-5648-9305-f3d9cca346f9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/21/d621ca7e6d4f6cc2be92b3c11913ac3a/pa/GZ17047_2a12880b6673dcf3ddd3ade0a8ce83d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07dc1ade-6431-5648-9305-f3d9cca346f9/07dc1ade-6431-5648-9305-f3d9cca346f9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/21/d621ca7e6d4f6cc2be92b3c11913ac3a/pa/GZ17047_ee91985f170ff1ba0afb24a4e1ecde6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07dc1ade-6431-5648-9305-f3d9cca346f9/07dc1ade-6431-5648-9305-f3d9cca346f9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65640,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/21/d621ca7e6d4f6cc2be92b3c11913ac3a/pa/GZ17047_3b369a20559481e3131e693419fb279e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07dc1ade-6431-5648-9305-f3d9cca346f9/07dc1ade-6431-5648-9305-f3d9cca346f9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/21/d621ca7e6d4f6cc2be92b3c11913ac3a/pa/GZ17047_623c405388cbe558e8750062ac58f83e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07dc1ade-6431-5648-9305-f3d9cca346f9/07dc1ade-6431-5648-9305-f3d9cca346f9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/21/d621ca7e6d4f6cc2be92b3c11913ac3a/pa/GZ17047_190cf9ba6ec7c893feab5826501d6b39.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Renegade 1.0 TGDi Sport 4x2',
 'transmission': 'manual',
 'trim': 'Sport 4x2',
 'year': 2019}
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GZ17047%27 HTTP/1.1" 200 None
2026-03-29 08:35:20 [auto1.be] INFO: Saving data for GZ17047: {'created_time': 1774773320.904222, 'last_price_update_time': 1774773320.904232, 'auction_closing_time': 1774885062.0}
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GZ17047') HTTP/1.1" 204 0
2026-03-29 08:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0d749a67-a5b3-5c03-8979-33e82d662694 with identifier: EL71552
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 08:35:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-29 08:35:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 08:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0d749a67-a5b3-5c03-8979-33e82d662694 with identifier: EL71552
2026-03-29 08:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0d749a67-a5b3-5c03-8979-33e82d662694 with identifier: EL71552 to the API
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:26:44Z',
 'fuel_type': 'petrol',
 'id': '0d749a67-a5b3-5c03-8979-33e82d662694',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL71552',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 183139,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-15',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 360',
 'transmission': 'automatic',
 'trim': '360',
 'year': 2015}
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL71552%27 HTTP/1.1" 200 None
2026-03-29 08:35:21 [auto1.be] INFO: Saving data for EL71552: {'auction_closing_time': 1774884404.0, 'created_time': 1773133233.497316, 'last_price_update_time': 1774773321.391836}
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EL71552') HTTP/1.1" 204 0
2026-03-29 08:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 078a1d43-c79b-5739-8d43-253a90eb93db with identifier: EL91929
2026-03-29 08:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 078a1d43-c79b-5739-8d43-253a90eb93db with identifier: EL91929
2026-03-29 08:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 078a1d43-c79b-5739-8d43-253a90eb93db with identifier: EL91929 to the API
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:04:58Z',
 'fuel_type': 'petrol',
 'id': '078a1d43-c79b-5739-8d43-253a90eb93db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL91929',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 96090,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-31',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 T4 R-Design AWD',
 'transmission': 'automatic',
 'trim': 'R-Design AWD',
 'year': 2019}
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL91929%27 HTTP/1.1" 200 None
2026-03-29 08:35:21 [auto1.be] INFO: Saving data for EL91929: {'auction_closing_time': 1774883098.0, 'created_time': 1773134160.940849, 'last_price_update_time': 1774773321.71885}
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EL91929') HTTP/1.1" 204 0
2026-03-29 08:35:21 [auto1.be] INFO: Found listing with ID: SK78967
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK78967%27 HTTP/1.1" 200 None
2026-03-29 08:35:21 [auto1.be] INFO: Scrape type for SK78967: 2
2026-03-29 08:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3445d87-79fb-52d7-be15-5882fef0d262 with identifier: SK78967
2026-03-29 08:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3445d87-79fb-52d7-be15-5882fef0d262 with scrape type 2
2026-03-29 08:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3445d87-79fb-52d7-be15-5882fef0d262 with scrape type 2
2026-03-29 08:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f3445d87-79fb-52d7-be15-5882fef0d262, identifier: SK78967
2026-03-29 08:35:21 [auto1.be] INFO: Found listing with ID: FC05247
2026-03-29 08:35:21 [auto1.be] INFO: Found listing with ID: NC38410
2026-03-29 08:35:21 [auto1.be] INFO: Found listing with ID: LE91648
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE91648%27 HTTP/1.1" 200 None
2026-03-29 08:35:21 [auto1.be] INFO: Scrape type for LE91648: 2
2026-03-29 08:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1efb1a35-4c8a-549d-941c-7eb47a31c85b with identifier: LE91648
2026-03-29 08:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1efb1a35-4c8a-549d-941c-7eb47a31c85b with scrape type 2
2026-03-29 08:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1efb1a35-4c8a-549d-941c-7eb47a31c85b with scrape type 2
2026-03-29 08:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1efb1a35-4c8a-549d-941c-7eb47a31c85b, identifier: LE91648
2026-03-29 08:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f3445d87-79fb-52d7-be15-5882fef0d262 with identifier: SK78967
2026-03-29 08:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f3445d87-79fb-52d7-be15-5882fef0d262 with identifier: SK78967
2026-03-29 08:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f3445d87-79fb-52d7-be15-5882fef0d262 with identifier: SK78967 to the API
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:31:14Z',
 'fuel_type': 'diesel',
 'id': 'f3445d87-79fb-52d7-be15-5882fef0d262',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK78967',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 180334,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-22',
 'seller_name': None,
 'title': 'BMW 4er 418d Gran Coupé M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK78967%27 HTTP/1.1" 200 None
2026-03-29 08:35:22 [auto1.be] INFO: Saving data for SK78967: {'auction_closing_time': 1774884674.0, 'created_time': 1773134804.365513, 'last_price_update_time': 1774773322.28208}
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SK78967') HTTP/1.1" 204 0
2026-03-29 08:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1efb1a35-4c8a-549d-941c-7eb47a31c85b with identifier: LE91648
2026-03-29 08:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1efb1a35-4c8a-549d-941c-7eb47a31c85b with identifier: LE91648
2026-03-29 08:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1efb1a35-4c8a-549d-941c-7eb47a31c85b with identifier: LE91648 to the API
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:33:15Z',
 'fuel_type': 'diesel',
 'id': '1efb1a35-4c8a-549d-941c-7eb47a31c85b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE91648',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 122827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-03',
 'seller_name': None,
 'title': 'BMW 3er 320d GT M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE91648%27 HTTP/1.1" 200 None
2026-03-29 08:35:22 [auto1.be] INFO: Saving data for LE91648: {'auction_closing_time': 1774884795.0, 'created_time': 1773136989.3621, 'last_price_update_time': 1774773322.588719}
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LE91648') HTTP/1.1" 204 0
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: ZZ00486
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ00486%27 HTTP/1.1" 200 None
2026-03-29 08:35:22 [auto1.be] INFO: Scrape type for ZZ00486: 1
2026-03-29 08:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: TX69988
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: HK94342
2026-03-29 08:35:22 [auto1.be] INFO: Found listing with ID: YK14398
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK14398%27 HTTP/1.1" 200 None
2026-03-29 08:35:22 [auto1.be] INFO: Scrape type for YK14398: 2
2026-03-29 08:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af1030bb-e11c-5961-bd74-3b365bf0ed3c with identifier: YK14398
2026-03-29 08:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af1030bb-e11c-5961-bd74-3b365bf0ed3c with scrape type 2
2026-03-29 08:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af1030bb-e11c-5961-bd74-3b365bf0ed3c with scrape type 2
2026-03-29 08:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: af1030bb-e11c-5961-bd74-3b365bf0ed3c, identifier: YK14398
2026-03-29 08:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: af1030bb-e11c-5961-bd74-3b365bf0ed3c with identifier: YK14398
2026-03-29 08:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: af1030bb-e11c-5961-bd74-3b365bf0ed3c with identifier: YK14398
2026-03-29 08:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: af1030bb-e11c-5961-bd74-3b365bf0ed3c with identifier: YK14398 to the API
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:17:41Z',
 'fuel_type': 'diesel',
 'id': 'af1030bb-e11c-5961-bd74-3b365bf0ed3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK14398',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 169153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-30',
 'seller_name': None,
 'title': 'MINI Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK14398%27 HTTP/1.1" 200 None
2026-03-29 08:35:23 [auto1.be] INFO: Saving data for YK14398: {'auction_closing_time': 1774883861.0, 'created_time': 1773301704.078089, 'last_price_update_time': 1774773323.035091}
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YK14398') HTTP/1.1" 204 0
2026-03-29 08:35:23 [auto1.be] INFO: Found listing with ID: FC68971
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC68971%27 HTTP/1.1" 200 None
2026-03-29 08:35:23 [auto1.be] INFO: Scrape type for FC68971: 2
2026-03-29 08:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72c53946-e7ab-574c-b3da-793c735f791b with identifier: FC68971
2026-03-29 08:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72c53946-e7ab-574c-b3da-793c735f791b with scrape type 2
2026-03-29 08:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72c53946-e7ab-574c-b3da-793c735f791b with scrape type 2
2026-03-29 08:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 72c53946-e7ab-574c-b3da-793c735f791b, identifier: FC68971
2026-03-29 08:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 72c53946-e7ab-574c-b3da-793c735f791b with identifier: FC68971
2026-03-29 08:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 72c53946-e7ab-574c-b3da-793c735f791b with identifier: FC68971
2026-03-29 08:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 72c53946-e7ab-574c-b3da-793c735f791b with identifier: FC68971 to the API
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:23:29Z',
 'fuel_type': 'diesel',
 'id': '72c53946-e7ab-574c-b3da-793c735f791b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC68971',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XE',
 'odometer': 76835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-07',
 'seller_name': None,
 'title': 'Jaguar XE 20d R-Sport',
 'transmission': 'automatic',
 'trim': 'R-Sport',
 'year': 2017}
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC68971%27 HTTP/1.1" 200 None
2026-03-29 08:35:23 [auto1.be] INFO: Saving data for FC68971: {'auction_closing_time': 1774884209.0, 'created_time': 1773136187.526546, 'last_price_update_time': 1774773323.585005}
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FC68971') HTTP/1.1" 204 0
2026-03-29 08:35:23 [auto1.be] INFO: Channel: 24h | Page: 5 | totalHits: 1252 | hits on page: 40
2026-03-29 08:35:23 [auto1.be] INFO: Found listing with ID: SL05027
2026-03-29 08:35:23 [auto1.be] INFO: Found listing with ID: TE49371
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE49371%27 HTTP/1.1" 200 None
2026-03-29 08:35:23 [auto1.be] INFO: Scrape type for TE49371: 1
2026-03-29 08:35:23 [auto1.be] INFO: Found listing with ID: SB67636
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB67636%27 HTTP/1.1" 200 None
2026-03-29 08:35:23 [auto1.be] INFO: Scrape type for SB67636: 2
2026-03-29 08:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbebe295-ccd7-5e45-a4df-92b27a8f0ccb with identifier: SB67636
2026-03-29 08:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbebe295-ccd7-5e45-a4df-92b27a8f0ccb with scrape type 2
2026-03-29 08:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbebe295-ccd7-5e45-a4df-92b27a8f0ccb with scrape type 2
2026-03-29 08:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cbebe295-ccd7-5e45-a4df-92b27a8f0ccb, identifier: SB67636
2026-03-29 08:35:23 [auto1.be] INFO: Found listing with ID: EK47235
2026-03-29 08:35:23 [auto1.be] INFO: Found listing with ID: SJ26894
2026-03-29 08:35:23 [auto1.be] INFO: Found listing with ID: VP06293
2026-03-29 08:35:23 [auto1.be] INFO: Found listing with ID: CC34063
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC34063%27 HTTP/1.1" 200 None
2026-03-29 08:35:23 [auto1.be] INFO: Scrape type for CC34063: 1
2026-03-29 08:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cbebe295-ccd7-5e45-a4df-92b27a8f0ccb with identifier: SB67636
2026-03-29 08:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cbebe295-ccd7-5e45-a4df-92b27a8f0ccb with identifier: SB67636
2026-03-29 08:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cbebe295-ccd7-5e45-a4df-92b27a8f0ccb with identifier: SB67636 to the API
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:27:27Z',
 'fuel_type': 'diesel',
 'id': 'cbebe295-ccd7-5e45-a4df-92b27a8f0ccb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB67636',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 204706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-29',
 'seller_name': None,
 'title': 'Fiat Ducato 2.3 Multijet L2H2 RS: 3450 mm',
 'transmission': 'manual',
 'trim': 'L2H2 RS: 3450 mm',
 'year': 2020}
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB67636%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [auto1.be] INFO: Saving data for SB67636: {'auction_closing_time': 1774884447.0, 'created_time': 1774352243.056934, 'last_price_update_time': 1774773324.048844}
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SB67636') HTTP/1.1" 204 0
2026-03-29 08:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DF78239/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RG41014> (referer: https://www.auto1.com/v1/car-details-view/RG41014/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EA40127/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: ZU13483
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: CE14127
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE14127%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [auto1.be] INFO: Scrape type for CE14127: 0
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: KA88762
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KA88762%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [auto1.be] INFO: Scrape type for KA88762: 0
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: ML65590
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: GG74067
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG74067%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [auto1.be] INFO: Scrape type for GG74067: 0
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: HN37913
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HN37913%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [auto1.be] INFO: Scrape type for HN37913: 0
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: YU22338
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: SW98803
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: LP50838
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: NH43704
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH43704%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [auto1.be] INFO: Scrape type for NH43704: 0
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: MW29844
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: FH45476
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: NP55006
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: XM15621
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM15621%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [auto1.be] INFO: Scrape type for XM15621: 0
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: DP40243
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: BR63185
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: FM14350
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM14350%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [auto1.be] INFO: Scrape type for FM14350: 0
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: WL66260
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL66260%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [auto1.be] INFO: Scrape type for WL66260: 0
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: FY63763
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY63763%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [auto1.be] INFO: Scrape type for FY63763: 0
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: CD50133
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD50133%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [auto1.be] INFO: Scrape type for CD50133: 0
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: SZ16034
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ16034%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [auto1.be] INFO: Scrape type for SZ16034: 0
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: FP25504
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP25504%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [auto1.be] INFO: Scrape type for FP25504: 0
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: BX88810
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX88810%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [auto1.be] INFO: Scrape type for BX88810: 0
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: EJ45470
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ45470%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [auto1.be] INFO: Scrape type for EJ45470: 0
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: AK19302
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: EZ00027
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ00027%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [auto1.be] INFO: Scrape type for EZ00027: 0
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: PD85961
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD85961%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [auto1.be] INFO: Scrape type for PD85961: 0
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: NR82041
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: HU84368
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: CC85070
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: KE26750
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE26750%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [auto1.be] INFO: Scrape type for KE26750: 0
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: EA25293
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA25293%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [auto1.be] INFO: Scrape type for EA25293: 0
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: SP00889
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: SR49598
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: XU03064
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU03064%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [auto1.be] INFO: Scrape type for XU03064: 2
2026-03-29 08:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14232f81-1b5a-5dd6-9aed-02252910cad7 with identifier: XU03064
2026-03-29 08:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14232f81-1b5a-5dd6-9aed-02252910cad7 with scrape type 2
2026-03-29 08:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14232f81-1b5a-5dd6-9aed-02252910cad7 with scrape type 2
2026-03-29 08:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 14232f81-1b5a-5dd6-9aed-02252910cad7, identifier: XU03064
2026-03-29 08:35:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: LD32822
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: DH17925
2026-03-29 08:35:24 [auto1.be] INFO: Found listing with ID: UX89863
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX89863%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [auto1.be] INFO: Scrape type for UX89863: 1
2026-03-29 08:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 14232f81-1b5a-5dd6-9aed-02252910cad7 with identifier: XU03064
2026-03-29 08:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 14232f81-1b5a-5dd6-9aed-02252910cad7 with identifier: XU03064
2026-03-29 08:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 14232f81-1b5a-5dd6-9aed-02252910cad7 with identifier: XU03064 to the API
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:00:20Z',
 'fuel_type': 'diesel',
 'id': '14232f81-1b5a-5dd6-9aed-02252910cad7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU03064',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 81592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-29',
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi 320 L2 Titanium',
 'transmission': 'automatic',
 'trim': '320 L2 Titanium',
 'year': 2023}
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU03064%27 HTTP/1.1" 200 None
2026-03-29 08:35:24 [auto1.be] INFO: Saving data for XU03064: {'auction_closing_time': 1774882820.0, 'created_time': 1774600279.863399, 'last_price_update_time': 1774773324.878629}
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XU03064') HTTP/1.1" 204 0
2026-03-29 08:35:25 [auto1.be] INFO: Found listing with ID: NN99297
2026-03-29 08:35:25 [auto1.be] INFO: Found listing with ID: UX94260
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX94260%27 HTTP/1.1" 200 None
2026-03-29 08:35:25 [auto1.be] INFO: Scrape type for UX94260: 0
2026-03-29 08:35:25 [auto1.be] INFO: Found listing with ID: YW61664
2026-03-29 08:35:25 [auto1.be] INFO: Found listing with ID: JS18374
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS18374%27 HTTP/1.1" 200 None
2026-03-29 08:35:25 [auto1.be] INFO: Scrape type for JS18374: 0
2026-03-29 08:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DP17314> (referer: https://www.auto1.com/v1/car-details-view/DP17314/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MM05603> (referer: https://www.auto1.com/v1/car-details-view/MM05603/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:25 [auto1.be] INFO: Found listing with ID: UX80051
2026-03-29 08:35:25 [auto1.be] INFO: Found listing with ID: MG99487
2026-03-29 08:35:25 [auto1.be] INFO: Found listing with ID: AJ87899
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AJ87899%27 HTTP/1.1" 200 None
2026-03-29 08:35:25 [auto1.be] INFO: Scrape type for AJ87899: 1
2026-03-29 08:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DY35896/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0be5a3a9-0343-59dd-a02a-ee162047992c with identifier: RG41014
2026-03-29 08:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0be5a3a9-0343-59dd-a02a-ee162047992c with scrape type 1
2026-03-29 08:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0be5a3a9-0343-59dd-a02a-ee162047992c
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F29%252F90293b473f658287e99331fdf7f1ab26%252Fpa%252FRG41014_57816c826cfa5267f8e837fbb5889eb5.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/29/90293b473f658287e99331fdf7f1ab26/pa/RG41014_57816c826cfa5267f8e837fbb5889eb5.jpg already downloaded
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F29%252F90293b473f658287e99331fdf7f1ab26%252Fpa%252FRG41014_b63bf7f34227246b7e4dfc82900dd9f2.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/29/90293b473f658287e99331fdf7f1ab26/pa/RG41014_b63bf7f34227246b7e4dfc82900dd9f2.jpg already downloaded
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F29%252F90293b473f658287e99331fdf7f1ab26%252Fpa%252FRG41014_0b5616d5f3db6373564d4d09f013ef61.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/29/90293b473f658287e99331fdf7f1ab26/pa/RG41014_0b5616d5f3db6373564d4d09f013ef61.jpg already downloaded
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F29%252F90293b473f658287e99331fdf7f1ab26%252Fpa%252FRG41014_21012e7d1b982fa886013085894895a8.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/29/90293b473f658287e99331fdf7f1ab26/pa/RG41014_21012e7d1b982fa886013085894895a8.jpg already downloaded
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F29%252F90293b473f658287e99331fdf7f1ab26%252Fpa%252FRG41014_5de27da71fa42824e813b5b456d8e7cf.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/29/90293b473f658287e99331fdf7f1ab26/pa/RG41014_5de27da71fa42824e813b5b456d8e7cf.jpg already downloaded
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F29%252F90293b473f658287e99331fdf7f1ab26%252Fpa%252FRG41014_0aab7f3f4afb17a92fa1d692eae65660.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/29/90293b473f658287e99331fdf7f1ab26/pa/RG41014_0aab7f3f4afb17a92fa1d692eae65660.jpg already downloaded
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F29%252F90293b473f658287e99331fdf7f1ab26%252Fpa%252FRG41014_7e144c79cce45c6d98f9d286fdb9dcf3.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/29/90293b473f658287e99331fdf7f1ab26/pa/RG41014_7e144c79cce45c6d98f9d286fdb9dcf3.jpg already downloaded
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F29%252F90293b473f658287e99331fdf7f1ab26%252Fpa%252FRG41014_eb41a53008a4b447d81eaff0b031c561.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/29/90293b473f658287e99331fdf7f1ab26/pa/RG41014_eb41a53008a4b447d81eaff0b031c561.jpg already downloaded
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F29%252F90293b473f658287e99331fdf7f1ab26%252Fpa%252FRG41014_a1f427135de9425dda9c21c1902c4194.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/29/90293b473f658287e99331fdf7f1ab26/pa/RG41014_a1f427135de9425dda9c21c1902c4194.jpg already downloaded
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F29%252F90293b473f658287e99331fdf7f1ab26%252Fpa%252FRG41014_5e728ee5b46f74d01422bf8efd2eb268.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/29/90293b473f658287e99331fdf7f1ab26/pa/RG41014_5e728ee5b46f74d01422bf8efd2eb268.jpg already downloaded
2026-03-29 08:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0be5a3a9-0343-59dd-a02a-ee162047992c, identifier: RG41014
2026-03-29 08:35:25 [auto1.be] INFO: Found listing with ID: RL01911
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL01911%27 HTTP/1.1" 200 None
2026-03-29 08:35:25 [auto1.be] INFO: Scrape type for RL01911: 2
2026-03-29 08:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 942d178e-eac0-554e-a2a9-66af95a740a9 with identifier: RL01911
2026-03-29 08:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 942d178e-eac0-554e-a2a9-66af95a740a9 with scrape type 2
2026-03-29 08:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 942d178e-eac0-554e-a2a9-66af95a740a9 with scrape type 2
2026-03-29 08:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 942d178e-eac0-554e-a2a9-66af95a740a9, identifier: RL01911
2026-03-29 08:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0be5a3a9-0343-59dd-a02a-ee162047992c with identifier: RG41014
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-29 08:35:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 08:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0be5a3a9-0343-59dd-a02a-ee162047992c with identifier: RG41014
2026-03-29 08:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0be5a3a9-0343-59dd-a02a-ee162047992c with identifier: RG41014 to the API
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RG41014>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.3L',
 'engine_horse_power': 280,
 'expiration_date': '2026-03-30T15:21:10Z',
 'fuel_type': 'petrol',
 'id': '0be5a3a9-0343-59dd-a02a-ee162047992c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG41014',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 46867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img90/29/90293b473f658287e99331fdf7f1ab26/pa/RG41014_57816c826cfa5267f8e837fbb5889eb5.jpg',
                'https://img-pa.auto1.com/img90/29/90293b473f658287e99331fdf7f1ab26/pa/RG41014_b63bf7f34227246b7e4dfc82900dd9f2.jpg',
                'https://img-pa.auto1.com/img90/29/90293b473f658287e99331fdf7f1ab26/pa/RG41014_0b5616d5f3db6373564d4d09f013ef61.jpg',
                'https://img-pa.auto1.com/img90/29/90293b473f658287e99331fdf7f1ab26/pa/RG41014_21012e7d1b982fa886013085894895a8.jpg',
                'https://img-pa.auto1.com/img90/29/90293b473f658287e99331fdf7f1ab26/pa/RG41014_5de27da71fa42824e813b5b456d8e7cf.jpg',
                'https://img-pa.auto1.com/img90/29/90293b473f658287e99331fdf7f1ab26/pa/RG41014_0aab7f3f4afb17a92fa1d692eae65660.jpg',
                'https://img-pa.auto1.com/img90/29/90293b473f658287e99331fdf7f1ab26/pa/RG41014_7e144c79cce45c6d98f9d286fdb9dcf3.jpg',
                'https://img-pa.auto1.com/img90/29/90293b473f658287e99331fdf7f1ab26/pa/RG41014_eb41a53008a4b447d81eaff0b031c561.jpg',
                'https://img-pa.auto1.com/img90/29/90293b473f658287e99331fdf7f1ab26/pa/RG41014_a1f427135de9425dda9c21c1902c4194.jpg',
                'https://img-pa.auto1.com/img90/29/90293b473f658287e99331fdf7f1ab26/pa/RG41014_5e728ee5b46f74d01422bf8efd2eb268.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0be5a3a9-0343-59dd-a02a-ee162047992c/0be5a3a9-0343-59dd-a02a-ee162047992c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/29/90293b473f658287e99331fdf7f1ab26/pa/RG41014_57816c826cfa5267f8e837fbb5889eb5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0be5a3a9-0343-59dd-a02a-ee162047992c/0be5a3a9-0343-59dd-a02a-ee162047992c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/29/90293b473f658287e99331fdf7f1ab26/pa/RG41014_b63bf7f34227246b7e4dfc82900dd9f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0be5a3a9-0343-59dd-a02a-ee162047992c/0be5a3a9-0343-59dd-a02a-ee162047992c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71813,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/29/90293b473f658287e99331fdf7f1ab26/pa/RG41014_0b5616d5f3db6373564d4d09f013ef61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0be5a3a9-0343-59dd-a02a-ee162047992c/0be5a3a9-0343-59dd-a02a-ee162047992c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/29/90293b473f658287e99331fdf7f1ab26/pa/RG41014_21012e7d1b982fa886013085894895a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0be5a3a9-0343-59dd-a02a-ee162047992c/0be5a3a9-0343-59dd-a02a-ee162047992c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/29/90293b473f658287e99331fdf7f1ab26/pa/RG41014_5de27da71fa42824e813b5b456d8e7cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0be5a3a9-0343-59dd-a02a-ee162047992c/0be5a3a9-0343-59dd-a02a-ee162047992c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84460,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/29/90293b473f658287e99331fdf7f1ab26/pa/RG41014_0aab7f3f4afb17a92fa1d692eae65660.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0be5a3a9-0343-59dd-a02a-ee162047992c/0be5a3a9-0343-59dd-a02a-ee162047992c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65934,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/29/90293b473f658287e99331fdf7f1ab26/pa/RG41014_7e144c79cce45c6d98f9d286fdb9dcf3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0be5a3a9-0343-59dd-a02a-ee162047992c/0be5a3a9-0343-59dd-a02a-ee162047992c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/29/90293b473f658287e99331fdf7f1ab26/pa/RG41014_eb41a53008a4b447d81eaff0b031c561.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0be5a3a9-0343-59dd-a02a-ee162047992c/0be5a3a9-0343-59dd-a02a-ee162047992c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/29/90293b473f658287e99331fdf7f1ab26/pa/RG41014_a1f427135de9425dda9c21c1902c4194.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0be5a3a9-0343-59dd-a02a-ee162047992c/0be5a3a9-0343-59dd-a02a-ee162047992c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/29/90293b473f658287e99331fdf7f1ab26/pa/RG41014_5e728ee5b46f74d01422bf8efd2eb268.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 2.3 EcoBoost ST X',
 'transmission': 'automatic',
 'trim': 'ST X',
 'year': 2022}
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RG41014%27 HTTP/1.1" 200 None
2026-03-29 08:35:25 [auto1.be] INFO: Saving data for RG41014: {'created_time': 1774773325.870237, 'last_price_update_time': 1774773325.870246, 'auction_closing_time': 1774884070.0}
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RG41014') HTTP/1.1" 204 0
2026-03-29 08:35:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 942d178e-eac0-554e-a2a9-66af95a740a9 with identifier: RL01911
2026-03-29 08:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 942d178e-eac0-554e-a2a9-66af95a740a9 with identifier: RL01911
2026-03-29 08:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 942d178e-eac0-554e-a2a9-66af95a740a9 with identifier: RL01911 to the API
2026-03-29 08:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 440,
 'expiration_date': '2026-03-30T15:46:08Z',
 'fuel_type': 'petrol',
 'id': '942d178e-eac0-554e-a2a9-66af95a740a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL01911',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 159940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-15',
 'seller_name': None,
 'title': 'Porsche Cayenne S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL01911%27 HTTP/1.1" 200 None
2026-03-29 08:35:26 [auto1.be] INFO: Saving data for RL01911: {'auction_closing_time': 1774885568.0, 'created_time': 1773236052.776618, 'last_price_update_time': 1774773326.200568}
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RL01911') HTTP/1.1" 204 0
2026-03-29 08:35:26 [auto1.be] INFO: Found listing with ID: FG10633
2026-03-29 08:35:26 [auto1.be] INFO: Found listing with ID: KE27400
2026-03-29 08:35:26 [auto1.be] INFO: Found listing with ID: JV95971
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV95971%27 HTTP/1.1" 200 None
2026-03-29 08:35:26 [auto1.be] INFO: Scrape type for JV95971: 2
2026-03-29 08:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9007042e-c0f4-502a-ac2e-7bb33ba6ea54 with identifier: JV95971
2026-03-29 08:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9007042e-c0f4-502a-ac2e-7bb33ba6ea54 with scrape type 2
2026-03-29 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9007042e-c0f4-502a-ac2e-7bb33ba6ea54 with scrape type 2
2026-03-29 08:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9007042e-c0f4-502a-ac2e-7bb33ba6ea54, identifier: JV95971
2026-03-29 08:35:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e53342b-0f9c-511d-8783-d9dea083c6e9 with identifier: DP17314
2026-03-29 08:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e53342b-0f9c-511d-8783-d9dea083c6e9 with scrape type 1
2026-03-29 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2e53342b-0f9c-511d-8783-d9dea083c6e9
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fc1%252F06c1d778811c34ad7530c3e5a6548924%252Fpa%252FDP17314_82b7e04034a759e4f34c489aa5fe2411.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/c1/06c1d778811c34ad7530c3e5a6548924/pa/DP17314_82b7e04034a759e4f34c489aa5fe2411.jpg already downloaded
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fc1%252F06c1d778811c34ad7530c3e5a6548924%252Fpa%252FDP17314_c2a7c77d8b7e684d2699a1578b482f7b.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/c1/06c1d778811c34ad7530c3e5a6548924/pa/DP17314_c2a7c77d8b7e684d2699a1578b482f7b.jpg already downloaded
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fc1%252F06c1d778811c34ad7530c3e5a6548924%252Fpa%252FDP17314_e6cac571df12a443b28b32b477d89b12.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/c1/06c1d778811c34ad7530c3e5a6548924/pa/DP17314_e6cac571df12a443b28b32b477d89b12.jpg already downloaded
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fc1%252F06c1d778811c34ad7530c3e5a6548924%252Fpa%252FDP17314_1e0f73b113812a666cd35c4a1f9a37e1.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/c1/06c1d778811c34ad7530c3e5a6548924/pa/DP17314_1e0f73b113812a666cd35c4a1f9a37e1.jpg already downloaded
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fc1%252F06c1d778811c34ad7530c3e5a6548924%252Fpa%252FDP17314_ea6a5ac751dc30fd22234664bbf11a3e.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/c1/06c1d778811c34ad7530c3e5a6548924/pa/DP17314_ea6a5ac751dc30fd22234664bbf11a3e.jpg already downloaded
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fc1%252F06c1d778811c34ad7530c3e5a6548924%252Fpa%252FDP17314_1ff066af74a9c9bd41305063204d055d.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/c1/06c1d778811c34ad7530c3e5a6548924/pa/DP17314_1ff066af74a9c9bd41305063204d055d.jpg already downloaded
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fc1%252F06c1d778811c34ad7530c3e5a6548924%252Fpa%252FDP17314_b80ab7c2da8ee14d300eb0dd5c18afb2.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/c1/06c1d778811c34ad7530c3e5a6548924/pa/DP17314_b80ab7c2da8ee14d300eb0dd5c18afb2.jpg already downloaded
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fc1%252F06c1d778811c34ad7530c3e5a6548924%252Fpa%252FDP17314_a973cfc0ad0934d7ed14b03ba6804b7a.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/c1/06c1d778811c34ad7530c3e5a6548924/pa/DP17314_a973cfc0ad0934d7ed14b03ba6804b7a.jpg already downloaded
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fc1%252F06c1d778811c34ad7530c3e5a6548924%252Fpa%252FDP17314_409dc141f767bea5f100eed31dcf555e.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/c1/06c1d778811c34ad7530c3e5a6548924/pa/DP17314_409dc141f767bea5f100eed31dcf555e.jpg already downloaded
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fc1%252F06c1d778811c34ad7530c3e5a6548924%252Fpa%252FDP17314_539bd1310a6fbbc35696dfec024b98fd.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/c1/06c1d778811c34ad7530c3e5a6548924/pa/DP17314_539bd1310a6fbbc35696dfec024b98fd.jpg already downloaded
2026-03-29 08:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2e53342b-0f9c-511d-8783-d9dea083c6e9, identifier: DP17314
2026-03-29 08:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd425d4c-1f37-533a-a79d-b659780a3a9a with identifier: MM05603
2026-03-29 08:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd425d4c-1f37-533a-a79d-b659780a3a9a with scrape type 1
2026-03-29 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fd425d4c-1f37-533a-a79d-b659780a3a9a
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fec%252Fb4ec819c931a174f1d7b3c419d1059e3%252Fpa%252FMM05603_47cf1a3a1c402927d2f2a192c0fcc964.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ec/b4ec819c931a174f1d7b3c419d1059e3/pa/MM05603_47cf1a3a1c402927d2f2a192c0fcc964.jpg already downloaded
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fec%252Fb4ec819c931a174f1d7b3c419d1059e3%252Fpa%252FMM05603_ade007ce7fd2695a1c33197ff7cce53c.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ec/b4ec819c931a174f1d7b3c419d1059e3/pa/MM05603_ade007ce7fd2695a1c33197ff7cce53c.jpg already downloaded
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fec%252Fb4ec819c931a174f1d7b3c419d1059e3%252Fpa%252FMM05603_307da5d380015b3bb0f00c7d3bba9a15.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ec/b4ec819c931a174f1d7b3c419d1059e3/pa/MM05603_307da5d380015b3bb0f00c7d3bba9a15.jpg already downloaded
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fec%252Fb4ec819c931a174f1d7b3c419d1059e3%252Fpa%252FMM05603_12453260da5e2a6229bef9168f55ad80.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ec/b4ec819c931a174f1d7b3c419d1059e3/pa/MM05603_12453260da5e2a6229bef9168f55ad80.jpg already downloaded
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fec%252Fb4ec819c931a174f1d7b3c419d1059e3%252Fpa%252FMM05603_aeb864d6b42aaa0905f36ce760f7b123.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ec/b4ec819c931a174f1d7b3c419d1059e3/pa/MM05603_aeb864d6b42aaa0905f36ce760f7b123.jpg already downloaded
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fec%252Fb4ec819c931a174f1d7b3c419d1059e3%252Fpa%252FMM05603_833288609d7203818871775a2799b19e.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ec/b4ec819c931a174f1d7b3c419d1059e3/pa/MM05603_833288609d7203818871775a2799b19e.jpg already downloaded
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fec%252Fb4ec819c931a174f1d7b3c419d1059e3%252Fpa%252FMM05603_84563ac9318578269ccfe68942daff83.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ec/b4ec819c931a174f1d7b3c419d1059e3/pa/MM05603_84563ac9318578269ccfe68942daff83.jpg already downloaded
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fec%252Fb4ec819c931a174f1d7b3c419d1059e3%252Fpa%252FMM05603_17d5b32766d4d04a5658938a3f8bf7a4.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ec/b4ec819c931a174f1d7b3c419d1059e3/pa/MM05603_17d5b32766d4d04a5658938a3f8bf7a4.jpg already downloaded
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fec%252Fb4ec819c931a174f1d7b3c419d1059e3%252Fpa%252FMM05603_92cf3bc301f58d46d8893a72d0b6539d.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ec/b4ec819c931a174f1d7b3c419d1059e3/pa/MM05603_92cf3bc301f58d46d8893a72d0b6539d.jpg already downloaded
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fec%252Fb4ec819c931a174f1d7b3c419d1059e3%252Fpa%252FMM05603_a661a74963c2eb78b7ea3732cffec75a.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ec/b4ec819c931a174f1d7b3c419d1059e3/pa/MM05603_a661a74963c2eb78b7ea3732cffec75a.jpg already downloaded
2026-03-29 08:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fd425d4c-1f37-533a-a79d-b659780a3a9a, identifier: MM05603
2026-03-29 08:35:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9007042e-c0f4-502a-ac2e-7bb33ba6ea54 with identifier: JV95971
2026-03-29 08:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9007042e-c0f4-502a-ac2e-7bb33ba6ea54 with identifier: JV95971
2026-03-29 08:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9007042e-c0f4-502a-ac2e-7bb33ba6ea54 with identifier: JV95971 to the API
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:26:11Z',
 'fuel_type': 'diesel',
 'id': '9007042e-c0f4-502a-ac2e-7bb33ba6ea54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV95971',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 180959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-14',
 'seller_name': None,
 'title': 'MINI Cabrio Cooper D Highgate',
 'transmission': 'manual',
 'trim': 'Highgate',
 'year': 2013}
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV95971%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [auto1.be] INFO: Saving data for JV95971: {'auction_closing_time': 1774884371.0, 'created_time': 1773779817.748891, 'last_price_update_time': 1774773327.291324}
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JV95971') HTTP/1.1" 204 0
2026-03-29 08:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2e53342b-0f9c-511d-8783-d9dea083c6e9 with identifier: DP17314
2026-03-29 08:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2e53342b-0f9c-511d-8783-d9dea083c6e9 with identifier: DP17314
2026-03-29 08:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2e53342b-0f9c-511d-8783-d9dea083c6e9 with identifier: DP17314 to the API
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DP17314>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:29:52Z',
 'fuel_type': 'petrol',
 'id': '2e53342b-0f9c-511d-8783-d9dea083c6e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP17314',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 90855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img06/c1/06c1d778811c34ad7530c3e5a6548924/pa/DP17314_82b7e04034a759e4f34c489aa5fe2411.jpg',
                'https://img-pa.auto1.com/img06/c1/06c1d778811c34ad7530c3e5a6548924/pa/DP17314_c2a7c77d8b7e684d2699a1578b482f7b.jpg',
                'https://img-pa.auto1.com/img06/c1/06c1d778811c34ad7530c3e5a6548924/pa/DP17314_e6cac571df12a443b28b32b477d89b12.jpg',
                'https://img-pa.auto1.com/img06/c1/06c1d778811c34ad7530c3e5a6548924/pa/DP17314_1e0f73b113812a666cd35c4a1f9a37e1.jpg',
                'https://img-pa.auto1.com/img06/c1/06c1d778811c34ad7530c3e5a6548924/pa/DP17314_ea6a5ac751dc30fd22234664bbf11a3e.jpg',
                'https://img-pa.auto1.com/img06/c1/06c1d778811c34ad7530c3e5a6548924/pa/DP17314_1ff066af74a9c9bd41305063204d055d.jpg',
                'https://img-pa.auto1.com/img06/c1/06c1d778811c34ad7530c3e5a6548924/pa/DP17314_b80ab7c2da8ee14d300eb0dd5c18afb2.jpg',
                'https://img-pa.auto1.com/img06/c1/06c1d778811c34ad7530c3e5a6548924/pa/DP17314_a973cfc0ad0934d7ed14b03ba6804b7a.jpg',
                'https://img-pa.auto1.com/img06/c1/06c1d778811c34ad7530c3e5a6548924/pa/DP17314_409dc141f767bea5f100eed31dcf555e.jpg',
                'https://img-pa.auto1.com/img06/c1/06c1d778811c34ad7530c3e5a6548924/pa/DP17314_539bd1310a6fbbc35696dfec024b98fd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e53342b-0f9c-511d-8783-d9dea083c6e9/2e53342b-0f9c-511d-8783-d9dea083c6e9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/c1/06c1d778811c34ad7530c3e5a6548924/pa/DP17314_82b7e04034a759e4f34c489aa5fe2411.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e53342b-0f9c-511d-8783-d9dea083c6e9/2e53342b-0f9c-511d-8783-d9dea083c6e9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1240564,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img06/c1/06c1d778811c34ad7530c3e5a6548924/pa/DP17314_c2a7c77d8b7e684d2699a1578b482f7b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e53342b-0f9c-511d-8783-d9dea083c6e9/2e53342b-0f9c-511d-8783-d9dea083c6e9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/c1/06c1d778811c34ad7530c3e5a6548924/pa/DP17314_e6cac571df12a443b28b32b477d89b12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e53342b-0f9c-511d-8783-d9dea083c6e9/2e53342b-0f9c-511d-8783-d9dea083c6e9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115118,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/c1/06c1d778811c34ad7530c3e5a6548924/pa/DP17314_1e0f73b113812a666cd35c4a1f9a37e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e53342b-0f9c-511d-8783-d9dea083c6e9/2e53342b-0f9c-511d-8783-d9dea083c6e9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1195932,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img06/c1/06c1d778811c34ad7530c3e5a6548924/pa/DP17314_ea6a5ac751dc30fd22234664bbf11a3e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e53342b-0f9c-511d-8783-d9dea083c6e9/2e53342b-0f9c-511d-8783-d9dea083c6e9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1141003,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img06/c1/06c1d778811c34ad7530c3e5a6548924/pa/DP17314_1ff066af74a9c9bd41305063204d055d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e53342b-0f9c-511d-8783-d9dea083c6e9/2e53342b-0f9c-511d-8783-d9dea083c6e9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 834961,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img06/c1/06c1d778811c34ad7530c3e5a6548924/pa/DP17314_b80ab7c2da8ee14d300eb0dd5c18afb2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e53342b-0f9c-511d-8783-d9dea083c6e9/2e53342b-0f9c-511d-8783-d9dea083c6e9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/c1/06c1d778811c34ad7530c3e5a6548924/pa/DP17314_a973cfc0ad0934d7ed14b03ba6804b7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e53342b-0f9c-511d-8783-d9dea083c6e9/2e53342b-0f9c-511d-8783-d9dea083c6e9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1219559,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img06/c1/06c1d778811c34ad7530c3e5a6548924/pa/DP17314_409dc141f767bea5f100eed31dcf555e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e53342b-0f9c-511d-8783-d9dea083c6e9/2e53342b-0f9c-511d-8783-d9dea083c6e9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111913,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/c1/06c1d778811c34ad7530c3e5a6548924/pa/DP17314_539bd1310a6fbbc35696dfec024b98fd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT United',
 'transmission': 'automatic',
 'trim': 'United',
 'year': 2021}
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP17314%27 HTTP/1.1" 200 None
2026-03-29 08:35:27 [auto1.be] INFO: Saving data for DP17314: {'created_time': 1774773327.731981, 'last_price_update_time': 1774773327.73199, 'auction_closing_time': 1774884592.0}
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DP17314') HTTP/1.1" 204 0
2026-03-29 08:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fd425d4c-1f37-533a-a79d-b659780a3a9a with identifier: MM05603
2026-03-29 08:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fd425d4c-1f37-533a-a79d-b659780a3a9a with identifier: MM05603
2026-03-29 08:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fd425d4c-1f37-533a-a79d-b659780a3a9a with identifier: MM05603 to the API
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MM05603>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:14:01Z',
 'fuel_type': 'petrol',
 'id': 'fd425d4c-1f37-533a-a79d-b659780a3a9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM05603',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 34480,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgb4/ec/b4ec819c931a174f1d7b3c419d1059e3/pa/MM05603_47cf1a3a1c402927d2f2a192c0fcc964.jpg',
                'https://img-pa.auto1.com/imgb4/ec/b4ec819c931a174f1d7b3c419d1059e3/pa/MM05603_ade007ce7fd2695a1c33197ff7cce53c.jpg',
                'https://img-pa.auto1.com/imgb4/ec/b4ec819c931a174f1d7b3c419d1059e3/pa/MM05603_307da5d380015b3bb0f00c7d3bba9a15.jpg',
                'https://img-pa.auto1.com/imgb4/ec/b4ec819c931a174f1d7b3c419d1059e3/pa/MM05603_12453260da5e2a6229bef9168f55ad80.jpg',
                'https://img-pa.auto1.com/imgb4/ec/b4ec819c931a174f1d7b3c419d1059e3/pa/MM05603_aeb864d6b42aaa0905f36ce760f7b123.jpg',
                'https://img-pa.auto1.com/imgb4/ec/b4ec819c931a174f1d7b3c419d1059e3/pa/MM05603_833288609d7203818871775a2799b19e.jpg',
                'https://img-pa.auto1.com/imgb4/ec/b4ec819c931a174f1d7b3c419d1059e3/pa/MM05603_84563ac9318578269ccfe68942daff83.jpg',
                'https://img-pa.auto1.com/imgb4/ec/b4ec819c931a174f1d7b3c419d1059e3/pa/MM05603_17d5b32766d4d04a5658938a3f8bf7a4.jpg',
                'https://img-pa.auto1.com/imgb4/ec/b4ec819c931a174f1d7b3c419d1059e3/pa/MM05603_92cf3bc301f58d46d8893a72d0b6539d.jpg',
                'https://img-pa.auto1.com/imgb4/ec/b4ec819c931a174f1d7b3c419d1059e3/pa/MM05603_a661a74963c2eb78b7ea3732cffec75a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd425d4c-1f37-533a-a79d-b659780a3a9a/fd425d4c-1f37-533a-a79d-b659780a3a9a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/ec/b4ec819c931a174f1d7b3c419d1059e3/pa/MM05603_47cf1a3a1c402927d2f2a192c0fcc964.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd425d4c-1f37-533a-a79d-b659780a3a9a/fd425d4c-1f37-533a-a79d-b659780a3a9a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/ec/b4ec819c931a174f1d7b3c419d1059e3/pa/MM05603_ade007ce7fd2695a1c33197ff7cce53c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd425d4c-1f37-533a-a79d-b659780a3a9a/fd425d4c-1f37-533a-a79d-b659780a3a9a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/ec/b4ec819c931a174f1d7b3c419d1059e3/pa/MM05603_307da5d380015b3bb0f00c7d3bba9a15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd425d4c-1f37-533a-a79d-b659780a3a9a/fd425d4c-1f37-533a-a79d-b659780a3a9a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/ec/b4ec819c931a174f1d7b3c419d1059e3/pa/MM05603_12453260da5e2a6229bef9168f55ad80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd425d4c-1f37-533a-a79d-b659780a3a9a/fd425d4c-1f37-533a-a79d-b659780a3a9a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60632,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/ec/b4ec819c931a174f1d7b3c419d1059e3/pa/MM05603_aeb864d6b42aaa0905f36ce760f7b123.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd425d4c-1f37-533a-a79d-b659780a3a9a/fd425d4c-1f37-533a-a79d-b659780a3a9a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/ec/b4ec819c931a174f1d7b3c419d1059e3/pa/MM05603_833288609d7203818871775a2799b19e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd425d4c-1f37-533a-a79d-b659780a3a9a/fd425d4c-1f37-533a-a79d-b659780a3a9a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/ec/b4ec819c931a174f1d7b3c419d1059e3/pa/MM05603_84563ac9318578269ccfe68942daff83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd425d4c-1f37-533a-a79d-b659780a3a9a/fd425d4c-1f37-533a-a79d-b659780a3a9a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/ec/b4ec819c931a174f1d7b3c419d1059e3/pa/MM05603_17d5b32766d4d04a5658938a3f8bf7a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd425d4c-1f37-533a-a79d-b659780a3a9a/fd425d4c-1f37-533a-a79d-b659780a3a9a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68678,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/ec/b4ec819c931a174f1d7b3c419d1059e3/pa/MM05603_92cf3bc301f58d46d8893a72d0b6539d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd425d4c-1f37-533a-a79d-b659780a3a9a/fd425d4c-1f37-533a-a79d-b659780a3a9a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/ec/b4ec819c931a174f1d7b3c419d1059e3/pa/MM05603_a661a74963c2eb78b7ea3732cffec75a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque P200 Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MM05603%27 HTTP/1.1" 200 None
2026-03-29 08:35:28 [auto1.be] INFO: Saving data for MM05603: {'created_time': 1774773328.060415, 'last_price_update_time': 1774773328.060424, 'auction_closing_time': 1774883641.0}
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MM05603') HTTP/1.1" 204 0
2026-03-29 08:35:28 [auto1.be] INFO: Found listing with ID: LK25886
2026-03-29 08:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VM01272/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TE49371/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:28 [auto1.be] INFO: Channel: 24h | Page: 6 | totalHits: 1252 | hits on page: 40
2026-03-29 08:35:28 [auto1.be] INFO: Found listing with ID: YW00445
2026-03-29 08:35:28 [auto1.be] INFO: Found listing with ID: JD01885
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JD01885%27 HTTP/1.1" 200 None
2026-03-29 08:35:28 [auto1.be] INFO: Scrape type for JD01885: 0
2026-03-29 08:35:28 [auto1.be] INFO: Found listing with ID: TX45109
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX45109%27 HTTP/1.1" 200 None
2026-03-29 08:35:28 [auto1.be] INFO: Scrape type for TX45109: 0
2026-03-29 08:35:28 [auto1.be] INFO: Found listing with ID: GK88228
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GK88228%27 HTTP/1.1" 200 None
2026-03-29 08:35:28 [auto1.be] INFO: Scrape type for GK88228: 0
2026-03-29 08:35:28 [auto1.be] INFO: Found listing with ID: XZ48466
2026-03-29 08:35:28 [auto1.be] INFO: Found listing with ID: RP30975
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RP30975%27 HTTP/1.1" 200 None
2026-03-29 08:35:28 [auto1.be] INFO: Scrape type for RP30975: 0
2026-03-29 08:35:28 [auto1.be] INFO: Found listing with ID: TV92859
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV92859%27 HTTP/1.1" 200 None
2026-03-29 08:35:28 [auto1.be] INFO: Scrape type for TV92859: 0
2026-03-29 08:35:28 [auto1.be] INFO: Found listing with ID: XZ54371
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ54371%27 HTTP/1.1" 200 None
2026-03-29 08:35:28 [auto1.be] INFO: Scrape type for XZ54371: 2
2026-03-29 08:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1603053a-812f-5d8f-a76f-4826030020e5 with identifier: XZ54371
2026-03-29 08:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1603053a-812f-5d8f-a76f-4826030020e5 with scrape type 2
2026-03-29 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1603053a-812f-5d8f-a76f-4826030020e5 with scrape type 2
2026-03-29 08:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1603053a-812f-5d8f-a76f-4826030020e5, identifier: XZ54371
2026-03-29 08:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1603053a-812f-5d8f-a76f-4826030020e5 with identifier: XZ54371
2026-03-29 08:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1603053a-812f-5d8f-a76f-4826030020e5 with identifier: XZ54371
2026-03-29 08:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1603053a-812f-5d8f-a76f-4826030020e5 with identifier: XZ54371 to the API
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:49:59Z',
 'fuel_type': 'petrol',
 'id': '1603053a-812f-5d8f-a76f-4826030020e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ54371',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 67531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-11',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2018}
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ54371%27 HTTP/1.1" 200 None
2026-03-29 08:35:28 [auto1.be] INFO: Saving data for XZ54371: {'auction_closing_time': 1774885799.0, 'created_time': 1773301759.722365, 'last_price_update_time': 1774773328.696433}
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XZ54371') HTTP/1.1" 204 0
2026-03-29 08:35:28 [auto1.be] INFO: Found listing with ID: DW61635
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW61635%27 HTTP/1.1" 200 None
2026-03-29 08:35:28 [auto1.be] INFO: Scrape type for DW61635: 2
2026-03-29 08:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93e51fe1-0876-577a-8329-d692268c9773 with identifier: DW61635
2026-03-29 08:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93e51fe1-0876-577a-8329-d692268c9773 with scrape type 2
2026-03-29 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93e51fe1-0876-577a-8329-d692268c9773 with scrape type 2
2026-03-29 08:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 93e51fe1-0876-577a-8329-d692268c9773, identifier: DW61635
2026-03-29 08:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 93e51fe1-0876-577a-8329-d692268c9773 with identifier: DW61635
2026-03-29 08:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 93e51fe1-0876-577a-8329-d692268c9773 with identifier: DW61635
2026-03-29 08:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 93e51fe1-0876-577a-8329-d692268c9773 with identifier: DW61635 to the API
2026-03-29 08:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:43:29Z',
 'fuel_type': 'petrol',
 'id': '93e51fe1-0876-577a-8329-d692268c9773',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW61635',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 104639,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-07-16',
 'seller_name': None,
 'title': 'Renault Megane 1.4 Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2002}
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW61635%27 HTTP/1.1" 200 None
2026-03-29 08:35:29 [auto1.be] INFO: Saving data for DW61635: {'auction_closing_time': 1774885409.0, 'created_time': 1774557219.813369, 'last_price_update_time': 1774773329.119983}
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DW61635') HTTP/1.1" 204 0
2026-03-29 08:35:29 [auto1.be] INFO: Found listing with ID: BT09121
2026-03-29 08:35:29 [auto1.be] INFO: Found listing with ID: GT11330
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GT11330%27 HTTP/1.1" 200 None
2026-03-29 08:35:29 [auto1.be] INFO: Scrape type for GT11330: 0
2026-03-29 08:35:29 [auto1.be] INFO: Found listing with ID: CX99155
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX99155%27 HTTP/1.1" 200 None
2026-03-29 08:35:29 [auto1.be] INFO: Scrape type for CX99155: 0
2026-03-29 08:35:29 [auto1.be] INFO: Found listing with ID: CX21788
2026-03-29 08:35:29 [auto1.be] INFO: Found listing with ID: KX60472
2026-03-29 08:35:29 [auto1.be] INFO: Found listing with ID: WE70666
2026-03-29 08:35:29 [auto1.be] INFO: Found listing with ID: HS59761
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS59761%27 HTTP/1.1" 200 None
2026-03-29 08:35:29 [auto1.be] INFO: Scrape type for HS59761: 0
2026-03-29 08:35:29 [auto1.be] INFO: Found listing with ID: LZ48262
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LZ48262%27 HTTP/1.1" 200 None
2026-03-29 08:35:29 [auto1.be] INFO: Scrape type for LZ48262: 0
2026-03-29 08:35:29 [auto1.be] INFO: Found listing with ID: RM46702
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM46702%27 HTTP/1.1" 200 None
2026-03-29 08:35:29 [auto1.be] INFO: Scrape type for RM46702: 0
2026-03-29 08:35:29 [auto1.be] INFO: Found listing with ID: ML85388
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML85388%27 HTTP/1.1" 200 None
2026-03-29 08:35:29 [auto1.be] INFO: Scrape type for ML85388: 2
2026-03-29 08:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42769972-c432-5d32-aaf0-c251c5dd4e3c with identifier: ML85388
2026-03-29 08:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42769972-c432-5d32-aaf0-c251c5dd4e3c with scrape type 2
2026-03-29 08:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42769972-c432-5d32-aaf0-c251c5dd4e3c with scrape type 2
2026-03-29 08:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 42769972-c432-5d32-aaf0-c251c5dd4e3c, identifier: ML85388
2026-03-29 08:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 42769972-c432-5d32-aaf0-c251c5dd4e3c with identifier: ML85388
2026-03-29 08:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 42769972-c432-5d32-aaf0-c251c5dd4e3c with identifier: ML85388
2026-03-29 08:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 42769972-c432-5d32-aaf0-c251c5dd4e3c with identifier: ML85388 to the API
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:02:37Z',
 'fuel_type': 'hybrid',
 'id': '42769972-c432-5d32-aaf0-c251c5dd4e3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML85388',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 213734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-07',
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2017}
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML85388%27 HTTP/1.1" 200 None
2026-03-29 08:35:29 [auto1.be] INFO: Saving data for ML85388: {'auction_closing_time': 1774882957.0, 'created_time': 1774557179.473528, 'last_price_update_time': 1774773329.623443}
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ML85388') HTTP/1.1" 204 0
2026-03-29 08:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZZ00486/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:29 [auto1.be] INFO: Found listing with ID: AJ68637
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AJ68637%27 HTTP/1.1" 200 None
2026-03-29 08:35:29 [auto1.be] INFO: Scrape type for AJ68637: 2
2026-03-29 08:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee21d84f-d6ac-5fbd-b303-1b42f25e0b01 with identifier: AJ68637
2026-03-29 08:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee21d84f-d6ac-5fbd-b303-1b42f25e0b01 with scrape type 2
2026-03-29 08:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee21d84f-d6ac-5fbd-b303-1b42f25e0b01 with scrape type 2
2026-03-29 08:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ee21d84f-d6ac-5fbd-b303-1b42f25e0b01, identifier: AJ68637
2026-03-29 08:35:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UX89863/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CC34063/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ee21d84f-d6ac-5fbd-b303-1b42f25e0b01 with identifier: AJ68637
2026-03-29 08:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ee21d84f-d6ac-5fbd-b303-1b42f25e0b01 with identifier: AJ68637
2026-03-29 08:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ee21d84f-d6ac-5fbd-b303-1b42f25e0b01 with identifier: AJ68637 to the API
2026-03-29 08:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:09:07Z',
 'fuel_type': 'diesel',
 'id': 'ee21d84f-d6ac-5fbd-b303-1b42f25e0b01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ68637',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 282721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-30',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Business BlueMotion',
 'transmission': 'manual',
 'trim': 'Business BlueMotion',
 'year': 2019}
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AJ68637%27 HTTP/1.1" 200 None
2026-03-29 08:35:30 [auto1.be] INFO: Saving data for AJ68637: {'auction_closing_time': 1774883347.0, 'created_time': 1774557210.944023, 'last_price_update_time': 1774773330.146613}
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AJ68637') HTTP/1.1" 204 0
2026-03-29 08:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:30 [auto1.be] INFO: Found listing with ID: HW95173
2026-03-29 08:35:30 [auto1.be] INFO: Found listing with ID: SW90596
2026-03-29 08:35:30 [auto1.be] INFO: Found listing with ID: HY77866
2026-03-29 08:35:30 [auto1.be] INFO: Found listing with ID: CT30439
2026-03-29 08:35:30 [auto1.be] INFO: Found listing with ID: BD10300
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD10300%27 HTTP/1.1" 200 None
2026-03-29 08:35:30 [auto1.be] INFO: Scrape type for BD10300: 0
2026-03-29 08:35:30 [auto1.be] INFO: Found listing with ID: JW86952
2026-03-29 08:35:30 [auto1.be] INFO: Found listing with ID: RK79502
2026-03-29 08:35:30 [auto1.be] INFO: Found listing with ID: RK12486
2026-03-29 08:35:30 [auto1.be] INFO: Found listing with ID: ZS70359
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZS70359%27 HTTP/1.1" 200 None
2026-03-29 08:35:30 [auto1.be] INFO: Scrape type for ZS70359: 0
2026-03-29 08:35:30 [auto1.be] INFO: Found listing with ID: SE23508
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE23508%27 HTTP/1.1" 200 None
2026-03-29 08:35:30 [auto1.be] INFO: Scrape type for SE23508: 2
2026-03-29 08:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c69bc39-c11c-5919-8d30-91351a0d8613 with identifier: SE23508
2026-03-29 08:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c69bc39-c11c-5919-8d30-91351a0d8613 with scrape type 2
2026-03-29 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c69bc39-c11c-5919-8d30-91351a0d8613 with scrape type 2
2026-03-29 08:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4c69bc39-c11c-5919-8d30-91351a0d8613, identifier: SE23508
2026-03-29 08:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4c69bc39-c11c-5919-8d30-91351a0d8613 with identifier: SE23508
2026-03-29 08:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4c69bc39-c11c-5919-8d30-91351a0d8613 with identifier: SE23508
2026-03-29 08:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4c69bc39-c11c-5919-8d30-91351a0d8613 with identifier: SE23508 to the API
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:02:02Z',
 'fuel_type': 'petrol',
 'id': '4c69bc39-c11c-5919-8d30-91351a0d8613',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE23508',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 198922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-01',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Sport & Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Sport & Style BlueMotion Tech',
 'year': 2012}
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE23508%27 HTTP/1.1" 200 None
2026-03-29 08:35:30 [auto1.be] INFO: Saving data for SE23508: {'auction_closing_time': 1774882922.0, 'created_time': 1774557228.459315, 'last_price_update_time': 1774773330.650453}
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SE23508') HTTP/1.1" 204 0
2026-03-29 08:35:30 [auto1.be] INFO: Found listing with ID: SN78128
2026-03-29 08:35:30 [auto1.be] INFO: Found listing with ID: WW99205
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW99205%27 HTTP/1.1" 200 None
2026-03-29 08:35:30 [auto1.be] INFO: Scrape type for WW99205: 2
2026-03-29 08:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 952fc525-855c-5468-94f2-9f1dc66a8654 with identifier: WW99205
2026-03-29 08:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 952fc525-855c-5468-94f2-9f1dc66a8654 with scrape type 2
2026-03-29 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 952fc525-855c-5468-94f2-9f1dc66a8654 with scrape type 2
2026-03-29 08:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 952fc525-855c-5468-94f2-9f1dc66a8654, identifier: WW99205
2026-03-29 08:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 952fc525-855c-5468-94f2-9f1dc66a8654 with identifier: WW99205
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 08:35:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-29 08:35:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 08:35:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 952fc525-855c-5468-94f2-9f1dc66a8654 with identifier: WW99205
2026-03-29 08:35:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 952fc525-855c-5468-94f2-9f1dc66a8654 with identifier: WW99205 to the API
2026-03-29 08:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:42:26Z',
 'fuel_type': 'diesel',
 'id': '952fc525-855c-5468-94f2-9f1dc66a8654',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW99205',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 157448,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-19',
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 TDCi ECOnetic',
 'transmission': 'manual',
 'trim': 'ECOnetic',
 'year': 2009}
2026-03-29 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW99205%27 HTTP/1.1" 200 None
2026-03-29 08:35:31 [auto1.be] INFO: Saving data for WW99205: {'auction_closing_time': 1774885346.0, 'created_time': 1774600266.092938, 'last_price_update_time': 1774773331.594004}
2026-03-29 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WW99205') HTTP/1.1" 204 0
2026-03-29 08:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EA40127> (referer: https://www.auto1.com/v1/car-details-view/EA40127/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:31 [auto1.be] INFO: Found listing with ID: LH25651
2026-03-29 08:35:31 [auto1.be] INFO: Found listing with ID: VM12927
2026-03-29 08:35:31 [auto1.be] INFO: Found listing with ID: SD77902
2026-03-29 08:35:31 [auto1.be] INFO: Found listing with ID: LK16000
2026-03-29 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK16000%27 HTTP/1.1" 200 None
2026-03-29 08:35:31 [auto1.be] INFO: Scrape type for LK16000: 0
2026-03-29 08:35:31 [auto1.be] INFO: Found listing with ID: EK72945
2026-03-29 08:35:31 [auto1.be] INFO: Found listing with ID: WA10715
2026-03-29 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA10715%27 HTTP/1.1" 200 None
2026-03-29 08:35:31 [auto1.be] INFO: Scrape type for WA10715: 2
2026-03-29 08:35:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b06023d-030b-506e-9366-3f2bfff4ecb6 with identifier: WA10715
2026-03-29 08:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b06023d-030b-506e-9366-3f2bfff4ecb6 with scrape type 2
2026-03-29 08:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b06023d-030b-506e-9366-3f2bfff4ecb6 with scrape type 2
2026-03-29 08:35:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6b06023d-030b-506e-9366-3f2bfff4ecb6, identifier: WA10715
2026-03-29 08:35:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6b06023d-030b-506e-9366-3f2bfff4ecb6 with identifier: WA10715
2026-03-29 08:35:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6b06023d-030b-506e-9366-3f2bfff4ecb6 with identifier: WA10715
2026-03-29 08:35:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6b06023d-030b-506e-9366-3f2bfff4ecb6 with identifier: WA10715 to the API
2026-03-29 08:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:13Z',
 'fuel_type': 'petrol',
 'id': '6b06023d-030b-506e-9366-3f2bfff4ecb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA10715',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 80846,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-25',
 'seller_name': None,
 'title': 'Ford C-Max 1.5 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2019}
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA10715%27 HTTP/1.1" 200 None
2026-03-29 08:35:32 [auto1.be] INFO: Saving data for WA10715: {'auction_closing_time': 1774885693.0, 'created_time': 1774557103.761216, 'last_price_update_time': 1774773332.049805}
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WA10715') HTTP/1.1" 204 0
2026-03-29 08:35:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:32 [auto1.be] INFO: Found listing with ID: EB09170
2026-03-29 08:35:32 [auto1.be] INFO: Found listing with ID: XN92471
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN92471%27 HTTP/1.1" 200 None
2026-03-29 08:35:32 [auto1.be] INFO: Scrape type for XN92471: 0
2026-03-29 08:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DY35896> (referer: https://www.auto1.com/v1/car-details-view/DY35896/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VM01272> (referer: https://www.auto1.com/v1/car-details-view/VM01272/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33be8d1f-b8ba-5d66-802e-3f114b8f9f32 with identifier: EA40127
2026-03-29 08:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33be8d1f-b8ba-5d66-802e-3f114b8f9f32 with scrape type 1
2026-03-29 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 33be8d1f-b8ba-5d66-802e-3f114b8f9f32
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F03%252F0003c0ec5c01760a1e79de2830d8bcbe%252Fpa%252FEA40127_ee0041b85570b92f4afad226c005f17f.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/03/0003c0ec5c01760a1e79de2830d8bcbe/pa/EA40127_ee0041b85570b92f4afad226c005f17f.jpg already downloaded
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F03%252F0003c0ec5c01760a1e79de2830d8bcbe%252Fpa%252FEA40127_df21f409a9495a5371cda96f7786c81f.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/03/0003c0ec5c01760a1e79de2830d8bcbe/pa/EA40127_df21f409a9495a5371cda96f7786c81f.jpg already downloaded
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F03%252F0003c0ec5c01760a1e79de2830d8bcbe%252Fpa%252FEA40127_a6c5dc7e238ccc20247c0acff8aa5986.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/03/0003c0ec5c01760a1e79de2830d8bcbe/pa/EA40127_a6c5dc7e238ccc20247c0acff8aa5986.jpg already downloaded
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F03%252F0003c0ec5c01760a1e79de2830d8bcbe%252Fpa%252FEA40127_3d7773ba20dc9115c20d4e7dfe5b6844.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/03/0003c0ec5c01760a1e79de2830d8bcbe/pa/EA40127_3d7773ba20dc9115c20d4e7dfe5b6844.jpg already downloaded
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F03%252F0003c0ec5c01760a1e79de2830d8bcbe%252Fpa%252FEA40127_9c77c4efe88d4de9a31849afb8729e95.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/03/0003c0ec5c01760a1e79de2830d8bcbe/pa/EA40127_9c77c4efe88d4de9a31849afb8729e95.jpg already downloaded
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F03%252F0003c0ec5c01760a1e79de2830d8bcbe%252Fpa%252FEA40127_a20dca64e92c1eaa4d8471d7546521fd.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/03/0003c0ec5c01760a1e79de2830d8bcbe/pa/EA40127_a20dca64e92c1eaa4d8471d7546521fd.jpg already downloaded
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F03%252F0003c0ec5c01760a1e79de2830d8bcbe%252Fpa%252FEA40127_57693a1e58378fb2aceb3e2d5258fc6c.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/03/0003c0ec5c01760a1e79de2830d8bcbe/pa/EA40127_57693a1e58378fb2aceb3e2d5258fc6c.jpg already downloaded
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F03%252F0003c0ec5c01760a1e79de2830d8bcbe%252Fpa%252FEA40127_d67cc6aaf5abfb34b2fabda73adcf123.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/03/0003c0ec5c01760a1e79de2830d8bcbe/pa/EA40127_d67cc6aaf5abfb34b2fabda73adcf123.jpg already downloaded
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F03%252F0003c0ec5c01760a1e79de2830d8bcbe%252Fpa%252FEA40127_0c3f278de98397b253c2285aa891a253.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/03/0003c0ec5c01760a1e79de2830d8bcbe/pa/EA40127_0c3f278de98397b253c2285aa891a253.jpg already downloaded
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F03%252F0003c0ec5c01760a1e79de2830d8bcbe%252Fpa%252FEA40127_4cb39535d0e3008c417c77469afd3a25.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/03/0003c0ec5c01760a1e79de2830d8bcbe/pa/EA40127_4cb39535d0e3008c417c77469afd3a25.jpg already downloaded
2026-03-29 08:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 33be8d1f-b8ba-5d66-802e-3f114b8f9f32, identifier: EA40127
2026-03-29 08:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 33be8d1f-b8ba-5d66-802e-3f114b8f9f32 with identifier: EA40127
2026-03-29 08:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 33be8d1f-b8ba-5d66-802e-3f114b8f9f32 with identifier: EA40127
2026-03-29 08:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 33be8d1f-b8ba-5d66-802e-3f114b8f9f32 with identifier: EA40127 to the API
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EA40127>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 252,
 'expiration_date': '2026-03-30T15:23:34Z',
 'fuel_type': 'petrol',
 'id': '33be8d1f-b8ba-5d66-802e-3f114b8f9f32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA40127',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 84419,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img00/03/0003c0ec5c01760a1e79de2830d8bcbe/pa/EA40127_ee0041b85570b92f4afad226c005f17f.jpg',
                'https://img-pa.auto1.com/img00/03/0003c0ec5c01760a1e79de2830d8bcbe/pa/EA40127_df21f409a9495a5371cda96f7786c81f.jpg',
                'https://img-pa.auto1.com/img00/03/0003c0ec5c01760a1e79de2830d8bcbe/pa/EA40127_a6c5dc7e238ccc20247c0acff8aa5986.jpg',
                'https://img-pa.auto1.com/img00/03/0003c0ec5c01760a1e79de2830d8bcbe/pa/EA40127_3d7773ba20dc9115c20d4e7dfe5b6844.jpg',
                'https://img-pa.auto1.com/img00/03/0003c0ec5c01760a1e79de2830d8bcbe/pa/EA40127_9c77c4efe88d4de9a31849afb8729e95.jpg',
                'https://img-pa.auto1.com/img00/03/0003c0ec5c01760a1e79de2830d8bcbe/pa/EA40127_a20dca64e92c1eaa4d8471d7546521fd.jpg',
                'https://img-pa.auto1.com/img00/03/0003c0ec5c01760a1e79de2830d8bcbe/pa/EA40127_57693a1e58378fb2aceb3e2d5258fc6c.jpg',
                'https://img-pa.auto1.com/img00/03/0003c0ec5c01760a1e79de2830d8bcbe/pa/EA40127_d67cc6aaf5abfb34b2fabda73adcf123.jpg',
                'https://img-pa.auto1.com/img00/03/0003c0ec5c01760a1e79de2830d8bcbe/pa/EA40127_0c3f278de98397b253c2285aa891a253.jpg',
                'https://img-pa.auto1.com/img00/03/0003c0ec5c01760a1e79de2830d8bcbe/pa/EA40127_4cb39535d0e3008c417c77469afd3a25.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33be8d1f-b8ba-5d66-802e-3f114b8f9f32/33be8d1f-b8ba-5d66-802e-3f114b8f9f32_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/03/0003c0ec5c01760a1e79de2830d8bcbe/pa/EA40127_ee0041b85570b92f4afad226c005f17f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33be8d1f-b8ba-5d66-802e-3f114b8f9f32/33be8d1f-b8ba-5d66-802e-3f114b8f9f32_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/03/0003c0ec5c01760a1e79de2830d8bcbe/pa/EA40127_df21f409a9495a5371cda96f7786c81f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33be8d1f-b8ba-5d66-802e-3f114b8f9f32/33be8d1f-b8ba-5d66-802e-3f114b8f9f32_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101376,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/03/0003c0ec5c01760a1e79de2830d8bcbe/pa/EA40127_a6c5dc7e238ccc20247c0acff8aa5986.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33be8d1f-b8ba-5d66-802e-3f114b8f9f32/33be8d1f-b8ba-5d66-802e-3f114b8f9f32_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/03/0003c0ec5c01760a1e79de2830d8bcbe/pa/EA40127_3d7773ba20dc9115c20d4e7dfe5b6844.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33be8d1f-b8ba-5d66-802e-3f114b8f9f32/33be8d1f-b8ba-5d66-802e-3f114b8f9f32_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/03/0003c0ec5c01760a1e79de2830d8bcbe/pa/EA40127_9c77c4efe88d4de9a31849afb8729e95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33be8d1f-b8ba-5d66-802e-3f114b8f9f32/33be8d1f-b8ba-5d66-802e-3f114b8f9f32_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/03/0003c0ec5c01760a1e79de2830d8bcbe/pa/EA40127_a20dca64e92c1eaa4d8471d7546521fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33be8d1f-b8ba-5d66-802e-3f114b8f9f32/33be8d1f-b8ba-5d66-802e-3f114b8f9f32_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/03/0003c0ec5c01760a1e79de2830d8bcbe/pa/EA40127_57693a1e58378fb2aceb3e2d5258fc6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33be8d1f-b8ba-5d66-802e-3f114b8f9f32/33be8d1f-b8ba-5d66-802e-3f114b8f9f32_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/03/0003c0ec5c01760a1e79de2830d8bcbe/pa/EA40127_d67cc6aaf5abfb34b2fabda73adcf123.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33be8d1f-b8ba-5d66-802e-3f114b8f9f32/33be8d1f-b8ba-5d66-802e-3f114b8f9f32_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/03/0003c0ec5c01760a1e79de2830d8bcbe/pa/EA40127_0c3f278de98397b253c2285aa891a253.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33be8d1f-b8ba-5d66-802e-3f114b8f9f32/33be8d1f-b8ba-5d66-802e-3f114b8f9f32_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/03/0003c0ec5c01760a1e79de2830d8bcbe/pa/EA40127_4cb39535d0e3008c417c77469afd3a25.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-19',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TFSI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2017}
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA40127%27 HTTP/1.1" 200 None
2026-03-29 08:35:32 [auto1.be] INFO: Saving data for EA40127: {'created_time': 1774773332.762408, 'last_price_update_time': 1774773332.762416, 'auction_closing_time': 1774884214.0}
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EA40127') HTTP/1.1" 204 0
2026-03-29 08:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef131b08-327c-5aa4-ac06-ff22198c1b06 with identifier: DY35896
2026-03-29 08:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef131b08-327c-5aa4-ac06-ff22198c1b06 with scrape type 1
2026-03-29 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ef131b08-327c-5aa4-ac06-ff22198c1b06
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fdd%252Fd6ddf6043009e348b5817080c5e73f2b%252Fpa%252FDY35896_da6a5c8ee0fae6397dc5ed28fbfa4f3a.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/dd/d6ddf6043009e348b5817080c5e73f2b/pa/DY35896_da6a5c8ee0fae6397dc5ed28fbfa4f3a.jpg already downloaded
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fdd%252Fd6ddf6043009e348b5817080c5e73f2b%252Fpa%252FDY35896_7a8a67e75faf0c03cf01b5690bbae9c9.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/dd/d6ddf6043009e348b5817080c5e73f2b/pa/DY35896_7a8a67e75faf0c03cf01b5690bbae9c9.jpg already downloaded
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fdd%252Fd6ddf6043009e348b5817080c5e73f2b%252Fpa%252FDY35896_d5b093cd8d83227c515ea0bdd05ba2a0.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/dd/d6ddf6043009e348b5817080c5e73f2b/pa/DY35896_d5b093cd8d83227c515ea0bdd05ba2a0.jpg already downloaded
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fdd%252Fd6ddf6043009e348b5817080c5e73f2b%252Fpa%252FDY35896_40932e008048d24594c5bafcb8f83d88.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/dd/d6ddf6043009e348b5817080c5e73f2b/pa/DY35896_40932e008048d24594c5bafcb8f83d88.jpg already downloaded
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fdd%252Fd6ddf6043009e348b5817080c5e73f2b%252Fpa%252FDY35896_46216d661e117ae4e576b54bc694d339.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/dd/d6ddf6043009e348b5817080c5e73f2b/pa/DY35896_46216d661e117ae4e576b54bc694d339.jpg already downloaded
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fdd%252Fd6ddf6043009e348b5817080c5e73f2b%252Fpa%252FDY35896_b8205db1c0c9b36ddc1f7b7dadd0ba69.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/dd/d6ddf6043009e348b5817080c5e73f2b/pa/DY35896_b8205db1c0c9b36ddc1f7b7dadd0ba69.jpg already downloaded
2026-03-29 08:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ef131b08-327c-5aa4-ac06-ff22198c1b06, identifier: DY35896
2026-03-29 08:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03cbc889-708d-5c6c-b63f-11ffbe2cd065 with identifier: VM01272
2026-03-29 08:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03cbc889-708d-5c6c-b63f-11ffbe2cd065 with scrape type 1
2026-03-29 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 03cbc889-708d-5c6c-b63f-11ffbe2cd065
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F8d%252Fab8d1710df10ea4688a08b80d7598e75%252Fpa%252FVM01272_5440aeae1f484f4e19dd3120564425db.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/8d/ab8d1710df10ea4688a08b80d7598e75/pa/VM01272_5440aeae1f484f4e19dd3120564425db.jpg already downloaded
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F8d%252Fab8d1710df10ea4688a08b80d7598e75%252Fpa%252FVM01272_42f3a034092c8bcc2469d0bb959775b1.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/8d/ab8d1710df10ea4688a08b80d7598e75/pa/VM01272_42f3a034092c8bcc2469d0bb959775b1.jpg already downloaded
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F8d%252Fab8d1710df10ea4688a08b80d7598e75%252Fpa%252FVM01272_70a4be17e8ce176db534a892bb7fd734.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/8d/ab8d1710df10ea4688a08b80d7598e75/pa/VM01272_70a4be17e8ce176db534a892bb7fd734.jpg already downloaded
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F8d%252Fab8d1710df10ea4688a08b80d7598e75%252Fpa%252FVM01272_1c3506bd7986a2e505354e65b463be18.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/8d/ab8d1710df10ea4688a08b80d7598e75/pa/VM01272_1c3506bd7986a2e505354e65b463be18.jpg already downloaded
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F8d%252Fab8d1710df10ea4688a08b80d7598e75%252Fpa%252FVM01272_706cf07932e53b70c1b87fe704c5ecc4.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/8d/ab8d1710df10ea4688a08b80d7598e75/pa/VM01272_706cf07932e53b70c1b87fe704c5ecc4.jpg already downloaded
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F8d%252Fab8d1710df10ea4688a08b80d7598e75%252Fpa%252FVM01272_11e8ba064efe333a342a31250684d4ee.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/8d/ab8d1710df10ea4688a08b80d7598e75/pa/VM01272_11e8ba064efe333a342a31250684d4ee.jpg already downloaded
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F8d%252Fab8d1710df10ea4688a08b80d7598e75%252Fpa%252FVM01272_73805fe54d5be4e75437cb241b5d44ad.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/8d/ab8d1710df10ea4688a08b80d7598e75/pa/VM01272_73805fe54d5be4e75437cb241b5d44ad.jpg already downloaded
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F8d%252Fab8d1710df10ea4688a08b80d7598e75%252Fpa%252FVM01272_61f571c9185216921f3a6084757ca2a8.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/8d/ab8d1710df10ea4688a08b80d7598e75/pa/VM01272_61f571c9185216921f3a6084757ca2a8.jpg already downloaded
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F8d%252Fab8d1710df10ea4688a08b80d7598e75%252Fpa%252FVM01272_1348c30d01e91dde938d1f4c9eccd988.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/8d/ab8d1710df10ea4688a08b80d7598e75/pa/VM01272_1348c30d01e91dde938d1f4c9eccd988.jpg already downloaded
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F8d%252Fab8d1710df10ea4688a08b80d7598e75%252Fpa%252FVM01272_e8b59df2f7113bfcd4305e3fbb1e6c16.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/8d/ab8d1710df10ea4688a08b80d7598e75/pa/VM01272_e8b59df2f7113bfcd4305e3fbb1e6c16.jpg already downloaded
2026-03-29 08:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 03cbc889-708d-5c6c-b63f-11ffbe2cd065, identifier: VM01272
2026-03-29 08:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ef131b08-327c-5aa4-ac06-ff22198c1b06 with identifier: DY35896
2026-03-29 08:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ef131b08-327c-5aa4-ac06-ff22198c1b06 with identifier: DY35896
2026-03-29 08:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ef131b08-327c-5aa4-ac06-ff22198c1b06 with identifier: DY35896 to the API
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DY35896>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.8L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:24:02Z',
 'fuel_type': 'petrol',
 'id': 'ef131b08-327c-5aa4-ac06-ff22198c1b06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY35896',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mitsubishi',
 'model': 'Carisma',
 'odometer': 102060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgd6/dd/d6ddf6043009e348b5817080c5e73f2b/pa/DY35896_da6a5c8ee0fae6397dc5ed28fbfa4f3a.jpg',
                'https://img-pa.auto1.com/imgd6/dd/d6ddf6043009e348b5817080c5e73f2b/pa/DY35896_7a8a67e75faf0c03cf01b5690bbae9c9.jpg',
                'https://img-pa.auto1.com/imgd6/dd/d6ddf6043009e348b5817080c5e73f2b/pa/DY35896_d5b093cd8d83227c515ea0bdd05ba2a0.jpg',
                'https://img-pa.auto1.com/imgd6/dd/d6ddf6043009e348b5817080c5e73f2b/pa/DY35896_40932e008048d24594c5bafcb8f83d88.jpg',
                'https://img-pa.auto1.com/imgd6/dd/d6ddf6043009e348b5817080c5e73f2b/pa/DY35896_46216d661e117ae4e576b54bc694d339.jpg',
                'https://img-pa.auto1.com/imgd6/dd/d6ddf6043009e348b5817080c5e73f2b/pa/DY35896_b8205db1c0c9b36ddc1f7b7dadd0ba69.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef131b08-327c-5aa4-ac06-ff22198c1b06/ef131b08-327c-5aa4-ac06-ff22198c1b06_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114708,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/dd/d6ddf6043009e348b5817080c5e73f2b/pa/DY35896_da6a5c8ee0fae6397dc5ed28fbfa4f3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef131b08-327c-5aa4-ac06-ff22198c1b06/ef131b08-327c-5aa4-ac06-ff22198c1b06_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/dd/d6ddf6043009e348b5817080c5e73f2b/pa/DY35896_7a8a67e75faf0c03cf01b5690bbae9c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef131b08-327c-5aa4-ac06-ff22198c1b06/ef131b08-327c-5aa4-ac06-ff22198c1b06_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/dd/d6ddf6043009e348b5817080c5e73f2b/pa/DY35896_d5b093cd8d83227c515ea0bdd05ba2a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef131b08-327c-5aa4-ac06-ff22198c1b06/ef131b08-327c-5aa4-ac06-ff22198c1b06_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/dd/d6ddf6043009e348b5817080c5e73f2b/pa/DY35896_40932e008048d24594c5bafcb8f83d88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef131b08-327c-5aa4-ac06-ff22198c1b06/ef131b08-327c-5aa4-ac06-ff22198c1b06_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/dd/d6ddf6043009e348b5817080c5e73f2b/pa/DY35896_46216d661e117ae4e576b54bc694d339.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef131b08-327c-5aa4-ac06-ff22198c1b06/ef131b08-327c-5aa4-ac06-ff22198c1b06_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/dd/d6ddf6043009e348b5817080c5e73f2b/pa/DY35896_b8205db1c0c9b36ddc1f7b7dadd0ba69.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1999-06-03',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mitsubishi Carisma 1.8 GDI EXE',
 'transmission': 'manual',
 'trim': 'EXE',
 'year': 1999}
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY35896%27 HTTP/1.1" 200 None
2026-03-29 08:35:33 [auto1.be] INFO: Saving data for DY35896: {'created_time': 1774773333.622127, 'last_price_update_time': 1774773333.622136, 'auction_closing_time': 1774884242.0}
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DY35896') HTTP/1.1" 204 0
2026-03-29 08:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 03cbc889-708d-5c6c-b63f-11ffbe2cd065 with identifier: VM01272
2026-03-29 08:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 03cbc889-708d-5c6c-b63f-11ffbe2cd065 with identifier: VM01272
2026-03-29 08:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 03cbc889-708d-5c6c-b63f-11ffbe2cd065 with identifier: VM01272 to the API
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VM01272>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:03:56Z',
 'fuel_type': 'diesel',
 'id': '03cbc889-708d-5c6c-b63f-11ffbe2cd065',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM01272',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 101316,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgab/8d/ab8d1710df10ea4688a08b80d7598e75/pa/VM01272_5440aeae1f484f4e19dd3120564425db.jpg',
                'https://img-pa.auto1.com/imgab/8d/ab8d1710df10ea4688a08b80d7598e75/pa/VM01272_42f3a034092c8bcc2469d0bb959775b1.jpg',
                'https://img-pa.auto1.com/imgab/8d/ab8d1710df10ea4688a08b80d7598e75/pa/VM01272_70a4be17e8ce176db534a892bb7fd734.jpg',
                'https://img-pa.auto1.com/imgab/8d/ab8d1710df10ea4688a08b80d7598e75/pa/VM01272_1c3506bd7986a2e505354e65b463be18.jpg',
                'https://img-pa.auto1.com/imgab/8d/ab8d1710df10ea4688a08b80d7598e75/pa/VM01272_706cf07932e53b70c1b87fe704c5ecc4.jpg',
                'https://img-pa.auto1.com/imgab/8d/ab8d1710df10ea4688a08b80d7598e75/pa/VM01272_11e8ba064efe333a342a31250684d4ee.jpg',
                'https://img-pa.auto1.com/imgab/8d/ab8d1710df10ea4688a08b80d7598e75/pa/VM01272_73805fe54d5be4e75437cb241b5d44ad.jpg',
                'https://img-pa.auto1.com/imgab/8d/ab8d1710df10ea4688a08b80d7598e75/pa/VM01272_61f571c9185216921f3a6084757ca2a8.jpg',
                'https://img-pa.auto1.com/imgab/8d/ab8d1710df10ea4688a08b80d7598e75/pa/VM01272_1348c30d01e91dde938d1f4c9eccd988.jpg',
                'https://img-pa.auto1.com/imgab/8d/ab8d1710df10ea4688a08b80d7598e75/pa/VM01272_e8b59df2f7113bfcd4305e3fbb1e6c16.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03cbc889-708d-5c6c-b63f-11ffbe2cd065/03cbc889-708d-5c6c-b63f-11ffbe2cd065_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/8d/ab8d1710df10ea4688a08b80d7598e75/pa/VM01272_5440aeae1f484f4e19dd3120564425db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03cbc889-708d-5c6c-b63f-11ffbe2cd065/03cbc889-708d-5c6c-b63f-11ffbe2cd065_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/8d/ab8d1710df10ea4688a08b80d7598e75/pa/VM01272_42f3a034092c8bcc2469d0bb959775b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03cbc889-708d-5c6c-b63f-11ffbe2cd065/03cbc889-708d-5c6c-b63f-11ffbe2cd065_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/8d/ab8d1710df10ea4688a08b80d7598e75/pa/VM01272_70a4be17e8ce176db534a892bb7fd734.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03cbc889-708d-5c6c-b63f-11ffbe2cd065/03cbc889-708d-5c6c-b63f-11ffbe2cd065_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/8d/ab8d1710df10ea4688a08b80d7598e75/pa/VM01272_1c3506bd7986a2e505354e65b463be18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03cbc889-708d-5c6c-b63f-11ffbe2cd065/03cbc889-708d-5c6c-b63f-11ffbe2cd065_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/8d/ab8d1710df10ea4688a08b80d7598e75/pa/VM01272_706cf07932e53b70c1b87fe704c5ecc4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03cbc889-708d-5c6c-b63f-11ffbe2cd065/03cbc889-708d-5c6c-b63f-11ffbe2cd065_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/8d/ab8d1710df10ea4688a08b80d7598e75/pa/VM01272_11e8ba064efe333a342a31250684d4ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03cbc889-708d-5c6c-b63f-11ffbe2cd065/03cbc889-708d-5c6c-b63f-11ffbe2cd065_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/8d/ab8d1710df10ea4688a08b80d7598e75/pa/VM01272_73805fe54d5be4e75437cb241b5d44ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03cbc889-708d-5c6c-b63f-11ffbe2cd065/03cbc889-708d-5c6c-b63f-11ffbe2cd065_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/8d/ab8d1710df10ea4688a08b80d7598e75/pa/VM01272_61f571c9185216921f3a6084757ca2a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03cbc889-708d-5c6c-b63f-11ffbe2cd065/03cbc889-708d-5c6c-b63f-11ffbe2cd065_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/8d/ab8d1710df10ea4688a08b80d7598e75/pa/VM01272_1348c30d01e91dde938d1f4c9eccd988.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03cbc889-708d-5c6c-b63f-11ffbe2cd065/03cbc889-708d-5c6c-b63f-11ffbe2cd065_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/8d/ab8d1710df10ea4688a08b80d7598e75/pa/VM01272_e8b59df2f7113bfcd4305e3fbb1e6c16.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-19',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2011}
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM01272%27 HTTP/1.1" 200 None
2026-03-29 08:35:33 [auto1.be] INFO: Saving data for VM01272: {'created_time': 1774773333.943198, 'last_price_update_time': 1774773333.943209, 'auction_closing_time': 1774883036.0}
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VM01272') HTTP/1.1" 204 0
2026-03-29 08:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TE49371> (referer: https://www.auto1.com/v1/car-details-view/TE49371/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZZ00486> (referer: https://www.auto1.com/v1/car-details-view/ZZ00486/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AJ87899/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DF78239> (referer: https://www.auto1.com/v1/car-details-view/DF78239/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c85f81b-58a8-5286-88b5-daf9c24becc6 with identifier: TE49371
2026-03-29 08:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c85f81b-58a8-5286-88b5-daf9c24becc6 with scrape type 1
2026-03-29 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9c85f81b-58a8-5286-88b5-daf9c24becc6
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F74%252Fc0742406ce7755fd9a6bfbc3cdd41ecf%252Fpa%252FTE49371_497b5b04c0515a9947edfa847ad2afb4.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/74/c0742406ce7755fd9a6bfbc3cdd41ecf/pa/TE49371_497b5b04c0515a9947edfa847ad2afb4.jpg already downloaded
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F74%252Fc0742406ce7755fd9a6bfbc3cdd41ecf%252Fpa%252FTE49371_62f9e86b9589b9fb5561919c3ea62c81.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/74/c0742406ce7755fd9a6bfbc3cdd41ecf/pa/TE49371_62f9e86b9589b9fb5561919c3ea62c81.jpg already downloaded
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F74%252Fc0742406ce7755fd9a6bfbc3cdd41ecf%252Fpa%252FTE49371_15817d7bc51cdac249a41e2534241f94.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/74/c0742406ce7755fd9a6bfbc3cdd41ecf/pa/TE49371_15817d7bc51cdac249a41e2534241f94.jpg already downloaded
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F74%252Fc0742406ce7755fd9a6bfbc3cdd41ecf%252Fpa%252FTE49371_f07b40ab23caae73f7ab6ed23efc908d.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/74/c0742406ce7755fd9a6bfbc3cdd41ecf/pa/TE49371_f07b40ab23caae73f7ab6ed23efc908d.jpg already downloaded
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F74%252Fc0742406ce7755fd9a6bfbc3cdd41ecf%252Fpa%252FTE49371_741b8edfc2139e92d751fda1e7a320c8.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/74/c0742406ce7755fd9a6bfbc3cdd41ecf/pa/TE49371_741b8edfc2139e92d751fda1e7a320c8.jpg already downloaded
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F74%252Fc0742406ce7755fd9a6bfbc3cdd41ecf%252Fpa%252FTE49371_ed32762513a6537055e42c54a612f1ad.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/74/c0742406ce7755fd9a6bfbc3cdd41ecf/pa/TE49371_ed32762513a6537055e42c54a612f1ad.jpg already downloaded
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F74%252Fc0742406ce7755fd9a6bfbc3cdd41ecf%252Fpa%252FTE49371_1486ce2b4fd06aee7f55a20a13dd35ef.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/74/c0742406ce7755fd9a6bfbc3cdd41ecf/pa/TE49371_1486ce2b4fd06aee7f55a20a13dd35ef.jpg already downloaded
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F74%252Fc0742406ce7755fd9a6bfbc3cdd41ecf%252Fpa%252FTE49371_f44ebe2ffe01ed01647b69b5c52f0d4e.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/74/c0742406ce7755fd9a6bfbc3cdd41ecf/pa/TE49371_f44ebe2ffe01ed01647b69b5c52f0d4e.jpg already downloaded
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F74%252Fc0742406ce7755fd9a6bfbc3cdd41ecf%252Fpa%252FTE49371_8e0fdc4921432c2128c54caf8eb3a29a.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/74/c0742406ce7755fd9a6bfbc3cdd41ecf/pa/TE49371_8e0fdc4921432c2128c54caf8eb3a29a.jpg already downloaded
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252F74%252Fc0742406ce7755fd9a6bfbc3cdd41ecf%252Fpa%252FTE49371_e9c8ea10ef79ee661cd52f65a05a4a3f.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/74/c0742406ce7755fd9a6bfbc3cdd41ecf/pa/TE49371_e9c8ea10ef79ee661cd52f65a05a4a3f.jpg already downloaded
2026-03-29 08:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9c85f81b-58a8-5286-88b5-daf9c24becc6, identifier: TE49371
2026-03-29 08:35:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f444d1a-c303-50e9-9816-1d529ec66b90 with identifier: ZZ00486
2026-03-29 08:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f444d1a-c303-50e9-9816-1d529ec66b90 with scrape type 1
2026-03-29 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 5f444d1a-c303-50e9-9816-1d529ec66b90
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F96%252F9796ab073d53d08447c7250dd23d12a8%252Fpa%252FZZ00486_41e4ff7adda87ec7c2184763ae8695d5.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/96/9796ab073d53d08447c7250dd23d12a8/pa/ZZ00486_41e4ff7adda87ec7c2184763ae8695d5.jpg already downloaded
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F96%252F9796ab073d53d08447c7250dd23d12a8%252Fpa%252FZZ00486_cb1aa5fdd025e5f639314fa7568f0324.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/96/9796ab073d53d08447c7250dd23d12a8/pa/ZZ00486_cb1aa5fdd025e5f639314fa7568f0324.jpg already downloaded
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F96%252F9796ab073d53d08447c7250dd23d12a8%252Fpa%252FZZ00486_739d04ae49f07daf24cdb869fc9e18d3.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/96/9796ab073d53d08447c7250dd23d12a8/pa/ZZ00486_739d04ae49f07daf24cdb869fc9e18d3.jpg already downloaded
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F96%252F9796ab073d53d08447c7250dd23d12a8%252Fpa%252FZZ00486_d93b41dba6a00cba50ac34ee4c3d14bc.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/96/9796ab073d53d08447c7250dd23d12a8/pa/ZZ00486_d93b41dba6a00cba50ac34ee4c3d14bc.jpg already downloaded
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F96%252F9796ab073d53d08447c7250dd23d12a8%252Fpa%252FZZ00486_7f896a74e5d87c9dbc36e03d6b5e42e1.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/96/9796ab073d53d08447c7250dd23d12a8/pa/ZZ00486_7f896a74e5d87c9dbc36e03d6b5e42e1.jpg already downloaded
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F96%252F9796ab073d53d08447c7250dd23d12a8%252Fpa%252FZZ00486_14c43953aabf2ee7c4e320cff34acdf3.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/96/9796ab073d53d08447c7250dd23d12a8/pa/ZZ00486_14c43953aabf2ee7c4e320cff34acdf3.jpg already downloaded
2026-03-29 08:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5f444d1a-c303-50e9-9816-1d529ec66b90, identifier: ZZ00486
2026-03-29 08:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9c85f81b-58a8-5286-88b5-daf9c24becc6 with identifier: TE49371
2026-03-29 08:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9c85f81b-58a8-5286-88b5-daf9c24becc6 with identifier: TE49371
2026-03-29 08:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9c85f81b-58a8-5286-88b5-daf9c24becc6 with identifier: TE49371 to the API
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TE49371>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '1.3L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:32:06Z',
 'fuel_type': 'petrol',
 'id': '9c85f81b-58a8-5286-88b5-daf9c24becc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE49371',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 52383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgc0/74/c0742406ce7755fd9a6bfbc3cdd41ecf/pa/TE49371_497b5b04c0515a9947edfa847ad2afb4.jpg',
                'https://img-pa.auto1.com/imgc0/74/c0742406ce7755fd9a6bfbc3cdd41ecf/pa/TE49371_62f9e86b9589b9fb5561919c3ea62c81.jpg',
                'https://img-pa.auto1.com/imgc0/74/c0742406ce7755fd9a6bfbc3cdd41ecf/pa/TE49371_15817d7bc51cdac249a41e2534241f94.jpg',
                'https://img-pa.auto1.com/imgc0/74/c0742406ce7755fd9a6bfbc3cdd41ecf/pa/TE49371_f07b40ab23caae73f7ab6ed23efc908d.jpg',
                'https://img-pa.auto1.com/imgc0/74/c0742406ce7755fd9a6bfbc3cdd41ecf/pa/TE49371_741b8edfc2139e92d751fda1e7a320c8.jpg',
                'https://img-pa.auto1.com/imgc0/74/c0742406ce7755fd9a6bfbc3cdd41ecf/pa/TE49371_ed32762513a6537055e42c54a612f1ad.jpg',
                'https://img-pa.auto1.com/imgc0/74/c0742406ce7755fd9a6bfbc3cdd41ecf/pa/TE49371_1486ce2b4fd06aee7f55a20a13dd35ef.jpg',
                'https://img-pa.auto1.com/imgc0/74/c0742406ce7755fd9a6bfbc3cdd41ecf/pa/TE49371_f44ebe2ffe01ed01647b69b5c52f0d4e.jpg',
                'https://img-pa.auto1.com/imgc0/74/c0742406ce7755fd9a6bfbc3cdd41ecf/pa/TE49371_8e0fdc4921432c2128c54caf8eb3a29a.jpg',
                'https://img-pa.auto1.com/imgc0/74/c0742406ce7755fd9a6bfbc3cdd41ecf/pa/TE49371_e9c8ea10ef79ee661cd52f65a05a4a3f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c85f81b-58a8-5286-88b5-daf9c24becc6/9c85f81b-58a8-5286-88b5-daf9c24becc6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/74/c0742406ce7755fd9a6bfbc3cdd41ecf/pa/TE49371_497b5b04c0515a9947edfa847ad2afb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c85f81b-58a8-5286-88b5-daf9c24becc6/9c85f81b-58a8-5286-88b5-daf9c24becc6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/74/c0742406ce7755fd9a6bfbc3cdd41ecf/pa/TE49371_62f9e86b9589b9fb5561919c3ea62c81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c85f81b-58a8-5286-88b5-daf9c24becc6/9c85f81b-58a8-5286-88b5-daf9c24becc6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/74/c0742406ce7755fd9a6bfbc3cdd41ecf/pa/TE49371_15817d7bc51cdac249a41e2534241f94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c85f81b-58a8-5286-88b5-daf9c24becc6/9c85f81b-58a8-5286-88b5-daf9c24becc6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/74/c0742406ce7755fd9a6bfbc3cdd41ecf/pa/TE49371_f07b40ab23caae73f7ab6ed23efc908d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c85f81b-58a8-5286-88b5-daf9c24becc6/9c85f81b-58a8-5286-88b5-daf9c24becc6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/74/c0742406ce7755fd9a6bfbc3cdd41ecf/pa/TE49371_741b8edfc2139e92d751fda1e7a320c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c85f81b-58a8-5286-88b5-daf9c24becc6/9c85f81b-58a8-5286-88b5-daf9c24becc6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/74/c0742406ce7755fd9a6bfbc3cdd41ecf/pa/TE49371_ed32762513a6537055e42c54a612f1ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c85f81b-58a8-5286-88b5-daf9c24becc6/9c85f81b-58a8-5286-88b5-daf9c24becc6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/74/c0742406ce7755fd9a6bfbc3cdd41ecf/pa/TE49371_1486ce2b4fd06aee7f55a20a13dd35ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c85f81b-58a8-5286-88b5-daf9c24becc6/9c85f81b-58a8-5286-88b5-daf9c24becc6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/74/c0742406ce7755fd9a6bfbc3cdd41ecf/pa/TE49371_f44ebe2ffe01ed01647b69b5c52f0d4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c85f81b-58a8-5286-88b5-daf9c24becc6/9c85f81b-58a8-5286-88b5-daf9c24becc6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/74/c0742406ce7755fd9a6bfbc3cdd41ecf/pa/TE49371_8e0fdc4921432c2128c54caf8eb3a29a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c85f81b-58a8-5286-88b5-daf9c24becc6/9c85f81b-58a8-5286-88b5-daf9c24becc6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/74/c0742406ce7755fd9a6bfbc3cdd41ecf/pa/TE49371_e9c8ea10ef79ee661cd52f65a05a4a3f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Compass 1.3 T-GDi Longitude FWD',
 'transmission': 'automatic',
 'trim': 'Longitude FWD',
 'year': 2020}
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE49371%27 HTTP/1.1" 200 None
2026-03-29 08:35:34 [auto1.be] INFO: Saving data for TE49371: {'created_time': 1774773334.874826, 'last_price_update_time': 1774773334.874836, 'auction_closing_time': 1774884726.0}
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TE49371') HTTP/1.1" 204 0
2026-03-29 08:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5f444d1a-c303-50e9-9816-1d529ec66b90 with identifier: ZZ00486
2026-03-29 08:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5f444d1a-c303-50e9-9816-1d529ec66b90 with identifier: ZZ00486
2026-03-29 08:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5f444d1a-c303-50e9-9816-1d529ec66b90 with identifier: ZZ00486 to the API
2026-03-29 08:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZZ00486>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:48:42Z',
 'fuel_type': 'petrol',
 'id': '5f444d1a-c303-50e9-9816-1d529ec66b90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ00486',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Chevrolet',
 'model': 'Spark',
 'odometer': 90284,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img97/96/9796ab073d53d08447c7250dd23d12a8/pa/ZZ00486_41e4ff7adda87ec7c2184763ae8695d5.jpg',
                'https://img-pa.auto1.com/img97/96/9796ab073d53d08447c7250dd23d12a8/pa/ZZ00486_cb1aa5fdd025e5f639314fa7568f0324.jpg',
                'https://img-pa.auto1.com/img97/96/9796ab073d53d08447c7250dd23d12a8/pa/ZZ00486_739d04ae49f07daf24cdb869fc9e18d3.jpg',
                'https://img-pa.auto1.com/img97/96/9796ab073d53d08447c7250dd23d12a8/pa/ZZ00486_d93b41dba6a00cba50ac34ee4c3d14bc.jpg',
                'https://img-pa.auto1.com/img97/96/9796ab073d53d08447c7250dd23d12a8/pa/ZZ00486_7f896a74e5d87c9dbc36e03d6b5e42e1.jpg',
                'https://img-pa.auto1.com/img97/96/9796ab073d53d08447c7250dd23d12a8/pa/ZZ00486_14c43953aabf2ee7c4e320cff34acdf3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f444d1a-c303-50e9-9816-1d529ec66b90/5f444d1a-c303-50e9-9816-1d529ec66b90_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/96/9796ab073d53d08447c7250dd23d12a8/pa/ZZ00486_41e4ff7adda87ec7c2184763ae8695d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f444d1a-c303-50e9-9816-1d529ec66b90/5f444d1a-c303-50e9-9816-1d529ec66b90_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94396,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/96/9796ab073d53d08447c7250dd23d12a8/pa/ZZ00486_cb1aa5fdd025e5f639314fa7568f0324.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f444d1a-c303-50e9-9816-1d529ec66b90/5f444d1a-c303-50e9-9816-1d529ec66b90_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/96/9796ab073d53d08447c7250dd23d12a8/pa/ZZ00486_739d04ae49f07daf24cdb869fc9e18d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f444d1a-c303-50e9-9816-1d529ec66b90/5f444d1a-c303-50e9-9816-1d529ec66b90_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/96/9796ab073d53d08447c7250dd23d12a8/pa/ZZ00486_d93b41dba6a00cba50ac34ee4c3d14bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f444d1a-c303-50e9-9816-1d529ec66b90/5f444d1a-c303-50e9-9816-1d529ec66b90_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/96/9796ab073d53d08447c7250dd23d12a8/pa/ZZ00486_7f896a74e5d87c9dbc36e03d6b5e42e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5f444d1a-c303-50e9-9816-1d529ec66b90/5f444d1a-c303-50e9-9816-1d529ec66b90_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/96/9796ab073d53d08447c7250dd23d12a8/pa/ZZ00486_14c43953aabf2ee7c4e320cff34acdf3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Chevrolet Spark 1.2 LT',
 'transmission': 'manual',
 'trim': 'LT',
 'year': 2010}
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ00486%27 HTTP/1.1" 200 None
2026-03-29 08:35:35 [auto1.be] INFO: Saving data for ZZ00486: {'created_time': 1774773335.207569, 'last_price_update_time': 1774773335.20758, 'auction_closing_time': 1774885722.0}
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZZ00486') HTTP/1.1" 204 0
2026-03-29 08:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CC34063> (referer: https://www.auto1.com/v1/car-details-view/CC34063/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d163814c-326f-5b24-a2de-99ebfe1d3309 with identifier: DF78239
2026-03-29 08:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d163814c-326f-5b24-a2de-99ebfe1d3309 with scrape type 1
2026-03-29 08:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d163814c-326f-5b24-a2de-99ebfe1d3309
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F78%252F1378ce8896553292db95ec0df2439b38%252Fpa%252FDF78239_22938eaa39f34be588b79969dcb615fd.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/78/1378ce8896553292db95ec0df2439b38/pa/DF78239_22938eaa39f34be588b79969dcb615fd.jpg already downloaded
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F78%252F1378ce8896553292db95ec0df2439b38%252Fpa%252FDF78239_f74cb1d8bae539efa7e6b520d0602e83.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/78/1378ce8896553292db95ec0df2439b38/pa/DF78239_f74cb1d8bae539efa7e6b520d0602e83.jpg already downloaded
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F78%252F1378ce8896553292db95ec0df2439b38%252Fpa%252FDF78239_5f98ebd67ff62df944565579adbddeac.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/78/1378ce8896553292db95ec0df2439b38/pa/DF78239_5f98ebd67ff62df944565579adbddeac.jpg already downloaded
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F78%252F1378ce8896553292db95ec0df2439b38%252Fpa%252FDF78239_8393b22f13fa20245625f2d75a853f80.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/78/1378ce8896553292db95ec0df2439b38/pa/DF78239_8393b22f13fa20245625f2d75a853f80.jpg already downloaded
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F78%252F1378ce8896553292db95ec0df2439b38%252Fpa%252FDF78239_9db32dfadb9ae42a90bdb292c3571808.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/78/1378ce8896553292db95ec0df2439b38/pa/DF78239_9db32dfadb9ae42a90bdb292c3571808.jpg already downloaded
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F78%252F1378ce8896553292db95ec0df2439b38%252Fpa%252FDF78239_0e3ef27aa5232840529865966bdc4d85.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/78/1378ce8896553292db95ec0df2439b38/pa/DF78239_0e3ef27aa5232840529865966bdc4d85.jpg already downloaded
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F78%252F1378ce8896553292db95ec0df2439b38%252Fpa%252FDF78239_e5e5536b86a4e8f36c50443d382674e3.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/78/1378ce8896553292db95ec0df2439b38/pa/DF78239_e5e5536b86a4e8f36c50443d382674e3.jpg already downloaded
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F78%252F1378ce8896553292db95ec0df2439b38%252Fpa%252FDF78239_87631a4b064c2b15de2ae8a3ab587942.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/78/1378ce8896553292db95ec0df2439b38/pa/DF78239_87631a4b064c2b15de2ae8a3ab587942.jpg already downloaded
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F78%252F1378ce8896553292db95ec0df2439b38%252Fpa%252FDF78239_386e08b498cc0787797e5cf81b5cbd70.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/78/1378ce8896553292db95ec0df2439b38/pa/DF78239_386e08b498cc0787797e5cf81b5cbd70.jpg already downloaded
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F78%252F1378ce8896553292db95ec0df2439b38%252Fpa%252FDF78239_1ade073d2ff26be24b8ff104d19c4ced.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/78/1378ce8896553292db95ec0df2439b38/pa/DF78239_1ade073d2ff26be24b8ff104d19c4ced.jpg already downloaded
2026-03-29 08:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d163814c-326f-5b24-a2de-99ebfe1d3309, identifier: DF78239
2026-03-29 08:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d163814c-326f-5b24-a2de-99ebfe1d3309 with identifier: DF78239
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-29 08:35:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 08:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d163814c-326f-5b24-a2de-99ebfe1d3309 with identifier: DF78239
2026-03-29 08:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d163814c-326f-5b24-a2de-99ebfe1d3309 with identifier: DF78239 to the API
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DF78239>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:54:30Z',
 'fuel_type': 'diesel',
 'id': 'd163814c-326f-5b24-a2de-99ebfe1d3309',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF78239',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': '3er',
 'odometer': 202956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img13/78/1378ce8896553292db95ec0df2439b38/pa/DF78239_22938eaa39f34be588b79969dcb615fd.jpg',
                'https://img-pa.auto1.com/img13/78/1378ce8896553292db95ec0df2439b38/pa/DF78239_f74cb1d8bae539efa7e6b520d0602e83.jpg',
                'https://img-pa.auto1.com/img13/78/1378ce8896553292db95ec0df2439b38/pa/DF78239_5f98ebd67ff62df944565579adbddeac.jpg',
                'https://img-pa.auto1.com/img13/78/1378ce8896553292db95ec0df2439b38/pa/DF78239_8393b22f13fa20245625f2d75a853f80.jpg',
                'https://img-pa.auto1.com/img13/78/1378ce8896553292db95ec0df2439b38/pa/DF78239_9db32dfadb9ae42a90bdb292c3571808.jpg',
                'https://img-pa.auto1.com/img13/78/1378ce8896553292db95ec0df2439b38/pa/DF78239_0e3ef27aa5232840529865966bdc4d85.jpg',
                'https://img-pa.auto1.com/img13/78/1378ce8896553292db95ec0df2439b38/pa/DF78239_e5e5536b86a4e8f36c50443d382674e3.jpg',
                'https://img-pa.auto1.com/img13/78/1378ce8896553292db95ec0df2439b38/pa/DF78239_87631a4b064c2b15de2ae8a3ab587942.jpg',
                'https://img-pa.auto1.com/img13/78/1378ce8896553292db95ec0df2439b38/pa/DF78239_386e08b498cc0787797e5cf81b5cbd70.jpg',
                'https://img-pa.auto1.com/img13/78/1378ce8896553292db95ec0df2439b38/pa/DF78239_1ade073d2ff26be24b8ff104d19c4ced.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d163814c-326f-5b24-a2de-99ebfe1d3309/d163814c-326f-5b24-a2de-99ebfe1d3309_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/78/1378ce8896553292db95ec0df2439b38/pa/DF78239_22938eaa39f34be588b79969dcb615fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d163814c-326f-5b24-a2de-99ebfe1d3309/d163814c-326f-5b24-a2de-99ebfe1d3309_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/78/1378ce8896553292db95ec0df2439b38/pa/DF78239_f74cb1d8bae539efa7e6b520d0602e83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d163814c-326f-5b24-a2de-99ebfe1d3309/d163814c-326f-5b24-a2de-99ebfe1d3309_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71007,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/78/1378ce8896553292db95ec0df2439b38/pa/DF78239_5f98ebd67ff62df944565579adbddeac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d163814c-326f-5b24-a2de-99ebfe1d3309/d163814c-326f-5b24-a2de-99ebfe1d3309_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/78/1378ce8896553292db95ec0df2439b38/pa/DF78239_8393b22f13fa20245625f2d75a853f80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d163814c-326f-5b24-a2de-99ebfe1d3309/d163814c-326f-5b24-a2de-99ebfe1d3309_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/78/1378ce8896553292db95ec0df2439b38/pa/DF78239_9db32dfadb9ae42a90bdb292c3571808.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d163814c-326f-5b24-a2de-99ebfe1d3309/d163814c-326f-5b24-a2de-99ebfe1d3309_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/78/1378ce8896553292db95ec0df2439b38/pa/DF78239_0e3ef27aa5232840529865966bdc4d85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d163814c-326f-5b24-a2de-99ebfe1d3309/d163814c-326f-5b24-a2de-99ebfe1d3309_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/78/1378ce8896553292db95ec0df2439b38/pa/DF78239_e5e5536b86a4e8f36c50443d382674e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d163814c-326f-5b24-a2de-99ebfe1d3309/d163814c-326f-5b24-a2de-99ebfe1d3309_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/78/1378ce8896553292db95ec0df2439b38/pa/DF78239_87631a4b064c2b15de2ae8a3ab587942.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d163814c-326f-5b24-a2de-99ebfe1d3309/d163814c-326f-5b24-a2de-99ebfe1d3309_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/78/1378ce8896553292db95ec0df2439b38/pa/DF78239_386e08b498cc0787797e5cf81b5cbd70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d163814c-326f-5b24-a2de-99ebfe1d3309/d163814c-326f-5b24-a2de-99ebfe1d3309_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/78/1378ce8896553292db95ec0df2439b38/pa/DF78239_1ade073d2ff26be24b8ff104d19c4ced.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-08-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 325d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF78239%27 HTTP/1.1" 200 None
2026-03-29 08:35:36 [auto1.be] INFO: Saving data for DF78239: {'created_time': 1774773336.056211, 'last_price_update_time': 1774773336.05622, 'auction_closing_time': 1774886070.0}
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DF78239') HTTP/1.1" 204 0
2026-03-29 08:35:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UX89863> (referer: https://www.auto1.com/v1/car-details-view/UX89863/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a05fbb5-89c0-5bbc-9c09-d6c83857abb3 with identifier: CC34063
2026-03-29 08:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a05fbb5-89c0-5bbc-9c09-d6c83857abb3 with scrape type 1
2026-03-29 08:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2a05fbb5-89c0-5bbc-9c09-d6c83857abb3
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F3b%252Fab3b92246903686670c2ef05d8ed0503%252Fpa%252FCC34063_559ca2707035c54873437fc80b893a57.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/3b/ab3b92246903686670c2ef05d8ed0503/pa/CC34063_559ca2707035c54873437fc80b893a57.jpg already downloaded
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F3b%252Fab3b92246903686670c2ef05d8ed0503%252Fpa%252FCC34063_0151f00487f2695181b67dada8b9429d.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/3b/ab3b92246903686670c2ef05d8ed0503/pa/CC34063_0151f00487f2695181b67dada8b9429d.jpg already downloaded
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F3b%252Fab3b92246903686670c2ef05d8ed0503%252Fpa%252FCC34063_78f96ca56c57af489281eff1b7c87d09.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/3b/ab3b92246903686670c2ef05d8ed0503/pa/CC34063_78f96ca56c57af489281eff1b7c87d09.jpg already downloaded
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F3b%252Fab3b92246903686670c2ef05d8ed0503%252Fpa%252FCC34063_e738d854fed512984c5422f03307e76e.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/3b/ab3b92246903686670c2ef05d8ed0503/pa/CC34063_e738d854fed512984c5422f03307e76e.jpg already downloaded
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F3b%252Fab3b92246903686670c2ef05d8ed0503%252Fpa%252FCC34063_0b63e4c1fdabc57e57133150bd192e4e.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/3b/ab3b92246903686670c2ef05d8ed0503/pa/CC34063_0b63e4c1fdabc57e57133150bd192e4e.jpg already downloaded
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F3b%252Fab3b92246903686670c2ef05d8ed0503%252Fpa%252FCC34063_b230c112b445478473e50ea941cba222.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/3b/ab3b92246903686670c2ef05d8ed0503/pa/CC34063_b230c112b445478473e50ea941cba222.jpg already downloaded
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F3b%252Fab3b92246903686670c2ef05d8ed0503%252Fpa%252FCC34063_0386d3a0fca6a7a6fa978c963d3426f7.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/3b/ab3b92246903686670c2ef05d8ed0503/pa/CC34063_0386d3a0fca6a7a6fa978c963d3426f7.jpg already downloaded
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F3b%252Fab3b92246903686670c2ef05d8ed0503%252Fpa%252FCC34063_82c89c713612172eb8f7af6ae63afb32.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/3b/ab3b92246903686670c2ef05d8ed0503/pa/CC34063_82c89c713612172eb8f7af6ae63afb32.jpg already downloaded
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F3b%252Fab3b92246903686670c2ef05d8ed0503%252Fpa%252FCC34063_f596b9213690924bb38a62aff6e940f6.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/3b/ab3b92246903686670c2ef05d8ed0503/pa/CC34063_f596b9213690924bb38a62aff6e940f6.jpg already downloaded
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F3b%252Fab3b92246903686670c2ef05d8ed0503%252Fpa%252FCC34063_e68db5d246f5166b9b98975a48ca1016.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/3b/ab3b92246903686670c2ef05d8ed0503/pa/CC34063_e68db5d246f5166b9b98975a48ca1016.jpg already downloaded
2026-03-29 08:35:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2a05fbb5-89c0-5bbc-9c09-d6c83857abb3, identifier: CC34063
2026-03-29 08:35:36 [auto1.be] INFO: Channel: 24h | Page: 7 | totalHits: 1252 | hits on page: 40
2026-03-29 08:35:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2a05fbb5-89c0-5bbc-9c09-d6c83857abb3 with identifier: CC34063
2026-03-29 08:35:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2a05fbb5-89c0-5bbc-9c09-d6c83857abb3 with identifier: CC34063
2026-03-29 08:35:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2a05fbb5-89c0-5bbc-9c09-d6c83857abb3 with identifier: CC34063 to the API
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CC34063>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:52:59Z',
 'fuel_type': 'diesel',
 'id': '2a05fbb5-89c0-5bbc-9c09-d6c83857abb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC34063',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 189140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgab/3b/ab3b92246903686670c2ef05d8ed0503/pa/CC34063_559ca2707035c54873437fc80b893a57.jpg',
                'https://img-pa.auto1.com/imgab/3b/ab3b92246903686670c2ef05d8ed0503/pa/CC34063_0151f00487f2695181b67dada8b9429d.jpg',
                'https://img-pa.auto1.com/imgab/3b/ab3b92246903686670c2ef05d8ed0503/pa/CC34063_78f96ca56c57af489281eff1b7c87d09.jpg',
                'https://img-pa.auto1.com/imgab/3b/ab3b92246903686670c2ef05d8ed0503/pa/CC34063_e738d854fed512984c5422f03307e76e.jpg',
                'https://img-pa.auto1.com/imgab/3b/ab3b92246903686670c2ef05d8ed0503/pa/CC34063_0b63e4c1fdabc57e57133150bd192e4e.jpg',
                'https://img-pa.auto1.com/imgab/3b/ab3b92246903686670c2ef05d8ed0503/pa/CC34063_b230c112b445478473e50ea941cba222.jpg',
                'https://img-pa.auto1.com/imgab/3b/ab3b92246903686670c2ef05d8ed0503/pa/CC34063_0386d3a0fca6a7a6fa978c963d3426f7.jpg',
                'https://img-pa.auto1.com/imgab/3b/ab3b92246903686670c2ef05d8ed0503/pa/CC34063_82c89c713612172eb8f7af6ae63afb32.jpg',
                'https://img-pa.auto1.com/imgab/3b/ab3b92246903686670c2ef05d8ed0503/pa/CC34063_f596b9213690924bb38a62aff6e940f6.jpg',
                'https://img-pa.auto1.com/imgab/3b/ab3b92246903686670c2ef05d8ed0503/pa/CC34063_e68db5d246f5166b9b98975a48ca1016.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a05fbb5-89c0-5bbc-9c09-d6c83857abb3/2a05fbb5-89c0-5bbc-9c09-d6c83857abb3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/3b/ab3b92246903686670c2ef05d8ed0503/pa/CC34063_559ca2707035c54873437fc80b893a57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a05fbb5-89c0-5bbc-9c09-d6c83857abb3/2a05fbb5-89c0-5bbc-9c09-d6c83857abb3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/3b/ab3b92246903686670c2ef05d8ed0503/pa/CC34063_0151f00487f2695181b67dada8b9429d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a05fbb5-89c0-5bbc-9c09-d6c83857abb3/2a05fbb5-89c0-5bbc-9c09-d6c83857abb3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/3b/ab3b92246903686670c2ef05d8ed0503/pa/CC34063_78f96ca56c57af489281eff1b7c87d09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a05fbb5-89c0-5bbc-9c09-d6c83857abb3/2a05fbb5-89c0-5bbc-9c09-d6c83857abb3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/3b/ab3b92246903686670c2ef05d8ed0503/pa/CC34063_e738d854fed512984c5422f03307e76e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a05fbb5-89c0-5bbc-9c09-d6c83857abb3/2a05fbb5-89c0-5bbc-9c09-d6c83857abb3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/3b/ab3b92246903686670c2ef05d8ed0503/pa/CC34063_0b63e4c1fdabc57e57133150bd192e4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a05fbb5-89c0-5bbc-9c09-d6c83857abb3/2a05fbb5-89c0-5bbc-9c09-d6c83857abb3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/3b/ab3b92246903686670c2ef05d8ed0503/pa/CC34063_b230c112b445478473e50ea941cba222.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a05fbb5-89c0-5bbc-9c09-d6c83857abb3/2a05fbb5-89c0-5bbc-9c09-d6c83857abb3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/3b/ab3b92246903686670c2ef05d8ed0503/pa/CC34063_0386d3a0fca6a7a6fa978c963d3426f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a05fbb5-89c0-5bbc-9c09-d6c83857abb3/2a05fbb5-89c0-5bbc-9c09-d6c83857abb3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/3b/ab3b92246903686670c2ef05d8ed0503/pa/CC34063_82c89c713612172eb8f7af6ae63afb32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a05fbb5-89c0-5bbc-9c09-d6c83857abb3/2a05fbb5-89c0-5bbc-9c09-d6c83857abb3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/3b/ab3b92246903686670c2ef05d8ed0503/pa/CC34063_f596b9213690924bb38a62aff6e940f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a05fbb5-89c0-5bbc-9c09-d6c83857abb3/2a05fbb5-89c0-5bbc-9c09-d6c83857abb3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/3b/ab3b92246903686670c2ef05d8ed0503/pa/CC34063_e68db5d246f5166b9b98975a48ca1016.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.6 JTDM Turismo',
 'transmission': 'manual',
 'trim': 'Turismo',
 'year': 2010}
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC34063%27 HTTP/1.1" 200 None
2026-03-29 08:35:36 [auto1.be] INFO: Saving data for CC34063: {'created_time': 1774773336.676398, 'last_price_update_time': 1774773336.676408, 'auction_closing_time': 1774885979.0}
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CC34063') HTTP/1.1" 204 0
2026-03-29 08:35:36 [auto1.be] INFO: Found listing with ID: NB03494
2026-03-29 08:35:36 [auto1.be] INFO: Found listing with ID: CK14854
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK14854%27 HTTP/1.1" 200 None
2026-03-29 08:35:36 [auto1.be] INFO: Scrape type for CK14854: 0
2026-03-29 08:35:36 [auto1.be] INFO: Found listing with ID: WJ85942
2026-03-29 08:35:36 [auto1.be] INFO: Found listing with ID: ZL62218
2026-03-29 08:35:36 [auto1.be] INFO: Found listing with ID: KG55279
2026-03-29 08:35:36 [auto1.be] INFO: Found listing with ID: JS91211
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS91211%27 HTTP/1.1" 200 None
2026-03-29 08:35:36 [auto1.be] INFO: Scrape type for JS91211: 0
2026-03-29 08:35:36 [auto1.be] INFO: Found listing with ID: EX56301
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX56301%27 HTTP/1.1" 200 None
2026-03-29 08:35:36 [auto1.be] INFO: Scrape type for EX56301: 0
2026-03-29 08:35:36 [auto1.be] INFO: Found listing with ID: DL13581
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL13581%27 HTTP/1.1" 200 None
2026-03-29 08:35:36 [auto1.be] INFO: Scrape type for DL13581: 2
2026-03-29 08:35:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3c3753a-ae47-58f1-923e-7d8092dd3ad8 with identifier: DL13581
2026-03-29 08:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3c3753a-ae47-58f1-923e-7d8092dd3ad8 with scrape type 2
2026-03-29 08:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3c3753a-ae47-58f1-923e-7d8092dd3ad8 with scrape type 2
2026-03-29 08:35:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f3c3753a-ae47-58f1-923e-7d8092dd3ad8, identifier: DL13581
2026-03-29 08:35:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f3c3753a-ae47-58f1-923e-7d8092dd3ad8 with identifier: DL13581
2026-03-29 08:35:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f3c3753a-ae47-58f1-923e-7d8092dd3ad8 with identifier: DL13581
2026-03-29 08:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f3c3753a-ae47-58f1-923e-7d8092dd3ad8 with identifier: DL13581 to the API
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:40:01Z',
 'fuel_type': 'diesel',
 'id': 'f3c3753a-ae47-58f1-923e-7d8092dd3ad8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL13581',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Movano',
 'odometer': 89805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-18',
 'seller_name': None,
 'title': 'Opel Movano 2.3 Biturbo CDTI HKa L2H2 3,5t',
 'transmission': 'manual',
 'trim': 'HKa L2H2 3,5t',
 'year': 2015}
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL13581%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [auto1.be] INFO: Saving data for DL13581: {'auction_closing_time': 1774885201.0, 'created_time': 1773137136.836779, 'last_price_update_time': 1774773337.222454}
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DL13581') HTTP/1.1" 204 0
2026-03-29 08:35:37 [auto1.be] INFO: Found listing with ID: EL84394
2026-03-29 08:35:37 [auto1.be] INFO: Found listing with ID: WG23357
2026-03-29 08:35:37 [auto1.be] INFO: Found listing with ID: HP15544
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP15544%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [auto1.be] INFO: Scrape type for HP15544: 2
2026-03-29 08:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56e4ca33-c073-51a0-b1d9-e895a5b9af41 with identifier: HP15544
2026-03-29 08:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56e4ca33-c073-51a0-b1d9-e895a5b9af41 with scrape type 2
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56e4ca33-c073-51a0-b1d9-e895a5b9af41 with scrape type 2
2026-03-29 08:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 56e4ca33-c073-51a0-b1d9-e895a5b9af41, identifier: HP15544
2026-03-29 08:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7578e7a-029a-51b8-b527-9e463ecb7214 with identifier: UX89863
2026-03-29 08:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7578e7a-029a-51b8-b527-9e463ecb7214 with scrape type 1
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b7578e7a-029a-51b8-b527-9e463ecb7214
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe0%252Fc2e0257b2f27bf580a20b8eb702722fe%252Fpa%252FUX89863_d23b96d3c9da1db3cb8753608c9481a7.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e0/c2e0257b2f27bf580a20b8eb702722fe/pa/UX89863_d23b96d3c9da1db3cb8753608c9481a7.jpg already downloaded
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe0%252Fc2e0257b2f27bf580a20b8eb702722fe%252Fpa%252FUX89863_739dbf1550222b01558cb40e45ad2387.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e0/c2e0257b2f27bf580a20b8eb702722fe/pa/UX89863_739dbf1550222b01558cb40e45ad2387.jpg already downloaded
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe0%252Fc2e0257b2f27bf580a20b8eb702722fe%252Fpa%252FUX89863_66a17080ad4e7b6facea2e0e0c70f1a3.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e0/c2e0257b2f27bf580a20b8eb702722fe/pa/UX89863_66a17080ad4e7b6facea2e0e0c70f1a3.jpg already downloaded
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe0%252Fc2e0257b2f27bf580a20b8eb702722fe%252Fpa%252FUX89863_b17fbe41766fcde4d8274e45ebd6aaae.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e0/c2e0257b2f27bf580a20b8eb702722fe/pa/UX89863_b17fbe41766fcde4d8274e45ebd6aaae.jpg already downloaded
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe0%252Fc2e0257b2f27bf580a20b8eb702722fe%252Fpa%252FUX89863_ecb7576f3d8ae19de842b48bd3120777.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e0/c2e0257b2f27bf580a20b8eb702722fe/pa/UX89863_ecb7576f3d8ae19de842b48bd3120777.jpg already downloaded
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe0%252Fc2e0257b2f27bf580a20b8eb702722fe%252Fpa%252FUX89863_aeb7e5f83dd6cbf1b3d88dd0cf1b7cde.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e0/c2e0257b2f27bf580a20b8eb702722fe/pa/UX89863_aeb7e5f83dd6cbf1b3d88dd0cf1b7cde.jpg already downloaded
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe0%252Fc2e0257b2f27bf580a20b8eb702722fe%252Fpa%252FUX89863_d3c633bfeecf0e0e65238a23c91f6d6b.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e0/c2e0257b2f27bf580a20b8eb702722fe/pa/UX89863_d3c633bfeecf0e0e65238a23c91f6d6b.jpg already downloaded
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe0%252Fc2e0257b2f27bf580a20b8eb702722fe%252Fpa%252FUX89863_3b0e22ba37566d52d553f449785f313c.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e0/c2e0257b2f27bf580a20b8eb702722fe/pa/UX89863_3b0e22ba37566d52d553f449785f313c.jpg already downloaded
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe0%252Fc2e0257b2f27bf580a20b8eb702722fe%252Fpa%252FUX89863_5c40c70cc7337fdaeb49e168c7ebe039.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e0/c2e0257b2f27bf580a20b8eb702722fe/pa/UX89863_5c40c70cc7337fdaeb49e168c7ebe039.jpg already downloaded
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe0%252Fc2e0257b2f27bf580a20b8eb702722fe%252Fpa%252FUX89863_bb1fe8b30ebe5998e300f276a23c18b8.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e0/c2e0257b2f27bf580a20b8eb702722fe/pa/UX89863_bb1fe8b30ebe5998e300f276a23c18b8.jpg already downloaded
2026-03-29 08:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b7578e7a-029a-51b8-b527-9e463ecb7214, identifier: UX89863
2026-03-29 08:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 56e4ca33-c073-51a0-b1d9-e895a5b9af41 with identifier: HP15544
2026-03-29 08:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 56e4ca33-c073-51a0-b1d9-e895a5b9af41 with identifier: HP15544
2026-03-29 08:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 56e4ca33-c073-51a0-b1d9-e895a5b9af41 with identifier: HP15544 to the API
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:02:54Z',
 'fuel_type': 'diesel',
 'id': '56e4ca33-c073-51a0-b1d9-e895a5b9af41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP15544',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 116128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-09',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM B-Tech',
 'transmission': 'automatic',
 'trim': 'B-Tech',
 'year': 2020}
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP15544%27 HTTP/1.1" 200 None
2026-03-29 08:35:38 [auto1.be] INFO: Saving data for HP15544: {'auction_closing_time': 1774882974.0, 'created_time': 1774557097.753026, 'last_price_update_time': 1774773338.073393}
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HP15544') HTTP/1.1" 204 0
2026-03-29 08:35:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b7578e7a-029a-51b8-b527-9e463ecb7214 with identifier: UX89863
2026-03-29 08:35:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b7578e7a-029a-51b8-b527-9e463ecb7214 with identifier: UX89863
2026-03-29 08:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b7578e7a-029a-51b8-b527-9e463ecb7214 with identifier: UX89863 to the API
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UX89863>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:08:27Z',
 'fuel_type': 'diesel',
 'id': 'b7578e7a-029a-51b8-b527-9e463ecb7214',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX89863',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 154425,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgc2/e0/c2e0257b2f27bf580a20b8eb702722fe/pa/UX89863_d23b96d3c9da1db3cb8753608c9481a7.jpg',
                'https://img-pa.auto1.com/imgc2/e0/c2e0257b2f27bf580a20b8eb702722fe/pa/UX89863_739dbf1550222b01558cb40e45ad2387.jpg',
                'https://img-pa.auto1.com/imgc2/e0/c2e0257b2f27bf580a20b8eb702722fe/pa/UX89863_66a17080ad4e7b6facea2e0e0c70f1a3.jpg',
                'https://img-pa.auto1.com/imgc2/e0/c2e0257b2f27bf580a20b8eb702722fe/pa/UX89863_b17fbe41766fcde4d8274e45ebd6aaae.jpg',
                'https://img-pa.auto1.com/imgc2/e0/c2e0257b2f27bf580a20b8eb702722fe/pa/UX89863_ecb7576f3d8ae19de842b48bd3120777.jpg',
                'https://img-pa.auto1.com/imgc2/e0/c2e0257b2f27bf580a20b8eb702722fe/pa/UX89863_aeb7e5f83dd6cbf1b3d88dd0cf1b7cde.jpg',
                'https://img-pa.auto1.com/imgc2/e0/c2e0257b2f27bf580a20b8eb702722fe/pa/UX89863_d3c633bfeecf0e0e65238a23c91f6d6b.jpg',
                'https://img-pa.auto1.com/imgc2/e0/c2e0257b2f27bf580a20b8eb702722fe/pa/UX89863_3b0e22ba37566d52d553f449785f313c.jpg',
                'https://img-pa.auto1.com/imgc2/e0/c2e0257b2f27bf580a20b8eb702722fe/pa/UX89863_5c40c70cc7337fdaeb49e168c7ebe039.jpg',
                'https://img-pa.auto1.com/imgc2/e0/c2e0257b2f27bf580a20b8eb702722fe/pa/UX89863_bb1fe8b30ebe5998e300f276a23c18b8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7578e7a-029a-51b8-b527-9e463ecb7214/b7578e7a-029a-51b8-b527-9e463ecb7214_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/e0/c2e0257b2f27bf580a20b8eb702722fe/pa/UX89863_d23b96d3c9da1db3cb8753608c9481a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7578e7a-029a-51b8-b527-9e463ecb7214/b7578e7a-029a-51b8-b527-9e463ecb7214_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/e0/c2e0257b2f27bf580a20b8eb702722fe/pa/UX89863_739dbf1550222b01558cb40e45ad2387.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7578e7a-029a-51b8-b527-9e463ecb7214/b7578e7a-029a-51b8-b527-9e463ecb7214_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/e0/c2e0257b2f27bf580a20b8eb702722fe/pa/UX89863_66a17080ad4e7b6facea2e0e0c70f1a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7578e7a-029a-51b8-b527-9e463ecb7214/b7578e7a-029a-51b8-b527-9e463ecb7214_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/e0/c2e0257b2f27bf580a20b8eb702722fe/pa/UX89863_b17fbe41766fcde4d8274e45ebd6aaae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7578e7a-029a-51b8-b527-9e463ecb7214/b7578e7a-029a-51b8-b527-9e463ecb7214_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/e0/c2e0257b2f27bf580a20b8eb702722fe/pa/UX89863_ecb7576f3d8ae19de842b48bd3120777.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7578e7a-029a-51b8-b527-9e463ecb7214/b7578e7a-029a-51b8-b527-9e463ecb7214_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/e0/c2e0257b2f27bf580a20b8eb702722fe/pa/UX89863_aeb7e5f83dd6cbf1b3d88dd0cf1b7cde.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7578e7a-029a-51b8-b527-9e463ecb7214/b7578e7a-029a-51b8-b527-9e463ecb7214_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/e0/c2e0257b2f27bf580a20b8eb702722fe/pa/UX89863_d3c633bfeecf0e0e65238a23c91f6d6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7578e7a-029a-51b8-b527-9e463ecb7214/b7578e7a-029a-51b8-b527-9e463ecb7214_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/e0/c2e0257b2f27bf580a20b8eb702722fe/pa/UX89863_3b0e22ba37566d52d553f449785f313c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7578e7a-029a-51b8-b527-9e463ecb7214/b7578e7a-029a-51b8-b527-9e463ecb7214_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/e0/c2e0257b2f27bf580a20b8eb702722fe/pa/UX89863_5c40c70cc7337fdaeb49e168c7ebe039.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7578e7a-029a-51b8-b527-9e463ecb7214/b7578e7a-029a-51b8-b527-9e463ecb7214_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/e0/c2e0257b2f27bf580a20b8eb702722fe/pa/UX89863_bb1fe8b30ebe5998e300f276a23c18b8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Superb 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2014}
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX89863%27 HTTP/1.1" 200 None
2026-03-29 08:35:38 [auto1.be] INFO: Saving data for UX89863: {'created_time': 1774773338.405233, 'last_price_update_time': 1774773338.405244, 'auction_closing_time': 1774883307.0}
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UX89863') HTTP/1.1" 204 0
2026-03-29 08:35:38 [auto1.be] INFO: Found listing with ID: PB67516
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB67516%27 HTTP/1.1" 200 None
2026-03-29 08:35:38 [auto1.be] INFO: Scrape type for PB67516: 0
2026-03-29 08:35:38 [auto1.be] INFO: Found listing with ID: XB95573
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB95573%27 HTTP/1.1" 200 None
2026-03-29 08:35:38 [auto1.be] INFO: Scrape type for XB95573: 0
2026-03-29 08:35:38 [auto1.be] INFO: Found listing with ID: ND89972
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND89972%27 HTTP/1.1" 200 None
2026-03-29 08:35:38 [auto1.be] INFO: Scrape type for ND89972: 0
2026-03-29 08:35:38 [auto1.be] INFO: Found listing with ID: LG37246
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG37246%27 HTTP/1.1" 200 None
2026-03-29 08:35:38 [auto1.be] INFO: Scrape type for LG37246: 0
2026-03-29 08:35:38 [auto1.be] INFO: Found listing with ID: JB70681
2026-03-29 08:35:38 [auto1.be] INFO: Found listing with ID: JS91755
2026-03-29 08:35:38 [auto1.be] INFO: Found listing with ID: EV46077
2026-03-29 08:35:38 [auto1.be] INFO: Found listing with ID: FB34577
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FB34577%27 HTTP/1.1" 200 None
2026-03-29 08:35:38 [auto1.be] INFO: Scrape type for FB34577: 0
2026-03-29 08:35:38 [auto1.be] INFO: Found listing with ID: JV80966
2026-03-29 08:35:38 [auto1.be] INFO: Found listing with ID: GR79063
2026-03-29 08:35:38 [auto1.be] INFO: Found listing with ID: PR27183
2026-03-29 08:35:38 [auto1.be] INFO: Found listing with ID: KP74596
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP74596%27 HTTP/1.1" 200 None
2026-03-29 08:35:38 [auto1.be] INFO: Scrape type for KP74596: 0
2026-03-29 08:35:38 [auto1.be] INFO: Found listing with ID: TL70885
2026-03-29 08:35:38 [auto1.be] INFO: Found listing with ID: JW06840
2026-03-29 08:35:38 [auto1.be] INFO: Found listing with ID: RR43173
2026-03-29 08:35:38 [auto1.be] INFO: Found listing with ID: BN63741
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BN63741%27 HTTP/1.1" 200 None
2026-03-29 08:35:38 [auto1.be] INFO: Scrape type for BN63741: 0
2026-03-29 08:35:38 [auto1.be] INFO: Found listing with ID: NV81106
2026-03-29 08:35:38 [auto1.be] INFO: Found listing with ID: GL29646
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GL29646%27 HTTP/1.1" 200 None
2026-03-29 08:35:38 [auto1.be] INFO: Scrape type for GL29646: 0
2026-03-29 08:35:38 [auto1.be] INFO: Found listing with ID: ZG73435
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG73435%27 HTTP/1.1" 200 None
2026-03-29 08:35:38 [auto1.be] INFO: Scrape type for ZG73435: 0
2026-03-29 08:35:38 [auto1.be] INFO: Found listing with ID: HS23763
2026-03-29 08:35:38 [auto1.be] INFO: Found listing with ID: RA46458
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA46458%27 HTTP/1.1" 200 None
2026-03-29 08:35:38 [auto1.be] INFO: Scrape type for RA46458: 0
2026-03-29 08:35:38 [auto1.be] INFO: Found listing with ID: VE53331
2026-03-29 08:35:38 [auto1.be] INFO: Found listing with ID: HD23270
2026-03-29 08:35:38 [auto1.be] INFO: Found listing with ID: HP14917
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP14917%27 HTTP/1.1" 200 None
2026-03-29 08:35:38 [auto1.be] INFO: Scrape type for HP14917: 0
2026-03-29 08:35:38 [auto1.be] INFO: Found listing with ID: WK92284
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK92284%27 HTTP/1.1" 200 None
2026-03-29 08:35:38 [auto1.be] INFO: Scrape type for WK92284: 2
2026-03-29 08:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3947d5f0-185f-5649-9c9d-932e1a474b66 with identifier: WK92284
2026-03-29 08:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3947d5f0-185f-5649-9c9d-932e1a474b66 with scrape type 2
2026-03-29 08:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3947d5f0-185f-5649-9c9d-932e1a474b66 with scrape type 2
2026-03-29 08:35:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3947d5f0-185f-5649-9c9d-932e1a474b66, identifier: WK92284
2026-03-29 08:35:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3947d5f0-185f-5649-9c9d-932e1a474b66 with identifier: WK92284
2026-03-29 08:35:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3947d5f0-185f-5649-9c9d-932e1a474b66 with identifier: WK92284
2026-03-29 08:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3947d5f0-185f-5649-9c9d-932e1a474b66 with identifier: WK92284 to the API
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:59:22Z',
 'fuel_type': 'diesel',
 'id': '3947d5f0-185f-5649-9c9d-932e1a474b66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK92284',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 139184,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-01',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 d Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2018}
2026-03-29 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK92284%27 HTTP/1.1" 200 None
2026-03-29 08:35:39 [auto1.be] INFO: Saving data for WK92284: {'auction_closing_time': 1774886362.0, 'created_time': 1774557104.921767, 'last_price_update_time': 1774773339.105839}
2026-03-29 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WK92284') HTTP/1.1" 204 0
2026-03-29 08:35:39 [auto1.be] INFO: Found listing with ID: GX61337
2026-03-29 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX61337%27 HTTP/1.1" 200 None
2026-03-29 08:35:39 [auto1.be] INFO: Scrape type for GX61337: 0
2026-03-29 08:35:39 [auto1.be] INFO: Found listing with ID: UL34611
2026-03-29 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL34611%27 HTTP/1.1" 200 None
2026-03-29 08:35:39 [auto1.be] INFO: Scrape type for UL34611: 0
2026-03-29 08:35:39 [auto1.be] INFO: Found listing with ID: MW76341
2026-03-29 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW76341%27 HTTP/1.1" 200 None
2026-03-29 08:35:39 [auto1.be] INFO: Scrape type for MW76341: 0
2026-03-29 08:35:39 [auto1.be] INFO: Found listing with ID: AA49507
2026-03-29 08:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AJ87899> (referer: https://www.auto1.com/v1/car-details-view/AJ87899/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cb51bc2-517f-524e-9c83-72007b99a8d9 with identifier: AJ87899
2026-03-29 08:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cb51bc2-517f-524e-9c83-72007b99a8d9 with scrape type 1
2026-03-29 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3cb51bc2-517f-524e-9c83-72007b99a8d9
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd8%252Fd4d862bef6361c3fe2c217d53e526ee7%252Fpa%252FAJ87899_0cdd2fddf9ff28a0c601d11d640cdd46.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d8/d4d862bef6361c3fe2c217d53e526ee7/pa/AJ87899_0cdd2fddf9ff28a0c601d11d640cdd46.jpg already downloaded
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd8%252Fd4d862bef6361c3fe2c217d53e526ee7%252Fpa%252FAJ87899_885fe0d8d78e6169adfd380aeee62214.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d8/d4d862bef6361c3fe2c217d53e526ee7/pa/AJ87899_885fe0d8d78e6169adfd380aeee62214.jpg already downloaded
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd8%252Fd4d862bef6361c3fe2c217d53e526ee7%252Fpa%252FAJ87899_4d09b6c8f569a30333c9061890740564.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d8/d4d862bef6361c3fe2c217d53e526ee7/pa/AJ87899_4d09b6c8f569a30333c9061890740564.jpg already downloaded
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd8%252Fd4d862bef6361c3fe2c217d53e526ee7%252Fpa%252FAJ87899_e7f2e90a7d29f944d1f30e6624404a0a.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d8/d4d862bef6361c3fe2c217d53e526ee7/pa/AJ87899_e7f2e90a7d29f944d1f30e6624404a0a.jpg already downloaded
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd8%252Fd4d862bef6361c3fe2c217d53e526ee7%252Fpa%252FAJ87899_61221336d019eaf510a20be8537d753f.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d8/d4d862bef6361c3fe2c217d53e526ee7/pa/AJ87899_61221336d019eaf510a20be8537d753f.jpg already downloaded
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd8%252Fd4d862bef6361c3fe2c217d53e526ee7%252Fpa%252FAJ87899_b8220a99e740e80f1f883b97f00baf8d.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d8/d4d862bef6361c3fe2c217d53e526ee7/pa/AJ87899_b8220a99e740e80f1f883b97f00baf8d.jpg already downloaded
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd8%252Fd4d862bef6361c3fe2c217d53e526ee7%252Fpa%252FAJ87899_9f40a64be6b9843a14fed465642a6aa3.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d8/d4d862bef6361c3fe2c217d53e526ee7/pa/AJ87899_9f40a64be6b9843a14fed465642a6aa3.jpg already downloaded
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd8%252Fd4d862bef6361c3fe2c217d53e526ee7%252Fpa%252FAJ87899_a515a7eaa18f3e7c881e789d6377ce6c.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d8/d4d862bef6361c3fe2c217d53e526ee7/pa/AJ87899_a515a7eaa18f3e7c881e789d6377ce6c.jpg already downloaded
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd8%252Fd4d862bef6361c3fe2c217d53e526ee7%252Fpa%252FAJ87899_92b01b892a69882c71fc2ffb1ce4736e.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d8/d4d862bef6361c3fe2c217d53e526ee7/pa/AJ87899_92b01b892a69882c71fc2ffb1ce4736e.jpg already downloaded
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fd8%252Fd4d862bef6361c3fe2c217d53e526ee7%252Fpa%252FAJ87899_55ac5f3574427fd579e06fbc14cffb6d.jpg%27 HTTP/1.1" 200 None
2026-03-29 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/d8/d4d862bef6361c3fe2c217d53e526ee7/pa/AJ87899_55ac5f3574427fd579e06fbc14cffb6d.jpg already downloaded
2026-03-29 08:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3cb51bc2-517f-524e-9c83-72007b99a8d9, identifier: AJ87899
2026-03-29 08:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3cb51bc2-517f-524e-9c83-72007b99a8d9 with identifier: AJ87899
2026-03-29 08:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3cb51bc2-517f-524e-9c83-72007b99a8d9 with identifier: AJ87899
2026-03-29 08:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3cb51bc2-517f-524e-9c83-72007b99a8d9 with identifier: AJ87899 to the API
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AJ87899>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:24:51Z',
 'fuel_type': 'petrol',
 'id': '3cb51bc2-517f-524e-9c83-72007b99a8d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ87899',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 126897,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/imgd4/d8/d4d862bef6361c3fe2c217d53e526ee7/pa/AJ87899_0cdd2fddf9ff28a0c601d11d640cdd46.jpg',
                'https://img-pa.auto1.com/imgd4/d8/d4d862bef6361c3fe2c217d53e526ee7/pa/AJ87899_885fe0d8d78e6169adfd380aeee62214.jpg',
                'https://img-pa.auto1.com/imgd4/d8/d4d862bef6361c3fe2c217d53e526ee7/pa/AJ87899_4d09b6c8f569a30333c9061890740564.jpg',
                'https://img-pa.auto1.com/imgd4/d8/d4d862bef6361c3fe2c217d53e526ee7/pa/AJ87899_e7f2e90a7d29f944d1f30e6624404a0a.jpg',
                'https://img-pa.auto1.com/imgd4/d8/d4d862bef6361c3fe2c217d53e526ee7/pa/AJ87899_61221336d019eaf510a20be8537d753f.jpg',
                'https://img-pa.auto1.com/imgd4/d8/d4d862bef6361c3fe2c217d53e526ee7/pa/AJ87899_b8220a99e740e80f1f883b97f00baf8d.jpg',
                'https://img-pa.auto1.com/imgd4/d8/d4d862bef6361c3fe2c217d53e526ee7/pa/AJ87899_9f40a64be6b9843a14fed465642a6aa3.jpg',
                'https://img-pa.auto1.com/imgd4/d8/d4d862bef6361c3fe2c217d53e526ee7/pa/AJ87899_a515a7eaa18f3e7c881e789d6377ce6c.jpg',
                'https://img-pa.auto1.com/imgd4/d8/d4d862bef6361c3fe2c217d53e526ee7/pa/AJ87899_92b01b892a69882c71fc2ffb1ce4736e.jpg',
                'https://img-pa.auto1.com/imgd4/d8/d4d862bef6361c3fe2c217d53e526ee7/pa/AJ87899_55ac5f3574427fd579e06fbc14cffb6d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cb51bc2-517f-524e-9c83-72007b99a8d9/3cb51bc2-517f-524e-9c83-72007b99a8d9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d8/d4d862bef6361c3fe2c217d53e526ee7/pa/AJ87899_0cdd2fddf9ff28a0c601d11d640cdd46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cb51bc2-517f-524e-9c83-72007b99a8d9/3cb51bc2-517f-524e-9c83-72007b99a8d9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d8/d4d862bef6361c3fe2c217d53e526ee7/pa/AJ87899_885fe0d8d78e6169adfd380aeee62214.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cb51bc2-517f-524e-9c83-72007b99a8d9/3cb51bc2-517f-524e-9c83-72007b99a8d9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d8/d4d862bef6361c3fe2c217d53e526ee7/pa/AJ87899_4d09b6c8f569a30333c9061890740564.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cb51bc2-517f-524e-9c83-72007b99a8d9/3cb51bc2-517f-524e-9c83-72007b99a8d9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d8/d4d862bef6361c3fe2c217d53e526ee7/pa/AJ87899_e7f2e90a7d29f944d1f30e6624404a0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cb51bc2-517f-524e-9c83-72007b99a8d9/3cb51bc2-517f-524e-9c83-72007b99a8d9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d8/d4d862bef6361c3fe2c217d53e526ee7/pa/AJ87899_61221336d019eaf510a20be8537d753f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cb51bc2-517f-524e-9c83-72007b99a8d9/3cb51bc2-517f-524e-9c83-72007b99a8d9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d8/d4d862bef6361c3fe2c217d53e526ee7/pa/AJ87899_b8220a99e740e80f1f883b97f00baf8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cb51bc2-517f-524e-9c83-72007b99a8d9/3cb51bc2-517f-524e-9c83-72007b99a8d9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d8/d4d862bef6361c3fe2c217d53e526ee7/pa/AJ87899_9f40a64be6b9843a14fed465642a6aa3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cb51bc2-517f-524e-9c83-72007b99a8d9/3cb51bc2-517f-524e-9c83-72007b99a8d9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d8/d4d862bef6361c3fe2c217d53e526ee7/pa/AJ87899_a515a7eaa18f3e7c881e789d6377ce6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cb51bc2-517f-524e-9c83-72007b99a8d9/3cb51bc2-517f-524e-9c83-72007b99a8d9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d8/d4d862bef6361c3fe2c217d53e526ee7/pa/AJ87899_92b01b892a69882c71fc2ffb1ce4736e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cb51bc2-517f-524e-9c83-72007b99a8d9/3cb51bc2-517f-524e-9c83-72007b99a8d9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/d8/d4d862bef6361c3fe2c217d53e526ee7/pa/AJ87899_55ac5f3574427fd579e06fbc14cffb6d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-05-16',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cabrio Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AJ87899%27 HTTP/1.1" 200 None
2026-03-29 08:35:40 [auto1.be] INFO: Saving data for AJ87899: {'created_time': 1774773340.667777, 'last_price_update_time': 1774773340.667786, 'auction_closing_time': 1774884291.0}
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AJ87899') HTTP/1.1" 204 0
2026-03-29 08:35:40 [auto1.be] INFO: Channel: 24h | Page: 8 | totalHits: 1252 | hits on page: 40
2026-03-29 08:35:40 [auto1.be] INFO: Found listing with ID: EZ55101
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ55101%27 HTTP/1.1" 200 None
2026-03-29 08:35:40 [auto1.be] INFO: Scrape type for EZ55101: 0
2026-03-29 08:35:40 [auto1.be] INFO: Found listing with ID: TH53375
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH53375%27 HTTP/1.1" 200 None
2026-03-29 08:35:40 [auto1.be] INFO: Scrape type for TH53375: 2
2026-03-29 08:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 308b899d-5b1e-5d13-82a6-60fff2b4edd5 with identifier: TH53375
2026-03-29 08:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 308b899d-5b1e-5d13-82a6-60fff2b4edd5 with scrape type 2
2026-03-29 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 308b899d-5b1e-5d13-82a6-60fff2b4edd5 with scrape type 2
2026-03-29 08:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 308b899d-5b1e-5d13-82a6-60fff2b4edd5, identifier: TH53375
2026-03-29 08:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 308b899d-5b1e-5d13-82a6-60fff2b4edd5 with identifier: TH53375
2026-03-29 08:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 308b899d-5b1e-5d13-82a6-60fff2b4edd5 with identifier: TH53375
2026-03-29 08:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 308b899d-5b1e-5d13-82a6-60fff2b4edd5 with identifier: TH53375 to the API
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:15:13Z',
 'fuel_type': 'diesel',
 'id': '308b899d-5b1e-5d13-82a6-60fff2b4edd5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH53375',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito Tourer',
 'odometer': 177464,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-24',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito Tourer 119 CDI lang Select',
 'transmission': 'automatic',
 'trim': 'lang Select',
 'year': 2017}
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH53375%27 HTTP/1.1" 200 None
2026-03-29 08:35:41 [auto1.be] INFO: Saving data for TH53375: {'auction_closing_time': 1774883713.0, 'created_time': 1774557152.940883, 'last_price_update_time': 1774773341.104212}
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TH53375') HTTP/1.1" 204 0
2026-03-29 08:35:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:41 [auto1.be] INFO: Found listing with ID: RH88749
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH88749%27 HTTP/1.1" 200 None
2026-03-29 08:35:41 [auto1.be] INFO: Scrape type for RH88749: 0
2026-03-29 08:35:41 [auto1.be] INFO: Found listing with ID: LE66186
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE66186%27 HTTP/1.1" 200 None
2026-03-29 08:35:41 [auto1.be] INFO: Scrape type for LE66186: 0
2026-03-29 08:35:41 [auto1.be] INFO: Found listing with ID: RK42644
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK42644%27 HTTP/1.1" 200 None
2026-03-29 08:35:41 [auto1.be] INFO: Scrape type for RK42644: 0
2026-03-29 08:35:41 [auto1.be] INFO: Found listing with ID: AP73624
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AP73624%27 HTTP/1.1" 200 None
2026-03-29 08:35:41 [auto1.be] INFO: Scrape type for AP73624: 0
2026-03-29 08:35:41 [auto1.be] INFO: Found listing with ID: JV18684
2026-03-29 08:35:41 [auto1.be] INFO: Found listing with ID: DF44974
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF44974%27 HTTP/1.1" 200 None
2026-03-29 08:35:41 [auto1.be] INFO: Scrape type for DF44974: 2
2026-03-29 08:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3918341-d117-5a76-a190-c0d113d723e8 with identifier: DF44974
2026-03-29 08:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3918341-d117-5a76-a190-c0d113d723e8 with scrape type 2
2026-03-29 08:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3918341-d117-5a76-a190-c0d113d723e8 with scrape type 2
2026-03-29 08:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c3918341-d117-5a76-a190-c0d113d723e8, identifier: DF44974
2026-03-29 08:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c3918341-d117-5a76-a190-c0d113d723e8 with identifier: DF44974
2026-03-29 08:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c3918341-d117-5a76-a190-c0d113d723e8 with identifier: DF44974
2026-03-29 08:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c3918341-d117-5a76-a190-c0d113d723e8 with identifier: DF44974 to the API
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:21:15Z',
 'fuel_type': 'diesel',
 'id': 'c3918341-d117-5a76-a190-c0d113d723e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF44974',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 128495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-01',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Ultra',
 'transmission': 'manual',
 'trim': 'Ultra',
 'year': 2016}
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF44974%27 HTTP/1.1" 200 None
2026-03-29 08:35:41 [auto1.be] INFO: Saving data for DF44974: {'auction_closing_time': 1774884075.0, 'created_time': 1774557241.034083, 'last_price_update_time': 1774773341.86676}
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DF44974') HTTP/1.1" 204 0
2026-03-29 08:35:41 [auto1.be] INFO: Found listing with ID: DW87206
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW87206%27 HTTP/1.1" 200 None
2026-03-29 08:35:41 [auto1.be] INFO: Scrape type for DW87206: 0
2026-03-29 08:35:41 [auto1.be] INFO: Found listing with ID: NY99560
2026-03-29 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY99560%27 HTTP/1.1" 200 None
2026-03-29 08:35:42 [auto1.be] INFO: Scrape type for NY99560: 0
2026-03-29 08:35:42 [auto1.be] INFO: Found listing with ID: NC25574
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC25574%27 HTTP/1.1" 200 None
2026-03-29 08:35:42 [auto1.be] INFO: Scrape type for NC25574: 0
2026-03-29 08:35:42 [auto1.be] INFO: Found listing with ID: ZM46816
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM46816%27 HTTP/1.1" 200 None
2026-03-29 08:35:42 [auto1.be] INFO: Scrape type for ZM46816: 2
2026-03-29 08:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 893033fc-503b-505f-b9ed-049119557949 with identifier: ZM46816
2026-03-29 08:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 893033fc-503b-505f-b9ed-049119557949 with scrape type 2
2026-03-29 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 893033fc-503b-505f-b9ed-049119557949 with scrape type 2
2026-03-29 08:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 893033fc-503b-505f-b9ed-049119557949, identifier: ZM46816
2026-03-29 08:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 893033fc-503b-505f-b9ed-049119557949 with identifier: ZM46816
2026-03-29 08:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 893033fc-503b-505f-b9ed-049119557949 with identifier: ZM46816
2026-03-29 08:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 893033fc-503b-505f-b9ed-049119557949 with identifier: ZM46816 to the API
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:59:00Z',
 'fuel_type': 'diesel',
 'id': '893033fc-503b-505f-b9ed-049119557949',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM46816',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 156922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-23',
 'seller_name': None,
 'title': 'Audi Q2 1.6 TDI Sport edition',
 'transmission': 'manual',
 'trim': 'Sport edition',
 'year': 2017}
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM46816%27 HTTP/1.1" 200 None
2026-03-29 08:35:42 [auto1.be] INFO: Saving data for ZM46816: {'auction_closing_time': 1774886340.0, 'created_time': 1774557228.782041, 'last_price_update_time': 1774773342.428957}
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZM46816') HTTP/1.1" 204 0
2026-03-29 08:35:42 [auto1.be] INFO: Found listing with ID: RY85405
2026-03-29 08:35:42 [auto1.be] INFO: Found listing with ID: BA52354
2026-03-29 08:35:42 [auto1.be] INFO: Found listing with ID: NG50909
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG50909%27 HTTP/1.1" 200 None
2026-03-29 08:35:42 [auto1.be] INFO: Scrape type for NG50909: 0
2026-03-29 08:35:42 [auto1.be] INFO: Found listing with ID: TU47744
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU47744%27 HTTP/1.1" 200 None
2026-03-29 08:35:42 [auto1.be] INFO: Scrape type for TU47744: 0
2026-03-29 08:35:42 [auto1.be] INFO: Found listing with ID: GD11285
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GD11285%27 HTTP/1.1" 200 None
2026-03-29 08:35:42 [auto1.be] INFO: Scrape type for GD11285: 0
2026-03-29 08:35:42 [auto1.be] INFO: Found listing with ID: UC23117
2026-03-29 08:35:42 [auto1.be] INFO: Found listing with ID: RS46918
2026-03-29 08:35:42 [auto1.be] INFO: Found listing with ID: GF24104
2026-03-29 08:35:42 [auto1.be] INFO: Found listing with ID: NG90127
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG90127%27 HTTP/1.1" 200 None
2026-03-29 08:35:42 [auto1.be] INFO: Scrape type for NG90127: 0
2026-03-29 08:35:42 [auto1.be] INFO: Found listing with ID: PJ82537
2026-03-29 08:35:42 [auto1.be] INFO: Found listing with ID: BT94428
2026-03-29 08:35:42 [auto1.be] INFO: Found listing with ID: WC55286
2026-03-29 08:35:42 [auto1.be] INFO: Found listing with ID: CC17071
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC17071%27 HTTP/1.1" 200 None
2026-03-29 08:35:42 [auto1.be] INFO: Scrape type for CC17071: 0
2026-03-29 08:35:42 [auto1.be] INFO: Found listing with ID: KH63709
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH63709%27 HTTP/1.1" 200 None
2026-03-29 08:35:42 [auto1.be] INFO: Scrape type for KH63709: 0
2026-03-29 08:35:42 [auto1.be] INFO: Found listing with ID: YN02015
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN02015%27 HTTP/1.1" 200 None
2026-03-29 08:35:42 [auto1.be] INFO: Scrape type for YN02015: 0
2026-03-29 08:35:42 [auto1.be] INFO: Found listing with ID: MG81689
2026-03-29 08:35:42 [auto1.be] INFO: Found listing with ID: VW32861
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW32861%27 HTTP/1.1" 200 None
2026-03-29 08:35:42 [auto1.be] INFO: Scrape type for VW32861: 0
2026-03-29 08:35:42 [auto1.be] INFO: Found listing with ID: PE83293
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE83293%27 HTTP/1.1" 200 None
2026-03-29 08:35:42 [auto1.be] INFO: Scrape type for PE83293: 2
2026-03-29 08:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4a7db30-7d11-5a08-b83c-36646e27f7c9 with identifier: PE83293
2026-03-29 08:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4a7db30-7d11-5a08-b83c-36646e27f7c9 with scrape type 2
2026-03-29 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4a7db30-7d11-5a08-b83c-36646e27f7c9 with scrape type 2
2026-03-29 08:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b4a7db30-7d11-5a08-b83c-36646e27f7c9, identifier: PE83293
2026-03-29 08:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b4a7db30-7d11-5a08-b83c-36646e27f7c9 with identifier: PE83293
2026-03-29 08:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b4a7db30-7d11-5a08-b83c-36646e27f7c9 with identifier: PE83293
2026-03-29 08:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b4a7db30-7d11-5a08-b83c-36646e27f7c9 with identifier: PE83293 to the API
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:49:47Z',
 'fuel_type': 'petrol',
 'id': 'b4a7db30-7d11-5a08-b83c-36646e27f7c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE83293',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 57690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-24',
 'seller_name': None,
 'title': 'Hyundai i10 1.1 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2011}
2026-03-29 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE83293%27 HTTP/1.1" 200 None
2026-03-29 08:35:43 [auto1.be] INFO: Saving data for PE83293: {'auction_closing_time': 1774885787.0, 'created_time': 1774557191.550311, 'last_price_update_time': 1774773343.008499}
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PE83293') HTTP/1.1" 204 0
2026-03-29 08:35:43 [auto1.be] INFO: Found listing with ID: WA92632
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA92632%27 HTTP/1.1" 200 None
2026-03-29 08:35:43 [auto1.be] INFO: Scrape type for WA92632: 0
2026-03-29 08:35:43 [auto1.be] INFO: Found listing with ID: ZL15279
2026-03-29 08:35:43 [auto1.be] INFO: Found listing with ID: RW14221
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW14221%27 HTTP/1.1" 200 None
2026-03-29 08:35:43 [auto1.be] INFO: Scrape type for RW14221: 0
2026-03-29 08:35:43 [auto1.be] INFO: Found listing with ID: WV47829
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV47829%27 HTTP/1.1" 200 None
2026-03-29 08:35:43 [auto1.be] INFO: Scrape type for WV47829: 0
2026-03-29 08:35:43 [auto1.be] INFO: Found listing with ID: AK54797
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK54797%27 HTTP/1.1" 200 None
2026-03-29 08:35:43 [auto1.be] INFO: Scrape type for AK54797: 0
2026-03-29 08:35:43 [auto1.be] INFO: Found listing with ID: LK29098
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK29098%27 HTTP/1.1" 200 None
2026-03-29 08:35:43 [auto1.be] INFO: Scrape type for LK29098: 0
2026-03-29 08:35:43 [auto1.be] INFO: Found listing with ID: YP74524
2026-03-29 08:35:43 [auto1.be] INFO: Found listing with ID: YG22909
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG22909%27 HTTP/1.1" 200 None
2026-03-29 08:35:43 [auto1.be] INFO: Scrape type for YG22909: 2
2026-03-29 08:35:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ade3345c-0246-5af7-9e45-7c293e54e453 with identifier: YG22909
2026-03-29 08:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ade3345c-0246-5af7-9e45-7c293e54e453 with scrape type 2
2026-03-29 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ade3345c-0246-5af7-9e45-7c293e54e453 with scrape type 2
2026-03-29 08:35:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ade3345c-0246-5af7-9e45-7c293e54e453, identifier: YG22909
2026-03-29 08:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ade3345c-0246-5af7-9e45-7c293e54e453 with identifier: YG22909
2026-03-29 08:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ade3345c-0246-5af7-9e45-7c293e54e453 with identifier: YG22909
2026-03-29 08:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ade3345c-0246-5af7-9e45-7c293e54e453 with identifier: YG22909 to the API
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:27:33Z',
 'fuel_type': 'diesel',
 'id': 'ade3345c-0246-5af7-9e45-7c293e54e453',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG22909',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 118099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-15',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 Momentum Pro 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum Pro 2WD',
 'year': 2019}
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG22909%27 HTTP/1.1" 200 None
2026-03-29 08:35:43 [auto1.be] INFO: Saving data for YG22909: {'auction_closing_time': 1774884453.0, 'created_time': 1774557211.689161, 'last_price_update_time': 1774773343.639015}
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YG22909') HTTP/1.1" 204 0
2026-03-29 08:35:43 [auto1.be] INFO: Found listing with ID: DY69036
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY69036%27 HTTP/1.1" 200 None
2026-03-29 08:35:43 [auto1.be] INFO: Scrape type for DY69036: 0
2026-03-29 08:35:43 [auto1.be] INFO: Found listing with ID: BP14655
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP14655%27 HTTP/1.1" 200 None
2026-03-29 08:35:43 [auto1.be] INFO: Scrape type for BP14655: 0
2026-03-29 08:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:44 [auto1.be] INFO: Channel: 24h | Page: 9 | totalHits: 1252 | hits on page: 40
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: RZ47312
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: ND78338
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND78338%27 HTTP/1.1" 200 None
2026-03-29 08:35:44 [auto1.be] INFO: Scrape type for ND78338: 0
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: LK55982
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: DW77345
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: NN42853
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: CS90165
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS90165%27 HTTP/1.1" 200 None
2026-03-29 08:35:44 [auto1.be] INFO: Scrape type for CS90165: 0
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: LA76788
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA76788%27 HTTP/1.1" 200 None
2026-03-29 08:35:44 [auto1.be] INFO: Scrape type for LA76788: 0
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: HB19534
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB19534%27 HTTP/1.1" 200 None
2026-03-29 08:35:44 [auto1.be] INFO: Scrape type for HB19534: 0
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: AY47657
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: BU27000
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: PL61351
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL61351%27 HTTP/1.1" 200 None
2026-03-29 08:35:44 [auto1.be] INFO: Scrape type for PL61351: 0
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: AE13452
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: FG26500
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: MC44479
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC44479%27 HTTP/1.1" 200 None
2026-03-29 08:35:44 [auto1.be] INFO: Scrape type for MC44479: 0
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: WP32655
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: SC04496
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC04496%27 HTTP/1.1" 200 None
2026-03-29 08:35:44 [auto1.be] INFO: Scrape type for SC04496: 0
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: CC56747
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: XJ47711
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ47711%27 HTTP/1.1" 200 None
2026-03-29 08:35:44 [auto1.be] INFO: Scrape type for XJ47711: 0
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: CK49467
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: JA34397
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: XC31503
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: LE58292
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE58292%27 HTTP/1.1" 200 None
2026-03-29 08:35:44 [auto1.be] INFO: Scrape type for LE58292: 0
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: DL17322
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: SE12861
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE12861%27 HTTP/1.1" 200 None
2026-03-29 08:35:44 [auto1.be] INFO: Scrape type for SE12861: 0
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: BJ27729
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: EN18719
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: DP96573
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP96573%27 HTTP/1.1" 200 None
2026-03-29 08:35:44 [auto1.be] INFO: Scrape type for DP96573: 0
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: YM63500
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: WH07577
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: LJ91533
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LJ91533%27 HTTP/1.1" 200 None
2026-03-29 08:35:44 [auto1.be] INFO: Scrape type for LJ91533: 0
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: TY52799
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY52799%27 HTTP/1.1" 200 None
2026-03-29 08:35:44 [auto1.be] INFO: Scrape type for TY52799: 0
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: EM18277
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: XJ49438
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: ZB59407
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZB59407%27 HTTP/1.1" 200 None
2026-03-29 08:35:44 [auto1.be] INFO: Scrape type for ZB59407: 0
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: YW29468
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: NU46591
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU46591%27 HTTP/1.1" 200 None
2026-03-29 08:35:44 [auto1.be] INFO: Scrape type for NU46591: 0
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: AS01915
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: AB44644
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: XM93272
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM93272%27 HTTP/1.1" 200 None
2026-03-29 08:35:44 [auto1.be] INFO: Scrape type for XM93272: 0
2026-03-29 08:35:44 [auto1.be] INFO: Found listing with ID: TL07516
2026-03-29 08:35:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:45 [auto1.be] INFO: Channel: 24h | Page: 10 | totalHits: 1252 | hits on page: 40
2026-03-29 08:35:45 [auto1.be] INFO: Found listing with ID: JK00802
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JK00802%27 HTTP/1.1" 200 None
2026-03-29 08:35:45 [auto1.be] INFO: Scrape type for JK00802: 0
2026-03-29 08:35:45 [auto1.be] INFO: Found listing with ID: CS76215
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS76215%27 HTTP/1.1" 200 None
2026-03-29 08:35:45 [auto1.be] INFO: Scrape type for CS76215: 0
2026-03-29 08:35:45 [auto1.be] INFO: Found listing with ID: WD81319
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD81319%27 HTTP/1.1" 200 None
2026-03-29 08:35:45 [auto1.be] INFO: Scrape type for WD81319: 0
2026-03-29 08:35:45 [auto1.be] INFO: Found listing with ID: WA82695
2026-03-29 08:35:45 [auto1.be] INFO: Found listing with ID: ZM54310
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM54310%27 HTTP/1.1" 200 None
2026-03-29 08:35:45 [auto1.be] INFO: Scrape type for ZM54310: 0
2026-03-29 08:35:45 [auto1.be] INFO: Found listing with ID: AF68960
2026-03-29 08:35:45 [auto1.be] INFO: Found listing with ID: RW94228
2026-03-29 08:35:45 [auto1.be] INFO: Found listing with ID: FE52220
2026-03-29 08:35:45 [auto1.be] INFO: Found listing with ID: MZ83142
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ83142%27 HTTP/1.1" 200 None
2026-03-29 08:35:45 [auto1.be] INFO: Scrape type for MZ83142: 0
2026-03-29 08:35:45 [auto1.be] INFO: Found listing with ID: YG62523
2026-03-29 08:35:45 [auto1.be] INFO: Found listing with ID: CA72484
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA72484%27 HTTP/1.1" 200 None
2026-03-29 08:35:45 [auto1.be] INFO: Scrape type for CA72484: 0
2026-03-29 08:35:45 [auto1.be] INFO: Found listing with ID: XK61886
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK61886%27 HTTP/1.1" 200 None
2026-03-29 08:35:45 [auto1.be] INFO: Scrape type for XK61886: 2
2026-03-29 08:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18dafbc4-2a81-5a8c-9d11-0f297476e6af with identifier: XK61886
2026-03-29 08:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18dafbc4-2a81-5a8c-9d11-0f297476e6af with scrape type 2
2026-03-29 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18dafbc4-2a81-5a8c-9d11-0f297476e6af with scrape type 2
2026-03-29 08:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 18dafbc4-2a81-5a8c-9d11-0f297476e6af, identifier: XK61886
2026-03-29 08:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 18dafbc4-2a81-5a8c-9d11-0f297476e6af with identifier: XK61886
2026-03-29 08:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 18dafbc4-2a81-5a8c-9d11-0f297476e6af with identifier: XK61886
2026-03-29 08:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 18dafbc4-2a81-5a8c-9d11-0f297476e6af with identifier: XK61886 to the API
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:28:01Z',
 'fuel_type': 'petrol',
 'id': '18dafbc4-2a81-5a8c-9d11-0f297476e6af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK61886',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 98987,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-13',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 150',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK61886%27 HTTP/1.1" 200 None
2026-03-29 08:35:46 [auto1.be] INFO: Saving data for XK61886: {'auction_closing_time': 1774884481.0, 'created_time': 1773952979.905587, 'last_price_update_time': 1774773346.359678}
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XK61886') HTTP/1.1" 204 0
2026-03-29 08:35:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:46 [auto1.be] INFO: Found listing with ID: VU61418
2026-03-29 08:35:46 [auto1.be] INFO: Found listing with ID: ZF47475
2026-03-29 08:35:46 [auto1.be] INFO: Found listing with ID: XC82229
2026-03-29 08:35:46 [auto1.be] INFO: Found listing with ID: SD60477
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD60477%27 HTTP/1.1" 200 None
2026-03-29 08:35:46 [auto1.be] INFO: Scrape type for SD60477: 2
2026-03-29 08:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c28c308f-15ef-532a-9282-4ec5834d659a with identifier: SD60477
2026-03-29 08:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c28c308f-15ef-532a-9282-4ec5834d659a with scrape type 2
2026-03-29 08:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c28c308f-15ef-532a-9282-4ec5834d659a with scrape type 2
2026-03-29 08:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c28c308f-15ef-532a-9282-4ec5834d659a, identifier: SD60477
2026-03-29 08:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c28c308f-15ef-532a-9282-4ec5834d659a with identifier: SD60477
2026-03-29 08:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c28c308f-15ef-532a-9282-4ec5834d659a with identifier: SD60477
2026-03-29 08:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c28c308f-15ef-532a-9282-4ec5834d659a with identifier: SD60477 to the API
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:39:47Z',
 'fuel_type': 'petrol',
 'id': 'c28c308f-15ef-532a-9282-4ec5834d659a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD60477',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery 5',
 'odometer': 194585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-31',
 'seller_name': None,
 'title': 'Land Rover Discovery 5 2.0 Si4 TwinTurbo HSE',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2021}
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD60477%27 HTTP/1.1" 200 None
2026-03-29 08:35:46 [auto1.be] INFO: Saving data for SD60477: {'auction_closing_time': 1774885187.0, 'created_time': 1774557246.682763, 'last_price_update_time': 1774773346.909972}
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SD60477') HTTP/1.1" 204 0
2026-03-29 08:35:46 [auto1.be] INFO: Found listing with ID: PP48497
2026-03-29 08:35:46 [auto1.be] INFO: Found listing with ID: YB47559
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB47559%27 HTTP/1.1" 200 None
2026-03-29 08:35:46 [auto1.be] INFO: Scrape type for YB47559: 0
2026-03-29 08:35:46 [auto1.be] INFO: Found listing with ID: PT26763
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PT26763%27 HTTP/1.1" 200 None
2026-03-29 08:35:46 [auto1.be] INFO: Scrape type for PT26763: 0
2026-03-29 08:35:46 [auto1.be] INFO: Found listing with ID: PN18532
2026-03-29 08:35:46 [auto1.be] INFO: Found listing with ID: VD09174
2026-03-29 08:35:46 [auto1.be] INFO: Found listing with ID: DH81993
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH81993%27 HTTP/1.1" 200 None
2026-03-29 08:35:46 [auto1.be] INFO: Scrape type for DH81993: 0
2026-03-29 08:35:46 [auto1.be] INFO: Found listing with ID: FY33898
2026-03-29 08:35:46 [auto1.be] INFO: Found listing with ID: ST89131
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST89131%27 HTTP/1.1" 200 None
2026-03-29 08:35:47 [auto1.be] INFO: Scrape type for ST89131: 0
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: TU68669
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: PC96861
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC96861%27 HTTP/1.1" 200 None
2026-03-29 08:35:47 [auto1.be] INFO: Scrape type for PC96861: 0
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: PH64665
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: RH07818
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: LT97220
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: ML35155
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: UB84637
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: XJ82974
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: YV36261
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: MB19665
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB19665%27 HTTP/1.1" 200 None
2026-03-29 08:35:47 [auto1.be] INFO: Scrape type for MB19665: 0
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: SJ78748
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ78748%27 HTTP/1.1" 200 None
2026-03-29 08:35:47 [auto1.be] INFO: Scrape type for SJ78748: 0
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: UM90025
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM90025%27 HTTP/1.1" 200 None
2026-03-29 08:35:47 [auto1.be] INFO: Scrape type for UM90025: 0
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: NC04706
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: CD06973
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: LW74134
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW74134%27 HTTP/1.1" 200 None
2026-03-29 08:35:47 [auto1.be] INFO: Scrape type for LW74134: 0
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: AM54260
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM54260%27 HTTP/1.1" 200 None
2026-03-29 08:35:47 [auto1.be] INFO: Scrape type for AM54260: 0
2026-03-29 08:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:47 [auto1.be] INFO: Channel: 24h | Page: 11 | totalHits: 1252 | hits on page: 40
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: WP77061
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: WE68493
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE68493%27 HTTP/1.1" 200 None
2026-03-29 08:35:47 [auto1.be] INFO: Scrape type for WE68493: 0
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: TK93480
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: ZJ47299
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: JJ10339
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: RW29034
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: KD31542
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD31542%27 HTTP/1.1" 200 None
2026-03-29 08:35:47 [auto1.be] INFO: Scrape type for KD31542: 0
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: FV97066
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: DW89258
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW89258%27 HTTP/1.1" 200 None
2026-03-29 08:35:47 [auto1.be] INFO: Scrape type for DW89258: 0
2026-03-29 08:35:47 [auto1.be] INFO: Found listing with ID: AU32211
2026-03-29 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU32211%27 HTTP/1.1" 200 None
2026-03-29 08:35:48 [auto1.be] INFO: Scrape type for AU32211: 2
2026-03-29 08:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a04fdbc6-010c-5083-9052-2c13ea0e120f with identifier: AU32211
2026-03-29 08:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a04fdbc6-010c-5083-9052-2c13ea0e120f with scrape type 2
2026-03-29 08:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a04fdbc6-010c-5083-9052-2c13ea0e120f with scrape type 2
2026-03-29 08:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a04fdbc6-010c-5083-9052-2c13ea0e120f, identifier: AU32211
2026-03-29 08:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a04fdbc6-010c-5083-9052-2c13ea0e120f with identifier: AU32211
2026-03-29 08:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a04fdbc6-010c-5083-9052-2c13ea0e120f with identifier: AU32211
2026-03-29 08:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a04fdbc6-010c-5083-9052-2c13ea0e120f with identifier: AU32211 to the API
2026-03-29 08:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 212,
 'expiration_date': '2026-03-30T15:47:45Z',
 'fuel_type': 'diesel',
 'id': 'a04fdbc6-010c-5083-9052-2c13ea0e120f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU32211',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 87774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-15',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Raptor',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Raptor',
 'year': 2020}
2026-03-29 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU32211%27 HTTP/1.1" 200 None
2026-03-29 08:35:48 [auto1.be] INFO: Saving data for AU32211: {'auction_closing_time': 1774885665.0, 'created_time': 1774600290.140546, 'last_price_update_time': 1774773348.414262}
2026-03-29 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AU32211') HTTP/1.1" 204 0
2026-03-29 08:35:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:48 [auto1.be] INFO: Found listing with ID: RA68631
2026-03-29 08:35:48 [auto1.be] INFO: Found listing with ID: HA88594
2026-03-29 08:35:48 [auto1.be] INFO: Found listing with ID: DB63111
2026-03-29 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB63111%27 HTTP/1.1" 200 None
2026-03-29 08:35:48 [auto1.be] INFO: Scrape type for DB63111: 0
2026-03-29 08:35:48 [auto1.be] INFO: Found listing with ID: JZ16543
2026-03-29 08:35:48 [auto1.be] INFO: Found listing with ID: SX32022
2026-03-29 08:35:48 [auto1.be] INFO: Found listing with ID: NP17382
2026-03-29 08:35:48 [auto1.be] INFO: Found listing with ID: TF03002
2026-03-29 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF03002%27 HTTP/1.1" 200 None
2026-03-29 08:35:48 [auto1.be] INFO: Scrape type for TF03002: 2
2026-03-29 08:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 045185d6-ec84-53e2-bef2-8b5b975effb3 with identifier: TF03002
2026-03-29 08:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 045185d6-ec84-53e2-bef2-8b5b975effb3 with scrape type 2
2026-03-29 08:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 045185d6-ec84-53e2-bef2-8b5b975effb3 with scrape type 2
2026-03-29 08:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 045185d6-ec84-53e2-bef2-8b5b975effb3, identifier: TF03002
2026-03-29 08:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 045185d6-ec84-53e2-bef2-8b5b975effb3 with identifier: TF03002
2026-03-29 08:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 045185d6-ec84-53e2-bef2-8b5b975effb3 with identifier: TF03002
2026-03-29 08:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 045185d6-ec84-53e2-bef2-8b5b975effb3 with identifier: TF03002 to the API
2026-03-29 08:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:06:53Z',
 'fuel_type': 'petrol',
 'id': '045185d6-ec84-53e2-bef2-8b5b975effb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF03002',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 199816,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-27',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 FSI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2013}
2026-03-29 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF03002%27 HTTP/1.1" 200 None
2026-03-29 08:35:48 [auto1.be] INFO: Saving data for TF03002: {'auction_closing_time': 1774883213.0, 'created_time': 1774600275.066094, 'last_price_update_time': 1774773348.99138}
2026-03-29 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TF03002') HTTP/1.1" 204 0
2026-03-29 08:35:49 [auto1.be] INFO: Found listing with ID: KK24955
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KK24955%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [auto1.be] INFO: Scrape type for KK24955: 2
2026-03-29 08:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8559ff82-4084-5bd2-bddd-f93c8ed5cb64 with identifier: KK24955
2026-03-29 08:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8559ff82-4084-5bd2-bddd-f93c8ed5cb64 with scrape type 2
2026-03-29 08:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8559ff82-4084-5bd2-bddd-f93c8ed5cb64 with scrape type 2
2026-03-29 08:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8559ff82-4084-5bd2-bddd-f93c8ed5cb64, identifier: KK24955
2026-03-29 08:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8559ff82-4084-5bd2-bddd-f93c8ed5cb64 with identifier: KK24955
2026-03-29 08:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8559ff82-4084-5bd2-bddd-f93c8ed5cb64 with identifier: KK24955
2026-03-29 08:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8559ff82-4084-5bd2-bddd-f93c8ed5cb64 with identifier: KK24955 to the API
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:33:33Z',
 'fuel_type': 'petrol',
 'id': '8559ff82-4084-5bd2-bddd-f93c8ed5cb64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK24955',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 166708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-17',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 VTi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2016}
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KK24955%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [auto1.be] INFO: Saving data for KK24955: {'auction_closing_time': 1774884813.0, 'created_time': 1774557117.188305, 'last_price_update_time': 1774773349.441246}
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KK24955') HTTP/1.1" 204 0
2026-03-29 08:35:49 [auto1.be] INFO: Found listing with ID: BA13225
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA13225%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [auto1.be] INFO: Scrape type for BA13225: 0
2026-03-29 08:35:49 [auto1.be] INFO: Found listing with ID: TE72836
2026-03-29 08:35:49 [auto1.be] INFO: Found listing with ID: HY58683
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY58683%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [auto1.be] INFO: Scrape type for HY58683: 0
2026-03-29 08:35:49 [auto1.be] INFO: Found listing with ID: SS18683
2026-03-29 08:35:49 [auto1.be] INFO: Found listing with ID: XC12599
2026-03-29 08:35:49 [auto1.be] INFO: Found listing with ID: ZJ76170
2026-03-29 08:35:49 [auto1.be] INFO: Found listing with ID: XK75143
2026-03-29 08:35:49 [auto1.be] INFO: Found listing with ID: NP23299
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP23299%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [auto1.be] INFO: Scrape type for NP23299: 0
2026-03-29 08:35:49 [auto1.be] INFO: Found listing with ID: UA98228
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA98228%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [auto1.be] INFO: Scrape type for UA98228: 0
2026-03-29 08:35:49 [auto1.be] INFO: Found listing with ID: VT00410
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VT00410%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [auto1.be] INFO: Scrape type for VT00410: 0
2026-03-29 08:35:49 [auto1.be] INFO: Found listing with ID: ZH69808
2026-03-29 08:35:49 [auto1.be] INFO: Found listing with ID: WJ68976
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ68976%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [auto1.be] INFO: Scrape type for WJ68976: 0
2026-03-29 08:35:49 [auto1.be] INFO: Found listing with ID: CS08088
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS08088%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [auto1.be] INFO: Scrape type for CS08088: 0
2026-03-29 08:35:49 [auto1.be] INFO: Found listing with ID: TH19224
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH19224%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [auto1.be] INFO: Scrape type for TH19224: 0
2026-03-29 08:35:49 [auto1.be] INFO: Found listing with ID: XE73160
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE73160%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [auto1.be] INFO: Scrape type for XE73160: 0
2026-03-29 08:35:49 [auto1.be] INFO: Found listing with ID: VH38978
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VH38978%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [auto1.be] INFO: Scrape type for VH38978: 0
2026-03-29 08:35:49 [auto1.be] INFO: Found listing with ID: DY96127
2026-03-29 08:35:49 [auto1.be] INFO: Found listing with ID: HT10085
2026-03-29 08:35:49 [auto1.be] INFO: Found listing with ID: BB40778
2026-03-29 08:35:49 [auto1.be] INFO: Found listing with ID: DP96261
2026-03-29 08:35:49 [auto1.be] INFO: Found listing with ID: DK43204
2026-03-29 08:35:49 [auto1.be] INFO: Found listing with ID: WH41445
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH41445%27 HTTP/1.1" 200 None
2026-03-29 08:35:49 [auto1.be] INFO: Scrape type for WH41445: 0
2026-03-29 08:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:50 [auto1.be] INFO: Channel: 24h | Page: 12 | totalHits: 1252 | hits on page: 40
2026-03-29 08:35:50 [auto1.be] INFO: Found listing with ID: MD04738
2026-03-29 08:35:50 [auto1.be] INFO: Found listing with ID: WG62431
2026-03-29 08:35:50 [auto1.be] INFO: Found listing with ID: CB86664
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB86664%27 HTTP/1.1" 200 None
2026-03-29 08:35:50 [auto1.be] INFO: Scrape type for CB86664: 0
2026-03-29 08:35:50 [auto1.be] INFO: Found listing with ID: NW54949
2026-03-29 08:35:50 [auto1.be] INFO: Found listing with ID: ZK51965
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK51965%27 HTTP/1.1" 200 None
2026-03-29 08:35:50 [auto1.be] INFO: Scrape type for ZK51965: 0
2026-03-29 08:35:50 [auto1.be] INFO: Found listing with ID: TT75307
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT75307%27 HTTP/1.1" 200 None
2026-03-29 08:35:50 [auto1.be] INFO: Scrape type for TT75307: 0
2026-03-29 08:35:50 [auto1.be] INFO: Found listing with ID: EP09858
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP09858%27 HTTP/1.1" 200 None
2026-03-29 08:35:50 [auto1.be] INFO: Scrape type for EP09858: 0
2026-03-29 08:35:50 [auto1.be] INFO: Found listing with ID: CW40114
2026-03-29 08:35:50 [auto1.be] INFO: Found listing with ID: DH21315
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH21315%27 HTTP/1.1" 200 None
2026-03-29 08:35:50 [auto1.be] INFO: Scrape type for DH21315: 0
2026-03-29 08:35:50 [auto1.be] INFO: Found listing with ID: EW63431
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EW63431%27 HTTP/1.1" 200 None
2026-03-29 08:35:50 [auto1.be] INFO: Scrape type for EW63431: 2
2026-03-29 08:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8766d71c-f005-5ad6-a607-4b5d5ed7d704 with identifier: EW63431
2026-03-29 08:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8766d71c-f005-5ad6-a607-4b5d5ed7d704 with scrape type 2
2026-03-29 08:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8766d71c-f005-5ad6-a607-4b5d5ed7d704 with scrape type 2
2026-03-29 08:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8766d71c-f005-5ad6-a607-4b5d5ed7d704, identifier: EW63431
2026-03-29 08:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8766d71c-f005-5ad6-a607-4b5d5ed7d704 with identifier: EW63431
2026-03-29 08:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8766d71c-f005-5ad6-a607-4b5d5ed7d704 with identifier: EW63431
2026-03-29 08:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8766d71c-f005-5ad6-a607-4b5d5ed7d704 with identifier: EW63431 to the API
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:26:40Z',
 'fuel_type': 'diesel',
 'id': '8766d71c-f005-5ad6-a607-4b5d5ed7d704',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW63431',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 177017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-22',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EW63431%27 HTTP/1.1" 200 None
2026-03-29 08:35:50 [auto1.be] INFO: Saving data for EW63431: {'auction_closing_time': 1774884400.0, 'created_time': 1773693466.514536, 'last_price_update_time': 1774773350.993488}
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EW63431') HTTP/1.1" 204 0
2026-03-29 08:35:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: GH94077
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: RG44645
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RG44645%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for RG44645: 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: DS23322
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DS23322%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for DS23322: 2
2026-03-29 08:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32595404-1235-5729-b80a-df37f9f8a1ab with identifier: DS23322
2026-03-29 08:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32595404-1235-5729-b80a-df37f9f8a1ab with scrape type 2
2026-03-29 08:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32595404-1235-5729-b80a-df37f9f8a1ab with scrape type 2
2026-03-29 08:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 32595404-1235-5729-b80a-df37f9f8a1ab, identifier: DS23322
2026-03-29 08:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 32595404-1235-5729-b80a-df37f9f8a1ab with identifier: DS23322
2026-03-29 08:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 32595404-1235-5729-b80a-df37f9f8a1ab with identifier: DS23322
2026-03-29 08:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 32595404-1235-5729-b80a-df37f9f8a1ab with identifier: DS23322 to the API
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:57:02Z',
 'fuel_type': 'diesel',
 'id': '32595404-1235-5729-b80a-df37f9f8a1ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS23322',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 99310,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-30',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 TDCi EcoBlue ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2021}
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DS23322%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Saving data for DS23322: {'auction_closing_time': 1774886222.0, 'created_time': 1774557227.081863, 'last_price_update_time': 1774773351.502892}
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DS23322') HTTP/1.1" 204 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: LU38585
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: GW63299
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW63299%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for GW63299: 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: JF41683
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF41683%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for JF41683: 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: GJ23391
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: VM57702
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: FT96499
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT96499%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for FT96499: 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: XR84470
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR84470%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for XR84470: 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: FL46625
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL46625%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for FL46625: 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: AX12673
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX12673%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for AX12673: 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: GF63829
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF63829%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for GF63829: 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: JH02802
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH02802%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for JH02802: 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: KG19380
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG19380%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for KG19380: 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: HH24769
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH24769%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for HH24769: 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: CA55783
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: EP14144
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP14144%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for EP14144: 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: HP74170
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: EG14798
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: YN26679
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: HX42019
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: JW58136
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW58136%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for JW58136: 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: RM51088
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM51088%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for RM51088: 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: KW38150
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW38150%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for KW38150: 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: SV05686
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: JC96921
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC96921%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for JC96921: 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: CS46874
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS46874%27 HTTP/1.1" 200 None
2026-03-29 08:35:51 [auto1.be] INFO: Scrape type for CS46874: 0
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: GG55355
2026-03-29 08:35:51 [auto1.be] INFO: Found listing with ID: TK63545
2026-03-29 08:35:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:52 [auto1.be] INFO: Channel: 24h | Page: 13 | totalHits: 1252 | hits on page: 40
2026-03-29 08:35:52 [auto1.be] INFO: Found listing with ID: MP28046
2026-03-29 08:35:52 [auto1.be] INFO: Found listing with ID: HG61894
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HG61894%27 HTTP/1.1" 200 None
2026-03-29 08:35:52 [auto1.be] INFO: Scrape type for HG61894: 0
2026-03-29 08:35:52 [auto1.be] INFO: Found listing with ID: RB98158
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB98158%27 HTTP/1.1" 200 None
2026-03-29 08:35:52 [auto1.be] INFO: Scrape type for RB98158: 0
2026-03-29 08:35:52 [auto1.be] INFO: Found listing with ID: WA78577
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA78577%27 HTTP/1.1" 200 None
2026-03-29 08:35:52 [auto1.be] INFO: Scrape type for WA78577: 0
2026-03-29 08:35:52 [auto1.be] INFO: Found listing with ID: NP75657
2026-03-29 08:35:52 [auto1.be] INFO: Found listing with ID: BC49055
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC49055%27 HTTP/1.1" 200 None
2026-03-29 08:35:52 [auto1.be] INFO: Scrape type for BC49055: 2
2026-03-29 08:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9b88e7b-80c5-5158-8670-f261c41b45fc with identifier: BC49055
2026-03-29 08:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9b88e7b-80c5-5158-8670-f261c41b45fc with scrape type 2
2026-03-29 08:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9b88e7b-80c5-5158-8670-f261c41b45fc with scrape type 2
2026-03-29 08:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c9b88e7b-80c5-5158-8670-f261c41b45fc, identifier: BC49055
2026-03-29 08:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c9b88e7b-80c5-5158-8670-f261c41b45fc with identifier: BC49055
2026-03-29 08:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c9b88e7b-80c5-5158-8670-f261c41b45fc with identifier: BC49055
2026-03-29 08:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c9b88e7b-80c5-5158-8670-f261c41b45fc with identifier: BC49055 to the API
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:53:55Z',
 'fuel_type': 'petrol',
 'id': 'c9b88e7b-80c5-5158-8670-f261c41b45fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC49055',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Tigra',
 'odometer': 144720,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-07-10',
 'seller_name': None,
 'title': 'Opel Tigra 1.4 Enjoy',
 'transmission': 'manual',
 'trim': 'Enjoy',
 'year': 2005}
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC49055%27 HTTP/1.1" 200 None
2026-03-29 08:35:53 [auto1.be] INFO: Saving data for BC49055: {'auction_closing_time': 1774886035.0, 'created_time': 1774600271.352348, 'last_price_update_time': 1774773353.26087}
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BC49055') HTTP/1.1" 204 0
2026-03-29 08:35:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:53 [auto1.be] INFO: Found listing with ID: JJ27182
2026-03-29 08:35:53 [auto1.be] INFO: Found listing with ID: EG19315
2026-03-29 08:35:53 [auto1.be] INFO: Found listing with ID: CD53749
2026-03-29 08:35:53 [auto1.be] INFO: Found listing with ID: KN88676
2026-03-29 08:35:53 [auto1.be] INFO: Found listing with ID: RX75304
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX75304%27 HTTP/1.1" 200 None
2026-03-29 08:35:53 [auto1.be] INFO: Scrape type for RX75304: 0
2026-03-29 08:35:53 [auto1.be] INFO: Found listing with ID: DG02903
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DG02903%27 HTTP/1.1" 200 None
2026-03-29 08:35:53 [auto1.be] INFO: Scrape type for DG02903: 0
2026-03-29 08:35:53 [auto1.be] INFO: Found listing with ID: WU67286
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU67286%27 HTTP/1.1" 200 None
2026-03-29 08:35:53 [auto1.be] INFO: Scrape type for WU67286: 0
2026-03-29 08:35:53 [auto1.be] INFO: Found listing with ID: LL08256
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LL08256%27 HTTP/1.1" 200 None
2026-03-29 08:35:53 [auto1.be] INFO: Scrape type for LL08256: 0
2026-03-29 08:35:53 [auto1.be] INFO: Found listing with ID: CG84069
2026-03-29 08:35:53 [auto1.be] INFO: Found listing with ID: AV28567
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV28567%27 HTTP/1.1" 200 None
2026-03-29 08:35:53 [auto1.be] INFO: Scrape type for AV28567: 0
2026-03-29 08:35:53 [auto1.be] INFO: Found listing with ID: WB95668
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB95668%27 HTTP/1.1" 200 None
2026-03-29 08:35:53 [auto1.be] INFO: Scrape type for WB95668: 0
2026-03-29 08:35:53 [auto1.be] INFO: Found listing with ID: FS62191
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS62191%27 HTTP/1.1" 200 None
2026-03-29 08:35:53 [auto1.be] INFO: Scrape type for FS62191: 0
2026-03-29 08:35:53 [auto1.be] INFO: Found listing with ID: WU43595
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU43595%27 HTTP/1.1" 200 None
2026-03-29 08:35:53 [auto1.be] INFO: Scrape type for WU43595: 0
2026-03-29 08:35:53 [auto1.be] INFO: Found listing with ID: HK81119
2026-03-29 08:35:53 [auto1.be] INFO: Found listing with ID: ZJ33794
2026-03-29 08:35:53 [auto1.be] INFO: Found listing with ID: VF88831
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF88831%27 HTTP/1.1" 200 None
2026-03-29 08:35:53 [auto1.be] INFO: Scrape type for VF88831: 0
2026-03-29 08:35:53 [auto1.be] INFO: Found listing with ID: VK66376
2026-03-29 08:35:53 [auto1.be] INFO: Found listing with ID: RA11008
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA11008%27 HTTP/1.1" 200 None
2026-03-29 08:35:53 [auto1.be] INFO: Scrape type for RA11008: 2
2026-03-29 08:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4419f0c6-fafe-5a86-8bda-b9d9221dc288 with identifier: RA11008
2026-03-29 08:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4419f0c6-fafe-5a86-8bda-b9d9221dc288 with scrape type 2
2026-03-29 08:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4419f0c6-fafe-5a86-8bda-b9d9221dc288 with scrape type 2
2026-03-29 08:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4419f0c6-fafe-5a86-8bda-b9d9221dc288, identifier: RA11008
2026-03-29 08:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4419f0c6-fafe-5a86-8bda-b9d9221dc288 with identifier: RA11008
2026-03-29 08:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4419f0c6-fafe-5a86-8bda-b9d9221dc288 with identifier: RA11008
2026-03-29 08:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4419f0c6-fafe-5a86-8bda-b9d9221dc288 with identifier: RA11008 to the API
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:58:28Z',
 'fuel_type': 'diesel',
 'id': '4419f0c6-fafe-5a86-8bda-b9d9221dc288',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA11008',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 191118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-14',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.2 Td4 Pure',
 'transmission': 'automatic',
 'trim': 'Pure',
 'year': 2013}
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA11008%27 HTTP/1.1" 200 None
2026-03-29 08:35:53 [auto1.be] INFO: Saving data for RA11008: {'auction_closing_time': 1774886308.0, 'created_time': 1773779707.95762, 'last_price_update_time': 1774773353.977316}
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RA11008') HTTP/1.1" 204 0
2026-03-29 08:35:54 [auto1.be] INFO: Found listing with ID: KV01738
2026-03-29 08:35:54 [auto1.be] INFO: Found listing with ID: EE45657
2026-03-29 08:35:54 [auto1.be] INFO: Found listing with ID: PS61885
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS61885%27 HTTP/1.1" 200 None
2026-03-29 08:35:54 [auto1.be] INFO: Scrape type for PS61885: 0
2026-03-29 08:35:54 [auto1.be] INFO: Found listing with ID: UW52037
2026-03-29 08:35:54 [auto1.be] INFO: Found listing with ID: YW15851
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW15851%27 HTTP/1.1" 200 None
2026-03-29 08:35:54 [auto1.be] INFO: Scrape type for YW15851: 0
2026-03-29 08:35:54 [auto1.be] INFO: Found listing with ID: NS97708
2026-03-29 08:35:54 [auto1.be] INFO: Found listing with ID: MB15455
2026-03-29 08:35:54 [auto1.be] INFO: Found listing with ID: RY14212
2026-03-29 08:35:54 [auto1.be] INFO: Found listing with ID: PB96026
2026-03-29 08:35:54 [auto1.be] INFO: Found listing with ID: EL33380
2026-03-29 08:35:54 [auto1.be] INFO: Found listing with ID: UH14890
2026-03-29 08:35:54 [auto1.be] INFO: Found listing with ID: YK73361
2026-03-29 08:35:54 [auto1.be] INFO: Found listing with ID: FF99790
2026-03-29 08:35:54 [auto1.be] INFO: Found listing with ID: DP88518
2026-03-29 08:35:54 [auto1.be] INFO: Found listing with ID: XL26167
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL26167%27 HTTP/1.1" 200 None
2026-03-29 08:35:54 [auto1.be] INFO: Scrape type for XL26167: 0
2026-03-29 08:35:54 [auto1.be] INFO: Found listing with ID: YJ00240
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ00240%27 HTTP/1.1" 200 None
2026-03-29 08:35:54 [auto1.be] INFO: Scrape type for YJ00240: 0
2026-03-29 08:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:55 [auto1.be] INFO: Channel: 24h | Page: 14 | totalHits: 1252 | hits on page: 40
2026-03-29 08:35:55 [auto1.be] INFO: Found listing with ID: NB09051
2026-03-29 08:35:55 [auto1.be] INFO: Found listing with ID: GF65026
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF65026%27 HTTP/1.1" 200 None
2026-03-29 08:35:55 [auto1.be] INFO: Scrape type for GF65026: 0
2026-03-29 08:35:55 [auto1.be] INFO: Found listing with ID: HS49836
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS49836%27 HTTP/1.1" 200 None
2026-03-29 08:35:55 [auto1.be] INFO: Scrape type for HS49836: 0
2026-03-29 08:35:55 [auto1.be] INFO: Found listing with ID: CU87114
2026-03-29 08:35:55 [auto1.be] INFO: Found listing with ID: BV41613
2026-03-29 08:35:55 [auto1.be] INFO: Found listing with ID: UX15937
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX15937%27 HTTP/1.1" 200 None
2026-03-29 08:35:55 [auto1.be] INFO: Scrape type for UX15937: 2
2026-03-29 08:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1450a068-55de-5e8d-814a-11cfb726c7d8 with identifier: UX15937
2026-03-29 08:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1450a068-55de-5e8d-814a-11cfb726c7d8 with scrape type 2
2026-03-29 08:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1450a068-55de-5e8d-814a-11cfb726c7d8 with scrape type 2
2026-03-29 08:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1450a068-55de-5e8d-814a-11cfb726c7d8, identifier: UX15937
2026-03-29 08:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1450a068-55de-5e8d-814a-11cfb726c7d8 with identifier: UX15937
2026-03-29 08:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1450a068-55de-5e8d-814a-11cfb726c7d8 with identifier: UX15937
2026-03-29 08:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1450a068-55de-5e8d-814a-11cfb726c7d8 with identifier: UX15937 to the API
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:42:12Z',
 'fuel_type': 'petrol',
 'id': '1450a068-55de-5e8d-814a-11cfb726c7d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX15937',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 165373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-02',
 'seller_name': None,
 'title': 'Fiat 500X 1.0 Turbo City Cross',
 'transmission': 'manual',
 'trim': 'City Cross',
 'year': 2019}
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX15937%27 HTTP/1.1" 200 None
2026-03-29 08:35:55 [auto1.be] INFO: Saving data for UX15937: {'auction_closing_time': 1774885332.0, 'created_time': 1773237862.379495, 'last_price_update_time': 1774773355.676629}
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UX15937') HTTP/1.1" 204 0
2026-03-29 08:35:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:55 [auto1.be] INFO: Found listing with ID: RU19747
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU19747%27 HTTP/1.1" 200 None
2026-03-29 08:35:55 [auto1.be] INFO: Scrape type for RU19747: 0
2026-03-29 08:35:55 [auto1.be] INFO: Found listing with ID: ZS27075
2026-03-29 08:35:55 [auto1.be] INFO: Found listing with ID: UA67521
2026-03-29 08:35:55 [auto1.be] INFO: Found listing with ID: CS20047
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS20047%27 HTTP/1.1" 200 None
2026-03-29 08:35:55 [auto1.be] INFO: Scrape type for CS20047: 0
2026-03-29 08:35:55 [auto1.be] INFO: Found listing with ID: MK30308
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK30308%27 HTTP/1.1" 200 None
2026-03-29 08:35:55 [auto1.be] INFO: Scrape type for MK30308: 0
2026-03-29 08:35:55 [auto1.be] INFO: Found listing with ID: FA61625
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA61625%27 HTTP/1.1" 200 None
2026-03-29 08:35:55 [auto1.be] INFO: Scrape type for FA61625: 2
2026-03-29 08:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca60800a-cbc0-5456-8454-e5f8f0299db8 with identifier: FA61625
2026-03-29 08:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca60800a-cbc0-5456-8454-e5f8f0299db8 with scrape type 2
2026-03-29 08:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca60800a-cbc0-5456-8454-e5f8f0299db8 with scrape type 2
2026-03-29 08:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ca60800a-cbc0-5456-8454-e5f8f0299db8, identifier: FA61625
2026-03-29 08:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ca60800a-cbc0-5456-8454-e5f8f0299db8 with identifier: FA61625
2026-03-29 08:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ca60800a-cbc0-5456-8454-e5f8f0299db8 with identifier: FA61625
2026-03-29 08:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ca60800a-cbc0-5456-8454-e5f8f0299db8 with identifier: FA61625 to the API
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:15:44Z',
 'fuel_type': 'petrol',
 'id': 'ca60800a-cbc0-5456-8454-e5f8f0299db8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA61625',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 87303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-01',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Advantage 2WD',
 'transmission': 'manual',
 'trim': 'Advantage 2WD',
 'year': 2023}
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA61625%27 HTTP/1.1" 200 None
2026-03-29 08:35:56 [auto1.be] INFO: Saving data for FA61625: {'auction_closing_time': 1774883744.0, 'created_time': 1773909054.800169, 'last_price_update_time': 1774773356.236277}
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FA61625') HTTP/1.1" 204 0
2026-03-29 08:35:56 [auto1.be] INFO: Found listing with ID: YA85838
2026-03-29 08:35:56 [auto1.be] INFO: Found listing with ID: RL24593
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL24593%27 HTTP/1.1" 200 None
2026-03-29 08:35:56 [auto1.be] INFO: Scrape type for RL24593: 0
2026-03-29 08:35:56 [auto1.be] INFO: Found listing with ID: PJ20685
2026-03-29 08:35:56 [auto1.be] INFO: Found listing with ID: XV14848
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XV14848%27 HTTP/1.1" 200 None
2026-03-29 08:35:56 [auto1.be] INFO: Scrape type for XV14848: 0
2026-03-29 08:35:56 [auto1.be] INFO: Found listing with ID: DY20434
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY20434%27 HTTP/1.1" 200 None
2026-03-29 08:35:56 [auto1.be] INFO: Scrape type for DY20434: 0
2026-03-29 08:35:56 [auto1.be] INFO: Found listing with ID: CH15764
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH15764%27 HTTP/1.1" 200 None
2026-03-29 08:35:56 [auto1.be] INFO: Scrape type for CH15764: 0
2026-03-29 08:35:56 [auto1.be] INFO: Found listing with ID: HY35953
2026-03-29 08:35:56 [auto1.be] INFO: Found listing with ID: AX58227
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX58227%27 HTTP/1.1" 200 None
2026-03-29 08:35:56 [auto1.be] INFO: Scrape type for AX58227: 0
2026-03-29 08:35:56 [auto1.be] INFO: Found listing with ID: GG92230
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG92230%27 HTTP/1.1" 200 None
2026-03-29 08:35:56 [auto1.be] INFO: Scrape type for GG92230: 0
2026-03-29 08:35:56 [auto1.be] INFO: Found listing with ID: HM69306
2026-03-29 08:35:56 [auto1.be] INFO: Found listing with ID: XC97675
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC97675%27 HTTP/1.1" 200 None
2026-03-29 08:35:56 [auto1.be] INFO: Scrape type for XC97675: 0
2026-03-29 08:35:56 [auto1.be] INFO: Found listing with ID: LE04651
2026-03-29 08:35:56 [auto1.be] INFO: Found listing with ID: XZ27909
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ27909%27 HTTP/1.1" 200 None
2026-03-29 08:35:56 [auto1.be] INFO: Scrape type for XZ27909: 0
2026-03-29 08:35:56 [auto1.be] INFO: Found listing with ID: CV26650
2026-03-29 08:35:56 [auto1.be] INFO: Found listing with ID: XH41981
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH41981%27 HTTP/1.1" 200 None
2026-03-29 08:35:56 [auto1.be] INFO: Scrape type for XH41981: 0
2026-03-29 08:35:56 [auto1.be] INFO: Found listing with ID: SV23823
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV23823%27 HTTP/1.1" 200 None
2026-03-29 08:35:56 [auto1.be] INFO: Scrape type for SV23823: 0
2026-03-29 08:35:56 [auto1.be] INFO: Found listing with ID: HW65369
2026-03-29 08:35:56 [auto1.be] INFO: Found listing with ID: YC48670
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC48670%27 HTTP/1.1" 200 None
2026-03-29 08:35:56 [auto1.be] INFO: Scrape type for YC48670: 0
2026-03-29 08:35:56 [auto1.be] INFO: Found listing with ID: MK11042
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK11042%27 HTTP/1.1" 200 None
2026-03-29 08:35:56 [auto1.be] INFO: Scrape type for MK11042: 0
2026-03-29 08:35:56 [auto1.be] INFO: Found listing with ID: SZ23077
2026-03-29 08:35:56 [auto1.be] INFO: Found listing with ID: TS47815
2026-03-29 08:35:56 [auto1.be] INFO: Found listing with ID: RU10603
2026-03-29 08:35:56 [auto1.be] INFO: Found listing with ID: SX30605
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX30605%27 HTTP/1.1" 200 None
2026-03-29 08:35:56 [auto1.be] INFO: Scrape type for SX30605: 0
2026-03-29 08:35:56 [auto1.be] INFO: Found listing with ID: AX51995
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX51995%27 HTTP/1.1" 200 None
2026-03-29 08:35:56 [auto1.be] INFO: Scrape type for AX51995: 0
2026-03-29 08:35:56 [auto1.be] INFO: Found listing with ID: KW80684
2026-03-29 08:35:56 [auto1.be] INFO: Found listing with ID: LF90651
2026-03-29 08:35:56 [auto1.be] INFO: Found listing with ID: TH79553
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH79553%27 HTTP/1.1" 200 None
2026-03-29 08:35:56 [auto1.be] INFO: Scrape type for TH79553: 0
2026-03-29 08:35:56 [auto1.be] INFO: Found listing with ID: ZJ26609
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ26609%27 HTTP/1.1" 200 None
2026-03-29 08:35:56 [auto1.be] INFO: Scrape type for ZJ26609: 0
2026-03-29 08:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:35:57 [auto1.be] INFO: Channel: 24h | Page: 15 | totalHits: 1252 | hits on page: 40
2026-03-29 08:35:57 [auto1.be] INFO: Found listing with ID: EK41744
2026-03-29 08:35:57 [auto1.be] INFO: Found listing with ID: BV36868
2026-03-29 08:35:57 [auto1.be] INFO: Found listing with ID: JB98140
2026-03-29 08:35:57 [auto1.be] INFO: Found listing with ID: ED70069
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED70069%27 HTTP/1.1" 200 None
2026-03-29 08:35:57 [auto1.be] INFO: Scrape type for ED70069: 0
2026-03-29 08:35:57 [auto1.be] INFO: Found listing with ID: RM32931
2026-03-29 08:35:57 [auto1.be] INFO: Found listing with ID: SK81997
2026-03-29 08:35:57 [auto1.be] INFO: Found listing with ID: XE15288
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE15288%27 HTTP/1.1" 200 None
2026-03-29 08:35:57 [auto1.be] INFO: Scrape type for XE15288: 0
2026-03-29 08:35:57 [auto1.be] INFO: Found listing with ID: PJ31589
2026-03-29 08:35:57 [auto1.be] INFO: Found listing with ID: MN41841
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MN41841%27 HTTP/1.1" 200 None
2026-03-29 08:35:57 [auto1.be] INFO: Scrape type for MN41841: 2
2026-03-29 08:35:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f978f149-e638-548e-8826-f7636922c944 with identifier: MN41841
2026-03-29 08:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f978f149-e638-548e-8826-f7636922c944 with scrape type 2
2026-03-29 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f978f149-e638-548e-8826-f7636922c944 with scrape type 2
2026-03-29 08:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f978f149-e638-548e-8826-f7636922c944, identifier: MN41841
2026-03-29 08:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f978f149-e638-548e-8826-f7636922c944 with identifier: MN41841
2026-03-29 08:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f978f149-e638-548e-8826-f7636922c944 with identifier: MN41841
2026-03-29 08:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f978f149-e638-548e-8826-f7636922c944 with identifier: MN41841 to the API
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:40:54Z',
 'fuel_type': 'petrol',
 'id': 'f978f149-e638-548e-8826-f7636922c944',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN41841',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 51950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-24',
 'seller_name': None,
 'title': 'Fiat 500X 1.0 Turbo Cross',
 'transmission': 'manual',
 'trim': 'Cross',
 'year': 2020}
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MN41841%27 HTTP/1.1" 200 None
2026-03-29 08:35:57 [auto1.be] INFO: Saving data for MN41841: {'auction_closing_time': 1774885254.0, 'created_time': 1774557197.321646, 'last_price_update_time': 1774773357.799652}
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MN41841') HTTP/1.1" 204 0
2026-03-29 08:35:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:35:57 [auto1.be] INFO: Found listing with ID: TV22564
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV22564%27 HTTP/1.1" 200 None
2026-03-29 08:35:57 [auto1.be] INFO: Scrape type for TV22564: 0
2026-03-29 08:35:57 [auto1.be] INFO: Found listing with ID: UF59925
2026-03-29 08:35:57 [auto1.be] INFO: Found listing with ID: UA82763
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA82763%27 HTTP/1.1" 200 None
2026-03-29 08:35:57 [auto1.be] INFO: Scrape type for UA82763: 2
2026-03-29 08:35:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 311bae9a-b079-581b-b8c8-5dd42c88efda with identifier: UA82763
2026-03-29 08:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 311bae9a-b079-581b-b8c8-5dd42c88efda with scrape type 2
2026-03-29 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 311bae9a-b079-581b-b8c8-5dd42c88efda with scrape type 2
2026-03-29 08:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 311bae9a-b079-581b-b8c8-5dd42c88efda, identifier: UA82763
2026-03-29 08:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 311bae9a-b079-581b-b8c8-5dd42c88efda with identifier: UA82763
2026-03-29 08:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 311bae9a-b079-581b-b8c8-5dd42c88efda with identifier: UA82763
2026-03-29 08:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 311bae9a-b079-581b-b8c8-5dd42c88efda with identifier: UA82763 to the API
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:34:18Z',
 'fuel_type': 'petrol',
 'id': '311bae9a-b079-581b-b8c8-5dd42c88efda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA82763',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 105664,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.0 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2018}
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA82763%27 HTTP/1.1" 200 None
2026-03-29 08:35:58 [auto1.be] INFO: Saving data for UA82763: {'auction_closing_time': 1774884858.0, 'created_time': 1774557082.88172, 'last_price_update_time': 1774773358.340151}
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UA82763') HTTP/1.1" 204 0
2026-03-29 08:35:58 [auto1.be] INFO: Found listing with ID: YX48939
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX48939%27 HTTP/1.1" 200 None
2026-03-29 08:35:58 [auto1.be] INFO: Scrape type for YX48939: 0
2026-03-29 08:35:58 [auto1.be] INFO: Found listing with ID: RA81540
2026-03-29 08:35:58 [auto1.be] INFO: Found listing with ID: RW15578
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW15578%27 HTTP/1.1" 200 None
2026-03-29 08:35:58 [auto1.be] INFO: Scrape type for RW15578: 2
2026-03-29 08:35:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73abd779-7569-5cae-994d-decd1e37cc99 with identifier: RW15578
2026-03-29 08:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73abd779-7569-5cae-994d-decd1e37cc99 with scrape type 2
2026-03-29 08:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73abd779-7569-5cae-994d-decd1e37cc99 with scrape type 2
2026-03-29 08:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 73abd779-7569-5cae-994d-decd1e37cc99, identifier: RW15578
2026-03-29 08:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 73abd779-7569-5cae-994d-decd1e37cc99 with identifier: RW15578
2026-03-29 08:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 73abd779-7569-5cae-994d-decd1e37cc99 with identifier: RW15578
2026-03-29 08:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 73abd779-7569-5cae-994d-decd1e37cc99 with identifier: RW15578 to the API
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:42:45Z',
 'fuel_type': 'petrol',
 'id': '73abd779-7569-5cae-994d-decd1e37cc99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW15578',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Combo',
 'odometer': 100923,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-17',
 'seller_name': None,
 'title': 'Opel Combo 1.4 Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2011}
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW15578%27 HTTP/1.1" 200 None
2026-03-29 08:35:58 [auto1.be] INFO: Saving data for RW15578: {'auction_closing_time': 1774885365.0, 'created_time': 1774557230.269752, 'last_price_update_time': 1774773358.798058}
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RW15578') HTTP/1.1" 204 0
2026-03-29 08:35:58 [auto1.be] INFO: Found listing with ID: LW38679
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW38679%27 HTTP/1.1" 200 None
2026-03-29 08:35:58 [auto1.be] INFO: Scrape type for LW38679: 0
2026-03-29 08:35:58 [auto1.be] INFO: Found listing with ID: WG20951
2026-03-29 08:35:58 [auto1.be] INFO: Found listing with ID: UW21644
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW21644%27 HTTP/1.1" 200 None
2026-03-29 08:35:58 [auto1.be] INFO: Scrape type for UW21644: 0
2026-03-29 08:35:58 [auto1.be] INFO: Found listing with ID: AG87445
2026-03-29 08:35:58 [auto1.be] INFO: Found listing with ID: LX45606
2026-03-29 08:35:58 [auto1.be] INFO: Found listing with ID: DE21401
2026-03-29 08:35:58 [auto1.be] INFO: Found listing with ID: MJ77172
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ77172%27 HTTP/1.1" 200 None
2026-03-29 08:35:58 [auto1.be] INFO: Scrape type for MJ77172: 0
2026-03-29 08:35:58 [auto1.be] INFO: Found listing with ID: RK68346
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK68346%27 HTTP/1.1" 200 None
2026-03-29 08:35:58 [auto1.be] INFO: Scrape type for RK68346: 0
2026-03-29 08:35:58 [auto1.be] INFO: Found listing with ID: VE52917
2026-03-29 08:35:58 [auto1.be] INFO: Found listing with ID: GC03502
2026-03-29 08:35:58 [auto1.be] INFO: Found listing with ID: JX04101
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX04101%27 HTTP/1.1" 200 None
2026-03-29 08:35:58 [auto1.be] INFO: Scrape type for JX04101: 0
2026-03-29 08:35:58 [auto1.be] INFO: Found listing with ID: YA14339
2026-03-29 08:35:58 [auto1.be] INFO: Found listing with ID: SD15124
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD15124%27 HTTP/1.1" 200 None
2026-03-29 08:35:58 [auto1.be] INFO: Scrape type for SD15124: 0
2026-03-29 08:35:58 [auto1.be] INFO: Found listing with ID: RR03336
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR03336%27 HTTP/1.1" 200 None
2026-03-29 08:35:58 [auto1.be] INFO: Scrape type for RR03336: 0
2026-03-29 08:35:58 [auto1.be] INFO: Found listing with ID: JZ92177
2026-03-29 08:35:58 [auto1.be] INFO: Found listing with ID: PF95077
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF95077%27 HTTP/1.1" 200 None
2026-03-29 08:35:58 [auto1.be] INFO: Scrape type for PF95077: 0
2026-03-29 08:35:58 [auto1.be] INFO: Found listing with ID: WE56106
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE56106%27 HTTP/1.1" 200 None
2026-03-29 08:35:58 [auto1.be] INFO: Scrape type for WE56106: 0
2026-03-29 08:35:58 [auto1.be] INFO: Found listing with ID: BC32945
2026-03-29 08:35:58 [auto1.be] INFO: Found listing with ID: NB71425
2026-03-29 08:35:58 [auto1.be] INFO: Found listing with ID: HJ67440
2026-03-29 08:35:58 [auto1.be] INFO: Found listing with ID: SF89359
2026-03-29 08:35:58 [auto1.be] INFO: Found listing with ID: PN62826
2026-03-29 08:35:58 [auto1.be] INFO: Found listing with ID: ZP07177
2026-03-29 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP07177%27 HTTP/1.1" 200 None
2026-03-29 08:35:59 [auto1.be] INFO: Scrape type for ZP07177: 2
2026-03-29 08:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69765ded-891c-5b27-a92d-03388c67e8a7 with identifier: ZP07177
2026-03-29 08:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69765ded-891c-5b27-a92d-03388c67e8a7 with scrape type 2
2026-03-29 08:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69765ded-891c-5b27-a92d-03388c67e8a7 with scrape type 2
2026-03-29 08:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 69765ded-891c-5b27-a92d-03388c67e8a7, identifier: ZP07177
2026-03-29 08:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 69765ded-891c-5b27-a92d-03388c67e8a7 with identifier: ZP07177
2026-03-29 08:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 69765ded-891c-5b27-a92d-03388c67e8a7 with identifier: ZP07177
2026-03-29 08:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 69765ded-891c-5b27-a92d-03388c67e8a7 with identifier: ZP07177 to the API
2026-03-29 08:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:39:59Z',
 'fuel_type': 'petrol',
 'id': '69765ded-891c-5b27-a92d-03388c67e8a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP07177',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 123075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-01',
 'seller_name': None,
 'title': 'BMW 3er 316i',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-29 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP07177%27 HTTP/1.1" 200 None
2026-03-29 08:35:59 [auto1.be] INFO: Saving data for ZP07177: {'auction_closing_time': 1774885199.0, 'created_time': 1774557181.691529, 'last_price_update_time': 1774773359.40868}
2026-03-29 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZP07177') HTTP/1.1" 204 0
2026-03-29 08:35:59 [auto1.be] INFO: Found listing with ID: EF70909
2026-03-29 08:35:59 [auto1.be] INFO: Found listing with ID: FC28046
2026-03-29 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC28046%27 HTTP/1.1" 200 None
2026-03-29 08:35:59 [auto1.be] INFO: Scrape type for FC28046: 0
2026-03-29 08:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:00 [auto1.be] INFO: Channel: 24h | Page: 16 | totalHits: 1252 | hits on page: 40
2026-03-29 08:36:00 [auto1.be] INFO: Found listing with ID: FP68376
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP68376%27 HTTP/1.1" 200 None
2026-03-29 08:36:00 [auto1.be] INFO: Scrape type for FP68376: 2
2026-03-29 08:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35d200c7-af14-5a63-a9e3-ba5a9a838fbf with identifier: FP68376
2026-03-29 08:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35d200c7-af14-5a63-a9e3-ba5a9a838fbf with scrape type 2
2026-03-29 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35d200c7-af14-5a63-a9e3-ba5a9a838fbf with scrape type 2
2026-03-29 08:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 35d200c7-af14-5a63-a9e3-ba5a9a838fbf, identifier: FP68376
2026-03-29 08:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 35d200c7-af14-5a63-a9e3-ba5a9a838fbf with identifier: FP68376
2026-03-29 08:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 35d200c7-af14-5a63-a9e3-ba5a9a838fbf with identifier: FP68376
2026-03-29 08:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 35d200c7-af14-5a63-a9e3-ba5a9a838fbf with identifier: FP68376 to the API
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:33:46Z',
 'fuel_type': 'petrol',
 'id': '35d200c7-af14-5a63-a9e3-ba5a9a838fbf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP68376',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 117701,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-12',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Energy',
 'transmission': 'manual',
 'trim': 'Energy',
 'year': 2015}
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP68376%27 HTTP/1.1" 200 None
2026-03-29 08:36:00 [auto1.be] INFO: Saving data for FP68376: {'auction_closing_time': 1774884826.0, 'created_time': 1774557189.746164, 'last_price_update_time': 1774773360.735094}
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FP68376') HTTP/1.1" 204 0
2026-03-29 08:36:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:00 [auto1.be] INFO: Found listing with ID: VL69873
2026-03-29 08:36:00 [auto1.be] INFO: Found listing with ID: AF71611
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF71611%27 HTTP/1.1" 200 None
2026-03-29 08:36:00 [auto1.be] INFO: Scrape type for AF71611: 0
2026-03-29 08:36:00 [auto1.be] INFO: Found listing with ID: FR21473
2026-03-29 08:36:00 [auto1.be] INFO: Found listing with ID: FK29667
2026-03-29 08:36:00 [auto1.be] INFO: Found listing with ID: FG88533
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG88533%27 HTTP/1.1" 200 None
2026-03-29 08:36:00 [auto1.be] INFO: Scrape type for FG88533: 0
2026-03-29 08:36:00 [auto1.be] INFO: Found listing with ID: AV34296
2026-03-29 08:36:00 [auto1.be] INFO: Found listing with ID: ET09366
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET09366%27 HTTP/1.1" 200 None
2026-03-29 08:36:00 [auto1.be] INFO: Scrape type for ET09366: 0
2026-03-29 08:36:00 [auto1.be] INFO: Found listing with ID: SB45161
2026-03-29 08:36:00 [auto1.be] INFO: Found listing with ID: YF28674
2026-03-29 08:36:00 [auto1.be] INFO: Found listing with ID: SR34780
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR34780%27 HTTP/1.1" 200 None
2026-03-29 08:36:00 [auto1.be] INFO: Scrape type for SR34780: 0
2026-03-29 08:36:00 [auto1.be] INFO: Found listing with ID: NK56969
2026-03-29 08:36:00 [auto1.be] INFO: Found listing with ID: MT09894
2026-03-29 08:36:00 [auto1.be] INFO: Found listing with ID: WB76864
2026-03-29 08:36:00 [auto1.be] INFO: Found listing with ID: JZ88652
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ88652%27 HTTP/1.1" 200 None
2026-03-29 08:36:00 [auto1.be] INFO: Scrape type for JZ88652: 2
2026-03-29 08:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b991e6f-1d23-5887-a345-1c2d47850084 with identifier: JZ88652
2026-03-29 08:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b991e6f-1d23-5887-a345-1c2d47850084 with scrape type 2
2026-03-29 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b991e6f-1d23-5887-a345-1c2d47850084 with scrape type 2
2026-03-29 08:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3b991e6f-1d23-5887-a345-1c2d47850084, identifier: JZ88652
2026-03-29 08:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3b991e6f-1d23-5887-a345-1c2d47850084 with identifier: JZ88652
2026-03-29 08:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3b991e6f-1d23-5887-a345-1c2d47850084 with identifier: JZ88652
2026-03-29 08:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3b991e6f-1d23-5887-a345-1c2d47850084 with identifier: JZ88652 to the API
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:38:16Z',
 'fuel_type': 'diesel',
 'id': '3b991e6f-1d23-5887-a345-1c2d47850084',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ88652',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 162300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-13',
 'seller_name': None,
 'title': 'Kia XCeed 1.6 CRDi Platinum Edition',
 'transmission': 'automatic',
 'trim': 'Platinum Edition',
 'year': 2020}
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ88652%27 HTTP/1.1" 200 None
2026-03-29 08:36:01 [auto1.be] INFO: Saving data for JZ88652: {'auction_closing_time': 1774885096.0, 'created_time': 1773909034.86822, 'last_price_update_time': 1774773361.287834}
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JZ88652') HTTP/1.1" 204 0
2026-03-29 08:36:01 [auto1.be] INFO: Found listing with ID: ZF81780
2026-03-29 08:36:01 [auto1.be] INFO: Found listing with ID: UV91092
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV91092%27 HTTP/1.1" 200 None
2026-03-29 08:36:01 [auto1.be] INFO: Scrape type for UV91092: 0
2026-03-29 08:36:01 [auto1.be] INFO: Found listing with ID: JX62848
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX62848%27 HTTP/1.1" 200 None
2026-03-29 08:36:01 [auto1.be] INFO: Scrape type for JX62848: 0
2026-03-29 08:36:01 [auto1.be] INFO: Found listing with ID: BS55977
2026-03-29 08:36:01 [auto1.be] INFO: Found listing with ID: ET18736
2026-03-29 08:36:01 [auto1.be] INFO: Found listing with ID: MA69424
2026-03-29 08:36:01 [auto1.be] INFO: Found listing with ID: ZR45530
2026-03-29 08:36:01 [auto1.be] INFO: Found listing with ID: VW08902
2026-03-29 08:36:01 [auto1.be] INFO: Found listing with ID: FS38787
2026-03-29 08:36:01 [auto1.be] INFO: Found listing with ID: HT09098
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT09098%27 HTTP/1.1" 200 None
2026-03-29 08:36:01 [auto1.be] INFO: Scrape type for HT09098: 0
2026-03-29 08:36:01 [auto1.be] INFO: Found listing with ID: KP16038
2026-03-29 08:36:01 [auto1.be] INFO: Found listing with ID: KC19835
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC19835%27 HTTP/1.1" 200 None
2026-03-29 08:36:01 [auto1.be] INFO: Scrape type for KC19835: 0
2026-03-29 08:36:01 [auto1.be] INFO: Found listing with ID: VU16052
2026-03-29 08:36:01 [auto1.be] INFO: Found listing with ID: HM47736
2026-03-29 08:36:01 [auto1.be] INFO: Found listing with ID: GF03232
2026-03-29 08:36:01 [auto1.be] INFO: Found listing with ID: UC56570
2026-03-29 08:36:01 [auto1.be] INFO: Found listing with ID: NN67810
2026-03-29 08:36:01 [auto1.be] INFO: Found listing with ID: FE88671
2026-03-29 08:36:01 [auto1.be] INFO: Found listing with ID: ZM54686
2026-03-29 08:36:01 [auto1.be] INFO: Found listing with ID: GR78986
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR78986%27 HTTP/1.1" 200 None
2026-03-29 08:36:01 [auto1.be] INFO: Scrape type for GR78986: 2
2026-03-29 08:36:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78187941-5f25-5bbe-9615-e404d832696b with identifier: GR78986
2026-03-29 08:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78187941-5f25-5bbe-9615-e404d832696b with scrape type 2
2026-03-29 08:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78187941-5f25-5bbe-9615-e404d832696b with scrape type 2
2026-03-29 08:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 78187941-5f25-5bbe-9615-e404d832696b, identifier: GR78986
2026-03-29 08:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 78187941-5f25-5bbe-9615-e404d832696b with identifier: GR78986
2026-03-29 08:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 78187941-5f25-5bbe-9615-e404d832696b with identifier: GR78986
2026-03-29 08:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 78187941-5f25-5bbe-9615-e404d832696b with identifier: GR78986 to the API
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-30T15:10:32Z',
 'fuel_type': 'hybrid',
 'id': '78187941-5f25-5bbe-9615-e404d832696b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR78986',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 81537,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-16',
 'seller_name': None,
 'title': 'BMW 3er 330e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR78986%27 HTTP/1.1" 200 None
2026-03-29 08:36:02 [auto1.be] INFO: Saving data for GR78986: {'auction_closing_time': 1774883432.0, 'created_time': 1774557247.275806, 'last_price_update_time': 1774773362.014177}
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GR78986') HTTP/1.1" 204 0
2026-03-29 08:36:02 [auto1.be] INFO: Found listing with ID: CP42003
2026-03-29 08:36:02 [auto1.be] INFO: Found listing with ID: RN56335
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RN56335%27 HTTP/1.1" 200 None
2026-03-29 08:36:02 [auto1.be] INFO: Scrape type for RN56335: 0
2026-03-29 08:36:02 [auto1.be] INFO: Found listing with ID: RF80171
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF80171%27 HTTP/1.1" 200 None
2026-03-29 08:36:02 [auto1.be] INFO: Scrape type for RF80171: 0
2026-03-29 08:36:02 [auto1.be] INFO: Found listing with ID: ZF78419
2026-03-29 08:36:02 [auto1.be] INFO: Found listing with ID: DT24627
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT24627%27 HTTP/1.1" 200 None
2026-03-29 08:36:02 [auto1.be] INFO: Scrape type for DT24627: 0
2026-03-29 08:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:04 [auto1.be] INFO: Channel: 24h | Page: 17 | totalHits: 1252 | hits on page: 40
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: YM99739
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: CH83928
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH83928%27 HTTP/1.1" 200 None
2026-03-29 08:36:04 [auto1.be] INFO: Scrape type for CH83928: 0
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: YT15018
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: BC69430
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC69430%27 HTTP/1.1" 200 None
2026-03-29 08:36:04 [auto1.be] INFO: Scrape type for BC69430: 0
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: BU90061
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: EV01420
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: PS72966
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: CR22525
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CR22525%27 HTTP/1.1" 200 None
2026-03-29 08:36:04 [auto1.be] INFO: Scrape type for CR22525: 0
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: HF54985
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: GH94733
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: CP91123
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP91123%27 HTTP/1.1" 200 None
2026-03-29 08:36:04 [auto1.be] INFO: Scrape type for CP91123: 0
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: FA30680
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: WL65720
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: KM67426
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: DM52841
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: YH09444
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: JP67733
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: RB53949
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB53949%27 HTTP/1.1" 200 None
2026-03-29 08:36:04 [auto1.be] INFO: Scrape type for RB53949: 2
2026-03-29 08:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b31cfe75-b57a-50f3-b353-36dc0366f07b with identifier: RB53949
2026-03-29 08:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b31cfe75-b57a-50f3-b353-36dc0366f07b with scrape type 2
2026-03-29 08:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b31cfe75-b57a-50f3-b353-36dc0366f07b with scrape type 2
2026-03-29 08:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b31cfe75-b57a-50f3-b353-36dc0366f07b, identifier: RB53949
2026-03-29 08:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b31cfe75-b57a-50f3-b353-36dc0366f07b with identifier: RB53949
2026-03-29 08:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b31cfe75-b57a-50f3-b353-36dc0366f07b with identifier: RB53949
2026-03-29 08:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b31cfe75-b57a-50f3-b353-36dc0366f07b with identifier: RB53949 to the API
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:26:20Z',
 'fuel_type': 'hybrid',
 'id': 'b31cfe75-b57a-50f3-b353-36dc0366f07b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB53949',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 127220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-26',
 'seller_name': None,
 'title': 'BMW 3er 320e Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2022}
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB53949%27 HTTP/1.1" 200 None
2026-03-29 08:36:04 [auto1.be] INFO: Saving data for RB53949: {'auction_closing_time': 1774884380.0, 'created_time': 1774557226.265258, 'last_price_update_time': 1774773364.677838}
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RB53949') HTTP/1.1" 204 0
2026-03-29 08:36:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: XD36076
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD36076%27 HTTP/1.1" 200 None
2026-03-29 08:36:04 [auto1.be] INFO: Scrape type for XD36076: 0
2026-03-29 08:36:04 [auto1.be] INFO: Found listing with ID: RK05604
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK05604%27 HTTP/1.1" 200 None
2026-03-29 08:36:04 [auto1.be] INFO: Scrape type for RK05604: 2
2026-03-29 08:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f30c28b3-8de6-5b14-9f0d-0220db214618 with identifier: RK05604
2026-03-29 08:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f30c28b3-8de6-5b14-9f0d-0220db214618 with scrape type 2
2026-03-29 08:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f30c28b3-8de6-5b14-9f0d-0220db214618 with scrape type 2
2026-03-29 08:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f30c28b3-8de6-5b14-9f0d-0220db214618, identifier: RK05604
2026-03-29 08:36:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f30c28b3-8de6-5b14-9f0d-0220db214618 with identifier: RK05604
2026-03-29 08:36:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f30c28b3-8de6-5b14-9f0d-0220db214618 with identifier: RK05604
2026-03-29 08:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f30c28b3-8de6-5b14-9f0d-0220db214618 with identifier: RK05604 to the API
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:40:36Z',
 'fuel_type': 'diesel',
 'id': 'f30c28b3-8de6-5b14-9f0d-0220db214618',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK05604',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 142442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-02',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI DPF Dynamic Start/Stop',
 'transmission': 'manual',
 'trim': 'Dynamic Start/Stop',
 'year': 2017}
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK05604%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [auto1.be] INFO: Saving data for RK05604: {'auction_closing_time': 1774885236.0, 'created_time': 1774557247.97669, 'last_price_update_time': 1774773365.300241}
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RK05604') HTTP/1.1" 204 0
2026-03-29 08:36:05 [auto1.be] INFO: Found listing with ID: WA39171
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA39171%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [auto1.be] INFO: Scrape type for WA39171: 0
2026-03-29 08:36:05 [auto1.be] INFO: Found listing with ID: AL21659
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AL21659%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [auto1.be] INFO: Scrape type for AL21659: 0
2026-03-29 08:36:05 [auto1.be] INFO: Found listing with ID: DC47068
2026-03-29 08:36:05 [auto1.be] INFO: Found listing with ID: ES19550
2026-03-29 08:36:05 [auto1.be] INFO: Found listing with ID: ZH14429
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH14429%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [auto1.be] INFO: Scrape type for ZH14429: 0
2026-03-29 08:36:05 [auto1.be] INFO: Found listing with ID: VV25356
2026-03-29 08:36:05 [auto1.be] INFO: Found listing with ID: GS99704
2026-03-29 08:36:05 [auto1.be] INFO: Found listing with ID: YJ44532
2026-03-29 08:36:05 [auto1.be] INFO: Found listing with ID: UD97693
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD97693%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [auto1.be] INFO: Scrape type for UD97693: 2
2026-03-29 08:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a99e162-f27d-56e2-a8f3-81cb4f738387 with identifier: UD97693
2026-03-29 08:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a99e162-f27d-56e2-a8f3-81cb4f738387 with scrape type 2
2026-03-29 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a99e162-f27d-56e2-a8f3-81cb4f738387 with scrape type 2
2026-03-29 08:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9a99e162-f27d-56e2-a8f3-81cb4f738387, identifier: UD97693
2026-03-29 08:36:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9a99e162-f27d-56e2-a8f3-81cb4f738387 with identifier: UD97693
2026-03-29 08:36:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9a99e162-f27d-56e2-a8f3-81cb4f738387 with identifier: UD97693
2026-03-29 08:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9a99e162-f27d-56e2-a8f3-81cb4f738387 with identifier: UD97693 to the API
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:50:14Z',
 'fuel_type': 'petrol',
 'id': '9a99e162-f27d-56e2-a8f3-81cb4f738387',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD97693',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 134582,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-26',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TFSI GTI "Performance" BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI "Performance" BlueMotion',
 'year': 2014}
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD97693%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [auto1.be] INFO: Saving data for UD97693: {'auction_closing_time': 1774885814.0, 'created_time': 1774557236.485623, 'last_price_update_time': 1774773365.788683}
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UD97693') HTTP/1.1" 204 0
2026-03-29 08:36:05 [auto1.be] INFO: Found listing with ID: VM79296
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM79296%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [auto1.be] INFO: Scrape type for VM79296: 0
2026-03-29 08:36:05 [auto1.be] INFO: Found listing with ID: YF30387
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF30387%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [auto1.be] INFO: Scrape type for YF30387: 0
2026-03-29 08:36:05 [auto1.be] INFO: Found listing with ID: NU98421
2026-03-29 08:36:05 [auto1.be] INFO: Found listing with ID: DY95002
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY95002%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [auto1.be] INFO: Scrape type for DY95002: 0
2026-03-29 08:36:05 [auto1.be] INFO: Found listing with ID: HL95749
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL95749%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [auto1.be] INFO: Scrape type for HL95749: 0
2026-03-29 08:36:05 [auto1.be] INFO: Found listing with ID: SA79242
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA79242%27 HTTP/1.1" 200 None
2026-03-29 08:36:05 [auto1.be] INFO: Scrape type for SA79242: 0
2026-03-29 08:36:05 [auto1.be] INFO: Found listing with ID: KF81819
2026-03-29 08:36:05 [auto1.be] INFO: Found listing with ID: WC10504
2026-03-29 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC10504%27 HTTP/1.1" 200 None
2026-03-29 08:36:06 [auto1.be] INFO: Scrape type for WC10504: 2
2026-03-29 08:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dff6dc5-220c-5482-a920-fa14a7a119fe with identifier: WC10504
2026-03-29 08:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dff6dc5-220c-5482-a920-fa14a7a119fe with scrape type 2
2026-03-29 08:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5dff6dc5-220c-5482-a920-fa14a7a119fe with scrape type 2
2026-03-29 08:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5dff6dc5-220c-5482-a920-fa14a7a119fe, identifier: WC10504
2026-03-29 08:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5dff6dc5-220c-5482-a920-fa14a7a119fe with identifier: WC10504
2026-03-29 08:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5dff6dc5-220c-5482-a920-fa14a7a119fe with identifier: WC10504
2026-03-29 08:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5dff6dc5-220c-5482-a920-fa14a7a119fe with identifier: WC10504 to the API
2026-03-29 08:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:22:49Z',
 'fuel_type': 'diesel',
 'id': '5dff6dc5-220c-5482-a920-fa14a7a119fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC10504',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 268796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-19',
 'seller_name': None,
 'title': 'Kia Sorento 2.5 CRDi Active Adventure',
 'transmission': 'manual',
 'trim': 'Active Adventure',
 'year': 2008}
2026-03-29 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC10504%27 HTTP/1.1" 200 None
2026-03-29 08:36:06 [auto1.be] INFO: Saving data for WC10504: {'auction_closing_time': 1774884169.0, 'created_time': 1774557240.030861, 'last_price_update_time': 1774773366.418368}
2026-03-29 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WC10504') HTTP/1.1" 204 0
2026-03-29 08:36:06 [auto1.be] INFO: Found listing with ID: KU12802
2026-03-29 08:36:06 [auto1.be] INFO: Found listing with ID: CE58685
2026-03-29 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE58685%27 HTTP/1.1" 200 None
2026-03-29 08:36:06 [auto1.be] INFO: Scrape type for CE58685: 0
2026-03-29 08:36:06 [auto1.be] INFO: Found listing with ID: YH98972
2026-03-29 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH98972%27 HTTP/1.1" 200 None
2026-03-29 08:36:06 [auto1.be] INFO: Scrape type for YH98972: 0
2026-03-29 08:36:06 [scrapy.extensions.logstats] INFO: Crawled 79 pages (at 47 pages/min), scraped 116 items (at 82 items/min)
2026-03-29 08:36:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-29 08:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:07 [auto1.be] INFO: Channel: 24h | Page: 18 | totalHits: 1252 | hits on page: 40
2026-03-29 08:36:07 [auto1.be] INFO: Found listing with ID: BJ55526
2026-03-29 08:36:07 [auto1.be] INFO: Found listing with ID: GP50240
2026-03-29 08:36:07 [auto1.be] INFO: Found listing with ID: SR93497
2026-03-29 08:36:07 [auto1.be] INFO: Found listing with ID: GN45273
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN45273%27 HTTP/1.1" 200 None
2026-03-29 08:36:07 [auto1.be] INFO: Scrape type for GN45273: 0
2026-03-29 08:36:07 [auto1.be] INFO: Found listing with ID: TW22956
2026-03-29 08:36:07 [auto1.be] INFO: Found listing with ID: AE23838
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE23838%27 HTTP/1.1" 200 None
2026-03-29 08:36:07 [auto1.be] INFO: Scrape type for AE23838: 0
2026-03-29 08:36:07 [auto1.be] INFO: Found listing with ID: MF96479
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MF96479%27 HTTP/1.1" 200 None
2026-03-29 08:36:07 [auto1.be] INFO: Scrape type for MF96479: 0
2026-03-29 08:36:07 [auto1.be] INFO: Found listing with ID: WD60187
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD60187%27 HTTP/1.1" 200 None
2026-03-29 08:36:07 [auto1.be] INFO: Scrape type for WD60187: 0
2026-03-29 08:36:07 [auto1.be] INFO: Found listing with ID: KF59500
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF59500%27 HTTP/1.1" 200 None
2026-03-29 08:36:07 [auto1.be] INFO: Scrape type for KF59500: 0
2026-03-29 08:36:07 [auto1.be] INFO: Found listing with ID: ZT52703
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZT52703%27 HTTP/1.1" 200 None
2026-03-29 08:36:07 [auto1.be] INFO: Scrape type for ZT52703: 0
2026-03-29 08:36:07 [auto1.be] INFO: Found listing with ID: ZR52684
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR52684%27 HTTP/1.1" 200 None
2026-03-29 08:36:07 [auto1.be] INFO: Scrape type for ZR52684: 0
2026-03-29 08:36:07 [auto1.be] INFO: Found listing with ID: GP69185
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP69185%27 HTTP/1.1" 200 None
2026-03-29 08:36:07 [auto1.be] INFO: Scrape type for GP69185: 0
2026-03-29 08:36:07 [auto1.be] INFO: Found listing with ID: DF09339
2026-03-29 08:36:07 [auto1.be] INFO: Found listing with ID: LY80968
2026-03-29 08:36:07 [auto1.be] INFO: Found listing with ID: CN47453
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN47453%27 HTTP/1.1" 200 None
2026-03-29 08:36:07 [auto1.be] INFO: Scrape type for CN47453: 0
2026-03-29 08:36:07 [auto1.be] INFO: Found listing with ID: BX96549
2026-03-29 08:36:07 [auto1.be] INFO: Found listing with ID: LM94739
2026-03-29 08:36:07 [auto1.be] INFO: Found listing with ID: UT35373
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT35373%27 HTTP/1.1" 200 None
2026-03-29 08:36:07 [auto1.be] INFO: Scrape type for UT35373: 2
2026-03-29 08:36:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41313130-d5aa-5e0f-860b-8946e4f59d87 with identifier: UT35373
2026-03-29 08:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41313130-d5aa-5e0f-860b-8946e4f59d87 with scrape type 2
2026-03-29 08:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41313130-d5aa-5e0f-860b-8946e4f59d87 with scrape type 2
2026-03-29 08:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 41313130-d5aa-5e0f-860b-8946e4f59d87, identifier: UT35373
2026-03-29 08:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 41313130-d5aa-5e0f-860b-8946e4f59d87 with identifier: UT35373
2026-03-29 08:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 41313130-d5aa-5e0f-860b-8946e4f59d87 with identifier: UT35373
2026-03-29 08:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 41313130-d5aa-5e0f-860b-8946e4f59d87 with identifier: UT35373 to the API
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 394,
 'expiration_date': '2026-03-30T15:52:51Z',
 'fuel_type': 'hybrid',
 'id': '41313130-d5aa-5e0f-860b-8946e4f59d87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT35373',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 223799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-20',
 'seller_name': None,
 'title': 'BMW X5 xDrive 45e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT35373%27 HTTP/1.1" 200 None
2026-03-29 08:36:08 [auto1.be] INFO: Saving data for UT35373: {'auction_closing_time': 1774885971.0, 'created_time': 1773237128.54277, 'last_price_update_time': 1774773368.08438}
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UT35373') HTTP/1.1" 204 0
2026-03-29 08:36:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:08 [auto1.be] INFO: Found listing with ID: KW15988
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW15988%27 HTTP/1.1" 200 None
2026-03-29 08:36:08 [auto1.be] INFO: Scrape type for KW15988: 0
2026-03-29 08:36:08 [auto1.be] INFO: Found listing with ID: ZR23499
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR23499%27 HTTP/1.1" 200 None
2026-03-29 08:36:08 [auto1.be] INFO: Scrape type for ZR23499: 0
2026-03-29 08:36:08 [auto1.be] INFO: Found listing with ID: YR29884
2026-03-29 08:36:08 [auto1.be] INFO: Found listing with ID: NK28391
2026-03-29 08:36:08 [auto1.be] INFO: Found listing with ID: KF50538
2026-03-29 08:36:08 [auto1.be] INFO: Found listing with ID: ZR56949
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR56949%27 HTTP/1.1" 200 None
2026-03-29 08:36:08 [auto1.be] INFO: Scrape type for ZR56949: 0
2026-03-29 08:36:08 [auto1.be] INFO: Found listing with ID: MA06269
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA06269%27 HTTP/1.1" 200 None
2026-03-29 08:36:08 [auto1.be] INFO: Scrape type for MA06269: 0
2026-03-29 08:36:08 [auto1.be] INFO: Found listing with ID: VZ78935
2026-03-29 08:36:08 [auto1.be] INFO: Found listing with ID: YU72813
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU72813%27 HTTP/1.1" 200 None
2026-03-29 08:36:08 [auto1.be] INFO: Scrape type for YU72813: 0
2026-03-29 08:36:08 [auto1.be] INFO: Found listing with ID: CB53563
2026-03-29 08:36:08 [auto1.be] INFO: Found listing with ID: NR94896
2026-03-29 08:36:08 [auto1.be] INFO: Found listing with ID: GW69223
2026-03-29 08:36:08 [auto1.be] INFO: Found listing with ID: BV56621
2026-03-29 08:36:08 [auto1.be] INFO: Found listing with ID: CM40127
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM40127%27 HTTP/1.1" 200 None
2026-03-29 08:36:08 [auto1.be] INFO: Scrape type for CM40127: 0
2026-03-29 08:36:08 [auto1.be] INFO: Found listing with ID: UB84592
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB84592%27 HTTP/1.1" 200 None
2026-03-29 08:36:08 [auto1.be] INFO: Scrape type for UB84592: 0
2026-03-29 08:36:08 [auto1.be] INFO: Found listing with ID: HT96077
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT96077%27 HTTP/1.1" 200 None
2026-03-29 08:36:08 [auto1.be] INFO: Scrape type for HT96077: 0
2026-03-29 08:36:08 [auto1.be] INFO: Found listing with ID: LE55631
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE55631%27 HTTP/1.1" 200 None
2026-03-29 08:36:08 [auto1.be] INFO: Scrape type for LE55631: 0
2026-03-29 08:36:08 [auto1.be] INFO: Found listing with ID: AK84541
2026-03-29 08:36:08 [auto1.be] INFO: Found listing with ID: PM96543
2026-03-29 08:36:08 [auto1.be] INFO: Found listing with ID: KF52558
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF52558%27 HTTP/1.1" 200 None
2026-03-29 08:36:08 [auto1.be] INFO: Scrape type for KF52558: 0
2026-03-29 08:36:08 [auto1.be] INFO: Found listing with ID: NM84060
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM84060%27 HTTP/1.1" 200 None
2026-03-29 08:36:08 [auto1.be] INFO: Scrape type for NM84060: 0
2026-03-29 08:36:08 [auto1.be] INFO: Found listing with ID: TW64249
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW64249%27 HTTP/1.1" 200 None
2026-03-29 08:36:08 [auto1.be] INFO: Scrape type for TW64249: 0
2026-03-29 08:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:09 [auto1.be] INFO: Channel: 24h | Page: 19 | totalHits: 1252 | hits on page: 40
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: XE64009
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: KU26204
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: ZN66630
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: PY81659
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY81659%27 HTTP/1.1" 200 None
2026-03-29 08:36:09 [auto1.be] INFO: Scrape type for PY81659: 0
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: ZG50395
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: TM97404
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: UV50609
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV50609%27 HTTP/1.1" 200 None
2026-03-29 08:36:09 [auto1.be] INFO: Scrape type for UV50609: 0
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: ZZ47044
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: UT04463
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: WK14396
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK14396%27 HTTP/1.1" 200 None
2026-03-29 08:36:09 [auto1.be] INFO: Scrape type for WK14396: 0
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: WE53696
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: RW49064
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW49064%27 HTTP/1.1" 200 None
2026-03-29 08:36:09 [auto1.be] INFO: Scrape type for RW49064: 0
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: NP69529
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: WU38196
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: ZL81412
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL81412%27 HTTP/1.1" 200 None
2026-03-29 08:36:09 [auto1.be] INFO: Scrape type for ZL81412: 0
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: FC74189
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: CS98471
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS98471%27 HTTP/1.1" 200 None
2026-03-29 08:36:09 [auto1.be] INFO: Scrape type for CS98471: 0
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: KC69840
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC69840%27 HTTP/1.1" 200 None
2026-03-29 08:36:09 [auto1.be] INFO: Scrape type for KC69840: 0
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: ZR84759
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR84759%27 HTTP/1.1" 200 None
2026-03-29 08:36:09 [auto1.be] INFO: Scrape type for ZR84759: 0
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: WG89987
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG89987%27 HTTP/1.1" 200 None
2026-03-29 08:36:09 [auto1.be] INFO: Scrape type for WG89987: 0
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: FE56390
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: BR84638
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: WC98842
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC98842%27 HTTP/1.1" 200 None
2026-03-29 08:36:09 [auto1.be] INFO: Scrape type for WC98842: 0
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: VM06685
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM06685%27 HTTP/1.1" 200 None
2026-03-29 08:36:09 [auto1.be] INFO: Scrape type for VM06685: 0
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: TS87931
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS87931%27 HTTP/1.1" 200 None
2026-03-29 08:36:09 [auto1.be] INFO: Scrape type for TS87931: 0
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: UL72077
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: VZ08217
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: UJ89543
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ89543%27 HTTP/1.1" 200 None
2026-03-29 08:36:09 [auto1.be] INFO: Scrape type for UJ89543: 0
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: SZ60181
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ60181%27 HTTP/1.1" 200 None
2026-03-29 08:36:09 [auto1.be] INFO: Scrape type for SZ60181: 0
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: JZ97752
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ97752%27 HTTP/1.1" 200 None
2026-03-29 08:36:09 [auto1.be] INFO: Scrape type for JZ97752: 0
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: YL00049
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: SF38570
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF38570%27 HTTP/1.1" 200 None
2026-03-29 08:36:09 [auto1.be] INFO: Scrape type for SF38570: 0
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: CG91643
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG91643%27 HTTP/1.1" 200 None
2026-03-29 08:36:09 [auto1.be] INFO: Scrape type for CG91643: 0
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: CP13942
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: RE48196
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: MS23670
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS23670%27 HTTP/1.1" 200 None
2026-03-29 08:36:09 [auto1.be] INFO: Scrape type for MS23670: 0
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: CU40853
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU40853%27 HTTP/1.1" 200 None
2026-03-29 08:36:09 [auto1.be] INFO: Scrape type for CU40853: 0
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: VA59143
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: PR31064
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR31064%27 HTTP/1.1" 200 None
2026-03-29 08:36:09 [auto1.be] INFO: Scrape type for PR31064: 0
2026-03-29 08:36:09 [auto1.be] INFO: Found listing with ID: KC33551
2026-03-29 08:36:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:11 [auto1.be] INFO: Channel: 24h | Page: 20 | totalHits: 1252 | hits on page: 40
2026-03-29 08:36:11 [auto1.be] INFO: Found listing with ID: CE65833
2026-03-29 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE65833%27 HTTP/1.1" 200 None
2026-03-29 08:36:11 [auto1.be] INFO: Scrape type for CE65833: 0
2026-03-29 08:36:11 [auto1.be] INFO: Found listing with ID: VA87646
2026-03-29 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA87646%27 HTTP/1.1" 200 None
2026-03-29 08:36:11 [auto1.be] INFO: Scrape type for VA87646: 0
2026-03-29 08:36:11 [auto1.be] INFO: Found listing with ID: RA65802
2026-03-29 08:36:11 [auto1.be] INFO: Found listing with ID: MJ08102
2026-03-29 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ08102%27 HTTP/1.1" 200 None
2026-03-29 08:36:11 [auto1.be] INFO: Scrape type for MJ08102: 2
2026-03-29 08:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00232223-a846-5900-9a5b-3db495a38efc with identifier: MJ08102
2026-03-29 08:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00232223-a846-5900-9a5b-3db495a38efc with scrape type 2
2026-03-29 08:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00232223-a846-5900-9a5b-3db495a38efc with scrape type 2
2026-03-29 08:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 00232223-a846-5900-9a5b-3db495a38efc, identifier: MJ08102
2026-03-29 08:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 00232223-a846-5900-9a5b-3db495a38efc with identifier: MJ08102
2026-03-29 08:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 00232223-a846-5900-9a5b-3db495a38efc with identifier: MJ08102
2026-03-29 08:36:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 00232223-a846-5900-9a5b-3db495a38efc with identifier: MJ08102 to the API
2026-03-29 08:36:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:57:48Z',
 'fuel_type': 'diesel',
 'id': '00232223-a846-5900-9a5b-3db495a38efc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ08102',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 320259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-12',
 'seller_name': None,
 'title': 'Citroen C4 1.6 Blue-HDi Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2017}
2026-03-29 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ08102%27 HTTP/1.1" 200 None
2026-03-29 08:36:11 [auto1.be] INFO: Saving data for MJ08102: {'auction_closing_time': 1774886268.0, 'created_time': 1774600269.800273, 'last_price_update_time': 1774773371.573252}
2026-03-29 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MJ08102') HTTP/1.1" 204 0
2026-03-29 08:36:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:11 [auto1.be] INFO: Found listing with ID: CF04837
2026-03-29 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF04837%27 HTTP/1.1" 200 None
2026-03-29 08:36:11 [auto1.be] INFO: Scrape type for CF04837: 2
2026-03-29 08:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30986abb-ad7c-5ee6-95f7-7b9cf351f8c0 with identifier: CF04837
2026-03-29 08:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30986abb-ad7c-5ee6-95f7-7b9cf351f8c0 with scrape type 2
2026-03-29 08:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30986abb-ad7c-5ee6-95f7-7b9cf351f8c0 with scrape type 2
2026-03-29 08:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 30986abb-ad7c-5ee6-95f7-7b9cf351f8c0, identifier: CF04837
2026-03-29 08:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 30986abb-ad7c-5ee6-95f7-7b9cf351f8c0 with identifier: CF04837
2026-03-29 08:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 30986abb-ad7c-5ee6-95f7-7b9cf351f8c0 with identifier: CF04837
2026-03-29 08:36:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 30986abb-ad7c-5ee6-95f7-7b9cf351f8c0 with identifier: CF04837 to the API
2026-03-29 08:36:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-30T15:38:45Z',
 'fuel_type': 'hybrid',
 'id': '30986abb-ad7c-5ee6-95f7-7b9cf351f8c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF04837',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 54083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-11',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Plug-in Hybrid 4WD',
 'transmission': 'automatic',
 'trim': '4WD',
 'year': 2021}
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF04837%27 HTTP/1.1" 200 None
2026-03-29 08:36:12 [auto1.be] INFO: Saving data for CF04837: {'auction_closing_time': 1774885125.0, 'created_time': 1774557210.236662, 'last_price_update_time': 1774773372.073345}
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CF04837') HTTP/1.1" 204 0
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: TS87416
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS87416%27 HTTP/1.1" 200 None
2026-03-29 08:36:12 [auto1.be] INFO: Scrape type for TS87416: 0
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: YB94076
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB94076%27 HTTP/1.1" 200 None
2026-03-29 08:36:12 [auto1.be] INFO: Scrape type for YB94076: 0
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: JM27578
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM27578%27 HTTP/1.1" 200 None
2026-03-29 08:36:12 [auto1.be] INFO: Scrape type for JM27578: 0
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: ZA01438
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: VJ27978
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: DF96327
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF96327%27 HTTP/1.1" 200 None
2026-03-29 08:36:12 [auto1.be] INFO: Scrape type for DF96327: 0
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: MC94265
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC94265%27 HTTP/1.1" 200 None
2026-03-29 08:36:12 [auto1.be] INFO: Scrape type for MC94265: 0
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: VP90118
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP90118%27 HTTP/1.1" 200 None
2026-03-29 08:36:12 [auto1.be] INFO: Scrape type for VP90118: 0
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: PY58607
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: PK93774
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK93774%27 HTTP/1.1" 200 None
2026-03-29 08:36:12 [auto1.be] INFO: Scrape type for PK93774: 0
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: BT72678
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT72678%27 HTTP/1.1" 200 None
2026-03-29 08:36:12 [auto1.be] INFO: Scrape type for BT72678: 0
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: TK06008
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK06008%27 HTTP/1.1" 200 None
2026-03-29 08:36:12 [auto1.be] INFO: Scrape type for TK06008: 0
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: VP91071
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: NM63028
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM63028%27 HTTP/1.1" 200 None
2026-03-29 08:36:12 [auto1.be] INFO: Scrape type for NM63028: 0
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: JY53618
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: VB55746
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: GS48835
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS48835%27 HTTP/1.1" 200 None
2026-03-29 08:36:12 [auto1.be] INFO: Scrape type for GS48835: 0
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: FA63464
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA63464%27 HTTP/1.1" 200 None
2026-03-29 08:36:12 [auto1.be] INFO: Scrape type for FA63464: 0
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: XA29570
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: MG12074
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: YD21406
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YD21406%27 HTTP/1.1" 200 None
2026-03-29 08:36:12 [auto1.be] INFO: Scrape type for YD21406: 0
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: XJ95743
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ95743%27 HTTP/1.1" 200 None
2026-03-29 08:36:12 [auto1.be] INFO: Scrape type for XJ95743: 0
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: DB02418
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB02418%27 HTTP/1.1" 200 None
2026-03-29 08:36:12 [auto1.be] INFO: Scrape type for DB02418: 0
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: XT36171
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT36171%27 HTTP/1.1" 200 None
2026-03-29 08:36:12 [auto1.be] INFO: Scrape type for XT36171: 0
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: MC66522
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC66522%27 HTTP/1.1" 200 None
2026-03-29 08:36:12 [auto1.be] INFO: Scrape type for MC66522: 0
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: ZK00678
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK00678%27 HTTP/1.1" 200 None
2026-03-29 08:36:12 [auto1.be] INFO: Scrape type for ZK00678: 0
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: DE33834
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: HH62001
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH62001%27 HTTP/1.1" 200 None
2026-03-29 08:36:12 [auto1.be] INFO: Scrape type for HH62001: 0
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: WF76478
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WF76478%27 HTTP/1.1" 200 None
2026-03-29 08:36:12 [auto1.be] INFO: Scrape type for WF76478: 0
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: SC59712
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: XH49609
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: SU72836
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU72836%27 HTTP/1.1" 200 None
2026-03-29 08:36:12 [auto1.be] INFO: Scrape type for SU72836: 0
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: ME81448
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ME81448%27 HTTP/1.1" 200 None
2026-03-29 08:36:12 [auto1.be] INFO: Scrape type for ME81448: 0
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: GV27154
2026-03-29 08:36:12 [auto1.be] INFO: Found listing with ID: XC10139
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC10139%27 HTTP/1.1" 200 None
2026-03-29 08:36:12 [auto1.be] INFO: Scrape type for XC10139: 0
2026-03-29 08:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:13 [auto1.be] INFO: Channel: 24h | Page: 21 | totalHits: 1252 | hits on page: 40
2026-03-29 08:36:13 [auto1.be] INFO: Found listing with ID: JS25395
2026-03-29 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS25395%27 HTTP/1.1" 200 None
2026-03-29 08:36:13 [auto1.be] INFO: Scrape type for JS25395: 0
2026-03-29 08:36:13 [auto1.be] INFO: Found listing with ID: RL32581
2026-03-29 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL32581%27 HTTP/1.1" 200 None
2026-03-29 08:36:13 [auto1.be] INFO: Scrape type for RL32581: 0
2026-03-29 08:36:13 [auto1.be] INFO: Found listing with ID: GA09150
2026-03-29 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GA09150%27 HTTP/1.1" 200 None
2026-03-29 08:36:13 [auto1.be] INFO: Scrape type for GA09150: 0
2026-03-29 08:36:13 [auto1.be] INFO: Found listing with ID: BN53670
2026-03-29 08:36:13 [auto1.be] INFO: Found listing with ID: CR21244
2026-03-29 08:36:13 [auto1.be] INFO: Found listing with ID: FY43318
2026-03-29 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY43318%27 HTTP/1.1" 200 None
2026-03-29 08:36:13 [auto1.be] INFO: Scrape type for FY43318: 0
2026-03-29 08:36:13 [auto1.be] INFO: Found listing with ID: FR80699
2026-03-29 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR80699%27 HTTP/1.1" 200 None
2026-03-29 08:36:13 [auto1.be] INFO: Scrape type for FR80699: 0
2026-03-29 08:36:13 [auto1.be] INFO: Found listing with ID: NM33768
2026-03-29 08:36:13 [auto1.be] INFO: Found listing with ID: ZX33086
2026-03-29 08:36:13 [auto1.be] INFO: Found listing with ID: BP38818
2026-03-29 08:36:13 [auto1.be] INFO: Found listing with ID: XT87195
2026-03-29 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT87195%27 HTTP/1.1" 200 None
2026-03-29 08:36:13 [auto1.be] INFO: Scrape type for XT87195: 2
2026-03-29 08:36:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8221b10a-9513-5872-a7dc-0ec12cdc3467 with identifier: XT87195
2026-03-29 08:36:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8221b10a-9513-5872-a7dc-0ec12cdc3467 with scrape type 2
2026-03-29 08:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8221b10a-9513-5872-a7dc-0ec12cdc3467 with scrape type 2
2026-03-29 08:36:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8221b10a-9513-5872-a7dc-0ec12cdc3467, identifier: XT87195
2026-03-29 08:36:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8221b10a-9513-5872-a7dc-0ec12cdc3467 with identifier: XT87195
2026-03-29 08:36:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8221b10a-9513-5872-a7dc-0ec12cdc3467 with identifier: XT87195
2026-03-29 08:36:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8221b10a-9513-5872-a7dc-0ec12cdc3467 with identifier: XT87195 to the API
2026-03-29 08:36:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:32:06Z',
 'fuel_type': 'petrol',
 'id': '8221b10a-9513-5872-a7dc-0ec12cdc3467',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT87195',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'B-Max',
 'odometer': 24623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-02',
 'seller_name': None,
 'title': 'Ford B-Max 1.0 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2012}
2026-03-29 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT87195%27 HTTP/1.1" 200 None
2026-03-29 08:36:13 [auto1.be] INFO: Saving data for XT87195: {'auction_closing_time': 1774884726.0, 'created_time': 1773434044.28735, 'last_price_update_time': 1774773373.935786}
2026-03-29 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XT87195') HTTP/1.1" 204 0
2026-03-29 08:36:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: KP16725
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP16725%27 HTTP/1.1" 200 None
2026-03-29 08:36:14 [auto1.be] INFO: Scrape type for KP16725: 0
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: GS68920
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: WP21428
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP21428%27 HTTP/1.1" 200 None
2026-03-29 08:36:14 [auto1.be] INFO: Scrape type for WP21428: 0
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: XC64567
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC64567%27 HTTP/1.1" 200 None
2026-03-29 08:36:14 [auto1.be] INFO: Scrape type for XC64567: 0
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: AU41446
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: NJ59863
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: EX63844
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX63844%27 HTTP/1.1" 200 None
2026-03-29 08:36:14 [auto1.be] INFO: Scrape type for EX63844: 0
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: XB11874
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: VA07887
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA07887%27 HTTP/1.1" 200 None
2026-03-29 08:36:14 [auto1.be] INFO: Scrape type for VA07887: 0
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: FJ79675
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ79675%27 HTTP/1.1" 200 None
2026-03-29 08:36:14 [auto1.be] INFO: Scrape type for FJ79675: 0
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: XT90325
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT90325%27 HTTP/1.1" 200 None
2026-03-29 08:36:14 [auto1.be] INFO: Scrape type for XT90325: 0
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: CS46585
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS46585%27 HTTP/1.1" 200 None
2026-03-29 08:36:14 [auto1.be] INFO: Scrape type for CS46585: 0
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: CG39340
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG39340%27 HTTP/1.1" 200 None
2026-03-29 08:36:14 [auto1.be] INFO: Scrape type for CG39340: 0
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: MX90898
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: LP39108
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP39108%27 HTTP/1.1" 200 None
2026-03-29 08:36:14 [auto1.be] INFO: Scrape type for LP39108: 0
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: NZ84501
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: LM00165
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM00165%27 HTTP/1.1" 200 None
2026-03-29 08:36:14 [auto1.be] INFO: Scrape type for LM00165: 0
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: LF23330
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: GH45635
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: SC36479
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC36479%27 HTTP/1.1" 200 None
2026-03-29 08:36:14 [auto1.be] INFO: Scrape type for SC36479: 0
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: AB25804
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: TX85632
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX85632%27 HTTP/1.1" 200 None
2026-03-29 08:36:14 [auto1.be] INFO: Scrape type for TX85632: 0
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: AD33980
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: CH34151
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH34151%27 HTTP/1.1" 200 None
2026-03-29 08:36:14 [auto1.be] INFO: Scrape type for CH34151: 0
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: VP78411
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP78411%27 HTTP/1.1" 200 None
2026-03-29 08:36:14 [auto1.be] INFO: Scrape type for VP78411: 0
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: DM43787
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM43787%27 HTTP/1.1" 200 None
2026-03-29 08:36:14 [auto1.be] INFO: Scrape type for DM43787: 0
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: SA37733
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA37733%27 HTTP/1.1" 200 None
2026-03-29 08:36:14 [auto1.be] INFO: Scrape type for SA37733: 0
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: ED59297
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED59297%27 HTTP/1.1" 200 None
2026-03-29 08:36:14 [auto1.be] INFO: Scrape type for ED59297: 0
2026-03-29 08:36:14 [auto1.be] INFO: Found listing with ID: SL51907
2026-03-29 08:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:15 [auto1.be] INFO: Channel: 24h | Page: 22 | totalHits: 1252 | hits on page: 40
2026-03-29 08:36:15 [auto1.be] INFO: Found listing with ID: DU38710
2026-03-29 08:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DU38710%27 HTTP/1.1" 200 None
2026-03-29 08:36:15 [auto1.be] INFO: Scrape type for DU38710: 0
2026-03-29 08:36:15 [auto1.be] INFO: Found listing with ID: JC93215
2026-03-29 08:36:15 [auto1.be] INFO: Found listing with ID: TD70367
2026-03-29 08:36:15 [auto1.be] INFO: Found listing with ID: YK80434
2026-03-29 08:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK80434%27 HTTP/1.1" 200 None
2026-03-29 08:36:15 [auto1.be] INFO: Scrape type for YK80434: 0
2026-03-29 08:36:15 [auto1.be] INFO: Found listing with ID: VZ63754
2026-03-29 08:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ63754%27 HTTP/1.1" 200 None
2026-03-29 08:36:15 [auto1.be] INFO: Scrape type for VZ63754: 2
2026-03-29 08:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b64282ab-f6df-5cfe-9a69-a4be1e74ae50 with identifier: VZ63754
2026-03-29 08:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b64282ab-f6df-5cfe-9a69-a4be1e74ae50 with scrape type 2
2026-03-29 08:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b64282ab-f6df-5cfe-9a69-a4be1e74ae50 with scrape type 2
2026-03-29 08:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b64282ab-f6df-5cfe-9a69-a4be1e74ae50, identifier: VZ63754
2026-03-29 08:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b64282ab-f6df-5cfe-9a69-a4be1e74ae50 with identifier: VZ63754
2026-03-29 08:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b64282ab-f6df-5cfe-9a69-a4be1e74ae50 with identifier: VZ63754
2026-03-29 08:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b64282ab-f6df-5cfe-9a69-a4be1e74ae50 with identifier: VZ63754 to the API
2026-03-29 08:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:30:40Z',
 'fuel_type': 'diesel',
 'id': 'b64282ab-f6df-5cfe-9a69-a4be1e74ae50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ63754',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 265866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-30',
 'seller_name': None,
 'title': 'Volvo V70 2.0 D4 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2014}
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ63754%27 HTTP/1.1" 200 None
2026-03-29 08:36:16 [auto1.be] INFO: Saving data for VZ63754: {'auction_closing_time': 1774884640.0, 'created_time': 1774600273.578802, 'last_price_update_time': 1774773376.661259}
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VZ63754') HTTP/1.1" 204 0
2026-03-29 08:36:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:16 [auto1.be] INFO: Found listing with ID: TU11660
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU11660%27 HTTP/1.1" 200 None
2026-03-29 08:36:16 [auto1.be] INFO: Scrape type for TU11660: 0
2026-03-29 08:36:16 [auto1.be] INFO: Found listing with ID: JW78855
2026-03-29 08:36:16 [auto1.be] INFO: Found listing with ID: LP97900
2026-03-29 08:36:16 [auto1.be] INFO: Found listing with ID: LP07116
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP07116%27 HTTP/1.1" 200 None
2026-03-29 08:36:16 [auto1.be] INFO: Scrape type for LP07116: 0
2026-03-29 08:36:16 [auto1.be] INFO: Found listing with ID: RX86056
2026-03-29 08:36:16 [auto1.be] INFO: Found listing with ID: AW74184
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AW74184%27 HTTP/1.1" 200 None
2026-03-29 08:36:16 [auto1.be] INFO: Scrape type for AW74184: 0
2026-03-29 08:36:16 [auto1.be] INFO: Found listing with ID: BK01349
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BK01349%27 HTTP/1.1" 200 None
2026-03-29 08:36:16 [auto1.be] INFO: Scrape type for BK01349: 0
2026-03-29 08:36:16 [auto1.be] INFO: Found listing with ID: BA37972
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA37972%27 HTTP/1.1" 200 None
2026-03-29 08:36:16 [auto1.be] INFO: Scrape type for BA37972: 0
2026-03-29 08:36:16 [auto1.be] INFO: Found listing with ID: XL43279
2026-03-29 08:36:16 [auto1.be] INFO: Found listing with ID: SC85120
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC85120%27 HTTP/1.1" 200 None
2026-03-29 08:36:16 [auto1.be] INFO: Scrape type for SC85120: 0
2026-03-29 08:36:16 [auto1.be] INFO: Found listing with ID: TW09601
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW09601%27 HTTP/1.1" 200 None
2026-03-29 08:36:16 [auto1.be] INFO: Scrape type for TW09601: 0
2026-03-29 08:36:16 [auto1.be] INFO: Found listing with ID: TZ99758
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TZ99758%27 HTTP/1.1" 200 None
2026-03-29 08:36:16 [auto1.be] INFO: Scrape type for TZ99758: 2
2026-03-29 08:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e26ae23-3dfe-5205-8b2f-9f7e92de5b18 with identifier: TZ99758
2026-03-29 08:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e26ae23-3dfe-5205-8b2f-9f7e92de5b18 with scrape type 2
2026-03-29 08:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e26ae23-3dfe-5205-8b2f-9f7e92de5b18 with scrape type 2
2026-03-29 08:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2e26ae23-3dfe-5205-8b2f-9f7e92de5b18, identifier: TZ99758
2026-03-29 08:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2e26ae23-3dfe-5205-8b2f-9f7e92de5b18 with identifier: TZ99758
2026-03-29 08:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2e26ae23-3dfe-5205-8b2f-9f7e92de5b18 with identifier: TZ99758
2026-03-29 08:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2e26ae23-3dfe-5205-8b2f-9f7e92de5b18 with identifier: TZ99758 to the API
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:52:58Z',
 'fuel_type': 'diesel',
 'id': '2e26ae23-3dfe-5205-8b2f-9f7e92de5b18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ99758',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 95081,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-31',
 'seller_name': None,
 'title': 'Land Rover Evoque D165 Mild-Hybrid R-Dynamic S',
 'transmission': 'automatic',
 'trim': 'R-Dynamic S',
 'year': 2021}
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TZ99758%27 HTTP/1.1" 200 None
2026-03-29 08:36:17 [auto1.be] INFO: Saving data for TZ99758: {'auction_closing_time': 1774885978.0, 'created_time': 1774600286.277373, 'last_price_update_time': 1774773377.297004}
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TZ99758') HTTP/1.1" 204 0
2026-03-29 08:36:17 [auto1.be] INFO: Found listing with ID: RH32729
2026-03-29 08:36:17 [auto1.be] INFO: Found listing with ID: UU12218
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU12218%27 HTTP/1.1" 200 None
2026-03-29 08:36:17 [auto1.be] INFO: Scrape type for UU12218: 0
2026-03-29 08:36:17 [auto1.be] INFO: Found listing with ID: LT47332
2026-03-29 08:36:17 [auto1.be] INFO: Found listing with ID: DY28234
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY28234%27 HTTP/1.1" 200 None
2026-03-29 08:36:17 [auto1.be] INFO: Scrape type for DY28234: 0
2026-03-29 08:36:17 [auto1.be] INFO: Found listing with ID: WS04459
2026-03-29 08:36:17 [auto1.be] INFO: Found listing with ID: KS43499
2026-03-29 08:36:17 [auto1.be] INFO: Found listing with ID: PB25162
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB25162%27 HTTP/1.1" 200 None
2026-03-29 08:36:17 [auto1.be] INFO: Scrape type for PB25162: 0
2026-03-29 08:36:17 [auto1.be] INFO: Found listing with ID: UA44051
2026-03-29 08:36:17 [auto1.be] INFO: Found listing with ID: PY12122
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY12122%27 HTTP/1.1" 200 None
2026-03-29 08:36:17 [auto1.be] INFO: Scrape type for PY12122: 0
2026-03-29 08:36:17 [auto1.be] INFO: Found listing with ID: BZ65544
2026-03-29 08:36:17 [auto1.be] INFO: Found listing with ID: HZ19238
2026-03-29 08:36:17 [auto1.be] INFO: Found listing with ID: KU11213
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU11213%27 HTTP/1.1" 200 None
2026-03-29 08:36:17 [auto1.be] INFO: Scrape type for KU11213: 0
2026-03-29 08:36:17 [auto1.be] INFO: Found listing with ID: DC17534
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC17534%27 HTTP/1.1" 200 None
2026-03-29 08:36:17 [auto1.be] INFO: Scrape type for DC17534: 0
2026-03-29 08:36:17 [auto1.be] INFO: Found listing with ID: AT20959
2026-03-29 08:36:17 [auto1.be] INFO: Found listing with ID: JM34078
2026-03-29 08:36:17 [auto1.be] INFO: Found listing with ID: WP69561
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP69561%27 HTTP/1.1" 200 None
2026-03-29 08:36:17 [auto1.be] INFO: Scrape type for WP69561: 0
2026-03-29 08:36:17 [auto1.be] INFO: Found listing with ID: YS56392
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS56392%27 HTTP/1.1" 200 None
2026-03-29 08:36:17 [auto1.be] INFO: Scrape type for YS56392: 2
2026-03-29 08:36:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edcc5390-50a7-54b2-ad24-fd722dbd2608 with identifier: YS56392
2026-03-29 08:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edcc5390-50a7-54b2-ad24-fd722dbd2608 with scrape type 2
2026-03-29 08:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edcc5390-50a7-54b2-ad24-fd722dbd2608 with scrape type 2
2026-03-29 08:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: edcc5390-50a7-54b2-ad24-fd722dbd2608, identifier: YS56392
2026-03-29 08:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: edcc5390-50a7-54b2-ad24-fd722dbd2608 with identifier: YS56392
2026-03-29 08:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: edcc5390-50a7-54b2-ad24-fd722dbd2608 with identifier: YS56392
2026-03-29 08:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: edcc5390-50a7-54b2-ad24-fd722dbd2608 with identifier: YS56392 to the API
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:27:10Z',
 'fuel_type': 'diesel',
 'id': 'edcc5390-50a7-54b2-ad24-fd722dbd2608',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS56392',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 392142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-18',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2012}
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS56392%27 HTTP/1.1" 200 None
2026-03-29 08:36:17 [auto1.be] INFO: Saving data for YS56392: {'auction_closing_time': 1774884430.0, 'created_time': 1774557198.346742, 'last_price_update_time': 1774773377.950041}
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YS56392') HTTP/1.1" 204 0
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: VB04696
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB04696%27 HTTP/1.1" 200 None
2026-03-29 08:36:18 [auto1.be] INFO: Scrape type for VB04696: 0
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: RR89556
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR89556%27 HTTP/1.1" 200 None
2026-03-29 08:36:18 [auto1.be] INFO: Scrape type for RR89556: 0
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: XM10489
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: RS45224
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: UW48678
2026-03-29 08:36:18 [auto1.be] INFO: Found listing with ID: FH97290
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH97290%27 HTTP/1.1" 200 None
2026-03-29 08:36:18 [auto1.be] INFO: Scrape type for FH97290: 0
2026-03-29 08:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:19 [auto1.be] INFO: Channel: 24h | Page: 23 | totalHits: 1252 | hits on page: 40
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: SZ65946
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ65946%27 HTTP/1.1" 200 None
2026-03-29 08:36:19 [auto1.be] INFO: Scrape type for SZ65946: 0
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: XJ24324
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: MV82025
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV82025%27 HTTP/1.1" 200 None
2026-03-29 08:36:19 [auto1.be] INFO: Scrape type for MV82025: 0
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: MZ51776
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: WH33984
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH33984%27 HTTP/1.1" 200 None
2026-03-29 08:36:19 [auto1.be] INFO: Scrape type for WH33984: 0
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: HU58936
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: ET79377
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET79377%27 HTTP/1.1" 200 None
2026-03-29 08:36:19 [auto1.be] INFO: Scrape type for ET79377: 0
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: UR44884
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR44884%27 HTTP/1.1" 200 None
2026-03-29 08:36:19 [auto1.be] INFO: Scrape type for UR44884: 0
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: LC46636
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: HM84114
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM84114%27 HTTP/1.1" 200 None
2026-03-29 08:36:19 [auto1.be] INFO: Scrape type for HM84114: 0
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: FN16517
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN16517%27 HTTP/1.1" 200 None
2026-03-29 08:36:19 [auto1.be] INFO: Scrape type for FN16517: 0
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: UF35860
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: SC73086
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: PR84870
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR84870%27 HTTP/1.1" 200 None
2026-03-29 08:36:19 [auto1.be] INFO: Scrape type for PR84870: 2
2026-03-29 08:36:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a517ed1f-1c9d-5773-a919-908f7dae6a5b with identifier: PR84870
2026-03-29 08:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a517ed1f-1c9d-5773-a919-908f7dae6a5b with scrape type 2
2026-03-29 08:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a517ed1f-1c9d-5773-a919-908f7dae6a5b with scrape type 2
2026-03-29 08:36:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a517ed1f-1c9d-5773-a919-908f7dae6a5b, identifier: PR84870
2026-03-29 08:36:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a517ed1f-1c9d-5773-a919-908f7dae6a5b with identifier: PR84870
2026-03-29 08:36:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a517ed1f-1c9d-5773-a919-908f7dae6a5b with identifier: PR84870
2026-03-29 08:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a517ed1f-1c9d-5773-a919-908f7dae6a5b with identifier: PR84870 to the API
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:41:05Z',
 'fuel_type': 'diesel',
 'id': 'a517ed1f-1c9d-5773-a919-908f7dae6a5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR84870',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 93347,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-30',
 'seller_name': None,
 'title': 'Nissan Qashqai 2.0 dCi Tekna 4x4',
 'transmission': 'automatic',
 'trim': 'Tekna 4x4',
 'year': 2011}
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR84870%27 HTTP/1.1" 200 None
2026-03-29 08:36:19 [auto1.be] INFO: Saving data for PR84870: {'auction_closing_time': 1774885265.0, 'created_time': 1773909033.045151, 'last_price_update_time': 1774773379.656285}
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PR84870') HTTP/1.1" 204 0
2026-03-29 08:36:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: NN69701
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: KG53590
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: ZX32272
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: WK50026
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK50026%27 HTTP/1.1" 200 None
2026-03-29 08:36:19 [auto1.be] INFO: Scrape type for WK50026: 0
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: MK20825
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK20825%27 HTTP/1.1" 200 None
2026-03-29 08:36:19 [auto1.be] INFO: Scrape type for MK20825: 0
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: YS48127
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS48127%27 HTTP/1.1" 200 None
2026-03-29 08:36:19 [auto1.be] INFO: Scrape type for YS48127: 0
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: RF74485
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF74485%27 HTTP/1.1" 200 None
2026-03-29 08:36:19 [auto1.be] INFO: Scrape type for RF74485: 0
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: NC57966
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: FU04844
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: FC28385
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: MU18005
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MU18005%27 HTTP/1.1" 200 None
2026-03-29 08:36:19 [auto1.be] INFO: Scrape type for MU18005: 0
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: UM95648
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: VA32651
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: KV94769
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV94769%27 HTTP/1.1" 200 None
2026-03-29 08:36:19 [auto1.be] INFO: Scrape type for KV94769: 0
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: LG02466
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: ZC67013
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC67013%27 HTTP/1.1" 200 None
2026-03-29 08:36:19 [auto1.be] INFO: Scrape type for ZC67013: 0
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: MZ96160
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: DD08232
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: ZK51287
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK51287%27 HTTP/1.1" 200 None
2026-03-29 08:36:19 [auto1.be] INFO: Scrape type for ZK51287: 0
2026-03-29 08:36:19 [auto1.be] INFO: Found listing with ID: JX00156
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX00156%27 HTTP/1.1" 200 None
2026-03-29 08:36:19 [auto1.be] INFO: Scrape type for JX00156: 2
2026-03-29 08:36:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9b2242d-16f1-5264-84f4-9db8b53e18c0 with identifier: JX00156
2026-03-29 08:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9b2242d-16f1-5264-84f4-9db8b53e18c0 with scrape type 2
2026-03-29 08:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9b2242d-16f1-5264-84f4-9db8b53e18c0 with scrape type 2
2026-03-29 08:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f9b2242d-16f1-5264-84f4-9db8b53e18c0, identifier: JX00156
2026-03-29 08:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f9b2242d-16f1-5264-84f4-9db8b53e18c0 with identifier: JX00156
2026-03-29 08:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f9b2242d-16f1-5264-84f4-9db8b53e18c0 with identifier: JX00156
2026-03-29 08:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f9b2242d-16f1-5264-84f4-9db8b53e18c0 with identifier: JX00156 to the API
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:07:16Z',
 'fuel_type': 'petrol',
 'id': 'f9b2242d-16f1-5264-84f4-9db8b53e18c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX00156',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix20',
 'odometer': 76795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-02',
 'seller_name': None,
 'title': 'Hyundai ix20 1.6 Comfort Blue',
 'transmission': 'manual',
 'trim': 'Comfort Blue',
 'year': 2012}
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX00156%27 HTTP/1.1" 200 None
2026-03-29 08:36:20 [auto1.be] INFO: Saving data for JX00156: {'auction_closing_time': 1774883236.0, 'created_time': 1774600271.716595, 'last_price_update_time': 1774773380.310162}
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JX00156') HTTP/1.1" 204 0
2026-03-29 08:36:20 [auto1.be] INFO: Found listing with ID: UN77217
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UN77217%27 HTTP/1.1" 200 None
2026-03-29 08:36:20 [auto1.be] INFO: Scrape type for UN77217: 0
2026-03-29 08:36:20 [auto1.be] INFO: Found listing with ID: VA33507
2026-03-29 08:36:20 [auto1.be] INFO: Found listing with ID: FM00077
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM00077%27 HTTP/1.1" 200 None
2026-03-29 08:36:20 [auto1.be] INFO: Scrape type for FM00077: 0
2026-03-29 08:36:20 [auto1.be] INFO: Found listing with ID: NS73936
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS73936%27 HTTP/1.1" 200 None
2026-03-29 08:36:20 [auto1.be] INFO: Scrape type for NS73936: 0
2026-03-29 08:36:20 [auto1.be] INFO: Found listing with ID: LY58233
2026-03-29 08:36:20 [auto1.be] INFO: Found listing with ID: XH30316
2026-03-29 08:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:21 [auto1.be] INFO: Channel: 24h | Page: 24 | totalHits: 1252 | hits on page: 40
2026-03-29 08:36:21 [auto1.be] INFO: Found listing with ID: RK82839
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK82839%27 HTTP/1.1" 200 None
2026-03-29 08:36:21 [auto1.be] INFO: Scrape type for RK82839: 0
2026-03-29 08:36:21 [auto1.be] INFO: Found listing with ID: LE69229
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE69229%27 HTTP/1.1" 200 None
2026-03-29 08:36:21 [auto1.be] INFO: Scrape type for LE69229: 2
2026-03-29 08:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 155cb591-5e0a-54ad-b09e-9e57a683a273 with identifier: LE69229
2026-03-29 08:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 155cb591-5e0a-54ad-b09e-9e57a683a273 with scrape type 2
2026-03-29 08:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 155cb591-5e0a-54ad-b09e-9e57a683a273 with scrape type 2
2026-03-29 08:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 155cb591-5e0a-54ad-b09e-9e57a683a273, identifier: LE69229
2026-03-29 08:36:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 155cb591-5e0a-54ad-b09e-9e57a683a273 with identifier: LE69229
2026-03-29 08:36:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 155cb591-5e0a-54ad-b09e-9e57a683a273 with identifier: LE69229
2026-03-29 08:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 155cb591-5e0a-54ad-b09e-9e57a683a273 with identifier: LE69229 to the API
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:03:14Z',
 'fuel_type': 'diesel',
 'id': '155cb591-5e0a-54ad-b09e-9e57a683a273',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE69229',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix20',
 'odometer': 155826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-28',
 'seller_name': None,
 'title': 'Hyundai ix20 1.4 CRDi App Mode',
 'transmission': 'manual',
 'trim': 'App Mode',
 'year': 2014}
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE69229%27 HTTP/1.1" 200 None
2026-03-29 08:36:21 [auto1.be] INFO: Saving data for LE69229: {'auction_closing_time': 1774882994.0, 'created_time': 1774557178.249835, 'last_price_update_time': 1774773381.835069}
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LE69229') HTTP/1.1" 204 0
2026-03-29 08:36:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:21 [auto1.be] INFO: Found listing with ID: CN29269
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN29269%27 HTTP/1.1" 200 None
2026-03-29 08:36:21 [auto1.be] INFO: Scrape type for CN29269: 0
2026-03-29 08:36:21 [auto1.be] INFO: Found listing with ID: HE95946
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE95946%27 HTTP/1.1" 200 None
2026-03-29 08:36:21 [auto1.be] INFO: Scrape type for HE95946: 0
2026-03-29 08:36:21 [auto1.be] INFO: Found listing with ID: ZN76480
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN76480%27 HTTP/1.1" 200 None
2026-03-29 08:36:21 [auto1.be] INFO: Scrape type for ZN76480: 0
2026-03-29 08:36:21 [auto1.be] INFO: Found listing with ID: BY25509
2026-03-29 08:36:21 [auto1.be] INFO: Found listing with ID: TR87241
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR87241%27 HTTP/1.1" 200 None
2026-03-29 08:36:21 [auto1.be] INFO: Scrape type for TR87241: 0
2026-03-29 08:36:21 [auto1.be] INFO: Found listing with ID: PU90284
2026-03-29 08:36:21 [auto1.be] INFO: Found listing with ID: VC92856
2026-03-29 08:36:21 [auto1.be] INFO: Found listing with ID: DJ08738
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ08738%27 HTTP/1.1" 200 None
2026-03-29 08:36:21 [auto1.be] INFO: Scrape type for DJ08738: 0
2026-03-29 08:36:21 [auto1.be] INFO: Found listing with ID: FN69818
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN69818%27 HTTP/1.1" 200 None
2026-03-29 08:36:21 [auto1.be] INFO: Scrape type for FN69818: 2
2026-03-29 08:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b67b4f29-ca49-576f-a62e-965446bc3ed3 with identifier: FN69818
2026-03-29 08:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b67b4f29-ca49-576f-a62e-965446bc3ed3 with scrape type 2
2026-03-29 08:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b67b4f29-ca49-576f-a62e-965446bc3ed3 with scrape type 2
2026-03-29 08:36:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b67b4f29-ca49-576f-a62e-965446bc3ed3, identifier: FN69818
2026-03-29 08:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b67b4f29-ca49-576f-a62e-965446bc3ed3 with identifier: FN69818
2026-03-29 08:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b67b4f29-ca49-576f-a62e-965446bc3ed3 with identifier: FN69818
2026-03-29 08:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b67b4f29-ca49-576f-a62e-965446bc3ed3 with identifier: FN69818 to the API
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 305,
 'expiration_date': '2026-03-30T15:03:51Z',
 'fuel_type': 'diesel',
 'id': 'b67b4f29-ca49-576f-a62e-965446bc3ed3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN69818',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 122497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-31',
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 3.0 SD V6 HSE',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2015}
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN69818%27 HTTP/1.1" 200 None
2026-03-29 08:36:22 [auto1.be] INFO: Saving data for FN69818: {'auction_closing_time': 1774883031.0, 'created_time': 1774600274.114139, 'last_price_update_time': 1774773382.352617}
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FN69818') HTTP/1.1" 204 0
2026-03-29 08:36:22 [auto1.be] INFO: Found listing with ID: XB17770
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB17770%27 HTTP/1.1" 200 None
2026-03-29 08:36:22 [auto1.be] INFO: Scrape type for XB17770: 0
2026-03-29 08:36:22 [auto1.be] INFO: Found listing with ID: SN22557
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN22557%27 HTTP/1.1" 200 None
2026-03-29 08:36:22 [auto1.be] INFO: Scrape type for SN22557: 0
2026-03-29 08:36:22 [auto1.be] INFO: Found listing with ID: MV28568
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV28568%27 HTTP/1.1" 200 None
2026-03-29 08:36:22 [auto1.be] INFO: Scrape type for MV28568: 0
2026-03-29 08:36:22 [auto1.be] INFO: Found listing with ID: FW88759
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW88759%27 HTTP/1.1" 200 None
2026-03-29 08:36:22 [auto1.be] INFO: Scrape type for FW88759: 0
2026-03-29 08:36:22 [auto1.be] INFO: Found listing with ID: FZ81347
2026-03-29 08:36:22 [auto1.be] INFO: Found listing with ID: CX83686
2026-03-29 08:36:22 [auto1.be] INFO: Found listing with ID: FR50529
2026-03-29 08:36:22 [auto1.be] INFO: Found listing with ID: PS82481
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS82481%27 HTTP/1.1" 200 None
2026-03-29 08:36:22 [auto1.be] INFO: Scrape type for PS82481: 0
2026-03-29 08:36:22 [auto1.be] INFO: Found listing with ID: UU07035
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU07035%27 HTTP/1.1" 200 None
2026-03-29 08:36:22 [auto1.be] INFO: Scrape type for UU07035: 0
2026-03-29 08:36:22 [auto1.be] INFO: Found listing with ID: WL68728
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL68728%27 HTTP/1.1" 200 None
2026-03-29 08:36:22 [auto1.be] INFO: Scrape type for WL68728: 0
2026-03-29 08:36:22 [auto1.be] INFO: Found listing with ID: MR51068
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR51068%27 HTTP/1.1" 200 None
2026-03-29 08:36:22 [auto1.be] INFO: Scrape type for MR51068: 2
2026-03-29 08:36:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cadc4e62-1ad2-559d-87f7-0b217b93ef9f with identifier: MR51068
2026-03-29 08:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cadc4e62-1ad2-559d-87f7-0b217b93ef9f with scrape type 2
2026-03-29 08:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cadc4e62-1ad2-559d-87f7-0b217b93ef9f with scrape type 2
2026-03-29 08:36:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cadc4e62-1ad2-559d-87f7-0b217b93ef9f, identifier: MR51068
2026-03-29 08:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cadc4e62-1ad2-559d-87f7-0b217b93ef9f with identifier: MR51068
2026-03-29 08:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cadc4e62-1ad2-559d-87f7-0b217b93ef9f with identifier: MR51068
2026-03-29 08:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cadc4e62-1ad2-559d-87f7-0b217b93ef9f with identifier: MR51068 to the API
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:16:34Z',
 'fuel_type': 'diesel',
 'id': 'cadc4e62-1ad2-559d-87f7-0b217b93ef9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR51068',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 146937,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-23',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.7 CRDi Comfort 2WD',
 'transmission': 'manual',
 'trim': 'Comfort 2WD',
 'year': 2017}
2026-03-29 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR51068%27 HTTP/1.1" 200 None
2026-03-29 08:36:23 [auto1.be] INFO: Saving data for MR51068: {'auction_closing_time': 1774883794.0, 'created_time': 1773301653.095499, 'last_price_update_time': 1774773383.016857}
2026-03-29 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MR51068') HTTP/1.1" 204 0
2026-03-29 08:36:23 [auto1.be] INFO: Found listing with ID: PY41942
2026-03-29 08:36:23 [auto1.be] INFO: Found listing with ID: TP16646
2026-03-29 08:36:23 [auto1.be] INFO: Found listing with ID: AZ39903
2026-03-29 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AZ39903%27 HTTP/1.1" 200 None
2026-03-29 08:36:23 [auto1.be] INFO: Scrape type for AZ39903: 0
2026-03-29 08:36:23 [auto1.be] INFO: Found listing with ID: HB98543
2026-03-29 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB98543%27 HTTP/1.1" 200 None
2026-03-29 08:36:23 [auto1.be] INFO: Scrape type for HB98543: 0
2026-03-29 08:36:23 [auto1.be] INFO: Found listing with ID: RU48742
2026-03-29 08:36:23 [auto1.be] INFO: Found listing with ID: DK63787
2026-03-29 08:36:23 [auto1.be] INFO: Found listing with ID: KG87325
2026-03-29 08:36:23 [auto1.be] INFO: Found listing with ID: HU17820
2026-03-29 08:36:23 [auto1.be] INFO: Found listing with ID: NL83155
2026-03-29 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NL83155%27 HTTP/1.1" 200 None
2026-03-29 08:36:23 [auto1.be] INFO: Scrape type for NL83155: 0
2026-03-29 08:36:23 [auto1.be] INFO: Found listing with ID: NV75936
2026-03-29 08:36:23 [auto1.be] INFO: Found listing with ID: AW25378
2026-03-29 08:36:23 [auto1.be] INFO: Found listing with ID: PF94112
2026-03-29 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF94112%27 HTTP/1.1" 200 None
2026-03-29 08:36:23 [auto1.be] INFO: Scrape type for PF94112: 0
2026-03-29 08:36:23 [auto1.be] INFO: Found listing with ID: XT95399
2026-03-29 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT95399%27 HTTP/1.1" 200 None
2026-03-29 08:36:23 [auto1.be] INFO: Scrape type for XT95399: 0
2026-03-29 08:36:23 [auto1.be] INFO: Found listing with ID: NT98676
2026-03-29 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NT98676%27 HTTP/1.1" 200 None
2026-03-29 08:36:23 [auto1.be] INFO: Scrape type for NT98676: 0
2026-03-29 08:36:23 [auto1.be] INFO: Found listing with ID: ZA12378
2026-03-29 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZA12378%27 HTTP/1.1" 200 None
2026-03-29 08:36:23 [auto1.be] INFO: Scrape type for ZA12378: 0
2026-03-29 08:36:23 [auto1.be] INFO: Found listing with ID: LS82290
2026-03-29 08:36:23 [auto1.be] INFO: Found listing with ID: FJ54867
2026-03-29 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ54867%27 HTTP/1.1" 200 None
2026-03-29 08:36:23 [auto1.be] INFO: Scrape type for FJ54867: 0
2026-03-29 08:36:23 [auto1.be] INFO: Found listing with ID: CM51817
2026-03-29 08:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:31 [auto1.be] INFO: Channel: 24h | Page: 25 | totalHits: 1252 | hits on page: 40
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: FA04427
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA04427%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for FA04427: 0
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: KD88013
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD88013%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for KD88013: 0
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: YY44687
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YY44687%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for YY44687: 0
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: BX66623
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX66623%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for BX66623: 0
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: NJ37001
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ37001%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for NJ37001: 0
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: DM24490
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM24490%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for DM24490: 0
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: PM87207
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM87207%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for PM87207: 0
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: RD23593
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: XW30503
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XW30503%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for XW30503: 0
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: GD95033
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: UE36464
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE36464%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for UE36464: 0
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: ER02883
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER02883%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for ER02883: 0
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: LG99308
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: KW17867
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: HT18059
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT18059%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for HT18059: 0
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: PE64709
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE64709%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for PE64709: 0
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: HS15781
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: HT80629
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: FT23017
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: ZM05640
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM05640%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for ZM05640: 0
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: KT01454
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT01454%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for KT01454: 0
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: AC59433
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AC59433%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for AC59433: 0
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: MY75694
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: LH19076
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: GM68229
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM68229%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for GM68229: 0
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: LK30146
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK30146%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for LK30146: 0
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: FT86060
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: TF49476
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: JT63704
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: UA37218
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA37218%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for UA37218: 0
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: SX16585
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: TF43790
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: NZ75648
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ75648%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for NZ75648: 0
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: ER91021
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER91021%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for ER91021: 0
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: LF44164
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: SV00163
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: EM88075
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM88075%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for EM88075: 0
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: VM07385
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: WC19794
2026-03-29 08:36:31 [auto1.be] INFO: Found listing with ID: UV16393
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV16393%27 HTTP/1.1" 200 None
2026-03-29 08:36:31 [auto1.be] INFO: Scrape type for UV16393: 0
2026-03-29 08:36:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:32 [auto1.be] INFO: Channel: 24h | Page: 26 | totalHits: 1252 | hits on page: 40
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: AY92488
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY92488%27 HTTP/1.1" 200 None
2026-03-29 08:36:32 [auto1.be] INFO: Scrape type for AY92488: 0
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: SB51494
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: KM81672
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: JC37428
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: RL22884
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL22884%27 HTTP/1.1" 200 None
2026-03-29 08:36:32 [auto1.be] INFO: Scrape type for RL22884: 0
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: WH35268
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH35268%27 HTTP/1.1" 200 None
2026-03-29 08:36:32 [auto1.be] INFO: Scrape type for WH35268: 0
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: DZ29736
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ29736%27 HTTP/1.1" 200 None
2026-03-29 08:36:32 [auto1.be] INFO: Scrape type for DZ29736: 0
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: BT48733
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: JM52918
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: PJ47204
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: WV93881
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: ZN30582
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN30582%27 HTTP/1.1" 200 None
2026-03-29 08:36:32 [auto1.be] INFO: Scrape type for ZN30582: 0
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: DW89604
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW89604%27 HTTP/1.1" 200 None
2026-03-29 08:36:32 [auto1.be] INFO: Scrape type for DW89604: 0
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: WV93759
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: JB30712
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB30712%27 HTTP/1.1" 200 None
2026-03-29 08:36:32 [auto1.be] INFO: Scrape type for JB30712: 0
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: XK23104
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK23104%27 HTTP/1.1" 200 None
2026-03-29 08:36:32 [auto1.be] INFO: Scrape type for XK23104: 0
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: SG83875
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SG83875%27 HTTP/1.1" 200 None
2026-03-29 08:36:32 [auto1.be] INFO: Scrape type for SG83875: 0
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: UM29446
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM29446%27 HTTP/1.1" 200 None
2026-03-29 08:36:32 [auto1.be] INFO: Scrape type for UM29446: 0
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: XS20349
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS20349%27 HTTP/1.1" 200 None
2026-03-29 08:36:32 [auto1.be] INFO: Scrape type for XS20349: 0
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: TA24587
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA24587%27 HTTP/1.1" 200 None
2026-03-29 08:36:32 [auto1.be] INFO: Scrape type for TA24587: 0
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: MM51411
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MM51411%27 HTTP/1.1" 200 None
2026-03-29 08:36:32 [auto1.be] INFO: Scrape type for MM51411: 0
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: EM05161
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM05161%27 HTTP/1.1" 200 None
2026-03-29 08:36:32 [auto1.be] INFO: Scrape type for EM05161: 0
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: HZ76034
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: US61524
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: DP44577
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP44577%27 HTTP/1.1" 200 None
2026-03-29 08:36:32 [auto1.be] INFO: Scrape type for DP44577: 0
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: KU92863
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU92863%27 HTTP/1.1" 200 None
2026-03-29 08:36:32 [auto1.be] INFO: Scrape type for KU92863: 0
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: XU79591
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU79591%27 HTTP/1.1" 200 None
2026-03-29 08:36:32 [auto1.be] INFO: Scrape type for XU79591: 0
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: LM11563
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM11563%27 HTTP/1.1" 200 None
2026-03-29 08:36:32 [auto1.be] INFO: Scrape type for LM11563: 0
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: VZ26705
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ26705%27 HTTP/1.1" 200 None
2026-03-29 08:36:32 [auto1.be] INFO: Scrape type for VZ26705: 0
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: GW19918
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW19918%27 HTTP/1.1" 200 None
2026-03-29 08:36:32 [auto1.be] INFO: Scrape type for GW19918: 0
2026-03-29 08:36:32 [auto1.be] INFO: Found listing with ID: UY14877
2026-03-29 08:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY14877%27 HTTP/1.1" 200 None
2026-03-29 08:36:33 [auto1.be] INFO: Scrape type for UY14877: 0
2026-03-29 08:36:33 [auto1.be] INFO: Found listing with ID: WJ93890
2026-03-29 08:36:33 [auto1.be] INFO: Found listing with ID: DN00999
2026-03-29 08:36:33 [auto1.be] INFO: Found listing with ID: GN49517
2026-03-29 08:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN49517%27 HTTP/1.1" 200 None
2026-03-29 08:36:33 [auto1.be] INFO: Scrape type for GN49517: 0
2026-03-29 08:36:33 [auto1.be] INFO: Found listing with ID: BE30988
2026-03-29 08:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BE30988%27 HTTP/1.1" 200 None
2026-03-29 08:36:33 [auto1.be] INFO: Scrape type for BE30988: 0
2026-03-29 08:36:33 [auto1.be] INFO: Found listing with ID: ZW40078
2026-03-29 08:36:33 [auto1.be] INFO: Found listing with ID: YW96446
2026-03-29 08:36:33 [auto1.be] INFO: Found listing with ID: LA99224
2026-03-29 08:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA99224%27 HTTP/1.1" 200 None
2026-03-29 08:36:33 [auto1.be] INFO: Scrape type for LA99224: 0
2026-03-29 08:36:33 [auto1.be] INFO: Found listing with ID: UE64828
2026-03-29 08:36:33 [auto1.be] INFO: Found listing with ID: GJ36560
2026-03-29 08:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ36560%27 HTTP/1.1" 200 None
2026-03-29 08:36:33 [auto1.be] INFO: Scrape type for GJ36560: 0
2026-03-29 08:36:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:33 [auto1.be] INFO: Channel: 24h | Page: 27 | totalHits: 1252 | hits on page: 40
2026-03-29 08:36:33 [auto1.be] INFO: Found listing with ID: KF94293
2026-03-29 08:36:33 [auto1.be] INFO: Found listing with ID: ER36240
2026-03-29 08:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER36240%27 HTTP/1.1" 200 None
2026-03-29 08:36:34 [auto1.be] INFO: Scrape type for ER36240: 0
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: SD86163
2026-03-29 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD86163%27 HTTP/1.1" 200 None
2026-03-29 08:36:34 [auto1.be] INFO: Scrape type for SD86163: 0
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: LM13926
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: AE63964
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: SL57288
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: BT92464
2026-03-29 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT92464%27 HTTP/1.1" 200 None
2026-03-29 08:36:34 [auto1.be] INFO: Scrape type for BT92464: 0
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: RK43455
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: KG93945
2026-03-29 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG93945%27 HTTP/1.1" 200 None
2026-03-29 08:36:34 [auto1.be] INFO: Scrape type for KG93945: 0
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: FB93927
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: SV46049
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: WV65314
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: FM81572
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: HJ19751
2026-03-29 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ19751%27 HTTP/1.1" 200 None
2026-03-29 08:36:34 [auto1.be] INFO: Scrape type for HJ19751: 0
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: MW50956
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: JJ70860
2026-03-29 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ70860%27 HTTP/1.1" 200 None
2026-03-29 08:36:34 [auto1.be] INFO: Scrape type for JJ70860: 0
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: DN28044
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: WG38275
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: NC08569
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: JR09444
2026-03-29 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JR09444%27 HTTP/1.1" 200 None
2026-03-29 08:36:34 [auto1.be] INFO: Scrape type for JR09444: 0
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: CF30779
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: WT53046
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: DR48094
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: JZ34939
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: TX04561
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: ET82729
2026-03-29 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET82729%27 HTTP/1.1" 200 None
2026-03-29 08:36:34 [auto1.be] INFO: Scrape type for ET82729: 0
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: BC33060
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: HL00392
2026-03-29 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL00392%27 HTTP/1.1" 200 None
2026-03-29 08:36:34 [auto1.be] INFO: Scrape type for HL00392: 0
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: EP00364
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: AU29077
2026-03-29 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU29077%27 HTTP/1.1" 200 None
2026-03-29 08:36:34 [auto1.be] INFO: Scrape type for AU29077: 0
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: FL05782
2026-03-29 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL05782%27 HTTP/1.1" 200 None
2026-03-29 08:36:34 [auto1.be] INFO: Scrape type for FL05782: 0
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: HB59214
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: SX95001
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: UY27001
2026-03-29 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY27001%27 HTTP/1.1" 200 None
2026-03-29 08:36:34 [auto1.be] INFO: Scrape type for UY27001: 0
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: UR33188
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: CM21252
2026-03-29 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM21252%27 HTTP/1.1" 200 None
2026-03-29 08:36:34 [auto1.be] INFO: Scrape type for CM21252: 0
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: SU85893
2026-03-29 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU85893%27 HTTP/1.1" 200 None
2026-03-29 08:36:34 [auto1.be] INFO: Scrape type for SU85893: 0
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: DT20121
2026-03-29 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT20121%27 HTTP/1.1" 200 None
2026-03-29 08:36:34 [auto1.be] INFO: Scrape type for DT20121: 0
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: VM76060
2026-03-29 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM76060%27 HTTP/1.1" 200 None
2026-03-29 08:36:34 [auto1.be] INFO: Scrape type for VM76060: 0
2026-03-29 08:36:34 [auto1.be] INFO: Found listing with ID: FJ57746
2026-03-29 08:36:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:36 [auto1.be] INFO: Channel: 24h | Page: 28 | totalHits: 1252 | hits on page: 40
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: KZ05274
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: TJ00131
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TJ00131%27 HTTP/1.1" 200 None
2026-03-29 08:36:36 [auto1.be] INFO: Scrape type for TJ00131: 0
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: VY36246
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VY36246%27 HTTP/1.1" 200 None
2026-03-29 08:36:36 [auto1.be] INFO: Scrape type for VY36246: 0
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: MJ04907
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ04907%27 HTTP/1.1" 200 None
2026-03-29 08:36:36 [auto1.be] INFO: Scrape type for MJ04907: 0
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: YG03175
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG03175%27 HTTP/1.1" 200 None
2026-03-29 08:36:36 [auto1.be] INFO: Scrape type for YG03175: 0
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: HK87235
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: UG65181
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UG65181%27 HTTP/1.1" 200 None
2026-03-29 08:36:36 [auto1.be] INFO: Scrape type for UG65181: 0
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: KT35610
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT35610%27 HTTP/1.1" 200 None
2026-03-29 08:36:36 [auto1.be] INFO: Scrape type for KT35610: 0
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: CD22470
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: SJ05954
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: GH80996
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH80996%27 HTTP/1.1" 200 None
2026-03-29 08:36:36 [auto1.be] INFO: Scrape type for GH80996: 0
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: ZY24236
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY24236%27 HTTP/1.1" 200 None
2026-03-29 08:36:36 [auto1.be] INFO: Scrape type for ZY24236: 0
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: FV90992
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: PG48700
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: ZZ74713
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ74713%27 HTTP/1.1" 200 None
2026-03-29 08:36:36 [auto1.be] INFO: Scrape type for ZZ74713: 0
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: XD67660
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD67660%27 HTTP/1.1" 200 None
2026-03-29 08:36:36 [auto1.be] INFO: Scrape type for XD67660: 0
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: DT55223
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT55223%27 HTTP/1.1" 200 None
2026-03-29 08:36:36 [auto1.be] INFO: Scrape type for DT55223: 0
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: EL95031
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL95031%27 HTTP/1.1" 200 None
2026-03-29 08:36:36 [auto1.be] INFO: Scrape type for EL95031: 0
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: DC62563
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: UX01518
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX01518%27 HTTP/1.1" 200 None
2026-03-29 08:36:36 [auto1.be] INFO: Scrape type for UX01518: 0
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: ZP95092
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: ZR35447
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: EK14732
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK14732%27 HTTP/1.1" 200 None
2026-03-29 08:36:36 [auto1.be] INFO: Scrape type for EK14732: 0
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: CA54828
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: UR02836
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR02836%27 HTTP/1.1" 200 None
2026-03-29 08:36:36 [auto1.be] INFO: Scrape type for UR02836: 0
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: XK01311
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK01311%27 HTTP/1.1" 200 None
2026-03-29 08:36:36 [auto1.be] INFO: Scrape type for XK01311: 0
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: FW70524
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: ED41371
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED41371%27 HTTP/1.1" 200 None
2026-03-29 08:36:36 [auto1.be] INFO: Scrape type for ED41371: 0
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: VX51166
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VX51166%27 HTTP/1.1" 200 None
2026-03-29 08:36:36 [auto1.be] INFO: Scrape type for VX51166: 0
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: BD29807
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD29807%27 HTTP/1.1" 200 None
2026-03-29 08:36:36 [auto1.be] INFO: Scrape type for BD29807: 0
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: NZ74768
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: AC55620
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: ZJ26009
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ26009%27 HTTP/1.1" 200 None
2026-03-29 08:36:36 [auto1.be] INFO: Scrape type for ZJ26009: 0
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: LR36013
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LR36013%27 HTTP/1.1" 200 None
2026-03-29 08:36:36 [auto1.be] INFO: Scrape type for LR36013: 0
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: YZ92764
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: ZZ63767
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: VW23905
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: BZ70123
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: TX50404
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX50404%27 HTTP/1.1" 200 None
2026-03-29 08:36:36 [auto1.be] INFO: Scrape type for TX50404: 0
2026-03-29 08:36:36 [auto1.be] INFO: Found listing with ID: XC95069
2026-03-29 08:36:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:37 [auto1.be] INFO: Channel: 24h | Page: 29 | totalHits: 1252 | hits on page: 40
2026-03-29 08:36:37 [auto1.be] INFO: Found listing with ID: BS70441
2026-03-29 08:36:37 [auto1.be] INFO: Found listing with ID: GM14941
2026-03-29 08:36:37 [auto1.be] INFO: Found listing with ID: SY87797
2026-03-29 08:36:37 [auto1.be] INFO: Found listing with ID: WV78161
2026-03-29 08:36:37 [auto1.be] INFO: Found listing with ID: ZV95387
2026-03-29 08:36:37 [auto1.be] INFO: Found listing with ID: HR69689
2026-03-29 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HR69689%27 HTTP/1.1" 200 None
2026-03-29 08:36:37 [auto1.be] INFO: Scrape type for HR69689: 0
2026-03-29 08:36:37 [auto1.be] INFO: Found listing with ID: KB40459
2026-03-29 08:36:37 [auto1.be] INFO: Found listing with ID: FC15884
2026-03-29 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC15884%27 HTTP/1.1" 200 None
2026-03-29 08:36:37 [auto1.be] INFO: Scrape type for FC15884: 0
2026-03-29 08:36:37 [auto1.be] INFO: Found listing with ID: KX73156
2026-03-29 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX73156%27 HTTP/1.1" 200 None
2026-03-29 08:36:38 [auto1.be] INFO: Scrape type for KX73156: 0
2026-03-29 08:36:38 [auto1.be] INFO: Found listing with ID: ZZ39097
2026-03-29 08:36:38 [auto1.be] INFO: Found listing with ID: SZ00073
2026-03-29 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ00073%27 HTTP/1.1" 200 None
2026-03-29 08:36:38 [auto1.be] INFO: Scrape type for SZ00073: 0
2026-03-29 08:36:38 [auto1.be] INFO: Found listing with ID: SC10935
2026-03-29 08:36:38 [auto1.be] INFO: Found listing with ID: BU18930
2026-03-29 08:36:38 [auto1.be] INFO: Found listing with ID: CA73486
2026-03-29 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA73486%27 HTTP/1.1" 200 None
2026-03-29 08:36:38 [auto1.be] INFO: Scrape type for CA73486: 0
2026-03-29 08:36:38 [auto1.be] INFO: Found listing with ID: NU74968
2026-03-29 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU74968%27 HTTP/1.1" 200 None
2026-03-29 08:36:38 [auto1.be] INFO: Scrape type for NU74968: 0
2026-03-29 08:36:38 [auto1.be] INFO: Found listing with ID: WX14373
2026-03-29 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX14373%27 HTTP/1.1" 200 None
2026-03-29 08:36:38 [auto1.be] INFO: Scrape type for WX14373: 0
2026-03-29 08:36:38 [auto1.be] INFO: Found listing with ID: YK61845
2026-03-29 08:36:38 [auto1.be] INFO: Found listing with ID: CN37182
2026-03-29 08:36:38 [auto1.be] INFO: Found listing with ID: EK79460
2026-03-29 08:36:38 [auto1.be] INFO: Found listing with ID: SW60531
2026-03-29 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW60531%27 HTTP/1.1" 200 None
2026-03-29 08:36:38 [auto1.be] INFO: Scrape type for SW60531: 0
2026-03-29 08:36:38 [auto1.be] INFO: Found listing with ID: KE51169
2026-03-29 08:36:38 [auto1.be] INFO: Found listing with ID: JJ51820
2026-03-29 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ51820%27 HTTP/1.1" 200 None
2026-03-29 08:36:38 [auto1.be] INFO: Scrape type for JJ51820: 0
2026-03-29 08:36:38 [auto1.be] INFO: Found listing with ID: KH65741
2026-03-29 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH65741%27 HTTP/1.1" 200 None
2026-03-29 08:36:38 [auto1.be] INFO: Scrape type for KH65741: 0
2026-03-29 08:36:38 [auto1.be] INFO: Found listing with ID: CV58665
2026-03-29 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV58665%27 HTTP/1.1" 200 None
2026-03-29 08:36:38 [auto1.be] INFO: Scrape type for CV58665: 0
2026-03-29 08:36:38 [auto1.be] INFO: Found listing with ID: NE94103
2026-03-29 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE94103%27 HTTP/1.1" 200 None
2026-03-29 08:36:38 [auto1.be] INFO: Scrape type for NE94103: 0
2026-03-29 08:36:38 [auto1.be] INFO: Found listing with ID: RC51689
2026-03-29 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC51689%27 HTTP/1.1" 200 None
2026-03-29 08:36:38 [auto1.be] INFO: Scrape type for RC51689: 0
2026-03-29 08:36:38 [auto1.be] INFO: Found listing with ID: XS76018
2026-03-29 08:36:38 [auto1.be] INFO: Found listing with ID: UY92003
2026-03-29 08:36:38 [auto1.be] INFO: Found listing with ID: NV64774
2026-03-29 08:36:38 [auto1.be] INFO: Found listing with ID: KB41449
2026-03-29 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KB41449%27 HTTP/1.1" 200 None
2026-03-29 08:36:38 [auto1.be] INFO: Scrape type for KB41449: 0
2026-03-29 08:36:38 [auto1.be] INFO: Found listing with ID: ET88330
2026-03-29 08:36:38 [auto1.be] INFO: Found listing with ID: KT00341
2026-03-29 08:36:38 [auto1.be] INFO: Found listing with ID: YH90615
2026-03-29 08:36:38 [auto1.be] INFO: Found listing with ID: CU35051
2026-03-29 08:36:38 [auto1.be] INFO: Found listing with ID: JU94491
2026-03-29 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU94491%27 HTTP/1.1" 200 None
2026-03-29 08:36:38 [auto1.be] INFO: Scrape type for JU94491: 0
2026-03-29 08:36:38 [auto1.be] INFO: Found listing with ID: PK02246
2026-03-29 08:36:38 [auto1.be] INFO: Found listing with ID: PU93740
2026-03-29 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU93740%27 HTTP/1.1" 200 None
2026-03-29 08:36:38 [auto1.be] INFO: Scrape type for PU93740: 0
2026-03-29 08:36:38 [auto1.be] INFO: Found listing with ID: LY17098
2026-03-29 08:36:38 [auto1.be] INFO: Found listing with ID: FC78029
2026-03-29 08:36:38 [auto1.be] INFO: Found listing with ID: EH00335
2026-03-29 08:36:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:39 [auto1.be] INFO: Channel: 24h | Page: 30 | totalHits: 1252 | hits on page: 40
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: WH49963
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: XG70738
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG70738%27 HTTP/1.1" 200 None
2026-03-29 08:36:39 [auto1.be] INFO: Scrape type for XG70738: 0
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: KL53758
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: GV92885
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV92885%27 HTTP/1.1" 200 None
2026-03-29 08:36:39 [auto1.be] INFO: Scrape type for GV92885: 0
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: RA73981
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: EJ96142
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: HE39793
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: DD83263
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: DV83163
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DV83163%27 HTTP/1.1" 200 None
2026-03-29 08:36:39 [auto1.be] INFO: Scrape type for DV83163: 0
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: SW21472
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: AF15006
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF15006%27 HTTP/1.1" 200 None
2026-03-29 08:36:39 [auto1.be] INFO: Scrape type for AF15006: 0
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: JY19882
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY19882%27 HTTP/1.1" 200 None
2026-03-29 08:36:39 [auto1.be] INFO: Scrape type for JY19882: 0
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: EY57880
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: JZ80953
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ80953%27 HTTP/1.1" 200 None
2026-03-29 08:36:39 [auto1.be] INFO: Scrape type for JZ80953: 0
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: TL44110
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL44110%27 HTTP/1.1" 200 None
2026-03-29 08:36:39 [auto1.be] INFO: Scrape type for TL44110: 0
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: ZN56944
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: FC31614
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC31614%27 HTTP/1.1" 200 None
2026-03-29 08:36:39 [auto1.be] INFO: Scrape type for FC31614: 0
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: HX50025
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: DH53723
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: CU06988
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU06988%27 HTTP/1.1" 200 None
2026-03-29 08:36:39 [auto1.be] INFO: Scrape type for CU06988: 0
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: RD62823
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: KH04328
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH04328%27 HTTP/1.1" 200 None
2026-03-29 08:36:39 [auto1.be] INFO: Scrape type for KH04328: 0
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: GN32494
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN32494%27 HTTP/1.1" 200 None
2026-03-29 08:36:39 [auto1.be] INFO: Scrape type for GN32494: 0
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: ZG72967
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: LA84805
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA84805%27 HTTP/1.1" 200 None
2026-03-29 08:36:39 [auto1.be] INFO: Scrape type for LA84805: 0
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: UH00217
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: RX31058
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX31058%27 HTTP/1.1" 200 None
2026-03-29 08:36:39 [auto1.be] INFO: Scrape type for RX31058: 0
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: BB55914
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB55914%27 HTTP/1.1" 200 None
2026-03-29 08:36:39 [auto1.be] INFO: Scrape type for BB55914: 0
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: JY01361
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: EU75132
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: KC67497
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC67497%27 HTTP/1.1" 200 None
2026-03-29 08:36:39 [auto1.be] INFO: Scrape type for KC67497: 0
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: FK09845
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: EB31921
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: DJ63605
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: US61346
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27US61346%27 HTTP/1.1" 200 None
2026-03-29 08:36:39 [auto1.be] INFO: Scrape type for US61346: 0
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: SY12350
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY12350%27 HTTP/1.1" 200 None
2026-03-29 08:36:39 [auto1.be] INFO: Scrape type for SY12350: 0
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: ST29091
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST29091%27 HTTP/1.1" 200 None
2026-03-29 08:36:39 [auto1.be] INFO: Scrape type for ST29091: 0
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: TV57254
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV57254%27 HTTP/1.1" 200 None
2026-03-29 08:36:39 [auto1.be] INFO: Scrape type for TV57254: 0
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: TC61218
2026-03-29 08:36:39 [auto1.be] INFO: Found listing with ID: PP72448
2026-03-29 08:36:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:41 [auto1.be] INFO: Channel: 24h | Page: 31 | totalHits: 1252 | hits on page: 40
2026-03-29 08:36:41 [auto1.be] INFO: Found listing with ID: EV21741
2026-03-29 08:36:41 [auto1.be] INFO: Found listing with ID: RF01360
2026-03-29 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF01360%27 HTTP/1.1" 200 None
2026-03-29 08:36:41 [auto1.be] INFO: Scrape type for RF01360: 0
2026-03-29 08:36:41 [auto1.be] INFO: Found listing with ID: UU14069
2026-03-29 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU14069%27 HTTP/1.1" 200 None
2026-03-29 08:36:41 [auto1.be] INFO: Scrape type for UU14069: 0
2026-03-29 08:36:41 [auto1.be] INFO: Found listing with ID: BZ95673
2026-03-29 08:36:41 [auto1.be] INFO: Found listing with ID: AG16412
2026-03-29 08:36:41 [auto1.be] INFO: Found listing with ID: TM16327
2026-03-29 08:36:41 [auto1.be] INFO: Found listing with ID: UC18604
2026-03-29 08:36:41 [auto1.be] INFO: Found listing with ID: TF70513
2026-03-29 08:36:41 [auto1.be] INFO: Found listing with ID: ZD95004
2026-03-29 08:36:41 [auto1.be] INFO: Found listing with ID: ES25967
2026-03-29 08:36:41 [auto1.be] INFO: Found listing with ID: PC01829
2026-03-29 08:36:41 [auto1.be] INFO: Found listing with ID: RW32127
2026-03-29 08:36:41 [auto1.be] INFO: Found listing with ID: CE27208
2026-03-29 08:36:41 [auto1.be] INFO: Found listing with ID: XG78459
2026-03-29 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG78459%27 HTTP/1.1" 200 None
2026-03-29 08:36:41 [auto1.be] INFO: Scrape type for XG78459: 2
2026-03-29 08:36:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99113383-36d9-5392-a76d-12671350da04 with identifier: XG78459
2026-03-29 08:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99113383-36d9-5392-a76d-12671350da04 with scrape type 2
2026-03-29 08:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99113383-36d9-5392-a76d-12671350da04 with scrape type 2
2026-03-29 08:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 99113383-36d9-5392-a76d-12671350da04, identifier: XG78459
2026-03-29 08:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 99113383-36d9-5392-a76d-12671350da04 with identifier: XG78459
2026-03-29 08:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 99113383-36d9-5392-a76d-12671350da04 with identifier: XG78459
2026-03-29 08:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 99113383-36d9-5392-a76d-12671350da04 with identifier: XG78459 to the API
2026-03-29 08:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:25:02Z',
 'fuel_type': 'diesel',
 'id': '99113383-36d9-5392-a76d-12671350da04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG78459',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S60',
 'odometer': 217480,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-18',
 'seller_name': None,
 'title': 'Volvo S60 1.6 D2 Summum',
 'transmission': 'manual',
 'trim': 'Summum',
 'year': 2011}
2026-03-29 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG78459%27 HTTP/1.1" 200 None
2026-03-29 08:36:41 [auto1.be] INFO: Saving data for XG78459: {'auction_closing_time': 1774884302.0, 'created_time': 1774686623.67846, 'last_price_update_time': 1774773401.966835}
2026-03-29 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XG78459') HTTP/1.1" 204 0
2026-03-29 08:36:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:42 [auto1.be] INFO: Found listing with ID: CG81228
2026-03-29 08:36:42 [auto1.be] INFO: Found listing with ID: RC25321
2026-03-29 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC25321%27 HTTP/1.1" 200 None
2026-03-29 08:36:42 [auto1.be] INFO: Scrape type for RC25321: 2
2026-03-29 08:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a810397a-27d8-53c7-8d39-8168e3de6697 with identifier: RC25321
2026-03-29 08:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a810397a-27d8-53c7-8d39-8168e3de6697 with scrape type 2
2026-03-29 08:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a810397a-27d8-53c7-8d39-8168e3de6697 with scrape type 2
2026-03-29 08:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a810397a-27d8-53c7-8d39-8168e3de6697, identifier: RC25321
2026-03-29 08:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a810397a-27d8-53c7-8d39-8168e3de6697 with identifier: RC25321
2026-03-29 08:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a810397a-27d8-53c7-8d39-8168e3de6697 with identifier: RC25321
2026-03-29 08:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a810397a-27d8-53c7-8d39-8168e3de6697 with identifier: RC25321 to the API
2026-03-29 08:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:29:03Z',
 'fuel_type': 'petrol',
 'id': 'a810397a-27d8-53c7-8d39-8168e3de6697',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC25321',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 100202,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-23',
 'seller_name': None,
 'title': 'Toyota Auris 1.2 Turbo Design Edition',
 'transmission': 'manual',
 'trim': 'Design Edition',
 'year': 2017}
2026-03-29 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC25321%27 HTTP/1.1" 200 None
2026-03-29 08:36:42 [auto1.be] INFO: Saving data for RC25321: {'auction_closing_time': 1774884543.0, 'created_time': 1774686622.288112, 'last_price_update_time': 1774773402.567377}
2026-03-29 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RC25321') HTTP/1.1" 204 0
2026-03-29 08:36:42 [auto1.be] INFO: Found listing with ID: YZ86935
2026-03-29 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YZ86935%27 HTTP/1.1" 200 None
2026-03-29 08:36:42 [auto1.be] INFO: Scrape type for YZ86935: 2
2026-03-29 08:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6af9c02e-3c22-5592-ba42-87cb997424a2 with identifier: YZ86935
2026-03-29 08:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6af9c02e-3c22-5592-ba42-87cb997424a2 with scrape type 2
2026-03-29 08:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6af9c02e-3c22-5592-ba42-87cb997424a2 with scrape type 2
2026-03-29 08:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6af9c02e-3c22-5592-ba42-87cb997424a2, identifier: YZ86935
2026-03-29 08:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6af9c02e-3c22-5592-ba42-87cb997424a2 with identifier: YZ86935
2026-03-29 08:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6af9c02e-3c22-5592-ba42-87cb997424a2 with identifier: YZ86935
2026-03-29 08:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6af9c02e-3c22-5592-ba42-87cb997424a2 with identifier: YZ86935 to the API
2026-03-29 08:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:40:28Z',
 'fuel_type': 'petrol',
 'id': '6af9c02e-3c22-5592-ba42-87cb997424a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ86935',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 219581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-21',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.8 TFSI Attraction',
 'transmission': 'automatic',
 'trim': 'Attraction',
 'year': 2012}
2026-03-29 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YZ86935%27 HTTP/1.1" 200 None
2026-03-29 08:36:42 [auto1.be] INFO: Saving data for YZ86935: {'auction_closing_time': 1774885228.0, 'created_time': 1774686632.447211, 'last_price_update_time': 1774773402.953135}
2026-03-29 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YZ86935') HTTP/1.1" 204 0
2026-03-29 08:36:42 [auto1.be] INFO: Found listing with ID: XB72565
2026-03-29 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB72565%27 HTTP/1.1" 200 None
2026-03-29 08:36:42 [auto1.be] INFO: Scrape type for XB72565: 2
2026-03-29 08:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b939a141-7d36-5e5c-8878-99839cc8c1aa with identifier: XB72565
2026-03-29 08:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b939a141-7d36-5e5c-8878-99839cc8c1aa with scrape type 2
2026-03-29 08:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b939a141-7d36-5e5c-8878-99839cc8c1aa with scrape type 2
2026-03-29 08:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b939a141-7d36-5e5c-8878-99839cc8c1aa, identifier: XB72565
2026-03-29 08:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b939a141-7d36-5e5c-8878-99839cc8c1aa with identifier: XB72565
2026-03-29 08:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b939a141-7d36-5e5c-8878-99839cc8c1aa with identifier: XB72565
2026-03-29 08:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b939a141-7d36-5e5c-8878-99839cc8c1aa with identifier: XB72565 to the API
2026-03-29 08:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:47:31Z',
 'fuel_type': 'petrol',
 'id': 'b939a141-7d36-5e5c-8878-99839cc8c1aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB72565',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 173649,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-27',
 'seller_name': None,
 'title': 'Fiat Punto 1.4 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2013}
2026-03-29 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB72565%27 HTTP/1.1" 200 None
2026-03-29 08:36:43 [auto1.be] INFO: Saving data for XB72565: {'auction_closing_time': 1774885651.0, 'created_time': 1774686633.738949, 'last_price_update_time': 1774773403.353359}
2026-03-29 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XB72565') HTTP/1.1" 204 0
2026-03-29 08:36:43 [auto1.be] INFO: Found listing with ID: WN54122
2026-03-29 08:36:43 [auto1.be] INFO: Found listing with ID: WM28184
2026-03-29 08:36:43 [auto1.be] INFO: Found listing with ID: UA48921
2026-03-29 08:36:43 [auto1.be] INFO: Found listing with ID: PV46198
2026-03-29 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV46198%27 HTTP/1.1" 200 None
2026-03-29 08:36:43 [auto1.be] INFO: Scrape type for PV46198: 2
2026-03-29 08:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90f40c8e-c4c4-5a97-bf2c-b01e97743af0 with identifier: PV46198
2026-03-29 08:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90f40c8e-c4c4-5a97-bf2c-b01e97743af0 with scrape type 2
2026-03-29 08:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90f40c8e-c4c4-5a97-bf2c-b01e97743af0 with scrape type 2
2026-03-29 08:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 90f40c8e-c4c4-5a97-bf2c-b01e97743af0, identifier: PV46198
2026-03-29 08:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 90f40c8e-c4c4-5a97-bf2c-b01e97743af0 with identifier: PV46198
2026-03-29 08:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 90f40c8e-c4c4-5a97-bf2c-b01e97743af0 with identifier: PV46198
2026-03-29 08:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 90f40c8e-c4c4-5a97-bf2c-b01e97743af0 with identifier: PV46198 to the API
2026-03-29 08:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:36:04Z',
 'fuel_type': 'diesel',
 'id': '90f40c8e-c4c4-5a97-bf2c-b01e97743af0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV46198',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 177585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-09',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 d BlueTEC AMG Line',
 'transmission': 'manual',
 'trim': 'BlueTEC AMG Line',
 'year': 2015}
2026-03-29 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV46198%27 HTTP/1.1" 200 None
2026-03-29 08:36:43 [auto1.be] INFO: Saving data for PV46198: {'auction_closing_time': 1774884964.0, 'created_time': 1774686636.101409, 'last_price_update_time': 1774773403.730458}
2026-03-29 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PV46198') HTTP/1.1" 204 0
2026-03-29 08:36:43 [auto1.be] INFO: Found listing with ID: LE69336
2026-03-29 08:36:43 [auto1.be] INFO: Found listing with ID: RY49845
2026-03-29 08:36:43 [auto1.be] INFO: Found listing with ID: ZT87936
2026-03-29 08:36:43 [auto1.be] INFO: Found listing with ID: VZ26828
2026-03-29 08:36:43 [auto1.be] INFO: Found listing with ID: RU30240
2026-03-29 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU30240%27 HTTP/1.1" 200 None
2026-03-29 08:36:43 [auto1.be] INFO: Scrape type for RU30240: 2
2026-03-29 08:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6ff7c35-d015-5ddc-9dc9-c05307fdb49a with identifier: RU30240
2026-03-29 08:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6ff7c35-d015-5ddc-9dc9-c05307fdb49a with scrape type 2
2026-03-29 08:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6ff7c35-d015-5ddc-9dc9-c05307fdb49a with scrape type 2
2026-03-29 08:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f6ff7c35-d015-5ddc-9dc9-c05307fdb49a, identifier: RU30240
2026-03-29 08:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f6ff7c35-d015-5ddc-9dc9-c05307fdb49a with identifier: RU30240
2026-03-29 08:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f6ff7c35-d015-5ddc-9dc9-c05307fdb49a with identifier: RU30240
2026-03-29 08:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f6ff7c35-d015-5ddc-9dc9-c05307fdb49a with identifier: RU30240 to the API
2026-03-29 08:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:15:26Z',
 'fuel_type': 'diesel',
 'id': 'f6ff7c35-d015-5ddc-9dc9-c05307fdb49a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU30240',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery 4',
 'odometer': 258528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-27',
 'seller_name': None,
 'title': 'Land Rover Discovery 4 3.0 TD V6 TDV6 HSE',
 'transmission': 'automatic',
 'trim': 'TDV6 HSE',
 'year': 2013}
2026-03-29 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU30240%27 HTTP/1.1" 200 None
2026-03-29 08:36:44 [auto1.be] INFO: Saving data for RU30240: {'auction_closing_time': 1774883726.0, 'created_time': 1774038909.415172, 'last_price_update_time': 1774773404.097625}
2026-03-29 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RU30240') HTTP/1.1" 204 0
2026-03-29 08:36:44 [auto1.be] INFO: Found listing with ID: KR16689
2026-03-29 08:36:44 [auto1.be] INFO: Found listing with ID: YV20290
2026-03-29 08:36:44 [auto1.be] INFO: Found listing with ID: XX22473
2026-03-29 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XX22473%27 HTTP/1.1" 200 None
2026-03-29 08:36:44 [auto1.be] INFO: Scrape type for XX22473: 2
2026-03-29 08:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2637847d-d04e-5098-93ad-f77b7b465c28 with identifier: XX22473
2026-03-29 08:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2637847d-d04e-5098-93ad-f77b7b465c28 with scrape type 2
2026-03-29 08:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2637847d-d04e-5098-93ad-f77b7b465c28 with scrape type 2
2026-03-29 08:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2637847d-d04e-5098-93ad-f77b7b465c28, identifier: XX22473
2026-03-29 08:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2637847d-d04e-5098-93ad-f77b7b465c28 with identifier: XX22473
2026-03-29 08:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2637847d-d04e-5098-93ad-f77b7b465c28 with identifier: XX22473
2026-03-29 08:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2637847d-d04e-5098-93ad-f77b7b465c28 with identifier: XX22473 to the API
2026-03-29 08:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:18:16Z',
 'fuel_type': 'diesel',
 'id': '2637847d-d04e-5098-93ad-f77b7b465c28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX22473',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 121488,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-14',
 'seller_name': None,
 'title': 'BMW 5er 520d Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2015}
2026-03-29 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XX22473%27 HTTP/1.1" 200 None
2026-03-29 08:36:44 [auto1.be] INFO: Saving data for XX22473: {'auction_closing_time': 1774883896.0, 'created_time': 1774686626.272066, 'last_price_update_time': 1774773404.573307}
2026-03-29 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XX22473') HTTP/1.1" 204 0
2026-03-29 08:36:44 [auto1.be] INFO: Found listing with ID: LK52725
2026-03-29 08:36:44 [auto1.be] INFO: Found listing with ID: TS84713
2026-03-29 08:36:44 [auto1.be] INFO: Found listing with ID: HY97997
2026-03-29 08:36:44 [auto1.be] INFO: Found listing with ID: YA99172
2026-03-29 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA99172%27 HTTP/1.1" 200 None
2026-03-29 08:36:44 [auto1.be] INFO: Scrape type for YA99172: 2
2026-03-29 08:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bda98b99-4937-5a42-8e63-c32c9fb7bce0 with identifier: YA99172
2026-03-29 08:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bda98b99-4937-5a42-8e63-c32c9fb7bce0 with scrape type 2
2026-03-29 08:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bda98b99-4937-5a42-8e63-c32c9fb7bce0 with scrape type 2
2026-03-29 08:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bda98b99-4937-5a42-8e63-c32c9fb7bce0, identifier: YA99172
2026-03-29 08:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bda98b99-4937-5a42-8e63-c32c9fb7bce0 with identifier: YA99172
2026-03-29 08:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bda98b99-4937-5a42-8e63-c32c9fb7bce0 with identifier: YA99172
2026-03-29 08:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bda98b99-4937-5a42-8e63-c32c9fb7bce0 with identifier: YA99172 to the API
2026-03-29 08:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:27:33Z',
 'fuel_type': 'petrol',
 'id': 'bda98b99-4937-5a42-8e63-c32c9fb7bce0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA99172',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 85500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-09',
 'seller_name': None,
 'title': 'Skoda Octavia 1.0 TSI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2017}
2026-03-29 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA99172%27 HTTP/1.1" 200 None
2026-03-29 08:36:44 [auto1.be] INFO: Saving data for YA99172: {'auction_closing_time': 1774884453.0, 'created_time': 1774686637.005285, 'last_price_update_time': 1774773404.952024}
2026-03-29 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YA99172') HTTP/1.1" 204 0
2026-03-29 08:36:44 [auto1.be] INFO: Found listing with ID: PD03709
2026-03-29 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD03709%27 HTTP/1.1" 200 None
2026-03-29 08:36:44 [auto1.be] INFO: Scrape type for PD03709: 2
2026-03-29 08:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38ce2412-ea07-572e-a344-4d0ddcad51ab with identifier: PD03709
2026-03-29 08:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38ce2412-ea07-572e-a344-4d0ddcad51ab with scrape type 2
2026-03-29 08:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38ce2412-ea07-572e-a344-4d0ddcad51ab with scrape type 2
2026-03-29 08:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 38ce2412-ea07-572e-a344-4d0ddcad51ab, identifier: PD03709
2026-03-29 08:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 38ce2412-ea07-572e-a344-4d0ddcad51ab with identifier: PD03709
2026-03-29 08:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 38ce2412-ea07-572e-a344-4d0ddcad51ab with identifier: PD03709
2026-03-29 08:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 38ce2412-ea07-572e-a344-4d0ddcad51ab with identifier: PD03709 to the API
2026-03-29 08:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-30T15:44:30Z',
 'fuel_type': 'diesel',
 'id': '38ce2412-ea07-572e-a344-4d0ddcad51ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD03709',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 144505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-26',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 400 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-29 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD03709%27 HTTP/1.1" 200 None
2026-03-29 08:36:45 [auto1.be] INFO: Saving data for PD03709: {'auction_closing_time': 1774885470.0, 'created_time': 1774686628.956482, 'last_price_update_time': 1774773405.33183}
2026-03-29 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PD03709') HTTP/1.1" 204 0
2026-03-29 08:36:45 [auto1.be] INFO: Found listing with ID: ZU52155
2026-03-29 08:36:45 [auto1.be] INFO: Found listing with ID: HJ47401
2026-03-29 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ47401%27 HTTP/1.1" 200 None
2026-03-29 08:36:45 [auto1.be] INFO: Scrape type for HJ47401: 2
2026-03-29 08:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de368a48-e901-5fdc-a5dc-188545f22020 with identifier: HJ47401
2026-03-29 08:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de368a48-e901-5fdc-a5dc-188545f22020 with scrape type 2
2026-03-29 08:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de368a48-e901-5fdc-a5dc-188545f22020 with scrape type 2
2026-03-29 08:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: de368a48-e901-5fdc-a5dc-188545f22020, identifier: HJ47401
2026-03-29 08:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: de368a48-e901-5fdc-a5dc-188545f22020 with identifier: HJ47401
2026-03-29 08:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: de368a48-e901-5fdc-a5dc-188545f22020 with identifier: HJ47401
2026-03-29 08:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: de368a48-e901-5fdc-a5dc-188545f22020 with identifier: HJ47401 to the API
2026-03-29 08:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:21:44Z',
 'fuel_type': 'diesel',
 'id': 'de368a48-e901-5fdc-a5dc-188545f22020',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ47401',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 170839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-09',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 CDI BlueEfficiency Urban',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Urban',
 'year': 2013}
2026-03-29 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ47401%27 HTTP/1.1" 200 None
2026-03-29 08:36:45 [auto1.be] INFO: Saving data for HJ47401: {'auction_closing_time': 1774884104.0, 'created_time': 1774002050.444121, 'last_price_update_time': 1774773405.709768}
2026-03-29 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HJ47401') HTTP/1.1" 204 0
2026-03-29 08:36:45 [auto1.be] INFO: Found listing with ID: FY94559
2026-03-29 08:36:45 [auto1.be] INFO: Found listing with ID: WY04920
2026-03-29 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WY04920%27 HTTP/1.1" 200 None
2026-03-29 08:36:45 [auto1.be] INFO: Scrape type for WY04920: 2
2026-03-29 08:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34d41633-c89c-5c81-8d05-452ae275da35 with identifier: WY04920
2026-03-29 08:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34d41633-c89c-5c81-8d05-452ae275da35 with scrape type 2
2026-03-29 08:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34d41633-c89c-5c81-8d05-452ae275da35 with scrape type 2
2026-03-29 08:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 34d41633-c89c-5c81-8d05-452ae275da35, identifier: WY04920
2026-03-29 08:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 34d41633-c89c-5c81-8d05-452ae275da35 with identifier: WY04920
2026-03-29 08:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 34d41633-c89c-5c81-8d05-452ae275da35 with identifier: WY04920
2026-03-29 08:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 34d41633-c89c-5c81-8d05-452ae275da35 with identifier: WY04920 to the API
2026-03-29 08:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-30T15:19:47Z',
 'fuel_type': 'petrol',
 'id': '34d41633-c89c-5c81-8d05-452ae275da35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY04920',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 106400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-07',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-29 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WY04920%27 HTTP/1.1" 200 None
2026-03-29 08:36:46 [auto1.be] INFO: Saving data for WY04920: {'auction_closing_time': 1774883987.0, 'created_time': 1774686624.466636, 'last_price_update_time': 1774773406.089372}
2026-03-29 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WY04920') HTTP/1.1" 204 0
2026-03-29 08:36:46 [auto1.be] INFO: Found listing with ID: PG64643
2026-03-29 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PG64643%27 HTTP/1.1" 200 None
2026-03-29 08:36:46 [auto1.be] INFO: Scrape type for PG64643: 0
2026-03-29 08:36:46 [auto1.be] INFO: Channel: 24h | Page: 32 | totalHits: 1252 | hits on page: 12
2026-03-29 08:36:46 [auto1.be] INFO: Found listing with ID: GF35922
2026-03-29 08:36:46 [auto1.be] INFO: Found listing with ID: BR73229
2026-03-29 08:36:46 [auto1.be] INFO: Found listing with ID: PV20794
2026-03-29 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV20794%27 HTTP/1.1" 200 None
2026-03-29 08:36:46 [auto1.be] INFO: Scrape type for PV20794: 2
2026-03-29 08:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5abfb09-096f-532b-9564-a74a71f4eb23 with identifier: PV20794
2026-03-29 08:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5abfb09-096f-532b-9564-a74a71f4eb23 with scrape type 2
2026-03-29 08:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5abfb09-096f-532b-9564-a74a71f4eb23 with scrape type 2
2026-03-29 08:36:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f5abfb09-096f-532b-9564-a74a71f4eb23, identifier: PV20794
2026-03-29 08:36:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f5abfb09-096f-532b-9564-a74a71f4eb23 with identifier: PV20794
2026-03-29 08:36:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f5abfb09-096f-532b-9564-a74a71f4eb23 with identifier: PV20794
2026-03-29 08:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f5abfb09-096f-532b-9564-a74a71f4eb23 with identifier: PV20794 to the API
2026-03-29 08:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:14:03Z',
 'fuel_type': 'diesel',
 'id': 'f5abfb09-096f-532b-9564-a74a71f4eb23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV20794',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 179167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-03',
 'seller_name': None,
 'title': 'BMW 1er 116d Edition M Sport Shadow',
 'transmission': 'automatic',
 'trim': 'Edition M Sport Shadow',
 'year': 2018}
2026-03-29 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV20794%27 HTTP/1.1" 200 None
2026-03-29 08:36:46 [auto1.be] INFO: Saving data for PV20794: {'auction_closing_time': 1774883643.0, 'created_time': 1773952983.201175, 'last_price_update_time': 1774773406.596993}
2026-03-29 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PV20794') HTTP/1.1" 204 0
2026-03-29 08:36:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 08:36:46 [auto1.be] INFO: Found listing with ID: BB63081
2026-03-29 08:36:46 [auto1.be] INFO: Found listing with ID: SD89253
2026-03-29 08:36:46 [auto1.be] INFO: Found listing with ID: SJ57770
2026-03-29 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ57770%27 HTTP/1.1" 200 None
2026-03-29 08:36:46 [auto1.be] INFO: Scrape type for SJ57770: 2
2026-03-29 08:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1 with identifier: SJ57770
2026-03-29 08:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1 with scrape type 2
2026-03-29 08:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1 with scrape type 2
2026-03-29 08:36:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1, identifier: SJ57770
2026-03-29 08:36:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1 with identifier: SJ57770
2026-03-29 08:36:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1 with identifier: SJ57770
2026-03-29 08:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1 with identifier: SJ57770 to the API
2026-03-29 08:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 08:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 08:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:11:14Z',
 'fuel_type': 'diesel',
 'id': '6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ57770',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 86756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-23',
 'seller_name': None,
 'title': 'Mitsubishi ASX 1.8 DI-D Inform 2WD',
 'transmission': 'manual',
 'trim': 'Inform 2WD',
 'year': 2011}
2026-03-29 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ57770%27 HTTP/1.1" 200 None
2026-03-29 08:36:46 [auto1.be] INFO: Saving data for SJ57770: {'auction_closing_time': 1774883474.0, 'created_time': 1774686627.159066, 'last_price_update_time': 1774773406.988998}
2026-03-29 08:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SJ57770') HTTP/1.1" 204 0
2026-03-29 08:36:47 [auto1.be] INFO: Found listing with ID: XR93319
2026-03-29 08:36:47 [auto1.be] INFO: Found listing with ID: AB98915
2026-03-29 08:36:47 [auto1.be] INFO: Found listing with ID: AB83336
2026-03-29 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB83336%27 HTTP/1.1" 200 None
2026-03-29 08:36:47 [auto1.be] INFO: Scrape type for AB83336: 0
2026-03-29 08:36:47 [auto1.be] INFO: Found listing with ID: MR34349
2026-03-29 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR34349%27 HTTP/1.1" 200 None
2026-03-29 08:36:47 [auto1.be] INFO: Scrape type for MR34349: 0
2026-03-29 08:36:47 [auto1.be] INFO: Found listing with ID: XL09418
2026-03-29 08:36:47 [auto1.be] INFO: Found listing with ID: UW48636
2026-03-29 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW48636%27 HTTP/1.1" 200 None
2026-03-29 08:36:47 [auto1.be] INFO: Scrape type for UW48636: 0
2026-03-29 08:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 08:36:47 [auto1.be] INFO: Channel: 24h | Page: 33 | totalHits: 1252 | hits on page: 0
2026-03-29 08:36:47 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-29 08:36:47 [auto1.be] INFO: auto1.be Batch config: batch 1/2
2026-03-29 08:36:47 [auto1.be] INFO: auto1.be Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 2, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 4, <ScrapeType.BATCH_SKIPPED: 5>: 7}
2026-03-29 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20last_price_update_time%20lt%201774341407 HTTP/1.1" 200 None
2026-03-29 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AV97157') HTTP/1.1" 204 0
2026-03-29 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AX75044') HTTP/1.1" 204 0
2026-03-29 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BD73203') HTTP/1.1" 204 0
2026-03-29 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BH45344') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BM74339') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BP77614') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CS23653') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CV85727') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CW64874') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DF48699') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ED71668') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EE32772') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EK55237') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EN01891') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GP05087') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GP84272') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GR16752') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GW35793') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GX02860') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HB42460') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HM64227') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HS95420') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JC64183') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JP19774') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LF26445') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LP39476') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LP81056') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LV64939') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MH38717') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MP71634') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MX38879') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NC88393') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NV66427') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PL20555') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PR28943') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RG15224') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RH38201') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RN24543') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RR67471') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SA97556') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ST25569') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SX40191') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SX77318') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TE43927') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TW61438') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UT92718') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VG77781') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WD07916') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WZ56628') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WZ71416') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XD29763') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XF36261') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XP64543') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XS74768') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YJ66512') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YP21335') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZC39990') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZF77148') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZL69126') HTTP/1.1" 204 0
2026-03-29 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZP85449') HTTP/1.1" 204 0
2026-03-29 08:36:48 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (141 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.be/task_25_2026-03-29T08_30_00.jl
2026-03-29 08:36:48 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 228466,
 'downloader/request_count': 95,
 'downloader/request_method_count/GET': 60,
 'downloader/request_method_count/POST': 35,
 'downloader/response_bytes': 7090781,
 'downloader/response_count': 95,
 'downloader/response_status_count/200': 95,
 'dupefilter/filtered': 11,
 'elapsed_time_seconds': 401.808583,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 29, 8, 36, 48, 512896, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 141,
 'log_count/DEBUG': 3181,
 'log_count/INFO': 3448,
 'memusage/max': 170315776,
 'memusage/startup': 150097920,
 'request_depth_max': 36,
 'response_received_count': 95,
 'scheduler/dequeued': 95,
 'scheduler/dequeued/memory': 95,
 'scheduler/enqueued': 95,
 'scheduler/enqueued/memory': 95,
 'scrape_type/batch_skipped': 636,
 'scrape_type/new': 29,
 'scrape_type/price_update': 112,
 'scrape_type/skipped': 504,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 108,
 'scrapy-zyte-api/error_ratio': 0.12037037037037036,
 'scrapy-zyte-api/errors': 13,
 "scrapy-zyte-api/exception_types/<class 'aiohttp.client_exceptions.ClientConnectorError'>": 13,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 5.887644777010734,
 'scrapy-zyte-api/mean_response_seconds': 5.947441246600721,
 'scrapy-zyte-api/processed': 95,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 95,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 94,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 95,
 'scrapy-zyte-api/request_args/httpRequestBody': 35,
 'scrapy-zyte-api/request_args/httpRequestMethod': 35,
 'scrapy-zyte-api/request_args/httpResponseBody': 95,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 95,
 'scrapy-zyte-api/request_args/sessionContext': 95,
 'scrapy-zyte-api/request_args/url': 95,
 'scrapy-zyte-api/status_codes/0': 13,
 'scrapy-zyte-api/status_codes/200': 95,
 'scrapy-zyte-api/success': 95,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 1292,
 'source/total_available': 1252,
 'start_time': datetime.datetime(2026, 3, 29, 8, 30, 6, 704313, tzinfo=datetime.timezone.utc)}
2026-03-29 08:36:48 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-29 08:36:48 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f9b346b2ed0>
2026-03-29 08:36:48 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f9b3485ff90>