2026-03-28 08:30:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 08:30:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 08:30:06 [auto1.be] INFO: Batch mode enabled: batch 1/2
2026-03-28 08:30:06 [auto1.be] INFO: Starting spider auto1.be
2026-03-28 08:30:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 08:30:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 08:30:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 08:30:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 08:30:06 [scrapy.extensions.telnet] INFO: Telnet Password: c32f07fdd38d904d
2026-03-28 08:30:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-28 08:30:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.be/task_25_2026-03-28T08_30_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-28 08:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 08:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 08:30:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 08:30:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 08:30:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 08:30:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-28 08:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 08:30:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-28 08:30:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 08:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 08:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 08:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 08:30:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 08:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 08:30:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 08:30:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 08:30:06 [scrapy.core.engine] INFO: Spider opened
2026-03-28 08:30:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 08:30:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-28 08:30:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-28 08:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 08:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 08:30:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-28 08:30:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-28 08:30:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-28 08:30:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-28 08:30:16 [auto1.be] INFO: Channel: 24h | Page: 0 | totalHits: 1700 | hits on page: 40
2026-03-28 08:30:16 [auto1.be] INFO: Found listing with ID: RW32127
2026-03-28 08:30:16 [auto1.be] INFO: Found listing with ID: CE27208
2026-03-28 08:30:16 [auto1.be] INFO: Found listing with ID: XG78459
2026-03-28 08:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG78459%27 HTTP/1.1" 200 None
2026-03-28 08:30:16 [auto1.be] INFO: Scrape type for XG78459: 1
2026-03-28 08:30:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:16 [auto1.be] INFO: Found listing with ID: CG81228
2026-03-28 08:30:16 [auto1.be] INFO: Found listing with ID: RC25321
2026-03-28 08:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC25321%27 HTTP/1.1" 200 None
2026-03-28 08:30:16 [auto1.be] INFO: Scrape type for RC25321: 1
2026-03-28 08:30:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:16 [auto1.be] INFO: Found listing with ID: YZ86935
2026-03-28 08:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YZ86935%27 HTTP/1.1" 200 None
2026-03-28 08:30:16 [auto1.be] INFO: Scrape type for YZ86935: 1
2026-03-28 08:30:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:16 [auto1.be] INFO: Found listing with ID: XB72565
2026-03-28 08:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB72565%27 HTTP/1.1" 200 None
2026-03-28 08:30:16 [auto1.be] INFO: Scrape type for XB72565: 1
2026-03-28 08:30:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:16 [auto1.be] INFO: Found listing with ID: WN54122
2026-03-28 08:30:16 [auto1.be] INFO: Found listing with ID: WM28184
2026-03-28 08:30:16 [auto1.be] INFO: Found listing with ID: UA48921
2026-03-28 08:30:16 [auto1.be] INFO: Found listing with ID: PV46198
2026-03-28 08:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV46198%27 HTTP/1.1" 200 None
2026-03-28 08:30:16 [auto1.be] INFO: Scrape type for PV46198: 1
2026-03-28 08:30:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:16 [auto1.be] INFO: Found listing with ID: LE69336
2026-03-28 08:30:16 [auto1.be] INFO: Found listing with ID: RY49845
2026-03-28 08:30:16 [auto1.be] INFO: Found listing with ID: ZT87936
2026-03-28 08:30:16 [auto1.be] INFO: Found listing with ID: VZ26828
2026-03-28 08:30:16 [auto1.be] INFO: Found listing with ID: RU30240
2026-03-28 08:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU30240%27 HTTP/1.1" 200 None
2026-03-28 08:30:16 [auto1.be] INFO: Scrape type for RU30240: 2
2026-03-28 08:30:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6ff7c35-d015-5ddc-9dc9-c05307fdb49a with identifier: RU30240
2026-03-28 08:30:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6ff7c35-d015-5ddc-9dc9-c05307fdb49a with scrape type 2
2026-03-28 08:30:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6ff7c35-d015-5ddc-9dc9-c05307fdb49a with scrape type 2
2026-03-28 08:30:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f6ff7c35-d015-5ddc-9dc9-c05307fdb49a, identifier: RU30240
2026-03-28 08:30:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f6ff7c35-d015-5ddc-9dc9-c05307fdb49a with identifier: RU30240
2026-03-28 08:30:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 08:30:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-28 08:30:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 08:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 08:30:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 08:30:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-28 08:30:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 08:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 08:30:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f6ff7c35-d015-5ddc-9dc9-c05307fdb49a with identifier: RU30240
2026-03-28 08:30:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f6ff7c35-d015-5ddc-9dc9-c05307fdb49a with identifier: RU30240 to the API
2026-03-28 08:30:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 210,
'expiration_date': '2026-03-30T15:15:26Z',
'fuel_type': 'diesel',
'id': 'f6ff7c35-d015-5ddc-9dc9-c05307fdb49a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU30240',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Discovery 4',
'odometer': 258528,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-27',
'seller_name': None,
'title': 'Land Rover Discovery 4 3.0 TD V6 TDV6 HSE',
'transmission': 'automatic',
'trim': 'TDV6 HSE',
'year': 2013}
2026-03-28 08:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU30240%27 HTTP/1.1" 200 None
2026-03-28 08:30:17 [auto1.be] INFO: Saving data for RU30240: {'auction_closing_time': 1774883726.0, 'created_time': 1774038909.415172, 'last_price_update_time': 1774686617.295833}
2026-03-28 08:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RU30240') HTTP/1.1" 204 0
2026-03-28 08:30:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:17 [auto1.be] INFO: Found listing with ID: KR16689
2026-03-28 08:30:17 [auto1.be] INFO: Found listing with ID: YV20290
2026-03-28 08:30:17 [auto1.be] INFO: Found listing with ID: EP21660
2026-03-28 08:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP21660%27 HTTP/1.1" 200 None
2026-03-28 08:30:17 [auto1.be] INFO: Scrape type for EP21660: 1
2026-03-28 08:30:17 [auto1.be] INFO: Found listing with ID: XX22473
2026-03-28 08:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XX22473%27 HTTP/1.1" 200 None
2026-03-28 08:30:17 [auto1.be] INFO: Scrape type for XX22473: 1
2026-03-28 08:30:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:17 [auto1.be] INFO: Found listing with ID: LK52725
2026-03-28 08:30:17 [auto1.be] INFO: Found listing with ID: TS84713
2026-03-28 08:30:17 [auto1.be] INFO: Found listing with ID: HY97997
2026-03-28 08:30:17 [auto1.be] INFO: Found listing with ID: YA99172
2026-03-28 08:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA99172%27 HTTP/1.1" 200 None
2026-03-28 08:30:17 [auto1.be] INFO: Scrape type for YA99172: 1
2026-03-28 08:30:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:17 [auto1.be] INFO: Found listing with ID: PD03709
2026-03-28 08:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD03709%27 HTTP/1.1" 200 None
2026-03-28 08:30:17 [auto1.be] INFO: Scrape type for PD03709: 1
2026-03-28 08:30:17 [auto1.be] INFO: Found listing with ID: ZU52155
2026-03-28 08:30:17 [auto1.be] INFO: Found listing with ID: HJ47401
2026-03-28 08:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ47401%27 HTTP/1.1" 200 None
2026-03-28 08:30:17 [auto1.be] INFO: Scrape type for HJ47401: 2
2026-03-28 08:30:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de368a48-e901-5fdc-a5dc-188545f22020 with identifier: HJ47401
2026-03-28 08:30:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de368a48-e901-5fdc-a5dc-188545f22020 with scrape type 2
2026-03-28 08:30:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de368a48-e901-5fdc-a5dc-188545f22020 with scrape type 2
2026-03-28 08:30:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: de368a48-e901-5fdc-a5dc-188545f22020, identifier: HJ47401
2026-03-28 08:30:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: de368a48-e901-5fdc-a5dc-188545f22020 with identifier: HJ47401
2026-03-28 08:30:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: de368a48-e901-5fdc-a5dc-188545f22020 with identifier: HJ47401
2026-03-28 08:30:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: de368a48-e901-5fdc-a5dc-188545f22020 with identifier: HJ47401 to the API
2026-03-28 08:30:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:21:44Z',
'fuel_type': 'diesel',
'id': 'de368a48-e901-5fdc-a5dc-188545f22020',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ47401',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 170839,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-09',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 CDI BlueEfficiency Urban',
'transmission': 'manual',
'trim': 'BlueEfficiency Urban',
'year': 2013}
2026-03-28 08:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ47401%27 HTTP/1.1" 200 None
2026-03-28 08:30:18 [auto1.be] INFO: Saving data for HJ47401: {'auction_closing_time': 1774884104.0, 'created_time': 1774002050.444121, 'last_price_update_time': 1774686618.612717}
2026-03-28 08:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HJ47401') HTTP/1.1" 204 0
2026-03-28 08:30:18 [auto1.be] INFO: Found listing with ID: FY94559
2026-03-28 08:30:18 [auto1.be] INFO: Found listing with ID: WY04920
2026-03-28 08:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WY04920%27 HTTP/1.1" 200 None
2026-03-28 08:30:18 [auto1.be] INFO: Scrape type for WY04920: 1
2026-03-28 08:30:18 [auto1.be] INFO: Found listing with ID: PG64643
2026-03-28 08:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PG64643%27 HTTP/1.1" 200 None
2026-03-28 08:30:18 [auto1.be] INFO: Scrape type for PG64643: 0
2026-03-28 08:30:18 [auto1.be] INFO: Found listing with ID: GF35922
2026-03-28 08:30:18 [auto1.be] INFO: Found listing with ID: BR73229
2026-03-28 08:30:18 [auto1.be] INFO: Found listing with ID: PV20794
2026-03-28 08:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV20794%27 HTTP/1.1" 200 None
2026-03-28 08:30:18 [auto1.be] INFO: Scrape type for PV20794: 2
2026-03-28 08:30:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5abfb09-096f-532b-9564-a74a71f4eb23 with identifier: PV20794
2026-03-28 08:30:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5abfb09-096f-532b-9564-a74a71f4eb23 with scrape type 2
2026-03-28 08:30:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5abfb09-096f-532b-9564-a74a71f4eb23 with scrape type 2
2026-03-28 08:30:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f5abfb09-096f-532b-9564-a74a71f4eb23, identifier: PV20794
2026-03-28 08:30:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f5abfb09-096f-532b-9564-a74a71f4eb23 with identifier: PV20794
2026-03-28 08:30:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 08:30:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 08:30:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 08:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 08:30:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f5abfb09-096f-532b-9564-a74a71f4eb23 with identifier: PV20794
2026-03-28 08:30:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f5abfb09-096f-532b-9564-a74a71f4eb23 with identifier: PV20794 to the API
2026-03-28 08:30:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:14:03Z',
'fuel_type': 'diesel',
'id': 'f5abfb09-096f-532b-9564-a74a71f4eb23',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV20794',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 179167,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-03',
'seller_name': None,
'title': 'BMW 1er 116d Edition M Sport Shadow',
'transmission': 'automatic',
'trim': 'Edition M Sport Shadow',
'year': 2018}
2026-03-28 08:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV20794%27 HTTP/1.1" 200 None
2026-03-28 08:30:19 [auto1.be] INFO: Saving data for PV20794: {'auction_closing_time': 1774883643.0, 'created_time': 1773952983.201175, 'last_price_update_time': 1774686619.4024}
2026-03-28 08:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PV20794') HTTP/1.1" 204 0
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: BB63081
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: SD89253
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: SJ57770
2026-03-28 08:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ57770%27 HTTP/1.1" 200 None
2026-03-28 08:30:19 [auto1.be] INFO: Scrape type for SJ57770: 1
2026-03-28 08:30:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RC25321/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:30:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YZ86935/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:30:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XG78459/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: XR93319
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: AB98915
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: AB83336
2026-03-28 08:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB83336%27 HTTP/1.1" 200 None
2026-03-28 08:30:19 [auto1.be] INFO: Scrape type for AB83336: 0
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: MR34349
2026-03-28 08:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR34349%27 HTTP/1.1" 200 None
2026-03-28 08:30:19 [auto1.be] INFO: Scrape type for MR34349: 0
2026-03-28 08:30:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XB72565/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:30:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:30:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:19 [auto1.be] INFO: Channel: 24h | Page: 1 | totalHits: 1700 | hits on page: 40
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: RW32127
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: CE27208
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: XG78459
2026-03-28 08:30:19 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/XG78459/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: CG81228
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: RC25321
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: YZ86935
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: XB72565
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: WN54122
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: WM28184
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: UA48921
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: PV46198
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: LE69336
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: RY49845
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: ZT87936
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: VZ26828
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: RU30240
2026-03-28 08:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU30240%27 HTTP/1.1" 200 None
2026-03-28 08:30:19 [auto1.be] INFO: Scrape type for RU30240: 0
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: KR16689
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: YV20290
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: EP21660
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: XX22473
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: LK52725
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: TS84713
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: HY97997
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: YA99172
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: PD03709
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: ZU52155
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: HJ47401
2026-03-28 08:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ47401%27 HTTP/1.1" 200 None
2026-03-28 08:30:19 [auto1.be] INFO: Scrape type for HJ47401: 0
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: FY94559
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: WY04920
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: PG64643
2026-03-28 08:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PG64643%27 HTTP/1.1" 200 None
2026-03-28 08:30:19 [auto1.be] INFO: Scrape type for PG64643: 0
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: GF35922
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: BR73229
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: PV20794
2026-03-28 08:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV20794%27 HTTP/1.1" 200 None
2026-03-28 08:30:19 [auto1.be] INFO: Scrape type for PV20794: 0
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: BB63081
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: SD89253
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: SJ57770
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: XR93319
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: AB98915
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: AB83336
2026-03-28 08:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB83336%27 HTTP/1.1" 200 None
2026-03-28 08:30:19 [auto1.be] INFO: Scrape type for AB83336: 0
2026-03-28 08:30:19 [auto1.be] INFO: Found listing with ID: MR34349
2026-03-28 08:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR34349%27 HTTP/1.1" 200 None
2026-03-28 08:30:19 [auto1.be] INFO: Scrape type for MR34349: 0
2026-03-28 08:30:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PV46198/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:30:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EP21660/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:30:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WY04920/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:30:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SJ57770/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:30:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YA99172/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:30:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XX22473/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:30:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PD03709/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:30:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RC25321> (referer: https://www.auto1.com/v1/car-details-view/RC25321/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:30:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YZ86935> (referer: https://www.auto1.com/v1/car-details-view/YZ86935/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:30:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XG78459> (referer: https://www.auto1.com/v1/car-details-view/XG78459/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:30:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a810397a-27d8-53c7-8d39-8168e3de6697 with identifier: RC25321
2026-03-28 08:30:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a810397a-27d8-53c7-8d39-8168e3de6697 with scrape type 1
2026-03-28 08:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a810397a-27d8-53c7-8d39-8168e3de6697
2026-03-28 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F1a%252F591a9f4e5fa8f434e2a21d443fe5c160%252Fpa%252FRC25321_59c3e5dc5b2f0aa84fbeabc8c21c9127.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/1a/591a9f4e5fa8f434e2a21d443fe5c160/pa/RC25321_59c3e5dc5b2f0aa84fbeabc8c21c9127.jpg already downloaded
2026-03-28 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F1a%252F591a9f4e5fa8f434e2a21d443fe5c160%252Fpa%252FRC25321_a2f15c66510c2d127e9a1c990281384c.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/1a/591a9f4e5fa8f434e2a21d443fe5c160/pa/RC25321_a2f15c66510c2d127e9a1c990281384c.jpg already downloaded
2026-03-28 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F1a%252F591a9f4e5fa8f434e2a21d443fe5c160%252Fpa%252FRC25321_2f128967c7f652f8019ae26cfa0a4750.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/1a/591a9f4e5fa8f434e2a21d443fe5c160/pa/RC25321_2f128967c7f652f8019ae26cfa0a4750.jpg already downloaded
2026-03-28 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F1a%252F591a9f4e5fa8f434e2a21d443fe5c160%252Fpa%252FRC25321_241bfc213fbce2da21f32319e6256b16.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/1a/591a9f4e5fa8f434e2a21d443fe5c160/pa/RC25321_241bfc213fbce2da21f32319e6256b16.jpg already downloaded
2026-03-28 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F1a%252F591a9f4e5fa8f434e2a21d443fe5c160%252Fpa%252FRC25321_76d22d4faf7825cdf5d2d76f846cc38b.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/1a/591a9f4e5fa8f434e2a21d443fe5c160/pa/RC25321_76d22d4faf7825cdf5d2d76f846cc38b.jpg already downloaded
2026-03-28 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F1a%252F591a9f4e5fa8f434e2a21d443fe5c160%252Fpa%252FRC25321_189572b3b853f96d65778d3f5145777c.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/1a/591a9f4e5fa8f434e2a21d443fe5c160/pa/RC25321_189572b3b853f96d65778d3f5145777c.jpg already downloaded
2026-03-28 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F1a%252F591a9f4e5fa8f434e2a21d443fe5c160%252Fpa%252FRC25321_9e48107c64fb2271e8860f7792a2b937.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/1a/591a9f4e5fa8f434e2a21d443fe5c160/pa/RC25321_9e48107c64fb2271e8860f7792a2b937.jpg already downloaded
2026-03-28 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F1a%252F591a9f4e5fa8f434e2a21d443fe5c160%252Fpa%252FRC25321_b3f35408dda2ae6af7156930856175eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/1a/591a9f4e5fa8f434e2a21d443fe5c160/pa/RC25321_b3f35408dda2ae6af7156930856175eb.jpg already downloaded
2026-03-28 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F1a%252F591a9f4e5fa8f434e2a21d443fe5c160%252Fpa%252FRC25321_e5001285d2179a674d6b785587628aea.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/1a/591a9f4e5fa8f434e2a21d443fe5c160/pa/RC25321_e5001285d2179a674d6b785587628aea.jpg already downloaded
2026-03-28 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252F1a%252F591a9f4e5fa8f434e2a21d443fe5c160%252Fpa%252FRC25321_55df45098cf3ea337a8b24d0bd5d7889.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/1a/591a9f4e5fa8f434e2a21d443fe5c160/pa/RC25321_55df45098cf3ea337a8b24d0bd5d7889.jpg already downloaded
2026-03-28 08:30:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a810397a-27d8-53c7-8d39-8168e3de6697, identifier: RC25321
2026-03-28 08:30:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a810397a-27d8-53c7-8d39-8168e3de6697 with identifier: RC25321
2026-03-28 08:30:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 08:30:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 08:30:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 08:30:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 08:30:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-28 08:30:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 08:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 08:30:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a810397a-27d8-53c7-8d39-8168e3de6697 with identifier: RC25321
2026-03-28 08:30:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a810397a-27d8-53c7-8d39-8168e3de6697 with identifier: RC25321 to the API
2026-03-28 08:30:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RC25321>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.2L',
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:29:03Z',
'fuel_type': 'petrol',
'id': 'a810397a-27d8-53c7-8d39-8168e3de6697',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC25321',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Toyota',
'model': 'Auris',
'odometer': 100202,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img59/1a/591a9f4e5fa8f434e2a21d443fe5c160/pa/RC25321_59c3e5dc5b2f0aa84fbeabc8c21c9127.jpg',
'https://img-pa.auto1.com/img59/1a/591a9f4e5fa8f434e2a21d443fe5c160/pa/RC25321_a2f15c66510c2d127e9a1c990281384c.jpg',
'https://img-pa.auto1.com/img59/1a/591a9f4e5fa8f434e2a21d443fe5c160/pa/RC25321_2f128967c7f652f8019ae26cfa0a4750.jpg',
'https://img-pa.auto1.com/img59/1a/591a9f4e5fa8f434e2a21d443fe5c160/pa/RC25321_241bfc213fbce2da21f32319e6256b16.jpg',
'https://img-pa.auto1.com/img59/1a/591a9f4e5fa8f434e2a21d443fe5c160/pa/RC25321_76d22d4faf7825cdf5d2d76f846cc38b.jpg',
'https://img-pa.auto1.com/img59/1a/591a9f4e5fa8f434e2a21d443fe5c160/pa/RC25321_189572b3b853f96d65778d3f5145777c.jpg',
'https://img-pa.auto1.com/img59/1a/591a9f4e5fa8f434e2a21d443fe5c160/pa/RC25321_9e48107c64fb2271e8860f7792a2b937.jpg',
'https://img-pa.auto1.com/img59/1a/591a9f4e5fa8f434e2a21d443fe5c160/pa/RC25321_b3f35408dda2ae6af7156930856175eb.jpg',
'https://img-pa.auto1.com/img59/1a/591a9f4e5fa8f434e2a21d443fe5c160/pa/RC25321_e5001285d2179a674d6b785587628aea.jpg',
'https://img-pa.auto1.com/img59/1a/591a9f4e5fa8f434e2a21d443fe5c160/pa/RC25321_55df45098cf3ea337a8b24d0bd5d7889.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a810397a-27d8-53c7-8d39-8168e3de6697/a810397a-27d8-53c7-8d39-8168e3de6697_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65947,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/1a/591a9f4e5fa8f434e2a21d443fe5c160/pa/RC25321_59c3e5dc5b2f0aa84fbeabc8c21c9127.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a810397a-27d8-53c7-8d39-8168e3de6697/a810397a-27d8-53c7-8d39-8168e3de6697_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62852,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/1a/591a9f4e5fa8f434e2a21d443fe5c160/pa/RC25321_a2f15c66510c2d127e9a1c990281384c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a810397a-27d8-53c7-8d39-8168e3de6697/a810397a-27d8-53c7-8d39-8168e3de6697_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70955,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/1a/591a9f4e5fa8f434e2a21d443fe5c160/pa/RC25321_2f128967c7f652f8019ae26cfa0a4750.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a810397a-27d8-53c7-8d39-8168e3de6697/a810397a-27d8-53c7-8d39-8168e3de6697_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61208,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/1a/591a9f4e5fa8f434e2a21d443fe5c160/pa/RC25321_241bfc213fbce2da21f32319e6256b16.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a810397a-27d8-53c7-8d39-8168e3de6697/a810397a-27d8-53c7-8d39-8168e3de6697_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68802,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/1a/591a9f4e5fa8f434e2a21d443fe5c160/pa/RC25321_76d22d4faf7825cdf5d2d76f846cc38b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a810397a-27d8-53c7-8d39-8168e3de6697/a810397a-27d8-53c7-8d39-8168e3de6697_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67208,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/1a/591a9f4e5fa8f434e2a21d443fe5c160/pa/RC25321_189572b3b853f96d65778d3f5145777c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a810397a-27d8-53c7-8d39-8168e3de6697/a810397a-27d8-53c7-8d39-8168e3de6697_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53640,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/1a/591a9f4e5fa8f434e2a21d443fe5c160/pa/RC25321_9e48107c64fb2271e8860f7792a2b937.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a810397a-27d8-53c7-8d39-8168e3de6697/a810397a-27d8-53c7-8d39-8168e3de6697_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67943,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/1a/591a9f4e5fa8f434e2a21d443fe5c160/pa/RC25321_b3f35408dda2ae6af7156930856175eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a810397a-27d8-53c7-8d39-8168e3de6697/a810397a-27d8-53c7-8d39-8168e3de6697_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69887,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/1a/591a9f4e5fa8f434e2a21d443fe5c160/pa/RC25321_e5001285d2179a674d6b785587628aea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a810397a-27d8-53c7-8d39-8168e3de6697/a810397a-27d8-53c7-8d39-8168e3de6697_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67639,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/1a/591a9f4e5fa8f434e2a21d443fe5c160/pa/RC25321_55df45098cf3ea337a8b24d0bd5d7889.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-10-23',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Auris 1.2 Turbo Design Edition',
'transmission': 'manual',
'trim': 'Design Edition',
'year': 2017}
2026-03-28 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC25321%27 HTTP/1.1" 200 None
2026-03-28 08:30:22 [auto1.be] INFO: Saving data for RC25321: {'created_time': 1774686622.288112, 'last_price_update_time': 1774686622.288123, 'auction_closing_time': 1774884543.0}
2026-03-28 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RC25321') HTTP/1.1" 204 0
2026-03-28 08:30:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XB72565> (referer: https://www.auto1.com/v1/car-details-view/XB72565/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:30:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:30:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WY04920> (referer: https://www.auto1.com/v1/car-details-view/WY04920/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:30:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EP21660> (referer: https://www.auto1.com/v1/car-details-view/EP21660/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6af9c02e-3c22-5592-ba42-87cb997424a2 with identifier: YZ86935
2026-03-28 08:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6af9c02e-3c22-5592-ba42-87cb997424a2 with scrape type 1
2026-03-28 08:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6af9c02e-3c22-5592-ba42-87cb997424a2
2026-03-28 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9d%252F919d48961816449e878c2bdc010fcf9f%252Fpa%252FYZ86935_adec6f8c4f0e82b8b99ea9e69071b5de.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_adec6f8c4f0e82b8b99ea9e69071b5de.jpg not downloaded yet
2026-03-28 08:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99113383-36d9-5392-a76d-12671350da04 with identifier: XG78459
2026-03-28 08:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99113383-36d9-5392-a76d-12671350da04 with scrape type 1
2026-03-28 08:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 99113383-36d9-5392-a76d-12671350da04
2026-03-28 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff9%252F6ef99c763086c9fcee72b6215a6a9843%252Fpa%252FXG78459_1ee74464315d7278b80158fe39d4f0fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f9/6ef99c763086c9fcee72b6215a6a9843/pa/XG78459_1ee74464315d7278b80158fe39d4f0fa.jpg already downloaded
2026-03-28 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff9%252F6ef99c763086c9fcee72b6215a6a9843%252Fpa%252FXG78459_dff514702bccf7147e9c554bd9bd6800.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f9/6ef99c763086c9fcee72b6215a6a9843/pa/XG78459_dff514702bccf7147e9c554bd9bd6800.jpg already downloaded
2026-03-28 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff9%252F6ef99c763086c9fcee72b6215a6a9843%252Fpa%252FXG78459_47f55dc91bf7b8a8c5c2639af41470e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f9/6ef99c763086c9fcee72b6215a6a9843/pa/XG78459_47f55dc91bf7b8a8c5c2639af41470e1.jpg already downloaded
2026-03-28 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff9%252F6ef99c763086c9fcee72b6215a6a9843%252Fpa%252FXG78459_23a0fc770d989c8a01d9efa45686fbab.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f9/6ef99c763086c9fcee72b6215a6a9843/pa/XG78459_23a0fc770d989c8a01d9efa45686fbab.jpg already downloaded
2026-03-28 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff9%252F6ef99c763086c9fcee72b6215a6a9843%252Fpa%252FXG78459_5711d0236ad08dc10157070cff561723.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f9/6ef99c763086c9fcee72b6215a6a9843/pa/XG78459_5711d0236ad08dc10157070cff561723.jpg already downloaded
2026-03-28 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff9%252F6ef99c763086c9fcee72b6215a6a9843%252Fpa%252FXG78459_5097392cca589445a6f40476ef036030.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f9/6ef99c763086c9fcee72b6215a6a9843/pa/XG78459_5097392cca589445a6f40476ef036030.jpg already downloaded
2026-03-28 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff9%252F6ef99c763086c9fcee72b6215a6a9843%252Fpa%252FXG78459_04f3788c564b6bb9656d2dcfb1db8edd.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f9/6ef99c763086c9fcee72b6215a6a9843/pa/XG78459_04f3788c564b6bb9656d2dcfb1db8edd.jpg already downloaded
2026-03-28 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff9%252F6ef99c763086c9fcee72b6215a6a9843%252Fpa%252FXG78459_b5ea2303b124ac077af2590c37f015b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f9/6ef99c763086c9fcee72b6215a6a9843/pa/XG78459_b5ea2303b124ac077af2590c37f015b0.jpg already downloaded
2026-03-28 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff9%252F6ef99c763086c9fcee72b6215a6a9843%252Fpa%252FXG78459_a584dd65683b5eb6c114b6231066f7d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f9/6ef99c763086c9fcee72b6215a6a9843/pa/XG78459_a584dd65683b5eb6c114b6231066f7d4.jpg already downloaded
2026-03-28 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff9%252F6ef99c763086c9fcee72b6215a6a9843%252Fpa%252FXG78459_d421ac7be07fe20d0b40ac1fb75a5f9d.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f9/6ef99c763086c9fcee72b6215a6a9843/pa/XG78459_d421ac7be07fe20d0b40ac1fb75a5f9d.jpg already downloaded
2026-03-28 08:30:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 99113383-36d9-5392-a76d-12671350da04, identifier: XG78459
2026-03-28 08:30:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 99113383-36d9-5392-a76d-12671350da04 with identifier: XG78459
2026-03-28 08:30:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 99113383-36d9-5392-a76d-12671350da04 with identifier: XG78459
2026-03-28 08:30:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 99113383-36d9-5392-a76d-12671350da04 with identifier: XG78459 to the API
2026-03-28 08:30:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XG78459>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:25:02Z',
'fuel_type': 'diesel',
'id': '99113383-36d9-5392-a76d-12671350da04',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG78459',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Volvo',
'model': 'S60',
'odometer': 217480,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img6e/f9/6ef99c763086c9fcee72b6215a6a9843/pa/XG78459_1ee74464315d7278b80158fe39d4f0fa.jpg',
'https://img-pa.auto1.com/img6e/f9/6ef99c763086c9fcee72b6215a6a9843/pa/XG78459_dff514702bccf7147e9c554bd9bd6800.jpg',
'https://img-pa.auto1.com/img6e/f9/6ef99c763086c9fcee72b6215a6a9843/pa/XG78459_47f55dc91bf7b8a8c5c2639af41470e1.jpg',
'https://img-pa.auto1.com/img6e/f9/6ef99c763086c9fcee72b6215a6a9843/pa/XG78459_23a0fc770d989c8a01d9efa45686fbab.jpg',
'https://img-pa.auto1.com/img6e/f9/6ef99c763086c9fcee72b6215a6a9843/pa/XG78459_5711d0236ad08dc10157070cff561723.jpg',
'https://img-pa.auto1.com/img6e/f9/6ef99c763086c9fcee72b6215a6a9843/pa/XG78459_5097392cca589445a6f40476ef036030.jpg',
'https://img-pa.auto1.com/img6e/f9/6ef99c763086c9fcee72b6215a6a9843/pa/XG78459_04f3788c564b6bb9656d2dcfb1db8edd.jpg',
'https://img-pa.auto1.com/img6e/f9/6ef99c763086c9fcee72b6215a6a9843/pa/XG78459_b5ea2303b124ac077af2590c37f015b0.jpg',
'https://img-pa.auto1.com/img6e/f9/6ef99c763086c9fcee72b6215a6a9843/pa/XG78459_a584dd65683b5eb6c114b6231066f7d4.jpg',
'https://img-pa.auto1.com/img6e/f9/6ef99c763086c9fcee72b6215a6a9843/pa/XG78459_d421ac7be07fe20d0b40ac1fb75a5f9d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99113383-36d9-5392-a76d-12671350da04/99113383-36d9-5392-a76d-12671350da04_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74085,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/f9/6ef99c763086c9fcee72b6215a6a9843/pa/XG78459_1ee74464315d7278b80158fe39d4f0fa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99113383-36d9-5392-a76d-12671350da04/99113383-36d9-5392-a76d-12671350da04_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69168,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/f9/6ef99c763086c9fcee72b6215a6a9843/pa/XG78459_dff514702bccf7147e9c554bd9bd6800.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99113383-36d9-5392-a76d-12671350da04/99113383-36d9-5392-a76d-12671350da04_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68287,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/f9/6ef99c763086c9fcee72b6215a6a9843/pa/XG78459_47f55dc91bf7b8a8c5c2639af41470e1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99113383-36d9-5392-a76d-12671350da04/99113383-36d9-5392-a76d-12671350da04_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61253,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/f9/6ef99c763086c9fcee72b6215a6a9843/pa/XG78459_23a0fc770d989c8a01d9efa45686fbab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99113383-36d9-5392-a76d-12671350da04/99113383-36d9-5392-a76d-12671350da04_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63393,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/f9/6ef99c763086c9fcee72b6215a6a9843/pa/XG78459_5711d0236ad08dc10157070cff561723.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99113383-36d9-5392-a76d-12671350da04/99113383-36d9-5392-a76d-12671350da04_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63927,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/f9/6ef99c763086c9fcee72b6215a6a9843/pa/XG78459_5097392cca589445a6f40476ef036030.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99113383-36d9-5392-a76d-12671350da04/99113383-36d9-5392-a76d-12671350da04_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61045,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/f9/6ef99c763086c9fcee72b6215a6a9843/pa/XG78459_04f3788c564b6bb9656d2dcfb1db8edd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99113383-36d9-5392-a76d-12671350da04/99113383-36d9-5392-a76d-12671350da04_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73099,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/f9/6ef99c763086c9fcee72b6215a6a9843/pa/XG78459_b5ea2303b124ac077af2590c37f015b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99113383-36d9-5392-a76d-12671350da04/99113383-36d9-5392-a76d-12671350da04_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68719,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/f9/6ef99c763086c9fcee72b6215a6a9843/pa/XG78459_a584dd65683b5eb6c114b6231066f7d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99113383-36d9-5392-a76d-12671350da04/99113383-36d9-5392-a76d-12671350da04_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66968,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6e/f9/6ef99c763086c9fcee72b6215a6a9843/pa/XG78459_d421ac7be07fe20d0b40ac1fb75a5f9d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-09-18',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo S60 1.6 D2 Summum',
'transmission': 'manual',
'trim': 'Summum',
'year': 2011}
2026-03-28 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG78459%27 HTTP/1.1" 200 None
2026-03-28 08:30:23 [auto1.be] INFO: Saving data for XG78459: {'created_time': 1774686623.67846, 'last_price_update_time': 1774686623.67847, 'auction_closing_time': 1774884302.0}
2026-03-28 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XG78459') HTTP/1.1" 204 0
2026-03-28 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9d%252F919d48961816449e878c2bdc010fcf9f%252Fpa%252FYZ86935_1adaccd743fe1be39b87e7e3bef05890.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_1adaccd743fe1be39b87e7e3bef05890.jpg not downloaded yet
2026-03-28 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9d%252F919d48961816449e878c2bdc010fcf9f%252Fpa%252FYZ86935_e9ec8ce775e862e795bb700092a071f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_e9ec8ce775e862e795bb700092a071f1.jpg not downloaded yet
2026-03-28 08:30:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b939a141-7d36-5e5c-8878-99839cc8c1aa with identifier: XB72565
2026-03-28 08:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b939a141-7d36-5e5c-8878-99839cc8c1aa with scrape type 1
2026-03-28 08:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b939a141-7d36-5e5c-8878-99839cc8c1aa
2026-03-28 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F86%252Fe0860d689a533793e105b17132c6e804%252Fpa%252FXB72565_1c7639ba496c2e11db259f83b0b00ebc.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/86/e0860d689a533793e105b17132c6e804/pa/XB72565_1c7639ba496c2e11db259f83b0b00ebc.jpg not downloaded yet
2026-03-28 08:30:23 [auto1.be] INFO: Channel: 24h | Page: 2 | totalHits: 1700 | hits on page: 40
2026-03-28 08:30:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34d41633-c89c-5c81-8d05-452ae275da35 with identifier: WY04920
2026-03-28 08:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34d41633-c89c-5c81-8d05-452ae275da35 with scrape type 1
2026-03-28 08:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 34d41633-c89c-5c81-8d05-452ae275da35
2026-03-28 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1f%252Fd21fbbd089afe1d52cebbabfc5ec4d92%252Fpa%252FWY04920_dcb425e3b158ef6628f84ceb90230ca5.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1f/d21fbbd089afe1d52cebbabfc5ec4d92/pa/WY04920_dcb425e3b158ef6628f84ceb90230ca5.jpg already downloaded
2026-03-28 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1f%252Fd21fbbd089afe1d52cebbabfc5ec4d92%252Fpa%252FWY04920_a72d61f14ce915500894ef0ab1ebc2e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1f/d21fbbd089afe1d52cebbabfc5ec4d92/pa/WY04920_a72d61f14ce915500894ef0ab1ebc2e9.jpg already downloaded
2026-03-28 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1f%252Fd21fbbd089afe1d52cebbabfc5ec4d92%252Fpa%252FWY04920_33d61eed9ab5857aadc374b4cd70a93c.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1f/d21fbbd089afe1d52cebbabfc5ec4d92/pa/WY04920_33d61eed9ab5857aadc374b4cd70a93c.jpg already downloaded
2026-03-28 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1f%252Fd21fbbd089afe1d52cebbabfc5ec4d92%252Fpa%252FWY04920_605cae370fc8536f3e2a41713ef0b790.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1f/d21fbbd089afe1d52cebbabfc5ec4d92/pa/WY04920_605cae370fc8536f3e2a41713ef0b790.jpg already downloaded
2026-03-28 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1f%252Fd21fbbd089afe1d52cebbabfc5ec4d92%252Fpa%252FWY04920_9bf04a9337bb0be6541d7a4443c8112a.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1f/d21fbbd089afe1d52cebbabfc5ec4d92/pa/WY04920_9bf04a9337bb0be6541d7a4443c8112a.jpg already downloaded
2026-03-28 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1f%252Fd21fbbd089afe1d52cebbabfc5ec4d92%252Fpa%252FWY04920_64a1caa338491b81d7b9b96ce95223fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1f/d21fbbd089afe1d52cebbabfc5ec4d92/pa/WY04920_64a1caa338491b81d7b9b96ce95223fe.jpg already downloaded
2026-03-28 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1f%252Fd21fbbd089afe1d52cebbabfc5ec4d92%252Fpa%252FWY04920_bcc6f5704f866044c8b7776fc4d31912.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1f/d21fbbd089afe1d52cebbabfc5ec4d92/pa/WY04920_bcc6f5704f866044c8b7776fc4d31912.jpg already downloaded
2026-03-28 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1f%252Fd21fbbd089afe1d52cebbabfc5ec4d92%252Fpa%252FWY04920_d45cb7d6cbf816c7418725675517ae80.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1f/d21fbbd089afe1d52cebbabfc5ec4d92/pa/WY04920_d45cb7d6cbf816c7418725675517ae80.jpg already downloaded
2026-03-28 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1f%252Fd21fbbd089afe1d52cebbabfc5ec4d92%252Fpa%252FWY04920_74573a930d341079ec2c0dfe346c8f4f.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1f/d21fbbd089afe1d52cebbabfc5ec4d92/pa/WY04920_74573a930d341079ec2c0dfe346c8f4f.jpg already downloaded
2026-03-28 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F1f%252Fd21fbbd089afe1d52cebbabfc5ec4d92%252Fpa%252FWY04920_c48ba7373ff67361e494e7a4d5c77baa.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/1f/d21fbbd089afe1d52cebbabfc5ec4d92/pa/WY04920_c48ba7373ff67361e494e7a4d5c77baa.jpg already downloaded
2026-03-28 08:30:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 34d41633-c89c-5c81-8d05-452ae275da35, identifier: WY04920
2026-03-28 08:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0c18fd3-3e02-5946-b55a-e8db1ea81413 with identifier: EP21660
2026-03-28 08:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0c18fd3-3e02-5946-b55a-e8db1ea81413 with scrape type 1
2026-03-28 08:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a0c18fd3-3e02-5946-b55a-e8db1ea81413
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff2%252F7df259cabf11dee4d77d8fe7bf01b8ab%252Fpa%252FEP21660_4abdf1adfd5f792bda43043681e90e22.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_4abdf1adfd5f792bda43043681e90e22.jpg not downloaded yet
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9d%252F919d48961816449e878c2bdc010fcf9f%252Fpa%252FYZ86935_d4fa18a087811c7e6e151e94c606bb23.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_d4fa18a087811c7e6e151e94c606bb23.jpg not downloaded yet
2026-03-28 08:30:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 34d41633-c89c-5c81-8d05-452ae275da35 with identifier: WY04920
2026-03-28 08:30:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 34d41633-c89c-5c81-8d05-452ae275da35 with identifier: WY04920
2026-03-28 08:30:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 34d41633-c89c-5c81-8d05-452ae275da35 with identifier: WY04920 to the API
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WY04920>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 98,
'expiration_date': '2026-03-30T15:19:47Z',
'fuel_type': 'petrol',
'id': '34d41633-c89c-5c81-8d05-452ae275da35',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY04920',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'MINI',
'model': 'MINI',
'odometer': 106400,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgd2/1f/d21fbbd089afe1d52cebbabfc5ec4d92/pa/WY04920_dcb425e3b158ef6628f84ceb90230ca5.jpg',
'https://img-pa.auto1.com/imgd2/1f/d21fbbd089afe1d52cebbabfc5ec4d92/pa/WY04920_a72d61f14ce915500894ef0ab1ebc2e9.jpg',
'https://img-pa.auto1.com/imgd2/1f/d21fbbd089afe1d52cebbabfc5ec4d92/pa/WY04920_33d61eed9ab5857aadc374b4cd70a93c.jpg',
'https://img-pa.auto1.com/imgd2/1f/d21fbbd089afe1d52cebbabfc5ec4d92/pa/WY04920_605cae370fc8536f3e2a41713ef0b790.jpg',
'https://img-pa.auto1.com/imgd2/1f/d21fbbd089afe1d52cebbabfc5ec4d92/pa/WY04920_9bf04a9337bb0be6541d7a4443c8112a.jpg',
'https://img-pa.auto1.com/imgd2/1f/d21fbbd089afe1d52cebbabfc5ec4d92/pa/WY04920_64a1caa338491b81d7b9b96ce95223fe.jpg',
'https://img-pa.auto1.com/imgd2/1f/d21fbbd089afe1d52cebbabfc5ec4d92/pa/WY04920_bcc6f5704f866044c8b7776fc4d31912.jpg',
'https://img-pa.auto1.com/imgd2/1f/d21fbbd089afe1d52cebbabfc5ec4d92/pa/WY04920_d45cb7d6cbf816c7418725675517ae80.jpg',
'https://img-pa.auto1.com/imgd2/1f/d21fbbd089afe1d52cebbabfc5ec4d92/pa/WY04920_74573a930d341079ec2c0dfe346c8f4f.jpg',
'https://img-pa.auto1.com/imgd2/1f/d21fbbd089afe1d52cebbabfc5ec4d92/pa/WY04920_c48ba7373ff67361e494e7a4d5c77baa.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34d41633-c89c-5c81-8d05-452ae275da35/34d41633-c89c-5c81-8d05-452ae275da35_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2474547,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21fbbd089afe1d52cebbabfc5ec4d92/pa/WY04920_dcb425e3b158ef6628f84ceb90230ca5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34d41633-c89c-5c81-8d05-452ae275da35/34d41633-c89c-5c81-8d05-452ae275da35_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68510,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21fbbd089afe1d52cebbabfc5ec4d92/pa/WY04920_a72d61f14ce915500894ef0ab1ebc2e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34d41633-c89c-5c81-8d05-452ae275da35/34d41633-c89c-5c81-8d05-452ae275da35_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2663018,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21fbbd089afe1d52cebbabfc5ec4d92/pa/WY04920_33d61eed9ab5857aadc374b4cd70a93c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34d41633-c89c-5c81-8d05-452ae275da35/34d41633-c89c-5c81-8d05-452ae275da35_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58346,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21fbbd089afe1d52cebbabfc5ec4d92/pa/WY04920_605cae370fc8536f3e2a41713ef0b790.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34d41633-c89c-5c81-8d05-452ae275da35/34d41633-c89c-5c81-8d05-452ae275da35_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2394531,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21fbbd089afe1d52cebbabfc5ec4d92/pa/WY04920_9bf04a9337bb0be6541d7a4443c8112a.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34d41633-c89c-5c81-8d05-452ae275da35/34d41633-c89c-5c81-8d05-452ae275da35_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2484910,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21fbbd089afe1d52cebbabfc5ec4d92/pa/WY04920_64a1caa338491b81d7b9b96ce95223fe.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34d41633-c89c-5c81-8d05-452ae275da35/34d41633-c89c-5c81-8d05-452ae275da35_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56600,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21fbbd089afe1d52cebbabfc5ec4d92/pa/WY04920_bcc6f5704f866044c8b7776fc4d31912.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34d41633-c89c-5c81-8d05-452ae275da35/34d41633-c89c-5c81-8d05-452ae275da35_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2385372,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21fbbd089afe1d52cebbabfc5ec4d92/pa/WY04920_d45cb7d6cbf816c7418725675517ae80.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34d41633-c89c-5c81-8d05-452ae275da35/34d41633-c89c-5c81-8d05-452ae275da35_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67423,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21fbbd089afe1d52cebbabfc5ec4d92/pa/WY04920_74573a930d341079ec2c0dfe346c8f4f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34d41633-c89c-5c81-8d05-452ae275da35/34d41633-c89c-5c81-8d05-452ae275da35_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67978,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/1f/d21fbbd089afe1d52cebbabfc5ec4d92/pa/WY04920_c48ba7373ff67361e494e7a4d5c77baa.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-03-07',
'seats_number': 4,
'seller_name': None,
'title': 'MINI One',
'transmission': 'manual',
'trim': '',
'year': 2013}
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WY04920%27 HTTP/1.1" 200 None
2026-03-28 08:30:24 [auto1.be] INFO: Saving data for WY04920: {'created_time': 1774686624.466636, 'last_price_update_time': 1774686624.466646, 'auction_closing_time': 1774883987.0}
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WY04920') HTTP/1.1" 204 0
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F86%252Fe0860d689a533793e105b17132c6e804%252Fpa%252FXB72565_a8dac61ad4aab26f8efb2b0814774e35.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/86/e0860d689a533793e105b17132c6e804/pa/XB72565_a8dac61ad4aab26f8efb2b0814774e35.jpg not downloaded yet
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: XL09418
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: UW48636
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW48636%27 HTTP/1.1" 200 None
2026-03-28 08:30:24 [auto1.be] INFO: Scrape type for UW48636: 0
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: PX22691
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: YA69116
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA69116%27 HTTP/1.1" 200 None
2026-03-28 08:30:24 [auto1.be] INFO: Scrape type for YA69116: 0
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: JD01885
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JD01885%27 HTTP/1.1" 200 None
2026-03-28 08:30:24 [auto1.be] INFO: Scrape type for JD01885: 0
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: PL61351
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL61351%27 HTTP/1.1" 200 None
2026-03-28 08:30:24 [auto1.be] INFO: Scrape type for PL61351: 0
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: NE40925
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: TU29469
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: YX19447
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX19447%27 HTTP/1.1" 200 None
2026-03-28 08:30:24 [auto1.be] INFO: Scrape type for YX19447: 0
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: ZP62550
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: YN02015
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN02015%27 HTTP/1.1" 200 None
2026-03-28 08:30:24 [auto1.be] INFO: Scrape type for YN02015: 0
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: EZ55101
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ55101%27 HTTP/1.1" 200 None
2026-03-28 08:30:24 [auto1.be] INFO: Scrape type for EZ55101: 0
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: WA82695
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: MK20825
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK20825%27 HTTP/1.1" 200 None
2026-03-28 08:30:24 [auto1.be] INFO: Scrape type for MK20825: 0
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: GK88228
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GK88228%27 HTTP/1.1" 200 None
2026-03-28 08:30:24 [auto1.be] INFO: Scrape type for GK88228: 0
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: WV47829
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV47829%27 HTTP/1.1" 200 None
2026-03-28 08:30:24 [auto1.be] INFO: Scrape type for WV47829: 0
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: KX87020
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX87020%27 HTTP/1.1" 200 None
2026-03-28 08:30:24 [auto1.be] INFO: Scrape type for KX87020: 0
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: AK97810
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK97810%27 HTTP/1.1" 200 None
2026-03-28 08:30:24 [auto1.be] INFO: Scrape type for AK97810: 0
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: RE30310
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: BA79285
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: ZH21985
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: WX93406
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: TU23478
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: ET15377
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET15377%27 HTTP/1.1" 200 None
2026-03-28 08:30:24 [auto1.be] INFO: Scrape type for ET15377: 0
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: NH68811
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: UB07200
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB07200%27 HTTP/1.1" 200 None
2026-03-28 08:30:24 [auto1.be] INFO: Scrape type for UB07200: 0
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: SK39898
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: JK00802
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JK00802%27 HTTP/1.1" 200 None
2026-03-28 08:30:24 [auto1.be] INFO: Scrape type for JK00802: 0
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: PZ36955
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PZ36955%27 HTTP/1.1" 200 None
2026-03-28 08:30:24 [auto1.be] INFO: Scrape type for PZ36955: 0
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: NY11434
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: XE88192
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: ZN43275
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN43275%27 HTTP/1.1" 200 None
2026-03-28 08:30:24 [auto1.be] INFO: Scrape type for ZN43275: 0
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: AV76677
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV76677%27 HTTP/1.1" 200 None
2026-03-28 08:30:24 [auto1.be] INFO: Scrape type for AV76677: 0
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: BA37972
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA37972%27 HTTP/1.1" 200 None
2026-03-28 08:30:24 [auto1.be] INFO: Scrape type for BA37972: 0
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: JN48445
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JN48445%27 HTTP/1.1" 200 None
2026-03-28 08:30:24 [auto1.be] INFO: Scrape type for JN48445: 0
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: FU55081
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: RB14392
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: MY55708
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: XK15851
2026-03-28 08:30:24 [auto1.be] INFO: Found listing with ID: AU94213
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU94213%27 HTTP/1.1" 200 None
2026-03-28 08:30:24 [auto1.be] INFO: Scrape type for AU94213: 0
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff2%252F7df259cabf11dee4d77d8fe7bf01b8ab%252Fpa%252FEP21660_9c4009bf5e5d7d5f2911289cab863c76.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_9c4009bf5e5d7d5f2911289cab863c76.jpg not downloaded yet
2026-03-28 08:30:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9d%252F919d48961816449e878c2bdc010fcf9f%252Fpa%252FYZ86935_9ca3c872c9919fb74eb0f9c61d3a91f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_9ca3c872c9919fb74eb0f9c61d3a91f0.jpg not downloaded yet
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F86%252Fe0860d689a533793e105b17132c6e804%252Fpa%252FXB72565_c74e19101c042aca6aada37304bdd67d.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/86/e0860d689a533793e105b17132c6e804/pa/XB72565_c74e19101c042aca6aada37304bdd67d.jpg not downloaded yet
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff2%252F7df259cabf11dee4d77d8fe7bf01b8ab%252Fpa%252FEP21660_0905d777f99c1accc025d9808503553f.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_0905d777f99c1accc025d9808503553f.jpg not downloaded yet
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9d%252F919d48961816449e878c2bdc010fcf9f%252Fpa%252FYZ86935_bcc6497aa130cee76334522c5ec0f7ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_bcc6497aa130cee76334522c5ec0f7ad.jpg not downloaded yet
2026-03-28 08:30:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XX22473> (referer: https://www.auto1.com/v1/car-details-view/XX22473/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:30:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YA99172> (referer: https://www.auto1.com/v1/car-details-view/YA99172/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F86%252Fe0860d689a533793e105b17132c6e804%252Fpa%252FXB72565_4ddf3f2980d6ddb585cc51cb405a7987.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/86/e0860d689a533793e105b17132c6e804/pa/XB72565_4ddf3f2980d6ddb585cc51cb405a7987.jpg not downloaded yet
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff2%252F7df259cabf11dee4d77d8fe7bf01b8ab%252Fpa%252FEP21660_8678947dbfb4c5b5cf449715da175296.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_8678947dbfb4c5b5cf449715da175296.jpg not downloaded yet
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9d%252F919d48961816449e878c2bdc010fcf9f%252Fpa%252FYZ86935_a60ef42be95e71058d3b33ec0883ee55.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_a60ef42be95e71058d3b33ec0883ee55.jpg not downloaded yet
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F86%252Fe0860d689a533793e105b17132c6e804%252Fpa%252FXB72565_33c56796a6fbdf7af15a0939cb578ddc.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/86/e0860d689a533793e105b17132c6e804/pa/XB72565_33c56796a6fbdf7af15a0939cb578ddc.jpg not downloaded yet
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff2%252F7df259cabf11dee4d77d8fe7bf01b8ab%252Fpa%252FEP21660_e187c4205d0eb59ab03dfd773a3ab60b.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_e187c4205d0eb59ab03dfd773a3ab60b.jpg not downloaded yet
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9d%252F919d48961816449e878c2bdc010fcf9f%252Fpa%252FYZ86935_af1eb9c5530159150be75e00b8455224.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_af1eb9c5530159150be75e00b8455224.jpg not downloaded yet
2026-03-28 08:30:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SJ57770> (referer: https://www.auto1.com/v1/car-details-view/SJ57770/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F86%252Fe0860d689a533793e105b17132c6e804%252Fpa%252FXB72565_86529f164baf0624c1bafa074e424f43.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/86/e0860d689a533793e105b17132c6e804/pa/XB72565_86529f164baf0624c1bafa074e424f43.jpg not downloaded yet
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff2%252F7df259cabf11dee4d77d8fe7bf01b8ab%252Fpa%252FEP21660_49260f7abaed3cbfd0d613e5836bc332.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_49260f7abaed3cbfd0d613e5836bc332.jpg not downloaded yet
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9d%252F919d48961816449e878c2bdc010fcf9f%252Fpa%252FYZ86935_f23ddcc485eaa8705d0bf5d428cbbf85.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_f23ddcc485eaa8705d0bf5d428cbbf85.jpg not downloaded yet
2026-03-28 08:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2637847d-d04e-5098-93ad-f77b7b465c28 with identifier: XX22473
2026-03-28 08:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2637847d-d04e-5098-93ad-f77b7b465c28 with scrape type 1
2026-03-28 08:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2637847d-d04e-5098-93ad-f77b7b465c28
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F97%252Fd297b99913244adb8845494d1b166b25%252Fpa%252FXX22473_630a2b7dbaf5e1f2dc7e1ddbb598dbcc.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/97/d297b99913244adb8845494d1b166b25/pa/XX22473_630a2b7dbaf5e1f2dc7e1ddbb598dbcc.jpg already downloaded
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F97%252Fd297b99913244adb8845494d1b166b25%252Fpa%252FXX22473_46a33427a4f0eeba554a5d91d90ca384.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/97/d297b99913244adb8845494d1b166b25/pa/XX22473_46a33427a4f0eeba554a5d91d90ca384.jpg already downloaded
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F97%252Fd297b99913244adb8845494d1b166b25%252Fpa%252FXX22473_eb08614ef1adb969e99f833496bf57ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/97/d297b99913244adb8845494d1b166b25/pa/XX22473_eb08614ef1adb969e99f833496bf57ac.jpg already downloaded
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F97%252Fd297b99913244adb8845494d1b166b25%252Fpa%252FXX22473_45e2cf13af48752d94a281e195b02919.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/97/d297b99913244adb8845494d1b166b25/pa/XX22473_45e2cf13af48752d94a281e195b02919.jpg already downloaded
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F97%252Fd297b99913244adb8845494d1b166b25%252Fpa%252FXX22473_85769c4e63ee1283ff37569670d0cd68.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/97/d297b99913244adb8845494d1b166b25/pa/XX22473_85769c4e63ee1283ff37569670d0cd68.jpg already downloaded
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F97%252Fd297b99913244adb8845494d1b166b25%252Fpa%252FXX22473_23957c916aee7cbbfbfa93727acf1ceb.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/97/d297b99913244adb8845494d1b166b25/pa/XX22473_23957c916aee7cbbfbfa93727acf1ceb.jpg already downloaded
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F97%252Fd297b99913244adb8845494d1b166b25%252Fpa%252FXX22473_a507fb12d0b35b489b3eb104f6b8aaf3.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/97/d297b99913244adb8845494d1b166b25/pa/XX22473_a507fb12d0b35b489b3eb104f6b8aaf3.jpg already downloaded
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F97%252Fd297b99913244adb8845494d1b166b25%252Fpa%252FXX22473_ead756c57010b50f39ac56b0c2136e09.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/97/d297b99913244adb8845494d1b166b25/pa/XX22473_ead756c57010b50f39ac56b0c2136e09.jpg already downloaded
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F97%252Fd297b99913244adb8845494d1b166b25%252Fpa%252FXX22473_04b41b212aba465eb728967326562841.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/97/d297b99913244adb8845494d1b166b25/pa/XX22473_04b41b212aba465eb728967326562841.jpg already downloaded
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F97%252Fd297b99913244adb8845494d1b166b25%252Fpa%252FXX22473_131905c7ec616d723bafdccb94bb4204.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/97/d297b99913244adb8845494d1b166b25/pa/XX22473_131905c7ec616d723bafdccb94bb4204.jpg already downloaded
2026-03-28 08:30:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2637847d-d04e-5098-93ad-f77b7b465c28, identifier: XX22473
2026-03-28 08:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bda98b99-4937-5a42-8e63-c32c9fb7bce0 with identifier: YA99172
2026-03-28 08:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bda98b99-4937-5a42-8e63-c32c9fb7bce0 with scrape type 1
2026-03-28 08:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bda98b99-4937-5a42-8e63-c32c9fb7bce0
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F05%252F20051b867c2006dc84fa8cf2319bc1d6%252Fpa%252FYA99172_74a4092c7f472c193ca7f8ebc8c615e6.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_74a4092c7f472c193ca7f8ebc8c615e6.jpg not downloaded yet
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff2%252F7df259cabf11dee4d77d8fe7bf01b8ab%252Fpa%252FEP21660_c1cfe0e286ddc7541d1def3ff9246cfd.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_c1cfe0e286ddc7541d1def3ff9246cfd.jpg not downloaded yet
2026-03-28 08:30:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2637847d-d04e-5098-93ad-f77b7b465c28 with identifier: XX22473
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 08:30:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 08:30:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2637847d-d04e-5098-93ad-f77b7b465c28 with identifier: XX22473
2026-03-28 08:30:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2637847d-d04e-5098-93ad-f77b7b465c28 with identifier: XX22473 to the API
2026-03-28 08:30:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XX22473>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:18:16Z',
'fuel_type': 'diesel',
'id': '2637847d-d04e-5098-93ad-f77b7b465c28',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX22473',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'BMW',
'model': '5er',
'odometer': 121488,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgd2/97/d297b99913244adb8845494d1b166b25/pa/XX22473_630a2b7dbaf5e1f2dc7e1ddbb598dbcc.jpg',
'https://img-pa.auto1.com/imgd2/97/d297b99913244adb8845494d1b166b25/pa/XX22473_46a33427a4f0eeba554a5d91d90ca384.jpg',
'https://img-pa.auto1.com/imgd2/97/d297b99913244adb8845494d1b166b25/pa/XX22473_eb08614ef1adb969e99f833496bf57ac.jpg',
'https://img-pa.auto1.com/imgd2/97/d297b99913244adb8845494d1b166b25/pa/XX22473_45e2cf13af48752d94a281e195b02919.jpg',
'https://img-pa.auto1.com/imgd2/97/d297b99913244adb8845494d1b166b25/pa/XX22473_85769c4e63ee1283ff37569670d0cd68.jpg',
'https://img-pa.auto1.com/imgd2/97/d297b99913244adb8845494d1b166b25/pa/XX22473_23957c916aee7cbbfbfa93727acf1ceb.jpg',
'https://img-pa.auto1.com/imgd2/97/d297b99913244adb8845494d1b166b25/pa/XX22473_a507fb12d0b35b489b3eb104f6b8aaf3.jpg',
'https://img-pa.auto1.com/imgd2/97/d297b99913244adb8845494d1b166b25/pa/XX22473_ead756c57010b50f39ac56b0c2136e09.jpg',
'https://img-pa.auto1.com/imgd2/97/d297b99913244adb8845494d1b166b25/pa/XX22473_04b41b212aba465eb728967326562841.jpg',
'https://img-pa.auto1.com/imgd2/97/d297b99913244adb8845494d1b166b25/pa/XX22473_131905c7ec616d723bafdccb94bb4204.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2637847d-d04e-5098-93ad-f77b7b465c28/2637847d-d04e-5098-93ad-f77b7b465c28_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2728494,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/97/d297b99913244adb8845494d1b166b25/pa/XX22473_630a2b7dbaf5e1f2dc7e1ddbb598dbcc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2637847d-d04e-5098-93ad-f77b7b465c28/2637847d-d04e-5098-93ad-f77b7b465c28_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2772258,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/97/d297b99913244adb8845494d1b166b25/pa/XX22473_46a33427a4f0eeba554a5d91d90ca384.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2637847d-d04e-5098-93ad-f77b7b465c28/2637847d-d04e-5098-93ad-f77b7b465c28_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75874,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/97/d297b99913244adb8845494d1b166b25/pa/XX22473_eb08614ef1adb969e99f833496bf57ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2637847d-d04e-5098-93ad-f77b7b465c28/2637847d-d04e-5098-93ad-f77b7b465c28_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2879992,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/97/d297b99913244adb8845494d1b166b25/pa/XX22473_45e2cf13af48752d94a281e195b02919.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2637847d-d04e-5098-93ad-f77b7b465c28/2637847d-d04e-5098-93ad-f77b7b465c28_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63028,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/97/d297b99913244adb8845494d1b166b25/pa/XX22473_85769c4e63ee1283ff37569670d0cd68.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2637847d-d04e-5098-93ad-f77b7b465c28/2637847d-d04e-5098-93ad-f77b7b465c28_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72747,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/97/d297b99913244adb8845494d1b166b25/pa/XX22473_23957c916aee7cbbfbfa93727acf1ceb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2637847d-d04e-5098-93ad-f77b7b465c28/2637847d-d04e-5098-93ad-f77b7b465c28_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61064,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/97/d297b99913244adb8845494d1b166b25/pa/XX22473_a507fb12d0b35b489b3eb104f6b8aaf3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2637847d-d04e-5098-93ad-f77b7b465c28/2637847d-d04e-5098-93ad-f77b7b465c28_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76787,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/97/d297b99913244adb8845494d1b166b25/pa/XX22473_ead756c57010b50f39ac56b0c2136e09.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2637847d-d04e-5098-93ad-f77b7b465c28/2637847d-d04e-5098-93ad-f77b7b465c28_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70678,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/97/d297b99913244adb8845494d1b166b25/pa/XX22473_04b41b212aba465eb728967326562841.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2637847d-d04e-5098-93ad-f77b7b465c28/2637847d-d04e-5098-93ad-f77b7b465c28_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58017,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd2/97/d297b99913244adb8845494d1b166b25/pa/XX22473_131905c7ec616d723bafdccb94bb4204.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-04-14',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 5er 520d Lounge',
'transmission': 'automatic',
'trim': 'Lounge',
'year': 2015}
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XX22473%27 HTTP/1.1" 200 None
2026-03-28 08:30:26 [auto1.be] INFO: Saving data for XX22473: {'created_time': 1774686626.272066, 'last_price_update_time': 1774686626.272076, 'auction_closing_time': 1774883896.0}
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XX22473') HTTP/1.1" 204 0
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9d%252F919d48961816449e878c2bdc010fcf9f%252Fpa%252FYZ86935_f7e5d1fb657e246047f5b721f0bc45de.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_f7e5d1fb657e246047f5b721f0bc45de.jpg not downloaded yet
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F05%252F20051b867c2006dc84fa8cf2319bc1d6%252Fpa%252FYA99172_23b56eae742976fcb54b055b031b4bb8.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_23b56eae742976fcb54b055b031b4bb8.jpg not downloaded yet
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff2%252F7df259cabf11dee4d77d8fe7bf01b8ab%252Fpa%252FEP21660_cf619bca08dd7d4e7596257630c11264.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_cf619bca08dd7d4e7596257630c11264.jpg not downloaded yet
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F05%252F20051b867c2006dc84fa8cf2319bc1d6%252Fpa%252FYA99172_0de78627cc53613742a448c9c74cc2d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_0de78627cc53613742a448c9c74cc2d6.jpg not downloaded yet
2026-03-28 08:30:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1 with identifier: SJ57770
2026-03-28 08:30:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1 with scrape type 1
2026-03-28 08:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fcc%252F0bccb6ac607fa768926fd7b1a9588971%252Fpa%252FSJ57770_9ec2a3511d4af004ffb9e801e437ba62.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/cc/0bccb6ac607fa768926fd7b1a9588971/pa/SJ57770_9ec2a3511d4af004ffb9e801e437ba62.jpg already downloaded
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fcc%252F0bccb6ac607fa768926fd7b1a9588971%252Fpa%252FSJ57770_9bd201a5a981100563ebeb8babfa4920.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/cc/0bccb6ac607fa768926fd7b1a9588971/pa/SJ57770_9bd201a5a981100563ebeb8babfa4920.jpg already downloaded
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fcc%252F0bccb6ac607fa768926fd7b1a9588971%252Fpa%252FSJ57770_be9528e19cdce10e2fff25ed890b4580.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/cc/0bccb6ac607fa768926fd7b1a9588971/pa/SJ57770_be9528e19cdce10e2fff25ed890b4580.jpg already downloaded
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fcc%252F0bccb6ac607fa768926fd7b1a9588971%252Fpa%252FSJ57770_f3dd165b69ec2a1c8dfdc1dd313aa7f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/cc/0bccb6ac607fa768926fd7b1a9588971/pa/SJ57770_f3dd165b69ec2a1c8dfdc1dd313aa7f9.jpg already downloaded
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fcc%252F0bccb6ac607fa768926fd7b1a9588971%252Fpa%252FSJ57770_dd1b19970e4cb6feebd85cf8f3205a35.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/cc/0bccb6ac607fa768926fd7b1a9588971/pa/SJ57770_dd1b19970e4cb6feebd85cf8f3205a35.jpg already downloaded
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fcc%252F0bccb6ac607fa768926fd7b1a9588971%252Fpa%252FSJ57770_905986ec5ece0ef8708264649314f266.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/cc/0bccb6ac607fa768926fd7b1a9588971/pa/SJ57770_905986ec5ece0ef8708264649314f266.jpg already downloaded
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fcc%252F0bccb6ac607fa768926fd7b1a9588971%252Fpa%252FSJ57770_8b362337ebb53e48faded8714432461e.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/cc/0bccb6ac607fa768926fd7b1a9588971/pa/SJ57770_8b362337ebb53e48faded8714432461e.jpg already downloaded
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fcc%252F0bccb6ac607fa768926fd7b1a9588971%252Fpa%252FSJ57770_e5c931bf6f4144e23e45eff4283bcf20.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/cc/0bccb6ac607fa768926fd7b1a9588971/pa/SJ57770_e5c931bf6f4144e23e45eff4283bcf20.jpg already downloaded
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fcc%252F0bccb6ac607fa768926fd7b1a9588971%252Fpa%252FSJ57770_46a2bd43331074a0f2af9e7572b80262.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/cc/0bccb6ac607fa768926fd7b1a9588971/pa/SJ57770_46a2bd43331074a0f2af9e7572b80262.jpg already downloaded
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fcc%252F0bccb6ac607fa768926fd7b1a9588971%252Fpa%252FSJ57770_d2967d09e6b30fc5fd53112d70092d75.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/cc/0bccb6ac607fa768926fd7b1a9588971/pa/SJ57770_d2967d09e6b30fc5fd53112d70092d75.jpg already downloaded
2026-03-28 08:30:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1, identifier: SJ57770
2026-03-28 08:30:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_4abdf1adfd5f792bda43043681e90e22.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff2%252F7df259cabf11dee4d77d8fe7bf01b8ab%252Fpa%252FEP21660_1d3f962fd8acded5fef76d03a1c9ae09.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_1d3f962fd8acded5fef76d03a1c9ae09.jpg not downloaded yet
2026-03-28 08:30:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1 with identifier: SJ57770
2026-03-28 08:30:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1 with identifier: SJ57770
2026-03-28 08:30:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1 with identifier: SJ57770 to the API
2026-03-28 08:30:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SJ57770>
{'auction_title': '',
'c_o_2_emission_value': 145,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.8L',
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:11:14Z',
'fuel_type': 'diesel',
'id': '6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ57770',
'listing': 'auction',
'location': 'BE, Pelt',
'make': 'Mitsubishi',
'model': 'ASX',
'odometer': 86756,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img0b/cc/0bccb6ac607fa768926fd7b1a9588971/pa/SJ57770_9ec2a3511d4af004ffb9e801e437ba62.jpg',
'https://img-pa.auto1.com/img0b/cc/0bccb6ac607fa768926fd7b1a9588971/pa/SJ57770_9bd201a5a981100563ebeb8babfa4920.jpg',
'https://img-pa.auto1.com/img0b/cc/0bccb6ac607fa768926fd7b1a9588971/pa/SJ57770_be9528e19cdce10e2fff25ed890b4580.jpg',
'https://img-pa.auto1.com/img0b/cc/0bccb6ac607fa768926fd7b1a9588971/pa/SJ57770_f3dd165b69ec2a1c8dfdc1dd313aa7f9.jpg',
'https://img-pa.auto1.com/img0b/cc/0bccb6ac607fa768926fd7b1a9588971/pa/SJ57770_dd1b19970e4cb6feebd85cf8f3205a35.jpg',
'https://img-pa.auto1.com/img0b/cc/0bccb6ac607fa768926fd7b1a9588971/pa/SJ57770_905986ec5ece0ef8708264649314f266.jpg',
'https://img-pa.auto1.com/img0b/cc/0bccb6ac607fa768926fd7b1a9588971/pa/SJ57770_8b362337ebb53e48faded8714432461e.jpg',
'https://img-pa.auto1.com/img0b/cc/0bccb6ac607fa768926fd7b1a9588971/pa/SJ57770_e5c931bf6f4144e23e45eff4283bcf20.jpg',
'https://img-pa.auto1.com/img0b/cc/0bccb6ac607fa768926fd7b1a9588971/pa/SJ57770_46a2bd43331074a0f2af9e7572b80262.jpg',
'https://img-pa.auto1.com/img0b/cc/0bccb6ac607fa768926fd7b1a9588971/pa/SJ57770_d2967d09e6b30fc5fd53112d70092d75.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1/6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96909,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/cc/0bccb6ac607fa768926fd7b1a9588971/pa/SJ57770_9ec2a3511d4af004ffb9e801e437ba62.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1/6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90874,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/cc/0bccb6ac607fa768926fd7b1a9588971/pa/SJ57770_9bd201a5a981100563ebeb8babfa4920.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1/6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93661,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/cc/0bccb6ac607fa768926fd7b1a9588971/pa/SJ57770_be9528e19cdce10e2fff25ed890b4580.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1/6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74607,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/cc/0bccb6ac607fa768926fd7b1a9588971/pa/SJ57770_f3dd165b69ec2a1c8dfdc1dd313aa7f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1/6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86201,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/cc/0bccb6ac607fa768926fd7b1a9588971/pa/SJ57770_dd1b19970e4cb6feebd85cf8f3205a35.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1/6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87424,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/cc/0bccb6ac607fa768926fd7b1a9588971/pa/SJ57770_905986ec5ece0ef8708264649314f266.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1/6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70436,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/cc/0bccb6ac607fa768926fd7b1a9588971/pa/SJ57770_8b362337ebb53e48faded8714432461e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1/6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88492,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/cc/0bccb6ac607fa768926fd7b1a9588971/pa/SJ57770_e5c931bf6f4144e23e45eff4283bcf20.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1/6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83170,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/cc/0bccb6ac607fa768926fd7b1a9588971/pa/SJ57770_46a2bd43331074a0f2af9e7572b80262.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1/6bafab21-b7dd-5bd0-ab9d-a4a52eb3bfa1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59377,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/cc/0bccb6ac607fa768926fd7b1a9588971/pa/SJ57770_d2967d09e6b30fc5fd53112d70092d75.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-02-23',
'seats_number': 5,
'seller_name': None,
'title': 'Mitsubishi ASX 1.8 DI-D Inform 2WD',
'transmission': 'manual',
'trim': 'Inform 2WD',
'year': 2011}
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ57770%27 HTTP/1.1" 200 None
2026-03-28 08:30:27 [auto1.be] INFO: Saving data for SJ57770: {'created_time': 1774686627.159066, 'last_price_update_time': 1774686627.159078, 'auction_closing_time': 1774883474.0}
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SJ57770') HTTP/1.1" 204 0
2026-03-28 08:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/86/e0860d689a533793e105b17132c6e804/pa/XB72565_1c7639ba496c2e11db259f83b0b00ebc.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F05%252F20051b867c2006dc84fa8cf2319bc1d6%252Fpa%252FYA99172_3005f5fa6d392930b151fda5bb61a35b.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_3005f5fa6d392930b151fda5bb61a35b.jpg not downloaded yet
2026-03-28 08:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_9c4009bf5e5d7d5f2911289cab863c76.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_1adaccd743fe1be39b87e7e3bef05890.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_adec6f8c4f0e82b8b99ea9e69071b5de.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_e9ec8ce775e862e795bb700092a071f1.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff2%252F7df259cabf11dee4d77d8fe7bf01b8ab%252Fpa%252FEP21660_1eca06fddc85ed0dc1c40e98131ef769.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_1eca06fddc85ed0dc1c40e98131ef769.jpg not downloaded yet
2026-03-28 08:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PD03709> (referer: https://www.auto1.com/v1/car-details-view/PD03709/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F05%252F20051b867c2006dc84fa8cf2319bc1d6%252Fpa%252FYA99172_0ecd855117fccc65ebad37721286575a.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_0ecd855117fccc65ebad37721286575a.jpg not downloaded yet
2026-03-28 08:30:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-28 08:30:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-28 08:30:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29c9a0de90>
2026-03-28 08:30:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c18fd3-3e02-5946-b55a-e8db1ea81413/a0c18fd3-3e02-5946-b55a-e8db1ea81413_image_0.jpg HTTP/1.1" 201 0
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff2%252F7df259cabf11dee4d77d8fe7bf01b8ab%252Fpa%252FEP21660_4abdf1adfd5f792bda43043681e90e22.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_4abdf1adfd5f792bda43043681e90e22.jpg saved to cache
2026-03-28 08:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0c18fd3-3e02-5946-b55a-e8db1ea81413
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F05%252F20051b867c2006dc84fa8cf2319bc1d6%252Fpa%252FYA99172_24f1cef3f0038426cec34746f24b7927.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_24f1cef3f0038426cec34746f24b7927.jpg not downloaded yet
2026-03-28 08:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/86/e0860d689a533793e105b17132c6e804/pa/XB72565_a8dac61ad4aab26f8efb2b0814774e35.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_d4fa18a087811c7e6e151e94c606bb23.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_bcc6497aa130cee76334522c5ec0f7ad.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_0905d777f99c1accc025d9808503553f.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_cf619bca08dd7d4e7596257630c11264.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/86/e0860d689a533793e105b17132c6e804/pa/XB72565_c74e19101c042aca6aada37304bdd67d.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_af1eb9c5530159150be75e00b8455224.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_9ca3c872c9919fb74eb0f9c61d3a91f0.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F05%252F20051b867c2006dc84fa8cf2319bc1d6%252Fpa%252FYA99172_39fcdf95932c4caefa6f32ded260a1a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_39fcdf95932c4caefa6f32ded260a1a1.jpg not downloaded yet
2026-03-28 08:30:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bbbd56d0>
2026-03-28 08:30:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b939a141-7d36-5e5c-8878-99839cc8c1aa/b939a141-7d36-5e5c-8878-99839cc8c1aa_image_0.jpg HTTP/1.1" 201 0
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F86%252Fe0860d689a533793e105b17132c6e804%252Fpa%252FXB72565_1c7639ba496c2e11db259f83b0b00ebc.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/86/e0860d689a533793e105b17132c6e804/pa/XB72565_1c7639ba496c2e11db259f83b0b00ebc.jpg saved to cache
2026-03-28 08:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b939a141-7d36-5e5c-8878-99839cc8c1aa
2026-03-28 08:30:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bba78c50>
2026-03-28 08:30:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c18fd3-3e02-5946-b55a-e8db1ea81413/a0c18fd3-3e02-5946-b55a-e8db1ea81413_image_1.jpg HTTP/1.1" 201 0
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff2%252F7df259cabf11dee4d77d8fe7bf01b8ab%252Fpa%252FEP21660_9c4009bf5e5d7d5f2911289cab863c76.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_9c4009bf5e5d7d5f2911289cab863c76.jpg saved to cache
2026-03-28 08:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a0c18fd3-3e02-5946-b55a-e8db1ea81413
2026-03-28 08:30:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29baf6d850>
2026-03-28 08:30:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6af9c02e-3c22-5592-ba42-87cb997424a2/6af9c02e-3c22-5592-ba42-87cb997424a2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9d%252F919d48961816449e878c2bdc010fcf9f%252Fpa%252FYZ86935_1adaccd743fe1be39b87e7e3bef05890.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_1adaccd743fe1be39b87e7e3bef05890.jpg saved to cache
2026-03-28 08:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6af9c02e-3c22-5592-ba42-87cb997424a2
2026-03-28 08:30:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bb045410>
2026-03-28 08:30:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6af9c02e-3c22-5592-ba42-87cb997424a2/6af9c02e-3c22-5592-ba42-87cb997424a2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9d%252F919d48961816449e878c2bdc010fcf9f%252Fpa%252FYZ86935_adec6f8c4f0e82b8b99ea9e69071b5de.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_adec6f8c4f0e82b8b99ea9e69071b5de.jpg saved to cache
2026-03-28 08:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6af9c02e-3c22-5592-ba42-87cb997424a2
2026-03-28 08:30:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29baf71710>
2026-03-28 08:30:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6af9c02e-3c22-5592-ba42-87cb997424a2/6af9c02e-3c22-5592-ba42-87cb997424a2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9d%252F919d48961816449e878c2bdc010fcf9f%252Fpa%252FYZ86935_e9ec8ce775e862e795bb700092a071f1.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_e9ec8ce775e862e795bb700092a071f1.jpg saved to cache
2026-03-28 08:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6af9c02e-3c22-5592-ba42-87cb997424a2
2026-03-28 08:30:27 [auto1.be] INFO: Channel: 24h | Page: 3 | totalHits: 1700 | hits on page: 40
2026-03-28 08:30:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38ce2412-ea07-572e-a344-4d0ddcad51ab with identifier: PD03709
2026-03-28 08:30:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38ce2412-ea07-572e-a344-4d0ddcad51ab with scrape type 1
2026-03-28 08:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 38ce2412-ea07-572e-a344-4d0ddcad51ab
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F54%252Fb0545c263b82c9b598d335a1900fe128%252Fpa%252FPD03709_4de46a36345fd959a14fd0f801b8d80e.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/54/b0545c263b82c9b598d335a1900fe128/pa/PD03709_4de46a36345fd959a14fd0f801b8d80e.jpg already downloaded
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F54%252Fb0545c263b82c9b598d335a1900fe128%252Fpa%252FPD03709_01e8dd0830a58704ea316e36a2d7fb2c.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/54/b0545c263b82c9b598d335a1900fe128/pa/PD03709_01e8dd0830a58704ea316e36a2d7fb2c.jpg already downloaded
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F54%252Fb0545c263b82c9b598d335a1900fe128%252Fpa%252FPD03709_10e3f9f4f6c0f214fd75520a78369602.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/54/b0545c263b82c9b598d335a1900fe128/pa/PD03709_10e3f9f4f6c0f214fd75520a78369602.jpg already downloaded
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F54%252Fb0545c263b82c9b598d335a1900fe128%252Fpa%252FPD03709_8cdede38ee9b63476d0b0f9c18b4a205.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/54/b0545c263b82c9b598d335a1900fe128/pa/PD03709_8cdede38ee9b63476d0b0f9c18b4a205.jpg already downloaded
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F54%252Fb0545c263b82c9b598d335a1900fe128%252Fpa%252FPD03709_87370c36c6d51e45c3f301c1627caa81.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/54/b0545c263b82c9b598d335a1900fe128/pa/PD03709_87370c36c6d51e45c3f301c1627caa81.jpg already downloaded
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F54%252Fb0545c263b82c9b598d335a1900fe128%252Fpa%252FPD03709_5a3f3bfd4e82a35351b36a944b353ad7.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/54/b0545c263b82c9b598d335a1900fe128/pa/PD03709_5a3f3bfd4e82a35351b36a944b353ad7.jpg already downloaded
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F54%252Fb0545c263b82c9b598d335a1900fe128%252Fpa%252FPD03709_cc5f4872c5abd83b64b0e5cd7113410b.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/54/b0545c263b82c9b598d335a1900fe128/pa/PD03709_cc5f4872c5abd83b64b0e5cd7113410b.jpg already downloaded
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F54%252Fb0545c263b82c9b598d335a1900fe128%252Fpa%252FPD03709_b3ed85c5c2107988eddaa94ed303d212.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/54/b0545c263b82c9b598d335a1900fe128/pa/PD03709_b3ed85c5c2107988eddaa94ed303d212.jpg already downloaded
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F54%252Fb0545c263b82c9b598d335a1900fe128%252Fpa%252FPD03709_20d24d55018b426514e7f084646f536e.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/54/b0545c263b82c9b598d335a1900fe128/pa/PD03709_20d24d55018b426514e7f084646f536e.jpg already downloaded
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F54%252Fb0545c263b82c9b598d335a1900fe128%252Fpa%252FPD03709_227ede2d9db4d11011dff1ba9bf11e40.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/54/b0545c263b82c9b598d335a1900fe128/pa/PD03709_227ede2d9db4d11011dff1ba9bf11e40.jpg already downloaded
2026-03-28 08:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 38ce2412-ea07-572e-a344-4d0ddcad51ab, identifier: PD03709
2026-03-28 08:30:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 38ce2412-ea07-572e-a344-4d0ddcad51ab with identifier: PD03709
2026-03-28 08:30:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 38ce2412-ea07-572e-a344-4d0ddcad51ab with identifier: PD03709
2026-03-28 08:30:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 38ce2412-ea07-572e-a344-4d0ddcad51ab with identifier: PD03709 to the API
2026-03-28 08:30:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PD03709>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.9L',
'engine_horse_power': 340,
'expiration_date': '2026-03-30T15:44:30Z',
'fuel_type': 'diesel',
'id': '38ce2412-ea07-572e-a344-4d0ddcad51ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD03709',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 144505,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgb0/54/b0545c263b82c9b598d335a1900fe128/pa/PD03709_4de46a36345fd959a14fd0f801b8d80e.jpg',
'https://img-pa.auto1.com/imgb0/54/b0545c263b82c9b598d335a1900fe128/pa/PD03709_01e8dd0830a58704ea316e36a2d7fb2c.jpg',
'https://img-pa.auto1.com/imgb0/54/b0545c263b82c9b598d335a1900fe128/pa/PD03709_10e3f9f4f6c0f214fd75520a78369602.jpg',
'https://img-pa.auto1.com/imgb0/54/b0545c263b82c9b598d335a1900fe128/pa/PD03709_8cdede38ee9b63476d0b0f9c18b4a205.jpg',
'https://img-pa.auto1.com/imgb0/54/b0545c263b82c9b598d335a1900fe128/pa/PD03709_87370c36c6d51e45c3f301c1627caa81.jpg',
'https://img-pa.auto1.com/imgb0/54/b0545c263b82c9b598d335a1900fe128/pa/PD03709_5a3f3bfd4e82a35351b36a944b353ad7.jpg',
'https://img-pa.auto1.com/imgb0/54/b0545c263b82c9b598d335a1900fe128/pa/PD03709_cc5f4872c5abd83b64b0e5cd7113410b.jpg',
'https://img-pa.auto1.com/imgb0/54/b0545c263b82c9b598d335a1900fe128/pa/PD03709_b3ed85c5c2107988eddaa94ed303d212.jpg',
'https://img-pa.auto1.com/imgb0/54/b0545c263b82c9b598d335a1900fe128/pa/PD03709_20d24d55018b426514e7f084646f536e.jpg',
'https://img-pa.auto1.com/imgb0/54/b0545c263b82c9b598d335a1900fe128/pa/PD03709_227ede2d9db4d11011dff1ba9bf11e40.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ce2412-ea07-572e-a344-4d0ddcad51ab/38ce2412-ea07-572e-a344-4d0ddcad51ab_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80598,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/54/b0545c263b82c9b598d335a1900fe128/pa/PD03709_4de46a36345fd959a14fd0f801b8d80e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ce2412-ea07-572e-a344-4d0ddcad51ab/38ce2412-ea07-572e-a344-4d0ddcad51ab_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78262,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/54/b0545c263b82c9b598d335a1900fe128/pa/PD03709_01e8dd0830a58704ea316e36a2d7fb2c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ce2412-ea07-572e-a344-4d0ddcad51ab/38ce2412-ea07-572e-a344-4d0ddcad51ab_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64228,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/54/b0545c263b82c9b598d335a1900fe128/pa/PD03709_10e3f9f4f6c0f214fd75520a78369602.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ce2412-ea07-572e-a344-4d0ddcad51ab/38ce2412-ea07-572e-a344-4d0ddcad51ab_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71360,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/54/b0545c263b82c9b598d335a1900fe128/pa/PD03709_8cdede38ee9b63476d0b0f9c18b4a205.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ce2412-ea07-572e-a344-4d0ddcad51ab/38ce2412-ea07-572e-a344-4d0ddcad51ab_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64732,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/54/b0545c263b82c9b598d335a1900fe128/pa/PD03709_87370c36c6d51e45c3f301c1627caa81.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ce2412-ea07-572e-a344-4d0ddcad51ab/38ce2412-ea07-572e-a344-4d0ddcad51ab_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72736,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/54/b0545c263b82c9b598d335a1900fe128/pa/PD03709_5a3f3bfd4e82a35351b36a944b353ad7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ce2412-ea07-572e-a344-4d0ddcad51ab/38ce2412-ea07-572e-a344-4d0ddcad51ab_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69342,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/54/b0545c263b82c9b598d335a1900fe128/pa/PD03709_cc5f4872c5abd83b64b0e5cd7113410b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ce2412-ea07-572e-a344-4d0ddcad51ab/38ce2412-ea07-572e-a344-4d0ddcad51ab_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71547,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/54/b0545c263b82c9b598d335a1900fe128/pa/PD03709_b3ed85c5c2107988eddaa94ed303d212.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ce2412-ea07-572e-a344-4d0ddcad51ab/38ce2412-ea07-572e-a344-4d0ddcad51ab_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73209,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/54/b0545c263b82c9b598d335a1900fe128/pa/PD03709_20d24d55018b426514e7f084646f536e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38ce2412-ea07-572e-a344-4d0ddcad51ab/38ce2412-ea07-572e-a344-4d0ddcad51ab_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58695,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/54/b0545c263b82c9b598d335a1900fe128/pa/PD03709_227ede2d9db4d11011dff1ba9bf11e40.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-02-26',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 400 d 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2019}
2026-03-28 08:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD03709%27 HTTP/1.1" 200 None
2026-03-28 08:30:28 [auto1.be] INFO: Saving data for PD03709: {'created_time': 1774686628.956482, 'last_price_update_time': 1774686628.956491, 'auction_closing_time': 1774885470.0}
2026-03-28 08:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PD03709') HTTP/1.1" 204 0
2026-03-28 08:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F05%252F20051b867c2006dc84fa8cf2319bc1d6%252Fpa%252FYA99172_a5c9dc3fe006b8f231284ccd2b5c5638.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_a5c9dc3fe006b8f231284ccd2b5c5638.jpg not downloaded yet
2026-03-28 08:30:28 [auto1.be] INFO: Found listing with ID: AM90339
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM90339%27 HTTP/1.1" 200 None
2026-03-28 08:30:29 [auto1.be] INFO: Scrape type for AM90339: 0
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: FF69776
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF69776%27 HTTP/1.1" 200 None
2026-03-28 08:30:29 [auto1.be] INFO: Scrape type for FF69776: 0
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: TA93870
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: ZR94706
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR94706%27 HTTP/1.1" 200 None
2026-03-28 08:30:29 [auto1.be] INFO: Scrape type for ZR94706: 0
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: XL14792
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL14792%27 HTTP/1.1" 200 None
2026-03-28 08:30:29 [auto1.be] INFO: Scrape type for XL14792: 0
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: JF06459
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: MK30308
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK30308%27 HTTP/1.1" 200 None
2026-03-28 08:30:29 [auto1.be] INFO: Scrape type for MK30308: 0
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: KL42374
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KL42374%27 HTTP/1.1" 200 None
2026-03-28 08:30:29 [auto1.be] INFO: Scrape type for KL42374: 0
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: YX04122
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX04122%27 HTTP/1.1" 200 None
2026-03-28 08:30:29 [auto1.be] INFO: Scrape type for YX04122: 0
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: PZ99747
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: XX88636
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XX88636%27 HTTP/1.1" 200 None
2026-03-28 08:30:29 [auto1.be] INFO: Scrape type for XX88636: 0
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: CH97070
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH97070%27 HTTP/1.1" 200 None
2026-03-28 08:30:29 [auto1.be] INFO: Scrape type for CH97070: 0
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: TB53896
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: PL30549
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: JB83669
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB83669%27 HTTP/1.1" 200 None
2026-03-28 08:30:29 [auto1.be] INFO: Scrape type for JB83669: 0
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: FD92001
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FD92001%27 HTTP/1.1" 200 None
2026-03-28 08:30:29 [auto1.be] INFO: Scrape type for FD92001: 0
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: LN19500
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LN19500%27 HTTP/1.1" 200 None
2026-03-28 08:30:29 [auto1.be] INFO: Scrape type for LN19500: 0
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: EL91929
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL91929%27 HTTP/1.1" 200 None
2026-03-28 08:30:29 [auto1.be] INFO: Scrape type for EL91929: 0
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: KS47676
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: KU28222
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: AY67294
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY67294%27 HTTP/1.1" 200 None
2026-03-28 08:30:29 [auto1.be] INFO: Scrape type for AY67294: 0
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: LN33262
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: HH92920
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH92920%27 HTTP/1.1" 200 None
2026-03-28 08:30:29 [auto1.be] INFO: Scrape type for HH92920: 0
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: FD47610
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FD47610%27 HTTP/1.1" 200 None
2026-03-28 08:30:29 [auto1.be] INFO: Scrape type for FD47610: 0
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: YM92505
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM92505%27 HTTP/1.1" 200 None
2026-03-28 08:30:29 [auto1.be] INFO: Scrape type for YM92505: 0
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: YA41293
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA41293%27 HTTP/1.1" 200 None
2026-03-28 08:30:29 [auto1.be] INFO: Scrape type for YA41293: 0
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: ZS70359
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZS70359%27 HTTP/1.1" 200 None
2026-03-28 08:30:29 [auto1.be] INFO: Scrape type for ZS70359: 0
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: WX65816
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX65816%27 HTTP/1.1" 200 None
2026-03-28 08:30:29 [auto1.be] INFO: Scrape type for WX65816: 0
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: PR31064
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR31064%27 HTTP/1.1" 200 None
2026-03-28 08:30:29 [auto1.be] INFO: Scrape type for PR31064: 0
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: YR74794
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YR74794%27 HTTP/1.1" 200 None
2026-03-28 08:30:29 [auto1.be] INFO: Scrape type for YR74794: 0
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: XC85996
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: LL08256
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LL08256%27 HTTP/1.1" 200 None
2026-03-28 08:30:29 [auto1.be] INFO: Scrape type for LL08256: 0
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: PY58607
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: FL46625
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL46625%27 HTTP/1.1" 200 None
2026-03-28 08:30:29 [auto1.be] INFO: Scrape type for FL46625: 0
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: BT72678
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT72678%27 HTTP/1.1" 200 None
2026-03-28 08:30:29 [auto1.be] INFO: Scrape type for BT72678: 0
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: AU41446
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: WS04459
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: XA29570
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: PU90284
2026-03-28 08:30:29 [auto1.be] INFO: Found listing with ID: CE58685
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE58685%27 HTTP/1.1" 200 None
2026-03-28 08:30:29 [auto1.be] INFO: Scrape type for CE58685: 0
2026-03-28 08:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PV46198> (referer: https://www.auto1.com/v1/car-details-view/PV46198/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:30:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29baf86ad0>
2026-03-28 08:30:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b939a141-7d36-5e5c-8878-99839cc8c1aa/b939a141-7d36-5e5c-8878-99839cc8c1aa_image_1.jpg HTTP/1.1" 201 0
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F86%252Fe0860d689a533793e105b17132c6e804%252Fpa%252FXB72565_a8dac61ad4aab26f8efb2b0814774e35.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/86/e0860d689a533793e105b17132c6e804/pa/XB72565_a8dac61ad4aab26f8efb2b0814774e35.jpg saved to cache
2026-03-28 08:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b939a141-7d36-5e5c-8878-99839cc8c1aa
2026-03-28 08:30:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bb92d350>
2026-03-28 08:30:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6af9c02e-3c22-5592-ba42-87cb997424a2/6af9c02e-3c22-5592-ba42-87cb997424a2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9d%252F919d48961816449e878c2bdc010fcf9f%252Fpa%252FYZ86935_d4fa18a087811c7e6e151e94c606bb23.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_d4fa18a087811c7e6e151e94c606bb23.jpg saved to cache
2026-03-28 08:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6af9c02e-3c22-5592-ba42-87cb997424a2
2026-03-28 08:30:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bb05ac50>
2026-03-28 08:30:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6af9c02e-3c22-5592-ba42-87cb997424a2/6af9c02e-3c22-5592-ba42-87cb997424a2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9d%252F919d48961816449e878c2bdc010fcf9f%252Fpa%252FYZ86935_bcc6497aa130cee76334522c5ec0f7ad.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_bcc6497aa130cee76334522c5ec0f7ad.jpg saved to cache
2026-03-28 08:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6af9c02e-3c22-5592-ba42-87cb997424a2
2026-03-28 08:30:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29baf8d790>
2026-03-28 08:30:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c18fd3-3e02-5946-b55a-e8db1ea81413/a0c18fd3-3e02-5946-b55a-e8db1ea81413_image_2.jpg HTTP/1.1" 201 0
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff2%252F7df259cabf11dee4d77d8fe7bf01b8ab%252Fpa%252FEP21660_0905d777f99c1accc025d9808503553f.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_0905d777f99c1accc025d9808503553f.jpg saved to cache
2026-03-28 08:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a0c18fd3-3e02-5946-b55a-e8db1ea81413
2026-03-28 08:30:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bbb78f10>
2026-03-28 08:30:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c18fd3-3e02-5946-b55a-e8db1ea81413/a0c18fd3-3e02-5946-b55a-e8db1ea81413_image_7.jpg HTTP/1.1" 201 0
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff2%252F7df259cabf11dee4d77d8fe7bf01b8ab%252Fpa%252FEP21660_cf619bca08dd7d4e7596257630c11264.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_cf619bca08dd7d4e7596257630c11264.jpg saved to cache
2026-03-28 08:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a0c18fd3-3e02-5946-b55a-e8db1ea81413
2026-03-28 08:30:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bb92f350>
2026-03-28 08:30:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b939a141-7d36-5e5c-8878-99839cc8c1aa/b939a141-7d36-5e5c-8878-99839cc8c1aa_image_2.jpg HTTP/1.1" 201 0
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F86%252Fe0860d689a533793e105b17132c6e804%252Fpa%252FXB72565_c74e19101c042aca6aada37304bdd67d.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/86/e0860d689a533793e105b17132c6e804/pa/XB72565_c74e19101c042aca6aada37304bdd67d.jpg saved to cache
2026-03-28 08:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b939a141-7d36-5e5c-8878-99839cc8c1aa
2026-03-28 08:30:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bbacec50>
2026-03-28 08:30:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6af9c02e-3c22-5592-ba42-87cb997424a2/6af9c02e-3c22-5592-ba42-87cb997424a2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9d%252F919d48961816449e878c2bdc010fcf9f%252Fpa%252FYZ86935_af1eb9c5530159150be75e00b8455224.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_af1eb9c5530159150be75e00b8455224.jpg saved to cache
2026-03-28 08:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6af9c02e-3c22-5592-ba42-87cb997424a2
2026-03-28 08:30:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29baf3f4d0>
2026-03-28 08:30:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6af9c02e-3c22-5592-ba42-87cb997424a2/6af9c02e-3c22-5592-ba42-87cb997424a2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9d%252F919d48961816449e878c2bdc010fcf9f%252Fpa%252FYZ86935_9ca3c872c9919fb74eb0f9c61d3a91f0.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_9ca3c872c9919fb74eb0f9c61d3a91f0.jpg saved to cache
2026-03-28 08:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6af9c02e-3c22-5592-ba42-87cb997424a2
2026-03-28 08:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_f7e5d1fb657e246047f5b721f0bc45de.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_1eca06fddc85ed0dc1c40e98131ef769.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_1d3f962fd8acded5fef76d03a1c9ae09.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_c1cfe0e286ddc7541d1def3ff9246cfd.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_23b56eae742976fcb54b055b031b4bb8.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F05%252F20051b867c2006dc84fa8cf2319bc1d6%252Fpa%252FYA99172_5c494c9318cd7480e724b33e0d70d8fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_5c494c9318cd7480e724b33e0d70d8fe.jpg not downloaded yet
2026-03-28 08:30:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F05%252F20051b867c2006dc84fa8cf2319bc1d6%252Fpa%252FYA99172_3c2912e2dd97bddc346bfcd7dd6253a7.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_3c2912e2dd97bddc346bfcd7dd6253a7.jpg not downloaded yet
2026-03-28 08:30:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90f40c8e-c4c4-5a97-bf2c-b01e97743af0 with identifier: PV46198
2026-03-28 08:30:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90f40c8e-c4c4-5a97-bf2c-b01e97743af0 with scrape type 1
2026-03-28 08:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 90f40c8e-c4c4-5a97-bf2c-b01e97743af0
2026-03-28 08:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F67%252F6b677a6a10b18d38ee2971393700ecfe%252Fpa%252FPV46198_9a9c9b6c7839e026db968652e4f480db.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_9a9c9b6c7839e026db968652e4f480db.jpg not downloaded yet
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F67%252F6b677a6a10b18d38ee2971393700ecfe%252Fpa%252FPV46198_4e64fa2ea8f8976dcecb202aa4096275.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_4e64fa2ea8f8976dcecb202aa4096275.jpg not downloaded yet
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F67%252F6b677a6a10b18d38ee2971393700ecfe%252Fpa%252FPV46198_c18e6f40ef8a6b66dcba14c6ba563bc1.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_c18e6f40ef8a6b66dcba14c6ba563bc1.jpg not downloaded yet
2026-03-28 08:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_f23ddcc485eaa8705d0bf5d428cbbf85.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_49260f7abaed3cbfd0d613e5836bc332.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F67%252F6b677a6a10b18d38ee2971393700ecfe%252Fpa%252FPV46198_34a68473397de5e1b9064ad225cc7418.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_34a68473397de5e1b9064ad225cc7418.jpg not downloaded yet
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bb94a050>
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6af9c02e-3c22-5592-ba42-87cb997424a2/6af9c02e-3c22-5592-ba42-87cb997424a2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9d%252F919d48961816449e878c2bdc010fcf9f%252Fpa%252FYZ86935_f7e5d1fb657e246047f5b721f0bc45de.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_f7e5d1fb657e246047f5b721f0bc45de.jpg saved to cache
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6af9c02e-3c22-5592-ba42-87cb997424a2
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bb0dd290>
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c18fd3-3e02-5946-b55a-e8db1ea81413/a0c18fd3-3e02-5946-b55a-e8db1ea81413_image_9.jpg HTTP/1.1" 201 0
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff2%252F7df259cabf11dee4d77d8fe7bf01b8ab%252Fpa%252FEP21660_1eca06fddc85ed0dc1c40e98131ef769.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_1eca06fddc85ed0dc1c40e98131ef769.jpg saved to cache
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a0c18fd3-3e02-5946-b55a-e8db1ea81413
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bae1c3d0>
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c18fd3-3e02-5946-b55a-e8db1ea81413/a0c18fd3-3e02-5946-b55a-e8db1ea81413_image_8.jpg HTTP/1.1" 201 0
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff2%252F7df259cabf11dee4d77d8fe7bf01b8ab%252Fpa%252FEP21660_1d3f962fd8acded5fef76d03a1c9ae09.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_1d3f962fd8acded5fef76d03a1c9ae09.jpg saved to cache
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a0c18fd3-3e02-5946-b55a-e8db1ea81413
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bbb71e50>
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c18fd3-3e02-5946-b55a-e8db1ea81413/a0c18fd3-3e02-5946-b55a-e8db1ea81413_image_6.jpg HTTP/1.1" 201 0
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff2%252F7df259cabf11dee4d77d8fe7bf01b8ab%252Fpa%252FEP21660_c1cfe0e286ddc7541d1def3ff9246cfd.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_c1cfe0e286ddc7541d1def3ff9246cfd.jpg saved to cache
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a0c18fd3-3e02-5946-b55a-e8db1ea81413
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bb01f0d0>
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bda98b99-4937-5a42-8e63-c32c9fb7bce0/bda98b99-4937-5a42-8e63-c32c9fb7bce0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F05%252F20051b867c2006dc84fa8cf2319bc1d6%252Fpa%252FYA99172_23b56eae742976fcb54b055b031b4bb8.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_23b56eae742976fcb54b055b031b4bb8.jpg saved to cache
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bda98b99-4937-5a42-8e63-c32c9fb7bce0
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F67%252F6b677a6a10b18d38ee2971393700ecfe%252Fpa%252FPV46198_c3a69854559b7bb993cd7e278fff4be8.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_c3a69854559b7bb993cd7e278fff4be8.jpg not downloaded yet
2026-03-28 08:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/86/e0860d689a533793e105b17132c6e804/pa/XB72565_86529f164baf0624c1bafa074e424f43.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_0ecd855117fccc65ebad37721286575a.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_e187c4205d0eb59ab03dfd773a3ab60b.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F67%252F6b677a6a10b18d38ee2971393700ecfe%252Fpa%252FPV46198_db616eedc7409f9525d009b701fe22dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_db616eedc7409f9525d009b701fe22dc.jpg not downloaded yet
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F67%252F6b677a6a10b18d38ee2971393700ecfe%252Fpa%252FPV46198_5b00988563c60b7b06e76593494fc81d.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_5b00988563c60b7b06e76593494fc81d.jpg not downloaded yet
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bbab2190>
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6af9c02e-3c22-5592-ba42-87cb997424a2/6af9c02e-3c22-5592-ba42-87cb997424a2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9d%252F919d48961816449e878c2bdc010fcf9f%252Fpa%252FYZ86935_f23ddcc485eaa8705d0bf5d428cbbf85.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_f23ddcc485eaa8705d0bf5d428cbbf85.jpg saved to cache
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6af9c02e-3c22-5592-ba42-87cb997424a2
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29baf09e50>
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c18fd3-3e02-5946-b55a-e8db1ea81413/a0c18fd3-3e02-5946-b55a-e8db1ea81413_image_5.jpg HTTP/1.1" 201 0
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff2%252F7df259cabf11dee4d77d8fe7bf01b8ab%252Fpa%252FEP21660_49260f7abaed3cbfd0d613e5836bc332.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_49260f7abaed3cbfd0d613e5836bc332.jpg saved to cache
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a0c18fd3-3e02-5946-b55a-e8db1ea81413
2026-03-28 08:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/86/e0860d689a533793e105b17132c6e804/pa/XB72565_33c56796a6fbdf7af15a0939cb578ddc.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F67%252F6b677a6a10b18d38ee2971393700ecfe%252Fpa%252FPV46198_36e8d9d6d4b76a872bdb100ee56d6948.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_36e8d9d6d4b76a872bdb100ee56d6948.jpg not downloaded yet
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F67%252F6b677a6a10b18d38ee2971393700ecfe%252Fpa%252FPV46198_6065c9d2a55658f74311e8fab2c15ff4.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_6065c9d2a55658f74311e8fab2c15ff4.jpg not downloaded yet
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bb0e7890>
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b939a141-7d36-5e5c-8878-99839cc8c1aa/b939a141-7d36-5e5c-8878-99839cc8c1aa_image_5.jpg HTTP/1.1" 201 0
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F86%252Fe0860d689a533793e105b17132c6e804%252Fpa%252FXB72565_86529f164baf0624c1bafa074e424f43.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/86/e0860d689a533793e105b17132c6e804/pa/XB72565_86529f164baf0624c1bafa074e424f43.jpg saved to cache
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b939a141-7d36-5e5c-8878-99839cc8c1aa
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bbacf6d0>
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bda98b99-4937-5a42-8e63-c32c9fb7bce0/bda98b99-4937-5a42-8e63-c32c9fb7bce0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F05%252F20051b867c2006dc84fa8cf2319bc1d6%252Fpa%252FYA99172_0ecd855117fccc65ebad37721286575a.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_0ecd855117fccc65ebad37721286575a.jpg saved to cache
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bda98b99-4937-5a42-8e63-c32c9fb7bce0
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29baf8fcd0>
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c18fd3-3e02-5946-b55a-e8db1ea81413/a0c18fd3-3e02-5946-b55a-e8db1ea81413_image_4.jpg HTTP/1.1" 201 0
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff2%252F7df259cabf11dee4d77d8fe7bf01b8ab%252Fpa%252FEP21660_e187c4205d0eb59ab03dfd773a3ab60b.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_e187c4205d0eb59ab03dfd773a3ab60b.jpg saved to cache
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a0c18fd3-3e02-5946-b55a-e8db1ea81413
2026-03-28 08:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_39fcdf95932c4caefa6f32ded260a1a1.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_a5c9dc3fe006b8f231284ccd2b5c5638.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F67%252F6b677a6a10b18d38ee2971393700ecfe%252Fpa%252FPV46198_f942186e68f7c292f365cd3487b3bc24.jpg%27 HTTP/1.1" 200 None
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_f942186e68f7c292f365cd3487b3bc24.jpg not downloaded yet
2026-03-28 08:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_8678947dbfb4c5b5cf449715da175296.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_a60ef42be95e71058d3b33ec0883ee55.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bbacfe10>
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b939a141-7d36-5e5c-8878-99839cc8c1aa/b939a141-7d36-5e5c-8878-99839cc8c1aa_image_4.jpg HTTP/1.1" 201 0
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F86%252Fe0860d689a533793e105b17132c6e804%252Fpa%252FXB72565_33c56796a6fbdf7af15a0939cb578ddc.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/86/e0860d689a533793e105b17132c6e804/pa/XB72565_33c56796a6fbdf7af15a0939cb578ddc.jpg saved to cache
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b939a141-7d36-5e5c-8878-99839cc8c1aa
2026-03-28 08:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_34a68473397de5e1b9064ad225cc7418.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_c18e6f40ef8a6b66dcba14c6ba563bc1.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_3005f5fa6d392930b151fda5bb61a35b.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_0de78627cc53613742a448c9c74cc2d6.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_24f1cef3f0038426cec34746f24b7927.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_74a4092c7f472c193ca7f8ebc8c615e6.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bafe5090>
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bda98b99-4937-5a42-8e63-c32c9fb7bce0/bda98b99-4937-5a42-8e63-c32c9fb7bce0_image_6.jpg HTTP/1.1" 201 0
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F05%252F20051b867c2006dc84fa8cf2319bc1d6%252Fpa%252FYA99172_39fcdf95932c4caefa6f32ded260a1a1.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_39fcdf95932c4caefa6f32ded260a1a1.jpg saved to cache
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bda98b99-4937-5a42-8e63-c32c9fb7bce0
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bb967d50>
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bda98b99-4937-5a42-8e63-c32c9fb7bce0/bda98b99-4937-5a42-8e63-c32c9fb7bce0_image_7.jpg HTTP/1.1" 201 0
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F05%252F20051b867c2006dc84fa8cf2319bc1d6%252Fpa%252FYA99172_a5c9dc3fe006b8f231284ccd2b5c5638.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_a5c9dc3fe006b8f231284ccd2b5c5638.jpg saved to cache
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bda98b99-4937-5a42-8e63-c32c9fb7bce0
2026-03-28 08:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_9a9c9b6c7839e026db968652e4f480db.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_c3a69854559b7bb993cd7e278fff4be8.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_36e8d9d6d4b76a872bdb100ee56d6948.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bb01f4d0>
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0c18fd3-3e02-5946-b55a-e8db1ea81413/a0c18fd3-3e02-5946-b55a-e8db1ea81413_image_3.jpg HTTP/1.1" 201 0
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ff2%252F7df259cabf11dee4d77d8fe7bf01b8ab%252Fpa%252FEP21660_8678947dbfb4c5b5cf449715da175296.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_8678947dbfb4c5b5cf449715da175296.jpg saved to cache
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a0c18fd3-3e02-5946-b55a-e8db1ea81413
2026-03-28 08:30:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0c18fd3-3e02-5946-b55a-e8db1ea81413, skipping ID generation
2026-03-28 08:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0c18fd3-3e02-5946-b55a-e8db1ea81413 with scrape type 1
2026-03-28 08:30:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0c18fd3-3e02-5946-b55a-e8db1ea81413 sending to next pipeline
2026-03-28 08:30:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a0c18fd3-3e02-5946-b55a-e8db1ea81413, identifier: EP21660
2026-03-28 08:30:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bb0d5750>
2026-03-28 08:30:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6af9c02e-3c22-5592-ba42-87cb997424a2/6af9c02e-3c22-5592-ba42-87cb997424a2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 08:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F9d%252F919d48961816449e878c2bdc010fcf9f%252Fpa%252FYZ86935_a60ef42be95e71058d3b33ec0883ee55.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_a60ef42be95e71058d3b33ec0883ee55.jpg saved to cache
2026-03-28 08:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6af9c02e-3c22-5592-ba42-87cb997424a2
2026-03-28 08:30:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6af9c02e-3c22-5592-ba42-87cb997424a2, skipping ID generation
2026-03-28 08:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6af9c02e-3c22-5592-ba42-87cb997424a2 with scrape type 1
2026-03-28 08:30:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6af9c02e-3c22-5592-ba42-87cb997424a2 sending to next pipeline
2026-03-28 08:30:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6af9c02e-3c22-5592-ba42-87cb997424a2, identifier: YZ86935
2026-03-28 08:30:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a0c18fd3-3e02-5946-b55a-e8db1ea81413 with identifier: EP21660
2026-03-28 08:30:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a0c18fd3-3e02-5946-b55a-e8db1ea81413 with identifier: EP21660
2026-03-28 08:30:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a0c18fd3-3e02-5946-b55a-e8db1ea81413 with identifier: EP21660 to the API
2026-03-28 08:30:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_8678947dbfb4c5b5cf449715da175296.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6C',
'engine': '3.2L',
'engine_horse_power': 200,
'expiration_date': '2026-03-30T15:05:42Z',
'fuel_type': 'diesel',
'id': 'a0c18fd3-3e02-5946-b55a-e8db1ea81413',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP21660',
'listing': 'auction',
'location': 'BE, Retie',
'make': 'Ford',
'model': 'Ranger',
'odometer': 112293,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c18fd3-3e02-5946-b55a-e8db1ea81413/a0c18fd3-3e02-5946-b55a-e8db1ea81413_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89071,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_4abdf1adfd5f792bda43043681e90e22.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c18fd3-3e02-5946-b55a-e8db1ea81413/a0c18fd3-3e02-5946-b55a-e8db1ea81413_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84150,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_9c4009bf5e5d7d5f2911289cab863c76.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c18fd3-3e02-5946-b55a-e8db1ea81413/a0c18fd3-3e02-5946-b55a-e8db1ea81413_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81090,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_0905d777f99c1accc025d9808503553f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c18fd3-3e02-5946-b55a-e8db1ea81413/a0c18fd3-3e02-5946-b55a-e8db1ea81413_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89603,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_8678947dbfb4c5b5cf449715da175296.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c18fd3-3e02-5946-b55a-e8db1ea81413/a0c18fd3-3e02-5946-b55a-e8db1ea81413_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84721,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_e187c4205d0eb59ab03dfd773a3ab60b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c18fd3-3e02-5946-b55a-e8db1ea81413/a0c18fd3-3e02-5946-b55a-e8db1ea81413_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89300,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_49260f7abaed3cbfd0d613e5836bc332.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c18fd3-3e02-5946-b55a-e8db1ea81413/a0c18fd3-3e02-5946-b55a-e8db1ea81413_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87303,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_c1cfe0e286ddc7541d1def3ff9246cfd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c18fd3-3e02-5946-b55a-e8db1ea81413/a0c18fd3-3e02-5946-b55a-e8db1ea81413_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94178,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_cf619bca08dd7d4e7596257630c11264.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c18fd3-3e02-5946-b55a-e8db1ea81413/a0c18fd3-3e02-5946-b55a-e8db1ea81413_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80612,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_1d3f962fd8acded5fef76d03a1c9ae09.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0c18fd3-3e02-5946-b55a-e8db1ea81413/a0c18fd3-3e02-5946-b55a-e8db1ea81413_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101433,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/f2/7df259cabf11dee4d77d8fe7bf01b8ab/pa/EP21660_1eca06fddc85ed0dc1c40e98131ef769.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-04-28',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Ranger 3.2 TDCi Doppelkabine Limited 4x4',
'transmission': 'automatic',
'trim': 'Doppelkabine Limited 4x4',
'year': 2019}
2026-03-28 08:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP21660%27 HTTP/1.1" 200 None
2026-03-28 08:30:31 [auto1.be] INFO: Saving data for EP21660: {'created_time': 1774686631.966026, 'last_price_update_time': 1774686631.966037, 'auction_closing_time': 1774883142.0}
2026-03-28 08:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EP21660') HTTP/1.1" 204 0
2026-03-28 08:30:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6af9c02e-3c22-5592-ba42-87cb997424a2 with identifier: YZ86935
2026-03-28 08:30:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6af9c02e-3c22-5592-ba42-87cb997424a2 with identifier: YZ86935
2026-03-28 08:30:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6af9c02e-3c22-5592-ba42-87cb997424a2 with identifier: YZ86935 to the API
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_a60ef42be95e71058d3b33ec0883ee55.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.8L',
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:40:28Z',
'fuel_type': 'petrol',
'id': '6af9c02e-3c22-5592-ba42-87cb997424a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ86935',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 219581,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6af9c02e-3c22-5592-ba42-87cb997424a2/6af9c02e-3c22-5592-ba42-87cb997424a2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101865,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_adec6f8c4f0e82b8b99ea9e69071b5de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6af9c02e-3c22-5592-ba42-87cb997424a2/6af9c02e-3c22-5592-ba42-87cb997424a2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103713,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_1adaccd743fe1be39b87e7e3bef05890.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6af9c02e-3c22-5592-ba42-87cb997424a2/6af9c02e-3c22-5592-ba42-87cb997424a2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98176,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_e9ec8ce775e862e795bb700092a071f1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6af9c02e-3c22-5592-ba42-87cb997424a2/6af9c02e-3c22-5592-ba42-87cb997424a2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79457,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_d4fa18a087811c7e6e151e94c606bb23.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6af9c02e-3c22-5592-ba42-87cb997424a2/6af9c02e-3c22-5592-ba42-87cb997424a2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97387,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_9ca3c872c9919fb74eb0f9c61d3a91f0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6af9c02e-3c22-5592-ba42-87cb997424a2/6af9c02e-3c22-5592-ba42-87cb997424a2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102428,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_bcc6497aa130cee76334522c5ec0f7ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6af9c02e-3c22-5592-ba42-87cb997424a2/6af9c02e-3c22-5592-ba42-87cb997424a2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89714,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_a60ef42be95e71058d3b33ec0883ee55.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6af9c02e-3c22-5592-ba42-87cb997424a2/6af9c02e-3c22-5592-ba42-87cb997424a2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101549,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_af1eb9c5530159150be75e00b8455224.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6af9c02e-3c22-5592-ba42-87cb997424a2/6af9c02e-3c22-5592-ba42-87cb997424a2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102616,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_f23ddcc485eaa8705d0bf5d428cbbf85.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6af9c02e-3c22-5592-ba42-87cb997424a2/6af9c02e-3c22-5592-ba42-87cb997424a2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73692,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/9d/919d48961816449e878c2bdc010fcf9f/pa/YZ86935_f7e5d1fb657e246047f5b721f0bc45de.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-02-21',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 Sportback 1.8 TFSI Attraction',
'transmission': 'automatic',
'trim': 'Attraction',
'year': 2012}
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YZ86935%27 HTTP/1.1" 200 None
2026-03-28 08:30:32 [auto1.be] INFO: Saving data for YZ86935: {'created_time': 1774686632.447211, 'last_price_update_time': 1774686632.447224, 'auction_closing_time': 1774885228.0}
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YZ86935') HTTP/1.1" 204 0
2026-03-28 08:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/86/e0860d689a533793e105b17132c6e804/pa/XB72565_4ddf3f2980d6ddb585cc51cb405a7987.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_4e64fa2ea8f8976dcecb202aa4096275.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_f942186e68f7c292f365cd3487b3bc24.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_5b00988563c60b7b06e76593494fc81d.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_db616eedc7409f9525d009b701fe22dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:30:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bb05a710>
2026-03-28 08:30:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90f40c8e-c4c4-5a97-bf2c-b01e97743af0/90f40c8e-c4c4-5a97-bf2c-b01e97743af0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F67%252F6b677a6a10b18d38ee2971393700ecfe%252Fpa%252FPV46198_34a68473397de5e1b9064ad225cc7418.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_34a68473397de5e1b9064ad225cc7418.jpg saved to cache
2026-03-28 08:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 90f40c8e-c4c4-5a97-bf2c-b01e97743af0
2026-03-28 08:30:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bba77990>
2026-03-28 08:30:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90f40c8e-c4c4-5a97-bf2c-b01e97743af0/90f40c8e-c4c4-5a97-bf2c-b01e97743af0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F67%252F6b677a6a10b18d38ee2971393700ecfe%252Fpa%252FPV46198_c18e6f40ef8a6b66dcba14c6ba563bc1.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_c18e6f40ef8a6b66dcba14c6ba563bc1.jpg saved to cache
2026-03-28 08:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 90f40c8e-c4c4-5a97-bf2c-b01e97743af0
2026-03-28 08:30:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 08:30:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bb97fb50>
2026-03-28 08:30:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bda98b99-4937-5a42-8e63-c32c9fb7bce0/bda98b99-4937-5a42-8e63-c32c9fb7bce0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F05%252F20051b867c2006dc84fa8cf2319bc1d6%252Fpa%252FYA99172_3005f5fa6d392930b151fda5bb61a35b.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_3005f5fa6d392930b151fda5bb61a35b.jpg saved to cache
2026-03-28 08:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bda98b99-4937-5a42-8e63-c32c9fb7bce0
2026-03-28 08:30:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 08:30:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bb032250>
2026-03-28 08:30:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bda98b99-4937-5a42-8e63-c32c9fb7bce0/bda98b99-4937-5a42-8e63-c32c9fb7bce0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F05%252F20051b867c2006dc84fa8cf2319bc1d6%252Fpa%252FYA99172_0de78627cc53613742a448c9c74cc2d6.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_0de78627cc53613742a448c9c74cc2d6.jpg saved to cache
2026-03-28 08:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bda98b99-4937-5a42-8e63-c32c9fb7bce0
2026-03-28 08:30:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 08:30:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bba55e90>
2026-03-28 08:30:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bda98b99-4937-5a42-8e63-c32c9fb7bce0/bda98b99-4937-5a42-8e63-c32c9fb7bce0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F05%252F20051b867c2006dc84fa8cf2319bc1d6%252Fpa%252FYA99172_24f1cef3f0038426cec34746f24b7927.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_24f1cef3f0038426cec34746f24b7927.jpg saved to cache
2026-03-28 08:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bda98b99-4937-5a42-8e63-c32c9fb7bce0
2026-03-28 08:30:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 08:30:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bba56390>
2026-03-28 08:30:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bda98b99-4937-5a42-8e63-c32c9fb7bce0/bda98b99-4937-5a42-8e63-c32c9fb7bce0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F05%252F20051b867c2006dc84fa8cf2319bc1d6%252Fpa%252FYA99172_74a4092c7f472c193ca7f8ebc8c615e6.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_74a4092c7f472c193ca7f8ebc8c615e6.jpg saved to cache
2026-03-28 08:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bda98b99-4937-5a42-8e63-c32c9fb7bce0
2026-03-28 08:30:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bb032950>
2026-03-28 08:30:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90f40c8e-c4c4-5a97-bf2c-b01e97743af0/90f40c8e-c4c4-5a97-bf2c-b01e97743af0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F67%252F6b677a6a10b18d38ee2971393700ecfe%252Fpa%252FPV46198_9a9c9b6c7839e026db968652e4f480db.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_9a9c9b6c7839e026db968652e4f480db.jpg saved to cache
2026-03-28 08:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 90f40c8e-c4c4-5a97-bf2c-b01e97743af0
2026-03-28 08:30:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bba26890>
2026-03-28 08:30:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90f40c8e-c4c4-5a97-bf2c-b01e97743af0/90f40c8e-c4c4-5a97-bf2c-b01e97743af0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F67%252F6b677a6a10b18d38ee2971393700ecfe%252Fpa%252FPV46198_c3a69854559b7bb993cd7e278fff4be8.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_c3a69854559b7bb993cd7e278fff4be8.jpg saved to cache
2026-03-28 08:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 90f40c8e-c4c4-5a97-bf2c-b01e97743af0
2026-03-28 08:30:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bba55410>
2026-03-28 08:30:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90f40c8e-c4c4-5a97-bf2c-b01e97743af0/90f40c8e-c4c4-5a97-bf2c-b01e97743af0_image_7.jpg HTTP/1.1" 201 0
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F67%252F6b677a6a10b18d38ee2971393700ecfe%252Fpa%252FPV46198_36e8d9d6d4b76a872bdb100ee56d6948.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_36e8d9d6d4b76a872bdb100ee56d6948.jpg saved to cache
2026-03-28 08:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 90f40c8e-c4c4-5a97-bf2c-b01e97743af0
2026-03-28 08:30:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bb0035d0>
2026-03-28 08:30:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b939a141-7d36-5e5c-8878-99839cc8c1aa/b939a141-7d36-5e5c-8878-99839cc8c1aa_image_3.jpg HTTP/1.1" 201 0
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F86%252Fe0860d689a533793e105b17132c6e804%252Fpa%252FXB72565_4ddf3f2980d6ddb585cc51cb405a7987.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/86/e0860d689a533793e105b17132c6e804/pa/XB72565_4ddf3f2980d6ddb585cc51cb405a7987.jpg saved to cache
2026-03-28 08:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b939a141-7d36-5e5c-8878-99839cc8c1aa
2026-03-28 08:30:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b939a141-7d36-5e5c-8878-99839cc8c1aa, skipping ID generation
2026-03-28 08:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b939a141-7d36-5e5c-8878-99839cc8c1aa with scrape type 1
2026-03-28 08:30:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b939a141-7d36-5e5c-8878-99839cc8c1aa sending to next pipeline
2026-03-28 08:30:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b939a141-7d36-5e5c-8878-99839cc8c1aa, identifier: XB72565
2026-03-28 08:30:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bba974d0>
2026-03-28 08:30:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90f40c8e-c4c4-5a97-bf2c-b01e97743af0/90f40c8e-c4c4-5a97-bf2c-b01e97743af0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F67%252F6b677a6a10b18d38ee2971393700ecfe%252Fpa%252FPV46198_4e64fa2ea8f8976dcecb202aa4096275.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_4e64fa2ea8f8976dcecb202aa4096275.jpg saved to cache
2026-03-28 08:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 90f40c8e-c4c4-5a97-bf2c-b01e97743af0
2026-03-28 08:30:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bb0e8190>
2026-03-28 08:30:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90f40c8e-c4c4-5a97-bf2c-b01e97743af0/90f40c8e-c4c4-5a97-bf2c-b01e97743af0_image_9.jpg HTTP/1.1" 201 0
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F67%252F6b677a6a10b18d38ee2971393700ecfe%252Fpa%252FPV46198_f942186e68f7c292f365cd3487b3bc24.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_f942186e68f7c292f365cd3487b3bc24.jpg saved to cache
2026-03-28 08:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 90f40c8e-c4c4-5a97-bf2c-b01e97743af0
2026-03-28 08:30:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bb950150>
2026-03-28 08:30:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90f40c8e-c4c4-5a97-bf2c-b01e97743af0/90f40c8e-c4c4-5a97-bf2c-b01e97743af0_image_6.jpg HTTP/1.1" 201 0
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F67%252F6b677a6a10b18d38ee2971393700ecfe%252Fpa%252FPV46198_5b00988563c60b7b06e76593494fc81d.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_5b00988563c60b7b06e76593494fc81d.jpg saved to cache
2026-03-28 08:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 90f40c8e-c4c4-5a97-bf2c-b01e97743af0
2026-03-28 08:30:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29c9cef390>
2026-03-28 08:30:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90f40c8e-c4c4-5a97-bf2c-b01e97743af0/90f40c8e-c4c4-5a97-bf2c-b01e97743af0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F67%252F6b677a6a10b18d38ee2971393700ecfe%252Fpa%252FPV46198_db616eedc7409f9525d009b701fe22dc.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_db616eedc7409f9525d009b701fe22dc.jpg saved to cache
2026-03-28 08:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 90f40c8e-c4c4-5a97-bf2c-b01e97743af0
2026-03-28 08:30:33 [auto1.be] INFO: Channel: 24h | Page: 4 | totalHits: 1700 | hits on page: 40
2026-03-28 08:30:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b939a141-7d36-5e5c-8878-99839cc8c1aa with identifier: XB72565
2026-03-28 08:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b939a141-7d36-5e5c-8878-99839cc8c1aa with identifier: XB72565
2026-03-28 08:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b939a141-7d36-5e5c-8878-99839cc8c1aa with identifier: XB72565 to the API
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge0/86/e0860d689a533793e105b17132c6e804/pa/XB72565_4ddf3f2980d6ddb585cc51cb405a7987.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:47:31Z',
'fuel_type': 'petrol',
'id': 'b939a141-7d36-5e5c-8878-99839cc8c1aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB72565',
'listing': 'auction',
'location': 'BE, Mons',
'make': 'Fiat',
'model': 'Punto',
'odometer': 173649,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b939a141-7d36-5e5c-8878-99839cc8c1aa/b939a141-7d36-5e5c-8878-99839cc8c1aa_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67444,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/86/e0860d689a533793e105b17132c6e804/pa/XB72565_1c7639ba496c2e11db259f83b0b00ebc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b939a141-7d36-5e5c-8878-99839cc8c1aa/b939a141-7d36-5e5c-8878-99839cc8c1aa_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69173,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/86/e0860d689a533793e105b17132c6e804/pa/XB72565_a8dac61ad4aab26f8efb2b0814774e35.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b939a141-7d36-5e5c-8878-99839cc8c1aa/b939a141-7d36-5e5c-8878-99839cc8c1aa_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72117,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/86/e0860d689a533793e105b17132c6e804/pa/XB72565_c74e19101c042aca6aada37304bdd67d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b939a141-7d36-5e5c-8878-99839cc8c1aa/b939a141-7d36-5e5c-8878-99839cc8c1aa_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78078,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/86/e0860d689a533793e105b17132c6e804/pa/XB72565_4ddf3f2980d6ddb585cc51cb405a7987.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b939a141-7d36-5e5c-8878-99839cc8c1aa/b939a141-7d36-5e5c-8878-99839cc8c1aa_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95813,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/86/e0860d689a533793e105b17132c6e804/pa/XB72565_33c56796a6fbdf7af15a0939cb578ddc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b939a141-7d36-5e5c-8878-99839cc8c1aa/b939a141-7d36-5e5c-8878-99839cc8c1aa_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61676,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/86/e0860d689a533793e105b17132c6e804/pa/XB72565_86529f164baf0624c1bafa074e424f43.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-02-27',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat Punto 1.4 Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2013}
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB72565%27 HTTP/1.1" 200 None
2026-03-28 08:30:33 [auto1.be] INFO: Saving data for XB72565: {'created_time': 1774686633.738949, 'last_price_update_time': 1774686633.73896, 'auction_closing_time': 1774885651.0}
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XB72565') HTTP/1.1" 204 0
2026-03-28 08:30:33 [auto1.be] INFO: Found listing with ID: JZ92177
2026-03-28 08:30:33 [auto1.be] INFO: Found listing with ID: ND78338
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND78338%27 HTTP/1.1" 200 None
2026-03-28 08:30:33 [auto1.be] INFO: Scrape type for ND78338: 0
2026-03-28 08:30:33 [auto1.be] INFO: Found listing with ID: SX32022
2026-03-28 08:30:33 [auto1.be] INFO: Found listing with ID: EZ92638
2026-03-28 08:30:33 [auto1.be] INFO: Found listing with ID: SB67636
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB67636%27 HTTP/1.1" 200 None
2026-03-28 08:30:33 [auto1.be] INFO: Scrape type for SB67636: 0
2026-03-28 08:30:33 [auto1.be] INFO: Found listing with ID: NA16602
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA16602%27 HTTP/1.1" 200 None
2026-03-28 08:30:33 [auto1.be] INFO: Scrape type for NA16602: 2
2026-03-28 08:30:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76793667-f594-5226-8f47-857b6b569092 with identifier: NA16602
2026-03-28 08:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76793667-f594-5226-8f47-857b6b569092 with scrape type 2
2026-03-28 08:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76793667-f594-5226-8f47-857b6b569092 with scrape type 2
2026-03-28 08:30:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 76793667-f594-5226-8f47-857b6b569092, identifier: NA16602
2026-03-28 08:30:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 76793667-f594-5226-8f47-857b6b569092 with identifier: NA16602
2026-03-28 08:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 76793667-f594-5226-8f47-857b6b569092 with identifier: NA16602
2026-03-28 08:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 76793667-f594-5226-8f47-857b6b569092 with identifier: NA16602 to the API
2026-03-28 08:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:29:48Z',
'fuel_type': 'diesel',
'id': '76793667-f594-5226-8f47-857b6b569092',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA16602',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Boxer',
'odometer': 72062,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-22',
'seller_name': None,
'title': 'Peugeot Boxer 2.2 Blue-HDi 335 L2H2 140 Stop&Start',
'transmission': 'manual',
'trim': '335 L2H2 140 Stop&Start',
'year': 2023}
2026-03-28 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA16602%27 HTTP/1.1" 200 None
2026-03-28 08:30:34 [auto1.be] INFO: Saving data for NA16602: {'auction_closing_time': 1774715388.0, 'created_time': 1774384518.116576, 'last_price_update_time': 1774686634.211682}
2026-03-28 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NA16602') HTTP/1.1" 204 0
2026-03-28 08:30:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:34 [auto1.be] INFO: Found listing with ID: NN69701
2026-03-28 08:30:34 [auto1.be] INFO: Found listing with ID: GM68139
2026-03-28 08:30:34 [auto1.be] INFO: Found listing with ID: VL69873
2026-03-28 08:30:34 [auto1.be] INFO: Found listing with ID: YC48670
2026-03-28 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC48670%27 HTTP/1.1" 200 None
2026-03-28 08:30:34 [auto1.be] INFO: Scrape type for YC48670: 0
2026-03-28 08:30:34 [auto1.be] INFO: Found listing with ID: JP67733
2026-03-28 08:30:34 [auto1.be] INFO: Found listing with ID: XB95573
2026-03-28 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB95573%27 HTTP/1.1" 200 None
2026-03-28 08:30:34 [auto1.be] INFO: Scrape type for XB95573: 0
2026-03-28 08:30:34 [auto1.be] INFO: Found listing with ID: LK25886
2026-03-28 08:30:34 [auto1.be] INFO: Found listing with ID: ZB59407
2026-03-28 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZB59407%27 HTTP/1.1" 200 None
2026-03-28 08:30:34 [auto1.be] INFO: Scrape type for ZB59407: 0
2026-03-28 08:30:34 [auto1.be] INFO: Found listing with ID: VC92856
2026-03-28 08:30:34 [auto1.be] INFO: Found listing with ID: CW56450
2026-03-28 08:30:34 [auto1.be] INFO: Found listing with ID: YM63500
2026-03-28 08:30:34 [auto1.be] INFO: Found listing with ID: AG87445
2026-03-28 08:30:34 [auto1.be] INFO: Found listing with ID: VA33507
2026-03-28 08:30:34 [auto1.be] INFO: Found listing with ID: PN18532
2026-03-28 08:30:34 [auto1.be] INFO: Found listing with ID: TE72836
2026-03-28 08:30:34 [auto1.be] INFO: Found listing with ID: UA44926
2026-03-28 08:30:34 [auto1.be] INFO: Found listing with ID: XU56519
2026-03-28 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU56519%27 HTTP/1.1" 200 None
2026-03-28 08:30:34 [auto1.be] INFO: Scrape type for XU56519: 2
2026-03-28 08:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5c5c01d-a7e7-5c8a-b17e-be1ceb71c516 with identifier: XU56519
2026-03-28 08:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5c5c01d-a7e7-5c8a-b17e-be1ceb71c516 with scrape type 2
2026-03-28 08:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5c5c01d-a7e7-5c8a-b17e-be1ceb71c516 with scrape type 2
2026-03-28 08:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d5c5c01d-a7e7-5c8a-b17e-be1ceb71c516, identifier: XU56519
2026-03-28 08:30:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d5c5c01d-a7e7-5c8a-b17e-be1ceb71c516 with identifier: XU56519
2026-03-28 08:30:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d5c5c01d-a7e7-5c8a-b17e-be1ceb71c516 with identifier: XU56519
2026-03-28 08:30:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d5c5c01d-a7e7-5c8a-b17e-be1ceb71c516 with identifier: XU56519 to the API
2026-03-28 08:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-28T16:02:46Z',
'fuel_type': 'diesel',
'id': 'd5c5c01d-a7e7-5c8a-b17e-be1ceb71c516',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU56519',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 330896,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-08',
'seller_name': None,
'title': 'Volkswagen Polo 1.9 TDI United',
'transmission': 'manual',
'trim': 'United',
'year': 2009}
2026-03-28 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU56519%27 HTTP/1.1" 200 None
2026-03-28 08:30:34 [auto1.be] INFO: Saving data for XU56519: {'auction_closing_time': 1774713766.0, 'created_time': 1774471327.527398, 'last_price_update_time': 1774686634.717361}
2026-03-28 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XU56519') HTTP/1.1" 204 0
2026-03-28 08:30:34 [auto1.be] INFO: Found listing with ID: NS97708
2026-03-28 08:30:34 [auto1.be] INFO: Found listing with ID: EP21632
2026-03-28 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP21632%27 HTTP/1.1" 200 None
2026-03-28 08:30:34 [auto1.be] INFO: Scrape type for EP21632: 2
2026-03-28 08:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca6114eb-46d4-58d2-a1b2-acd98b5a543e with identifier: EP21632
2026-03-28 08:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca6114eb-46d4-58d2-a1b2-acd98b5a543e with scrape type 2
2026-03-28 08:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca6114eb-46d4-58d2-a1b2-acd98b5a543e with scrape type 2
2026-03-28 08:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ca6114eb-46d4-58d2-a1b2-acd98b5a543e, identifier: EP21632
2026-03-28 08:30:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ca6114eb-46d4-58d2-a1b2-acd98b5a543e with identifier: EP21632
2026-03-28 08:30:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ca6114eb-46d4-58d2-a1b2-acd98b5a543e with identifier: EP21632
2026-03-28 08:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ca6114eb-46d4-58d2-a1b2-acd98b5a543e with identifier: EP21632 to the API
2026-03-28 08:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:54:46Z',
'fuel_type': 'petrol',
'id': 'ca6114eb-46d4-58d2-a1b2-acd98b5a543e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP21632',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 228583,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-05-18',
'seller_name': None,
'title': 'BMW 3er 320i',
'transmission': 'manual',
'trim': '',
'year': 2005}
2026-03-28 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP21632%27 HTTP/1.1" 200 None
2026-03-28 08:30:35 [auto1.be] INFO: Saving data for EP21632: {'auction_closing_time': 1774716886.0, 'created_time': 1774471176.019447, 'last_price_update_time': 1774686635.238957}
2026-03-28 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EP21632') HTTP/1.1" 204 0
2026-03-28 08:30:35 [auto1.be] INFO: Found listing with ID: JE64072
2026-03-28 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JE64072%27 HTTP/1.1" 200 None
2026-03-28 08:30:35 [auto1.be] INFO: Scrape type for JE64072: 0
2026-03-28 08:30:35 [auto1.be] INFO: Found listing with ID: AW18524
2026-03-28 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AW18524%27 HTTP/1.1" 200 None
2026-03-28 08:30:35 [auto1.be] INFO: Scrape type for AW18524: 0
2026-03-28 08:30:35 [auto1.be] INFO: Found listing with ID: PD31186
2026-03-28 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD31186%27 HTTP/1.1" 200 None
2026-03-28 08:30:35 [auto1.be] INFO: Scrape type for PD31186: 0
2026-03-28 08:30:35 [auto1.be] INFO: Found listing with ID: YS75558
2026-03-28 08:30:35 [auto1.be] INFO: Found listing with ID: NS20906
2026-03-28 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS20906%27 HTTP/1.1" 200 None
2026-03-28 08:30:35 [auto1.be] INFO: Scrape type for NS20906: 0
2026-03-28 08:30:35 [auto1.be] INFO: Found listing with ID: PJ37303
2026-03-28 08:30:35 [auto1.be] INFO: Found listing with ID: VS66255
2026-03-28 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VS66255%27 HTTP/1.1" 200 None
2026-03-28 08:30:35 [auto1.be] INFO: Scrape type for VS66255: 0
2026-03-28 08:30:35 [auto1.be] INFO: Found listing with ID: FZ96232
2026-03-28 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FZ96232%27 HTTP/1.1" 200 None
2026-03-28 08:30:35 [auto1.be] INFO: Scrape type for FZ96232: 0
2026-03-28 08:30:35 [auto1.be] INFO: Found listing with ID: SN78128
2026-03-28 08:30:35 [auto1.be] INFO: Found listing with ID: RL24593
2026-03-28 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL24593%27 HTTP/1.1" 200 None
2026-03-28 08:30:35 [auto1.be] INFO: Scrape type for RL24593: 0
2026-03-28 08:30:35 [auto1.be] INFO: Found listing with ID: LM02594
2026-03-28 08:30:35 [auto1.be] INFO: Found listing with ID: ZJ09914
2026-03-28 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ09914%27 HTTP/1.1" 200 None
2026-03-28 08:30:35 [auto1.be] INFO: Scrape type for ZJ09914: 0
2026-03-28 08:30:35 [auto1.be] INFO: Found listing with ID: HJ61714
2026-03-28 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ61714%27 HTTP/1.1" 200 None
2026-03-28 08:30:35 [auto1.be] INFO: Scrape type for HJ61714: 0
2026-03-28 08:30:35 [auto1.be] INFO: Found listing with ID: ZL48181
2026-03-28 08:30:35 [auto1.be] INFO: Found listing with ID: WS64524
2026-03-28 08:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_6065c9d2a55658f74311e8fab2c15ff4.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_5c494c9318cd7480e724b33e0d70d8fe.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_3c2912e2dd97bddc346bfcd7dd6253a7.jpg> (referer: https://www.auto1.com/)
2026-03-28 08:30:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 08:30:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bbbcdb10>
2026-03-28 08:30:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90f40c8e-c4c4-5a97-bf2c-b01e97743af0/90f40c8e-c4c4-5a97-bf2c-b01e97743af0_image_8.jpg HTTP/1.1" 201 0
2026-03-28 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F67%252F6b677a6a10b18d38ee2971393700ecfe%252Fpa%252FPV46198_6065c9d2a55658f74311e8fab2c15ff4.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_6065c9d2a55658f74311e8fab2c15ff4.jpg saved to cache
2026-03-28 08:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 90f40c8e-c4c4-5a97-bf2c-b01e97743af0
2026-03-28 08:30:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 90f40c8e-c4c4-5a97-bf2c-b01e97743af0, skipping ID generation
2026-03-28 08:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90f40c8e-c4c4-5a97-bf2c-b01e97743af0 with scrape type 1
2026-03-28 08:30:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 90f40c8e-c4c4-5a97-bf2c-b01e97743af0 sending to next pipeline
2026-03-28 08:30:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 90f40c8e-c4c4-5a97-bf2c-b01e97743af0, identifier: PV46198
2026-03-28 08:30:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 90f40c8e-c4c4-5a97-bf2c-b01e97743af0 with identifier: PV46198
2026-03-28 08:30:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 90f40c8e-c4c4-5a97-bf2c-b01e97743af0 with identifier: PV46198
2026-03-28 08:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 90f40c8e-c4c4-5a97-bf2c-b01e97743af0 with identifier: PV46198 to the API
2026-03-28 08:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_6065c9d2a55658f74311e8fab2c15ff4.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6B',
'engine': '1.6L',
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:36:04Z',
'fuel_type': 'diesel',
'id': '90f40c8e-c4c4-5a97-bf2c-b01e97743af0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV46198',
'listing': 'auction',
'location': 'BE, Oostakker',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 177585,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90f40c8e-c4c4-5a97-bf2c-b01e97743af0/90f40c8e-c4c4-5a97-bf2c-b01e97743af0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71870,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_9a9c9b6c7839e026db968652e4f480db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90f40c8e-c4c4-5a97-bf2c-b01e97743af0/90f40c8e-c4c4-5a97-bf2c-b01e97743af0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59814,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_4e64fa2ea8f8976dcecb202aa4096275.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90f40c8e-c4c4-5a97-bf2c-b01e97743af0/90f40c8e-c4c4-5a97-bf2c-b01e97743af0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64203,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_c18e6f40ef8a6b66dcba14c6ba563bc1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90f40c8e-c4c4-5a97-bf2c-b01e97743af0/90f40c8e-c4c4-5a97-bf2c-b01e97743af0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56898,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_34a68473397de5e1b9064ad225cc7418.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90f40c8e-c4c4-5a97-bf2c-b01e97743af0/90f40c8e-c4c4-5a97-bf2c-b01e97743af0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62087,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_c3a69854559b7bb993cd7e278fff4be8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90f40c8e-c4c4-5a97-bf2c-b01e97743af0/90f40c8e-c4c4-5a97-bf2c-b01e97743af0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58354,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_db616eedc7409f9525d009b701fe22dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90f40c8e-c4c4-5a97-bf2c-b01e97743af0/90f40c8e-c4c4-5a97-bf2c-b01e97743af0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45084,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_5b00988563c60b7b06e76593494fc81d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90f40c8e-c4c4-5a97-bf2c-b01e97743af0/90f40c8e-c4c4-5a97-bf2c-b01e97743af0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59108,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_36e8d9d6d4b76a872bdb100ee56d6948.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90f40c8e-c4c4-5a97-bf2c-b01e97743af0/90f40c8e-c4c4-5a97-bf2c-b01e97743af0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2372816,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_6065c9d2a55658f74311e8fab2c15ff4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90f40c8e-c4c4-5a97-bf2c-b01e97743af0/90f40c8e-c4c4-5a97-bf2c-b01e97743af0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59408,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/67/6b677a6a10b18d38ee2971393700ecfe/pa/PV46198_f942186e68f7c292f365cd3487b3bc24.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-09-09',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 d BlueTEC AMG Line',
'transmission': 'manual',
'trim': 'BlueTEC AMG Line',
'year': 2015}
2026-03-28 08:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV46198%27 HTTP/1.1" 200 None
2026-03-28 08:30:36 [auto1.be] INFO: Saving data for PV46198: {'created_time': 1774686636.101409, 'last_price_update_time': 1774686636.101418, 'auction_closing_time': 1774884964.0}
2026-03-28 08:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PV46198') HTTP/1.1" 204 0
2026-03-28 08:30:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 08:30:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bbbcdb50>
2026-03-28 08:30:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bda98b99-4937-5a42-8e63-c32c9fb7bce0/bda98b99-4937-5a42-8e63-c32c9fb7bce0_image_8.jpg HTTP/1.1" 201 0
2026-03-28 08:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F05%252F20051b867c2006dc84fa8cf2319bc1d6%252Fpa%252FYA99172_5c494c9318cd7480e724b33e0d70d8fe.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_5c494c9318cd7480e724b33e0d70d8fe.jpg saved to cache
2026-03-28 08:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bda98b99-4937-5a42-8e63-c32c9fb7bce0
2026-03-28 08:30:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 08:30:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 08:30:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f29bba84150>
2026-03-28 08:30:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 08:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 08:30:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 08:30:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bda98b99-4937-5a42-8e63-c32c9fb7bce0/bda98b99-4937-5a42-8e63-c32c9fb7bce0_image_9.jpg HTTP/1.1" 201 0
2026-03-28 08:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F05%252F20051b867c2006dc84fa8cf2319bc1d6%252Fpa%252FYA99172_3c2912e2dd97bddc346bfcd7dd6253a7.jpg') HTTP/1.1" 204 0
2026-03-28 08:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_3c2912e2dd97bddc346bfcd7dd6253a7.jpg saved to cache
2026-03-28 08:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bda98b99-4937-5a42-8e63-c32c9fb7bce0
2026-03-28 08:30:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bda98b99-4937-5a42-8e63-c32c9fb7bce0, skipping ID generation
2026-03-28 08:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bda98b99-4937-5a42-8e63-c32c9fb7bce0 with scrape type 1
2026-03-28 08:30:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bda98b99-4937-5a42-8e63-c32c9fb7bce0 sending to next pipeline
2026-03-28 08:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bda98b99-4937-5a42-8e63-c32c9fb7bce0, identifier: YA99172
2026-03-28 08:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bda98b99-4937-5a42-8e63-c32c9fb7bce0 with identifier: YA99172
2026-03-28 08:30:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bda98b99-4937-5a42-8e63-c32c9fb7bce0 with identifier: YA99172
2026-03-28 08:30:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bda98b99-4937-5a42-8e63-c32c9fb7bce0 with identifier: YA99172 to the API
2026-03-28 08:30:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_3c2912e2dd97bddc346bfcd7dd6253a7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 107,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.0L',
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:27:33Z',
'fuel_type': 'petrol',
'id': 'bda98b99-4937-5a42-8e63-c32c9fb7bce0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA99172',
'listing': 'auction',
'location': 'BE, Oostende',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 85500,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda98b99-4937-5a42-8e63-c32c9fb7bce0/bda98b99-4937-5a42-8e63-c32c9fb7bce0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2368846,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_74a4092c7f472c193ca7f8ebc8c615e6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda98b99-4937-5a42-8e63-c32c9fb7bce0/bda98b99-4937-5a42-8e63-c32c9fb7bce0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68898,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_23b56eae742976fcb54b055b031b4bb8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda98b99-4937-5a42-8e63-c32c9fb7bce0/bda98b99-4937-5a42-8e63-c32c9fb7bce0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2265786,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_0de78627cc53613742a448c9c74cc2d6.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda98b99-4937-5a42-8e63-c32c9fb7bce0/bda98b99-4937-5a42-8e63-c32c9fb7bce0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2157774,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_3005f5fa6d392930b151fda5bb61a35b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda98b99-4937-5a42-8e63-c32c9fb7bce0/bda98b99-4937-5a42-8e63-c32c9fb7bce0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61240,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_0ecd855117fccc65ebad37721286575a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda98b99-4937-5a42-8e63-c32c9fb7bce0/bda98b99-4937-5a42-8e63-c32c9fb7bce0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2252536,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_24f1cef3f0038426cec34746f24b7927.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda98b99-4937-5a42-8e63-c32c9fb7bce0/bda98b99-4937-5a42-8e63-c32c9fb7bce0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58872,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_39fcdf95932c4caefa6f32ded260a1a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda98b99-4937-5a42-8e63-c32c9fb7bce0/bda98b99-4937-5a42-8e63-c32c9fb7bce0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64755,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_a5c9dc3fe006b8f231284ccd2b5c5638.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda98b99-4937-5a42-8e63-c32c9fb7bce0/bda98b99-4937-5a42-8e63-c32c9fb7bce0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2442922,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_5c494c9318cd7480e724b33e0d70d8fe.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda98b99-4937-5a42-8e63-c32c9fb7bce0/bda98b99-4937-5a42-8e63-c32c9fb7bce0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2395548,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img20/05/20051b867c2006dc84fa8cf2319bc1d6/pa/YA99172_3c2912e2dd97bddc346bfcd7dd6253a7.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2017-02-09',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Octavia 1.0 TSI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2017}
2026-03-28 08:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA99172%27 HTTP/1.1" 200 None
2026-03-28 08:30:37 [auto1.be] INFO: Saving data for YA99172: {'created_time': 1774686637.005285, 'last_price_update_time': 1774686637.005294, 'auction_closing_time': 1774884453.0}
2026-03-28 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YA99172') HTTP/1.1" 204 0
2026-03-28 08:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:30:37 [auto1.be] INFO: Channel: 24h | Page: 5 | totalHits: 1701 | hits on page: 40
2026-03-28 08:30:37 [auto1.be] INFO: Found listing with ID: WS64524
2026-03-28 08:30:37 [auto1.be] INFO: Found listing with ID: UR44884
2026-03-28 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR44884%27 HTTP/1.1" 200 None
2026-03-28 08:30:37 [auto1.be] INFO: Scrape type for UR44884: 0
2026-03-28 08:30:37 [auto1.be] INFO: Found listing with ID: MH10936
2026-03-28 08:30:37 [auto1.be] INFO: Found listing with ID: DX33442
2026-03-28 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DX33442%27 HTTP/1.1" 200 None
2026-03-28 08:30:37 [auto1.be] INFO: Scrape type for DX33442: 2
2026-03-28 08:30:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 960e2a6c-664f-512b-b349-53f507076a9a with identifier: DX33442
2026-03-28 08:30:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 960e2a6c-664f-512b-b349-53f507076a9a with scrape type 2
2026-03-28 08:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 960e2a6c-664f-512b-b349-53f507076a9a with scrape type 2
2026-03-28 08:30:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 960e2a6c-664f-512b-b349-53f507076a9a, identifier: DX33442
2026-03-28 08:30:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 960e2a6c-664f-512b-b349-53f507076a9a with identifier: DX33442
2026-03-28 08:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 08:30:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-28 08:30:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 08:30:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 960e2a6c-664f-512b-b349-53f507076a9a with identifier: DX33442
2026-03-28 08:30:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 960e2a6c-664f-512b-b349-53f507076a9a with identifier: DX33442 to the API
2026-03-28 08:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:49:27Z',
'fuel_type': 'diesel',
'id': '960e2a6c-664f-512b-b349-53f507076a9a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX33442',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 79288,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-03',
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 180 d Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2016}
2026-03-28 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DX33442%27 HTTP/1.1" 200 None
2026-03-28 08:30:37 [auto1.be] INFO: Saving data for DX33442: {'auction_closing_time': 1774716567.0, 'created_time': 1774471377.531619, 'last_price_update_time': 1774686637.722341}
2026-03-28 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DX33442') HTTP/1.1" 204 0
2026-03-28 08:30:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:37 [auto1.be] INFO: Found listing with ID: HA88594
2026-03-28 08:30:37 [auto1.be] INFO: Found listing with ID: PB88221
2026-03-28 08:30:37 [auto1.be] INFO: Found listing with ID: DW77345
2026-03-28 08:30:37 [auto1.be] INFO: Found listing with ID: CC60514
2026-03-28 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC60514%27 HTTP/1.1" 200 None
2026-03-28 08:30:37 [auto1.be] INFO: Scrape type for CC60514: 0
2026-03-28 08:30:37 [auto1.be] INFO: Found listing with ID: BP07679
2026-03-28 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP07679%27 HTTP/1.1" 200 None
2026-03-28 08:30:37 [auto1.be] INFO: Scrape type for BP07679: 0
2026-03-28 08:30:37 [auto1.be] INFO: Found listing with ID: BJ84732
2026-03-28 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ84732%27 HTTP/1.1" 200 None
2026-03-28 08:30:37 [auto1.be] INFO: Scrape type for BJ84732: 0
2026-03-28 08:30:37 [auto1.be] INFO: Found listing with ID: ZY53321
2026-03-28 08:30:37 [auto1.be] INFO: Found listing with ID: TH79553
2026-03-28 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH79553%27 HTTP/1.1" 200 None
2026-03-28 08:30:37 [auto1.be] INFO: Scrape type for TH79553: 0
2026-03-28 08:30:37 [auto1.be] INFO: Found listing with ID: AN14983
2026-03-28 08:30:37 [auto1.be] INFO: Found listing with ID: KY60433
2026-03-28 08:30:37 [auto1.be] INFO: Found listing with ID: BY25509
2026-03-28 08:30:37 [auto1.be] INFO: Found listing with ID: HF70171
2026-03-28 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HF70171%27 HTTP/1.1" 200 None
2026-03-28 08:30:37 [auto1.be] INFO: Scrape type for HF70171: 2
2026-03-28 08:30:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2eef0d5c-777d-54ac-93a5-0e6ca95e067c with identifier: HF70171
2026-03-28 08:30:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eef0d5c-777d-54ac-93a5-0e6ca95e067c with scrape type 2
2026-03-28 08:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2eef0d5c-777d-54ac-93a5-0e6ca95e067c with scrape type 2
2026-03-28 08:30:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2eef0d5c-777d-54ac-93a5-0e6ca95e067c, identifier: HF70171
2026-03-28 08:30:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2eef0d5c-777d-54ac-93a5-0e6ca95e067c with identifier: HF70171
2026-03-28 08:30:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2eef0d5c-777d-54ac-93a5-0e6ca95e067c with identifier: HF70171
2026-03-28 08:30:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2eef0d5c-777d-54ac-93a5-0e6ca95e067c with identifier: HF70171 to the API
2026-03-28 08:30:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:36:22Z',
'fuel_type': 'diesel',
'id': '2eef0d5c-777d-54ac-93a5-0e6ca95e067c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF70171',
'listing': 'auction',
'make': 'Volvo',
'model': 'V90',
'odometer': 194737,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-15',
'seller_name': None,
'title': 'Volvo V90 2.0 D3',
'transmission': 'manual',
'trim': '',
'year': 2018}
2026-03-28 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HF70171%27 HTTP/1.1" 200 None
2026-03-28 08:30:38 [auto1.be] INFO: Saving data for HF70171: {'auction_closing_time': 1774715782.0, 'created_time': 1773133153.8016, 'last_price_update_time': 1774686638.246723}
2026-03-28 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HF70171') HTTP/1.1" 204 0
2026-03-28 08:30:38 [auto1.be] INFO: Found listing with ID: YV88346
2026-03-28 08:30:38 [auto1.be] INFO: Found listing with ID: CS11712
2026-03-28 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS11712%27 HTTP/1.1" 200 None
2026-03-28 08:30:38 [auto1.be] INFO: Scrape type for CS11712: 0
2026-03-28 08:30:38 [auto1.be] INFO: Found listing with ID: WA78577
2026-03-28 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA78577%27 HTTP/1.1" 200 None
2026-03-28 08:30:38 [auto1.be] INFO: Scrape type for WA78577: 0
2026-03-28 08:30:38 [auto1.be] INFO: Found listing with ID: NY90859
2026-03-28 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY90859%27 HTTP/1.1" 200 None
2026-03-28 08:30:38 [auto1.be] INFO: Scrape type for NY90859: 2
2026-03-28 08:30:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bce825ab-43a7-5273-8508-f31fac549eb1 with identifier: NY90859
2026-03-28 08:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bce825ab-43a7-5273-8508-f31fac549eb1 with scrape type 2
2026-03-28 08:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bce825ab-43a7-5273-8508-f31fac549eb1 with scrape type 2
2026-03-28 08:30:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bce825ab-43a7-5273-8508-f31fac549eb1, identifier: NY90859
2026-03-28 08:30:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bce825ab-43a7-5273-8508-f31fac549eb1 with identifier: NY90859
2026-03-28 08:30:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 08:30:38 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 08:30:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 08:30:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bce825ab-43a7-5273-8508-f31fac549eb1 with identifier: NY90859
2026-03-28 08:30:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bce825ab-43a7-5273-8508-f31fac549eb1 with identifier: NY90859 to the API
2026-03-28 08:30:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:05:39Z',
'fuel_type': 'diesel',
'id': 'bce825ab-43a7-5273-8508-f31fac549eb1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY90859',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 207845,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-08-12',
'seller_name': None,
'title': 'BMW X3 sDrive 18d',
'transmission': 'manual',
'trim': '',
'year': 2014}
2026-03-28 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY90859%27 HTTP/1.1" 200 None
2026-03-28 08:30:38 [auto1.be] INFO: Saving data for NY90859: {'auction_closing_time': 1774713939.0, 'created_time': 1774471299.523174, 'last_price_update_time': 1774686638.933808}
2026-03-28 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NY90859') HTTP/1.1" 204 0
2026-03-28 08:30:38 [auto1.be] INFO: Found listing with ID: SX76756
2026-03-28 08:30:38 [auto1.be] INFO: Found listing with ID: YU54459
2026-03-28 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU54459%27 HTTP/1.1" 200 None
2026-03-28 08:30:38 [auto1.be] INFO: Scrape type for YU54459: 0
2026-03-28 08:30:38 [auto1.be] INFO: Found listing with ID: ZJ26609
2026-03-28 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ26609%27 HTTP/1.1" 200 None
2026-03-28 08:30:38 [auto1.be] INFO: Scrape type for ZJ26609: 0
2026-03-28 08:30:38 [auto1.be] INFO: Found listing with ID: UN79459
2026-03-28 08:30:38 [auto1.be] INFO: Found listing with ID: RD83049
2026-03-28 08:30:38 [auto1.be] INFO: Found listing with ID: UE64261
2026-03-28 08:30:38 [auto1.be] INFO: Found listing with ID: UA02413
2026-03-28 08:30:38 [auto1.be] INFO: Found listing with ID: YW15851
2026-03-28 08:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW15851%27 HTTP/1.1" 200 None
2026-03-28 08:30:39 [auto1.be] INFO: Scrape type for YW15851: 0
2026-03-28 08:30:39 [auto1.be] INFO: Found listing with ID: PL33803
2026-03-28 08:30:39 [auto1.be] INFO: Found listing with ID: RS45224
2026-03-28 08:30:39 [auto1.be] INFO: Found listing with ID: FW97507
2026-03-28 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW97507%27 HTTP/1.1" 200 None
2026-03-28 08:30:39 [auto1.be] INFO: Scrape type for FW97507: 0
2026-03-28 08:30:39 [auto1.be] INFO: Found listing with ID: VM06685
2026-03-28 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM06685%27 HTTP/1.1" 200 None
2026-03-28 08:30:39 [auto1.be] INFO: Scrape type for VM06685: 0
2026-03-28 08:30:39 [auto1.be] INFO: Found listing with ID: BV48703
2026-03-28 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV48703%27 HTTP/1.1" 200 None
2026-03-28 08:30:39 [auto1.be] INFO: Scrape type for BV48703: 0
2026-03-28 08:30:39 [auto1.be] INFO: Found listing with ID: AP73624
2026-03-28 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AP73624%27 HTTP/1.1" 200 None
2026-03-28 08:30:39 [auto1.be] INFO: Scrape type for AP73624: 0
2026-03-28 08:30:39 [auto1.be] INFO: Found listing with ID: DK63787
2026-03-28 08:30:39 [auto1.be] INFO: Found listing with ID: GR59169
2026-03-28 08:30:39 [auto1.be] INFO: Found listing with ID: CD50328
2026-03-28 08:30:39 [auto1.be] INFO: Found listing with ID: EU62289
2026-03-28 08:30:39 [auto1.be] INFO: Found listing with ID: CD49424
2026-03-28 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD49424%27 HTTP/1.1" 200 None
2026-03-28 08:30:39 [auto1.be] INFO: Scrape type for CD49424: 0
2026-03-28 08:30:39 [auto1.be] INFO: Found listing with ID: TK06008
2026-03-28 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK06008%27 HTTP/1.1" 200 None
2026-03-28 08:30:39 [auto1.be] INFO: Scrape type for TK06008: 0
2026-03-28 08:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:30:40 [auto1.be] INFO: Channel: 24h | Page: 6 | totalHits: 1701 | hits on page: 40
2026-03-28 08:30:40 [auto1.be] INFO: Found listing with ID: CB83529
2026-03-28 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB83529%27 HTTP/1.1" 200 None
2026-03-28 08:30:40 [auto1.be] INFO: Scrape type for CB83529: 2
2026-03-28 08:30:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48249e61-c04f-5821-8308-cb2c705eded3 with identifier: CB83529
2026-03-28 08:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48249e61-c04f-5821-8308-cb2c705eded3 with scrape type 2
2026-03-28 08:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48249e61-c04f-5821-8308-cb2c705eded3 with scrape type 2
2026-03-28 08:30:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 48249e61-c04f-5821-8308-cb2c705eded3, identifier: CB83529
2026-03-28 08:30:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 48249e61-c04f-5821-8308-cb2c705eded3 with identifier: CB83529
2026-03-28 08:30:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 48249e61-c04f-5821-8308-cb2c705eded3 with identifier: CB83529
2026-03-28 08:30:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 48249e61-c04f-5821-8308-cb2c705eded3 with identifier: CB83529 to the API
2026-03-28 08:30:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 151,
'expiration_date': '2026-03-28T16:08:33Z',
'fuel_type': 'petrol',
'id': '48249e61-c04f-5821-8308-cb2c705eded3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB83529',
'listing': 'auction',
'make': 'Fiat',
'model': '500X',
'odometer': 52601,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-17',
'seller_name': None,
'title': 'Fiat 500X 1.3 Turbo Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2020}
2026-03-28 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB83529%27 HTTP/1.1" 200 None
2026-03-28 08:30:40 [auto1.be] INFO: Saving data for CB83529: {'auction_closing_time': 1774714113.0, 'created_time': 1774471302.056954, 'last_price_update_time': 1774686640.850151}
2026-03-28 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CB83529') HTTP/1.1" 204 0
2026-03-28 08:30:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:40 [auto1.be] INFO: Found listing with ID: UY34389
2026-03-28 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY34389%27 HTTP/1.1" 200 None
2026-03-28 08:30:40 [auto1.be] INFO: Scrape type for UY34389: 0
2026-03-28 08:30:40 [auto1.be] INFO: Found listing with ID: HE19111
2026-03-28 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE19111%27 HTTP/1.1" 200 None
2026-03-28 08:30:40 [auto1.be] INFO: Scrape type for HE19111: 0
2026-03-28 08:30:40 [auto1.be] INFO: Found listing with ID: YF40273
2026-03-28 08:30:40 [auto1.be] INFO: Found listing with ID: RW00406
2026-03-28 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW00406%27 HTTP/1.1" 200 None
2026-03-28 08:30:41 [auto1.be] INFO: Scrape type for RW00406: 0
2026-03-28 08:30:41 [auto1.be] INFO: Found listing with ID: UA36115
2026-03-28 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA36115%27 HTTP/1.1" 200 None
2026-03-28 08:30:41 [auto1.be] INFO: Scrape type for UA36115: 2
2026-03-28 08:30:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07c06722-9be6-5045-a40b-a0a5614eee69 with identifier: UA36115
2026-03-28 08:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07c06722-9be6-5045-a40b-a0a5614eee69 with scrape type 2
2026-03-28 08:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07c06722-9be6-5045-a40b-a0a5614eee69 with scrape type 2
2026-03-28 08:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 07c06722-9be6-5045-a40b-a0a5614eee69, identifier: UA36115
2026-03-28 08:30:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 07c06722-9be6-5045-a40b-a0a5614eee69 with identifier: UA36115
2026-03-28 08:30:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 07c06722-9be6-5045-a40b-a0a5614eee69 with identifier: UA36115
2026-03-28 08:30:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 07c06722-9be6-5045-a40b-a0a5614eee69 with identifier: UA36115 to the API
2026-03-28 08:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:11:38Z',
'fuel_type': 'diesel',
'id': '07c06722-9be6-5045-a40b-a0a5614eee69',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA36115',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 183131,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-12-08',
'seller_name': None,
'title': 'BMW 1er 116d',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-03-28 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA36115%27 HTTP/1.1" 200 None
2026-03-28 08:30:41 [auto1.be] INFO: Saving data for UA36115: {'auction_closing_time': 1774714298.0, 'created_time': 1774471224.856435, 'last_price_update_time': 1774686641.418858}
2026-03-28 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UA36115') HTTP/1.1" 204 0
2026-03-28 08:30:41 [auto1.be] INFO: Found listing with ID: XH41981
2026-03-28 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH41981%27 HTTP/1.1" 200 None
2026-03-28 08:30:41 [auto1.be] INFO: Scrape type for XH41981: 0
2026-03-28 08:30:41 [auto1.be] INFO: Found listing with ID: RH32729
2026-03-28 08:30:41 [auto1.be] INFO: Found listing with ID: UT11356
2026-03-28 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT11356%27 HTTP/1.1" 200 None
2026-03-28 08:30:41 [auto1.be] INFO: Scrape type for UT11356: 2
2026-03-28 08:30:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4156a1bd-84c8-5651-b62f-0b7d18523638 with identifier: UT11356
2026-03-28 08:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4156a1bd-84c8-5651-b62f-0b7d18523638 with scrape type 2
2026-03-28 08:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4156a1bd-84c8-5651-b62f-0b7d18523638 with scrape type 2
2026-03-28 08:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4156a1bd-84c8-5651-b62f-0b7d18523638, identifier: UT11356
2026-03-28 08:30:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4156a1bd-84c8-5651-b62f-0b7d18523638 with identifier: UT11356
2026-03-28 08:30:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4156a1bd-84c8-5651-b62f-0b7d18523638 with identifier: UT11356
2026-03-28 08:30:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4156a1bd-84c8-5651-b62f-0b7d18523638 with identifier: UT11356 to the API
2026-03-28 08:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:38:16Z',
'fuel_type': 'petrol',
'id': '4156a1bd-84c8-5651-b62f-0b7d18523638',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT11356',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 120794,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-13',
'seller_name': None,
'title': 'Opel Corsa 1.2 Color Edition',
'transmission': 'manual',
'trim': 'Color Edition',
'year': 2013}
2026-03-28 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT11356%27 HTTP/1.1" 200 None
2026-03-28 08:30:41 [auto1.be] INFO: Saving data for UT11356: {'auction_closing_time': 1774715896.0, 'created_time': 1774471289.881948, 'last_price_update_time': 1774686641.857553}
2026-03-28 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UT11356') HTTP/1.1" 204 0
2026-03-28 08:30:41 [auto1.be] INFO: Found listing with ID: EL33380
2026-03-28 08:30:41 [auto1.be] INFO: Found listing with ID: LK16000
2026-03-28 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK16000%27 HTTP/1.1" 200 None
2026-03-28 08:30:41 [auto1.be] INFO: Scrape type for LK16000: 0
2026-03-28 08:30:41 [auto1.be] INFO: Found listing with ID: HB25779
2026-03-28 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB25779%27 HTTP/1.1" 200 None
2026-03-28 08:30:41 [auto1.be] INFO: Scrape type for HB25779: 0
2026-03-28 08:30:41 [auto1.be] INFO: Found listing with ID: CW76300
2026-03-28 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW76300%27 HTTP/1.1" 200 None
2026-03-28 08:30:41 [auto1.be] INFO: Scrape type for CW76300: 2
2026-03-28 08:30:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69db270f-589b-57de-a7b1-4dce52fe7df2 with identifier: CW76300
2026-03-28 08:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69db270f-589b-57de-a7b1-4dce52fe7df2 with scrape type 2
2026-03-28 08:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69db270f-589b-57de-a7b1-4dce52fe7df2 with scrape type 2
2026-03-28 08:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 69db270f-589b-57de-a7b1-4dce52fe7df2, identifier: CW76300
2026-03-28 08:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 69db270f-589b-57de-a7b1-4dce52fe7df2 with identifier: CW76300
2026-03-28 08:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 69db270f-589b-57de-a7b1-4dce52fe7df2 with identifier: CW76300
2026-03-28 08:30:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 69db270f-589b-57de-a7b1-4dce52fe7df2 with identifier: CW76300 to the API
2026-03-28 08:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-28T16:41:39Z',
'fuel_type': 'petrol',
'id': '69db270f-589b-57de-a7b1-4dce52fe7df2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW76300',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 127046,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-02',
'seller_name': None,
'title': 'Peugeot 208 1.0 VTi Like',
'transmission': 'manual',
'trim': 'Like',
'year': 2016}
2026-03-28 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW76300%27 HTTP/1.1" 200 None
2026-03-28 08:30:42 [auto1.be] INFO: Saving data for CW76300: {'auction_closing_time': 1774716099.0, 'created_time': 1774471334.179541, 'last_price_update_time': 1774686642.315121}
2026-03-28 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CW76300') HTTP/1.1" 204 0
2026-03-28 08:30:42 [auto1.be] INFO: Found listing with ID: KH30418
2026-03-28 08:30:42 [auto1.be] INFO: Found listing with ID: KX63098
2026-03-28 08:30:42 [auto1.be] INFO: Found listing with ID: CK71488
2026-03-28 08:30:42 [auto1.be] INFO: Found listing with ID: BF87746
2026-03-28 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BF87746%27 HTTP/1.1" 200 None
2026-03-28 08:30:42 [auto1.be] INFO: Scrape type for BF87746: 0
2026-03-28 08:30:42 [auto1.be] INFO: Found listing with ID: RR89556
2026-03-28 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR89556%27 HTTP/1.1" 200 None
2026-03-28 08:30:42 [auto1.be] INFO: Scrape type for RR89556: 0
2026-03-28 08:30:42 [auto1.be] INFO: Found listing with ID: PJ31589
2026-03-28 08:30:42 [auto1.be] INFO: Found listing with ID: JN34238
2026-03-28 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JN34238%27 HTTP/1.1" 200 None
2026-03-28 08:30:42 [auto1.be] INFO: Scrape type for JN34238: 0
2026-03-28 08:30:42 [auto1.be] INFO: Found listing with ID: FU04844
2026-03-28 08:30:42 [auto1.be] INFO: Found listing with ID: NP31982
2026-03-28 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP31982%27 HTTP/1.1" 200 None
2026-03-28 08:30:42 [auto1.be] INFO: Scrape type for NP31982: 0
2026-03-28 08:30:42 [auto1.be] INFO: Found listing with ID: ZY23736
2026-03-28 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY23736%27 HTTP/1.1" 200 None
2026-03-28 08:30:42 [auto1.be] INFO: Scrape type for ZY23736: 0
2026-03-28 08:30:42 [auto1.be] INFO: Found listing with ID: AB25804
2026-03-28 08:30:42 [auto1.be] INFO: Found listing with ID: MR44504
2026-03-28 08:30:42 [auto1.be] INFO: Found listing with ID: AD33980
2026-03-28 08:30:42 [auto1.be] INFO: Found listing with ID: PY41942
2026-03-28 08:30:42 [auto1.be] INFO: Found listing with ID: BU20603
2026-03-28 08:30:42 [auto1.be] INFO: Found listing with ID: DJ10477
2026-03-28 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ10477%27 HTTP/1.1" 200 None
2026-03-28 08:30:42 [auto1.be] INFO: Scrape type for DJ10477: 0
2026-03-28 08:30:42 [auto1.be] INFO: Found listing with ID: LT82149
2026-03-28 08:30:42 [auto1.be] INFO: Found listing with ID: WK92284
2026-03-28 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK92284%27 HTTP/1.1" 200 None
2026-03-28 08:30:42 [auto1.be] INFO: Scrape type for WK92284: 0
2026-03-28 08:30:42 [auto1.be] INFO: Found listing with ID: YD21406
2026-03-28 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YD21406%27 HTTP/1.1" 200 None
2026-03-28 08:30:42 [auto1.be] INFO: Scrape type for YD21406: 0
2026-03-28 08:30:42 [auto1.be] INFO: Found listing with ID: VF99667
2026-03-28 08:30:42 [auto1.be] INFO: Found listing with ID: CC33949
2026-03-28 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC33949%27 HTTP/1.1" 200 None
2026-03-28 08:30:42 [auto1.be] INFO: Scrape type for CC33949: 0
2026-03-28 08:30:42 [auto1.be] INFO: Found listing with ID: ZZ76068
2026-03-28 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ76068%27 HTTP/1.1" 200 None
2026-03-28 08:30:42 [auto1.be] INFO: Scrape type for ZZ76068: 2
2026-03-28 08:30:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0d93a09-ceb7-5fb9-88bd-a2d543c128eb with identifier: ZZ76068
2026-03-28 08:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0d93a09-ceb7-5fb9-88bd-a2d543c128eb with scrape type 2
2026-03-28 08:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0d93a09-ceb7-5fb9-88bd-a2d543c128eb with scrape type 2
2026-03-28 08:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e0d93a09-ceb7-5fb9-88bd-a2d543c128eb, identifier: ZZ76068
2026-03-28 08:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e0d93a09-ceb7-5fb9-88bd-a2d543c128eb with identifier: ZZ76068
2026-03-28 08:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e0d93a09-ceb7-5fb9-88bd-a2d543c128eb with identifier: ZZ76068
2026-03-28 08:30:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e0d93a09-ceb7-5fb9-88bd-a2d543c128eb with identifier: ZZ76068 to the API
2026-03-28 08:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:18:00Z',
'fuel_type': 'diesel',
'id': 'e0d93a09-ceb7-5fb9-88bd-a2d543c128eb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ76068',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 127672,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-02-10',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 CDI Classic',
'transmission': 'automatic',
'trim': 'Classic',
'year': 2008}
2026-03-28 08:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ76068%27 HTTP/1.1" 200 None
2026-03-28 08:30:43 [auto1.be] INFO: Saving data for ZZ76068: {'auction_closing_time': 1774714680.0, 'created_time': 1774471350.651402, 'last_price_update_time': 1774686643.001905}
2026-03-28 08:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZZ76068') HTTP/1.1" 204 0
2026-03-28 08:30:43 [auto1.be] INFO: Found listing with ID: TY40613
2026-03-28 08:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY40613%27 HTTP/1.1" 200 None
2026-03-28 08:30:43 [auto1.be] INFO: Scrape type for TY40613: 0
2026-03-28 08:30:43 [auto1.be] INFO: Found listing with ID: DM43787
2026-03-28 08:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM43787%27 HTTP/1.1" 200 None
2026-03-28 08:30:43 [auto1.be] INFO: Scrape type for DM43787: 0
2026-03-28 08:30:43 [auto1.be] INFO: Found listing with ID: FC96000
2026-03-28 08:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC96000%27 HTTP/1.1" 200 None
2026-03-28 08:30:43 [auto1.be] INFO: Scrape type for FC96000: 2
2026-03-28 08:30:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f7993a9-53bf-57d7-94fb-78d9e3db4e94 with identifier: FC96000
2026-03-28 08:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f7993a9-53bf-57d7-94fb-78d9e3db4e94 with scrape type 2
2026-03-28 08:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f7993a9-53bf-57d7-94fb-78d9e3db4e94 with scrape type 2
2026-03-28 08:30:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1f7993a9-53bf-57d7-94fb-78d9e3db4e94, identifier: FC96000
2026-03-28 08:30:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1f7993a9-53bf-57d7-94fb-78d9e3db4e94 with identifier: FC96000
2026-03-28 08:30:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1f7993a9-53bf-57d7-94fb-78d9e3db4e94 with identifier: FC96000
2026-03-28 08:30:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1f7993a9-53bf-57d7-94fb-78d9e3db4e94 with identifier: FC96000 to the API
2026-03-28 08:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 205,
'expiration_date': '2026-03-28T16:43:47Z',
'fuel_type': 'diesel',
'id': '1f7993a9-53bf-57d7-94fb-78d9e3db4e94',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC96000',
'listing': 'auction',
'make': 'Volvo',
'model': 'S80',
'odometer': 261705,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-10-06',
'seller_name': None,
'title': 'Volvo S80 2.4 D5 Summum',
'transmission': 'manual',
'trim': 'Summum',
'year': 2009}
2026-03-28 08:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC96000%27 HTTP/1.1" 200 None
2026-03-28 08:30:43 [auto1.be] INFO: Saving data for FC96000: {'auction_closing_time': 1774716227.0, 'created_time': 1774038853.564632, 'last_price_update_time': 1774686643.539674}
2026-03-28 08:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FC96000') HTTP/1.1" 204 0
2026-03-28 08:30:43 [auto1.be] INFO: Found listing with ID: DW61635
2026-03-28 08:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW61635%27 HTTP/1.1" 200 None
2026-03-28 08:30:43 [auto1.be] INFO: Scrape type for DW61635: 0
2026-03-28 08:30:43 [auto1.be] INFO: Found listing with ID: DH81993
2026-03-28 08:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH81993%27 HTTP/1.1" 200 None
2026-03-28 08:30:43 [auto1.be] INFO: Scrape type for DH81993: 0
2026-03-28 08:30:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:30:43 [auto1.be] INFO: Channel: 24h | Page: 7 | totalHits: 1701 | hits on page: 40
2026-03-28 08:30:43 [auto1.be] INFO: Found listing with ID: RL73626
2026-03-28 08:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL73626%27 HTTP/1.1" 200 None
2026-03-28 08:30:44 [auto1.be] INFO: Scrape type for RL73626: 0
2026-03-28 08:30:44 [auto1.be] INFO: Found listing with ID: XF90058
2026-03-28 08:30:44 [auto1.be] INFO: Found listing with ID: WG55963
2026-03-28 08:30:44 [auto1.be] INFO: Found listing with ID: RY67713
2026-03-28 08:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY67713%27 HTTP/1.1" 200 None
2026-03-28 08:30:44 [auto1.be] INFO: Scrape type for RY67713: 2
2026-03-28 08:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1cfa1c3-275e-533e-9f9b-4b596eefbdaf with identifier: RY67713
2026-03-28 08:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1cfa1c3-275e-533e-9f9b-4b596eefbdaf with scrape type 2
2026-03-28 08:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1cfa1c3-275e-533e-9f9b-4b596eefbdaf with scrape type 2
2026-03-28 08:30:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f1cfa1c3-275e-533e-9f9b-4b596eefbdaf, identifier: RY67713
2026-03-28 08:30:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f1cfa1c3-275e-533e-9f9b-4b596eefbdaf with identifier: RY67713
2026-03-28 08:30:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f1cfa1c3-275e-533e-9f9b-4b596eefbdaf with identifier: RY67713
2026-03-28 08:30:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f1cfa1c3-275e-533e-9f9b-4b596eefbdaf with identifier: RY67713 to the API
2026-03-28 08:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:24:40Z',
'fuel_type': 'petrol',
'id': 'f1cfa1c3-275e-533e-9f9b-4b596eefbdaf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY67713',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 45491,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-04',
'seller_name': None,
'title': 'Skoda Fabia 1.0 TSI Monte Carlo',
'transmission': 'manual',
'trim': 'Monte Carlo',
'year': 2021}
2026-03-28 08:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY67713%27 HTTP/1.1" 200 None
2026-03-28 08:30:44 [auto1.be] INFO: Saving data for RY67713: {'auction_closing_time': 1774715080.0, 'created_time': 1774471355.022135, 'last_price_update_time': 1774686644.447093}
2026-03-28 08:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RY67713') HTTP/1.1" 204 0
2026-03-28 08:30:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:44 [auto1.be] INFO: Found listing with ID: LK47918
2026-03-28 08:30:44 [auto1.be] INFO: Found listing with ID: ML85388
2026-03-28 08:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML85388%27 HTTP/1.1" 200 None
2026-03-28 08:30:44 [auto1.be] INFO: Scrape type for ML85388: 0
2026-03-28 08:30:44 [auto1.be] INFO: Found listing with ID: GT24920
2026-03-28 08:30:44 [auto1.be] INFO: Found listing with ID: CK78813
2026-03-28 08:30:44 [auto1.be] INFO: Found listing with ID: FL07479
2026-03-28 08:30:44 [auto1.be] INFO: Found listing with ID: KV70453
2026-03-28 08:30:44 [auto1.be] INFO: Found listing with ID: BV36868
2026-03-28 08:30:44 [auto1.be] INFO: Found listing with ID: WU67286
2026-03-28 08:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU67286%27 HTTP/1.1" 200 None
2026-03-28 08:30:44 [auto1.be] INFO: Scrape type for WU67286: 0
2026-03-28 08:30:44 [auto1.be] INFO: Found listing with ID: XB51767
2026-03-28 08:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB51767%27 HTTP/1.1" 200 None
2026-03-28 08:30:44 [auto1.be] INFO: Scrape type for XB51767: 2
2026-03-28 08:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26f2e17f-0b87-5395-8285-9888f7d0f817 with identifier: XB51767
2026-03-28 08:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26f2e17f-0b87-5395-8285-9888f7d0f817 with scrape type 2
2026-03-28 08:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26f2e17f-0b87-5395-8285-9888f7d0f817 with scrape type 2
2026-03-28 08:30:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 26f2e17f-0b87-5395-8285-9888f7d0f817, identifier: XB51767
2026-03-28 08:30:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 26f2e17f-0b87-5395-8285-9888f7d0f817 with identifier: XB51767
2026-03-28 08:30:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 26f2e17f-0b87-5395-8285-9888f7d0f817 with identifier: XB51767
2026-03-28 08:30:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 26f2e17f-0b87-5395-8285-9888f7d0f817 with identifier: XB51767 to the API
2026-03-28 08:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-28T16:18:32Z',
'fuel_type': 'petrol',
'id': '26f2e17f-0b87-5395-8285-9888f7d0f817',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB51767',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 98948,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-14',
'seller_name': None,
'title': 'Renault Megane 1.3 TCe Limited',
'transmission': 'manual',
'trim': 'Limited',
'year': 2019}
2026-03-28 08:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB51767%27 HTTP/1.1" 200 None
2026-03-28 08:30:44 [auto1.be] INFO: Saving data for XB51767: {'auction_closing_time': 1774714712.0, 'created_time': 1774471328.5963, 'last_price_update_time': 1774686644.928478}
2026-03-28 08:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XB51767') HTTP/1.1" 204 0
2026-03-28 08:30:45 [auto1.be] INFO: Found listing with ID: CV26650
2026-03-28 08:30:45 [auto1.be] INFO: Found listing with ID: CT01503
2026-03-28 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CT01503%27 HTTP/1.1" 200 None
2026-03-28 08:30:45 [auto1.be] INFO: Scrape type for CT01503: 0
2026-03-28 08:30:45 [auto1.be] INFO: Found listing with ID: BT18330
2026-03-28 08:30:45 [auto1.be] INFO: Found listing with ID: GU08126
2026-03-28 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GU08126%27 HTTP/1.1" 200 None
2026-03-28 08:30:45 [auto1.be] INFO: Scrape type for GU08126: 2
2026-03-28 08:30:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e71bb64c-62f0-539c-a651-e39b39736446 with identifier: GU08126
2026-03-28 08:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e71bb64c-62f0-539c-a651-e39b39736446 with scrape type 2
2026-03-28 08:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e71bb64c-62f0-539c-a651-e39b39736446 with scrape type 2
2026-03-28 08:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e71bb64c-62f0-539c-a651-e39b39736446, identifier: GU08126
2026-03-28 08:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e71bb64c-62f0-539c-a651-e39b39736446 with identifier: GU08126
2026-03-28 08:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e71bb64c-62f0-539c-a651-e39b39736446 with identifier: GU08126
2026-03-28 08:30:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e71bb64c-62f0-539c-a651-e39b39736446 with identifier: GU08126 to the API
2026-03-28 08:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:21:06Z',
'fuel_type': 'diesel',
'id': 'e71bb64c-62f0-539c-a651-e39b39736446',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU08126',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Sports Tourer',
'odometer': 273187,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-13',
'seller_name': None,
'title': 'Opel Insignia Sports Tourer 2.0 CDTI Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2011}
2026-03-28 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GU08126%27 HTTP/1.1" 200 None
2026-03-28 08:30:45 [auto1.be] INFO: Saving data for GU08126: {'auction_closing_time': 1774714866.0, 'created_time': 1774471299.217635, 'last_price_update_time': 1774686645.434845}
2026-03-28 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GU08126') HTTP/1.1" 204 0
2026-03-28 08:30:45 [auto1.be] INFO: Found listing with ID: VA07887
2026-03-28 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA07887%27 HTTP/1.1" 200 None
2026-03-28 08:30:45 [auto1.be] INFO: Scrape type for VA07887: 0
2026-03-28 08:30:45 [auto1.be] INFO: Found listing with ID: JF01400
2026-03-28 08:30:45 [auto1.be] INFO: Found listing with ID: XR56379
2026-03-28 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR56379%27 HTTP/1.1" 200 None
2026-03-28 08:30:45 [auto1.be] INFO: Scrape type for XR56379: 2
2026-03-28 08:30:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 858aaac4-761a-5999-a380-0d722e730b45 with identifier: XR56379
2026-03-28 08:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 858aaac4-761a-5999-a380-0d722e730b45 with scrape type 2
2026-03-28 08:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 858aaac4-761a-5999-a380-0d722e730b45 with scrape type 2
2026-03-28 08:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 858aaac4-761a-5999-a380-0d722e730b45, identifier: XR56379
2026-03-28 08:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 858aaac4-761a-5999-a380-0d722e730b45 with identifier: XR56379
2026-03-28 08:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 858aaac4-761a-5999-a380-0d722e730b45 with identifier: XR56379
2026-03-28 08:30:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 858aaac4-761a-5999-a380-0d722e730b45 with identifier: XR56379 to the API
2026-03-28 08:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:44:59Z',
'fuel_type': 'diesel',
'id': '858aaac4-761a-5999-a380-0d722e730b45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR56379',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 159669,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-07',
'seller_name': None,
'title': 'Volvo XC60 2.0 D3 Kinetic 2WD',
'transmission': 'automatic',
'trim': 'Kinetic 2WD',
'year': 2017}
2026-03-28 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR56379%27 HTTP/1.1" 200 None
2026-03-28 08:30:45 [auto1.be] INFO: Saving data for XR56379: {'auction_closing_time': 1774716299.0, 'created_time': 1773224421.588728, 'last_price_update_time': 1774686645.884082}
2026-03-28 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XR56379') HTTP/1.1" 204 0
2026-03-28 08:30:45 [auto1.be] INFO: Found listing with ID: MB19665
2026-03-28 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB19665%27 HTTP/1.1" 200 None
2026-03-28 08:30:45 [auto1.be] INFO: Scrape type for MB19665: 0
2026-03-28 08:30:45 [auto1.be] INFO: Found listing with ID: VL13165
2026-03-28 08:30:45 [auto1.be] INFO: Found listing with ID: WN85390
2026-03-28 08:30:45 [auto1.be] INFO: Found listing with ID: TW09601
2026-03-28 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW09601%27 HTTP/1.1" 200 None
2026-03-28 08:30:45 [auto1.be] INFO: Scrape type for TW09601: 0
2026-03-28 08:30:45 [auto1.be] INFO: Found listing with ID: CN47453
2026-03-28 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN47453%27 HTTP/1.1" 200 None
2026-03-28 08:30:45 [auto1.be] INFO: Scrape type for CN47453: 0
2026-03-28 08:30:45 [auto1.be] INFO: Found listing with ID: SP00889
2026-03-28 08:30:45 [auto1.be] INFO: Found listing with ID: KV74957
2026-03-28 08:30:45 [auto1.be] INFO: Found listing with ID: YB46987
2026-03-28 08:30:45 [auto1.be] INFO: Found listing with ID: CW56663
2026-03-28 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW56663%27 HTTP/1.1" 200 None
2026-03-28 08:30:45 [auto1.be] INFO: Scrape type for CW56663: 0
2026-03-28 08:30:45 [auto1.be] INFO: Found listing with ID: UZ05678
2026-03-28 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UZ05678%27 HTTP/1.1" 200 None
2026-03-28 08:30:45 [auto1.be] INFO: Scrape type for UZ05678: 0
2026-03-28 08:30:45 [auto1.be] INFO: Found listing with ID: YJ37534
2026-03-28 08:30:45 [auto1.be] INFO: Found listing with ID: TY97185
2026-03-28 08:30:45 [auto1.be] INFO: Found listing with ID: WX02409
2026-03-28 08:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX02409%27 HTTP/1.1" 200 None
2026-03-28 08:30:46 [auto1.be] INFO: Scrape type for WX02409: 2
2026-03-28 08:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e7ac434-aa9e-52ab-8680-28518ed625cb with identifier: WX02409
2026-03-28 08:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e7ac434-aa9e-52ab-8680-28518ed625cb with scrape type 2
2026-03-28 08:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e7ac434-aa9e-52ab-8680-28518ed625cb with scrape type 2
2026-03-28 08:30:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7e7ac434-aa9e-52ab-8680-28518ed625cb, identifier: WX02409
2026-03-28 08:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7e7ac434-aa9e-52ab-8680-28518ed625cb with identifier: WX02409
2026-03-28 08:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7e7ac434-aa9e-52ab-8680-28518ed625cb with identifier: WX02409
2026-03-28 08:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7e7ac434-aa9e-52ab-8680-28518ed625cb with identifier: WX02409 to the API
2026-03-28 08:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:16:17Z',
'fuel_type': 'diesel',
'id': '7e7ac434-aa9e-52ab-8680-28518ed625cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX02409',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 193389,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-12',
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Energy Air',
'transmission': 'manual',
'trim': 'Air',
'year': 2015}
2026-03-28 08:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX02409%27 HTTP/1.1" 200 None
2026-03-28 08:30:46 [auto1.be] INFO: Saving data for WX02409: {'auction_closing_time': 1774714577.0, 'created_time': 1774471282.400488, 'last_price_update_time': 1774686646.4928}
2026-03-28 08:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WX02409') HTTP/1.1" 204 0
2026-03-28 08:30:46 [auto1.be] INFO: Found listing with ID: AV10256
2026-03-28 08:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV10256%27 HTTP/1.1" 200 None
2026-03-28 08:30:46 [auto1.be] INFO: Scrape type for AV10256: 0
2026-03-28 08:30:46 [auto1.be] INFO: Found listing with ID: ZX33086
2026-03-28 08:30:46 [auto1.be] INFO: Found listing with ID: TA63870
2026-03-28 08:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA63870%27 HTTP/1.1" 200 None
2026-03-28 08:30:46 [auto1.be] INFO: Scrape type for TA63870: 0
2026-03-28 08:30:46 [auto1.be] INFO: Found listing with ID: CG04214
2026-03-28 08:30:46 [auto1.be] INFO: Found listing with ID: MV08230
2026-03-28 08:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV08230%27 HTTP/1.1" 200 None
2026-03-28 08:30:46 [auto1.be] INFO: Scrape type for MV08230: 2
2026-03-28 08:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d1bd01f-12fe-51ca-9af1-45229ea32bc6 with identifier: MV08230
2026-03-28 08:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d1bd01f-12fe-51ca-9af1-45229ea32bc6 with scrape type 2
2026-03-28 08:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d1bd01f-12fe-51ca-9af1-45229ea32bc6 with scrape type 2
2026-03-28 08:30:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8d1bd01f-12fe-51ca-9af1-45229ea32bc6, identifier: MV08230
2026-03-28 08:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8d1bd01f-12fe-51ca-9af1-45229ea32bc6 with identifier: MV08230
2026-03-28 08:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8d1bd01f-12fe-51ca-9af1-45229ea32bc6 with identifier: MV08230
2026-03-28 08:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8d1bd01f-12fe-51ca-9af1-45229ea32bc6 with identifier: MV08230 to the API
2026-03-28 08:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:14:20Z',
'fuel_type': 'petrol',
'id': '8d1bd01f-12fe-51ca-9af1-45229ea32bc6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV08230',
'listing': 'auction',
'make': 'Jeep',
'model': 'Compass',
'odometer': 45683,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-11',
'seller_name': None,
'title': 'Jeep Compass 1.3 T-GDi Longitude FWD',
'transmission': 'automatic',
'trim': 'Longitude FWD',
'year': 2020}
2026-03-28 08:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV08230%27 HTTP/1.1" 200 None
2026-03-28 08:30:47 [auto1.be] INFO: Saving data for MV08230: {'auction_closing_time': 1774714460.0, 'created_time': 1773238803.651043, 'last_price_update_time': 1774686647.060069}
2026-03-28 08:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MV08230') HTTP/1.1" 204 0
2026-03-28 08:30:47 [auto1.be] INFO: Found listing with ID: KU26204
2026-03-28 08:30:47 [auto1.be] INFO: Found listing with ID: BH51844
2026-03-28 08:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:30:47 [auto1.be] INFO: Channel: 24h | Page: 8 | totalHits: 1701 | hits on page: 40
2026-03-28 08:30:47 [auto1.be] INFO: Found listing with ID: DZ18869
2026-03-28 08:30:47 [auto1.be] INFO: Found listing with ID: VM79296
2026-03-28 08:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM79296%27 HTTP/1.1" 200 None
2026-03-28 08:30:47 [auto1.be] INFO: Scrape type for VM79296: 0
2026-03-28 08:30:47 [auto1.be] INFO: Found listing with ID: ZF47475
2026-03-28 08:30:47 [auto1.be] INFO: Found listing with ID: GN45273
2026-03-28 08:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN45273%27 HTTP/1.1" 200 None
2026-03-28 08:30:47 [auto1.be] INFO: Scrape type for GN45273: 0
2026-03-28 08:30:47 [auto1.be] INFO: Found listing with ID: PC57264
2026-03-28 08:30:47 [auto1.be] INFO: Found listing with ID: GN83226
2026-03-28 08:30:47 [auto1.be] INFO: Found listing with ID: RD12029
2026-03-28 08:30:47 [auto1.be] INFO: Found listing with ID: BW40259
2026-03-28 08:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BW40259%27 HTTP/1.1" 200 None
2026-03-28 08:30:47 [auto1.be] INFO: Scrape type for BW40259: 2
2026-03-28 08:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06ce8dbc-7487-54b5-b3bc-500b58fc6ecc with identifier: BW40259
2026-03-28 08:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06ce8dbc-7487-54b5-b3bc-500b58fc6ecc with scrape type 2
2026-03-28 08:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06ce8dbc-7487-54b5-b3bc-500b58fc6ecc with scrape type 2
2026-03-28 08:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 06ce8dbc-7487-54b5-b3bc-500b58fc6ecc, identifier: BW40259
2026-03-28 08:30:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 06ce8dbc-7487-54b5-b3bc-500b58fc6ecc with identifier: BW40259
2026-03-28 08:30:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 06ce8dbc-7487-54b5-b3bc-500b58fc6ecc with identifier: BW40259
2026-03-28 08:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 06ce8dbc-7487-54b5-b3bc-500b58fc6ecc with identifier: BW40259 to the API
2026-03-28 08:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:55:45Z',
'fuel_type': 'diesel',
'id': '06ce8dbc-7487-54b5-b3bc-500b58fc6ecc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW40259',
'listing': 'auction',
'make': 'Iveco',
'model': 'Daily',
'odometer': 141661,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-07-01',
'seller_name': None,
'title': 'Iveco Daily 2.3 Diesel HKa 35 C Radstand 3000',
'transmission': 'manual',
'trim': 'HKa 35 C Radstand 3000',
'year': 2007}
2026-03-28 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BW40259%27 HTTP/1.1" 200 None
2026-03-28 08:30:48 [auto1.be] INFO: Saving data for BW40259: {'auction_closing_time': 1774716945.0, 'created_time': 1774471303.643476, 'last_price_update_time': 1774686648.089442}
2026-03-28 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BW40259') HTTP/1.1" 204 0
2026-03-28 08:30:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:48 [auto1.be] INFO: Found listing with ID: GS05656
2026-03-28 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS05656%27 HTTP/1.1" 200 None
2026-03-28 08:30:48 [auto1.be] INFO: Scrape type for GS05656: 0
2026-03-28 08:30:48 [auto1.be] INFO: Found listing with ID: RW29034
2026-03-28 08:30:48 [auto1.be] INFO: Found listing with ID: YR29884
2026-03-28 08:30:48 [auto1.be] INFO: Found listing with ID: GG52941
2026-03-28 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG52941%27 HTTP/1.1" 200 None
2026-03-28 08:30:48 [auto1.be] INFO: Scrape type for GG52941: 2
2026-03-28 08:30:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0122d845-3bf4-5531-8596-8bdb5c94b059 with identifier: GG52941
2026-03-28 08:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0122d845-3bf4-5531-8596-8bdb5c94b059 with scrape type 2
2026-03-28 08:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0122d845-3bf4-5531-8596-8bdb5c94b059 with scrape type 2
2026-03-28 08:30:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0122d845-3bf4-5531-8596-8bdb5c94b059, identifier: GG52941
2026-03-28 08:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0122d845-3bf4-5531-8596-8bdb5c94b059 with identifier: GG52941
2026-03-28 08:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0122d845-3bf4-5531-8596-8bdb5c94b059 with identifier: GG52941
2026-03-28 08:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0122d845-3bf4-5531-8596-8bdb5c94b059 with identifier: GG52941 to the API
2026-03-28 08:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:27:51Z',
'fuel_type': 'diesel',
'id': '0122d845-3bf4-5531-8596-8bdb5c94b059',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG52941',
'listing': 'auction',
'make': 'BMW',
'model': '4er',
'odometer': 245708,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-10-10',
'seller_name': None,
'title': 'BMW 4er 420d',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-28 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG52941%27 HTTP/1.1" 200 None
2026-03-28 08:30:48 [auto1.be] INFO: Saving data for GG52941: {'auction_closing_time': 1774715271.0, 'created_time': 1774471060.467122, 'last_price_update_time': 1774686648.717346}
2026-03-28 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GG52941') HTTP/1.1" 204 0
2026-03-28 08:30:48 [auto1.be] INFO: Found listing with ID: RZ07927
2026-03-28 08:30:48 [auto1.be] INFO: Found listing with ID: WC55286
2026-03-28 08:30:48 [auto1.be] INFO: Found listing with ID: YA14339
2026-03-28 08:30:48 [auto1.be] INFO: Found listing with ID: LR81556
2026-03-28 08:30:48 [auto1.be] INFO: Found listing with ID: PH43501
2026-03-28 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH43501%27 HTTP/1.1" 200 None
2026-03-28 08:30:48 [auto1.be] INFO: Scrape type for PH43501: 0
2026-03-28 08:30:48 [auto1.be] INFO: Found listing with ID: YJ60712
2026-03-28 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ60712%27 HTTP/1.1" 200 None
2026-03-28 08:30:48 [auto1.be] INFO: Scrape type for YJ60712: 2
2026-03-28 08:30:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bba2f93-9b9a-54d2-9265-2e65aa21ef3e with identifier: YJ60712
2026-03-28 08:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bba2f93-9b9a-54d2-9265-2e65aa21ef3e with scrape type 2
2026-03-28 08:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bba2f93-9b9a-54d2-9265-2e65aa21ef3e with scrape type 2
2026-03-28 08:30:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0bba2f93-9b9a-54d2-9265-2e65aa21ef3e, identifier: YJ60712
2026-03-28 08:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0bba2f93-9b9a-54d2-9265-2e65aa21ef3e with identifier: YJ60712
2026-03-28 08:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 08:30:48 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-28 08:30:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 08:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 08:30:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0bba2f93-9b9a-54d2-9265-2e65aa21ef3e with identifier: YJ60712
2026-03-28 08:30:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0bba2f93-9b9a-54d2-9265-2e65aa21ef3e with identifier: YJ60712 to the API
2026-03-28 08:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:25:18Z',
'fuel_type': 'petrol',
'id': '0bba2f93-9b9a-54d2-9265-2e65aa21ef3e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ60712',
'listing': 'auction',
'make': 'Peugeot',
'model': '5008',
'odometer': 129008,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-18',
'seller_name': None,
'title': 'Peugeot 5008 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2019}
2026-03-28 08:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ60712%27 HTTP/1.1" 200 None
2026-03-28 08:30:49 [auto1.be] INFO: Saving data for YJ60712: {'auction_closing_time': 1774715118.0, 'created_time': 1774470962.909589, 'last_price_update_time': 1774686649.379662}
2026-03-28 08:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YJ60712') HTTP/1.1" 204 0
2026-03-28 08:30:49 [auto1.be] INFO: Found listing with ID: VP39360
2026-03-28 08:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP39360%27 HTTP/1.1" 200 None
2026-03-28 08:30:49 [auto1.be] INFO: Scrape type for VP39360: 2
2026-03-28 08:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5aab96d7-0b2c-5e4c-a465-1f36af2c4971 with identifier: VP39360
2026-03-28 08:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5aab96d7-0b2c-5e4c-a465-1f36af2c4971 with scrape type 2
2026-03-28 08:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5aab96d7-0b2c-5e4c-a465-1f36af2c4971 with scrape type 2
2026-03-28 08:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5aab96d7-0b2c-5e4c-a465-1f36af2c4971, identifier: VP39360
2026-03-28 08:30:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5aab96d7-0b2c-5e4c-a465-1f36af2c4971 with identifier: VP39360
2026-03-28 08:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 08:30:49 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-28 08:30:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 08:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 08:30:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5aab96d7-0b2c-5e4c-a465-1f36af2c4971 with identifier: VP39360
2026-03-28 08:30:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5aab96d7-0b2c-5e4c-a465-1f36af2c4971 with identifier: VP39360 to the API
2026-03-28 08:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:29:18Z',
'fuel_type': 'gas',
'id': '5aab96d7-0b2c-5e4c-a465-1f36af2c4971',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP39360',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 66593,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-18',
'seller_name': None,
'title': 'Dacia Duster 1.6 SCe Prestige 4x2',
'transmission': 'manual',
'trim': 'Prestige 4x2',
'year': 2017}
2026-03-28 08:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP39360%27 HTTP/1.1" 200 None
2026-03-28 08:30:49 [auto1.be] INFO: Saving data for VP39360: {'auction_closing_time': 1774715358.0, 'created_time': 1774471279.694661, 'last_price_update_time': 1774686649.926621}
2026-03-28 08:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VP39360') HTTP/1.1" 204 0
2026-03-28 08:30:50 [auto1.be] INFO: Found listing with ID: LB60883
2026-03-28 08:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB60883%27 HTTP/1.1" 200 None
2026-03-28 08:30:50 [auto1.be] INFO: Scrape type for LB60883: 2
2026-03-28 08:30:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42950ad2-5aa7-50de-b829-4c3a82762697 with identifier: LB60883
2026-03-28 08:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42950ad2-5aa7-50de-b829-4c3a82762697 with scrape type 2
2026-03-28 08:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42950ad2-5aa7-50de-b829-4c3a82762697 with scrape type 2
2026-03-28 08:30:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 42950ad2-5aa7-50de-b829-4c3a82762697, identifier: LB60883
2026-03-28 08:30:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 42950ad2-5aa7-50de-b829-4c3a82762697 with identifier: LB60883
2026-03-28 08:30:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 42950ad2-5aa7-50de-b829-4c3a82762697 with identifier: LB60883
2026-03-28 08:30:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 42950ad2-5aa7-50de-b829-4c3a82762697 with identifier: LB60883 to the API
2026-03-28 08:30:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:09:10Z',
'fuel_type': 'diesel',
'id': '42950ad2-5aa7-50de-b829-4c3a82762697',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB60883',
'listing': 'auction',
'make': 'Fiat',
'model': 'Doblo',
'odometer': 30529,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-23',
'seller_name': None,
'title': 'Fiat Doblo 1.3 M-Jet Basis Maxi Kasten',
'transmission': 'manual',
'trim': 'Basis Maxi Kasten',
'year': 2017}
2026-03-28 08:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB60883%27 HTTP/1.1" 200 None
2026-03-28 08:30:50 [auto1.be] INFO: Saving data for LB60883: {'auction_closing_time': 1774714150.0, 'created_time': 1774471203.081588, 'last_price_update_time': 1774686650.414593}
2026-03-28 08:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LB60883') HTTP/1.1" 204 0
2026-03-28 08:30:50 [auto1.be] INFO: Found listing with ID: JX04101
2026-03-28 08:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX04101%27 HTTP/1.1" 200 None
2026-03-28 08:30:50 [auto1.be] INFO: Scrape type for JX04101: 0
2026-03-28 08:30:50 [auto1.be] INFO: Found listing with ID: FC74189
2026-03-28 08:30:50 [auto1.be] INFO: Found listing with ID: UJ84188
2026-03-28 08:30:50 [auto1.be] INFO: Found listing with ID: CP28232
2026-03-28 08:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP28232%27 HTTP/1.1" 200 None
2026-03-28 08:30:50 [auto1.be] INFO: Scrape type for CP28232: 2
2026-03-28 08:30:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45af6889-1c5f-56eb-943e-2f094f68d59e with identifier: CP28232
2026-03-28 08:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45af6889-1c5f-56eb-943e-2f094f68d59e with scrape type 2
2026-03-28 08:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45af6889-1c5f-56eb-943e-2f094f68d59e with scrape type 2
2026-03-28 08:30:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 45af6889-1c5f-56eb-943e-2f094f68d59e, identifier: CP28232
2026-03-28 08:30:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 45af6889-1c5f-56eb-943e-2f094f68d59e with identifier: CP28232
2026-03-28 08:30:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 45af6889-1c5f-56eb-943e-2f094f68d59e with identifier: CP28232
2026-03-28 08:30:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 45af6889-1c5f-56eb-943e-2f094f68d59e with identifier: CP28232 to the API
2026-03-28 08:30:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 159,
'expiration_date': '2026-03-28T16:55:57Z',
'fuel_type': 'petrol',
'id': '45af6889-1c5f-56eb-943e-2f094f68d59e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP28232',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 164759,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-07',
'seller_name': None,
'title': 'Nissan Qashqai 1.3 DIG-T N-Connecta',
'transmission': 'automatic',
'trim': 'N-Connecta',
'year': 2019}
2026-03-28 08:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP28232%27 HTTP/1.1" 200 None
2026-03-28 08:30:50 [auto1.be] INFO: Saving data for CP28232: {'auction_closing_time': 1774716957.0, 'created_time': 1773223900.133929, 'last_price_update_time': 1774686650.858586}
2026-03-28 08:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CP28232') HTTP/1.1" 204 0
2026-03-28 08:30:50 [auto1.be] INFO: Found listing with ID: DK34546
2026-03-28 08:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK34546%27 HTTP/1.1" 200 None
2026-03-28 08:30:50 [auto1.be] INFO: Scrape type for DK34546: 0
2026-03-28 08:30:50 [auto1.be] INFO: Found listing with ID: UZ89311
2026-03-28 08:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UZ89311%27 HTTP/1.1" 200 None
2026-03-28 08:30:50 [auto1.be] INFO: Scrape type for UZ89311: 2
2026-03-28 08:30:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dc8244e-1c4e-501d-a26f-aa8c8401d5b9 with identifier: UZ89311
2026-03-28 08:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dc8244e-1c4e-501d-a26f-aa8c8401d5b9 with scrape type 2
2026-03-28 08:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7dc8244e-1c4e-501d-a26f-aa8c8401d5b9 with scrape type 2
2026-03-28 08:30:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7dc8244e-1c4e-501d-a26f-aa8c8401d5b9, identifier: UZ89311
2026-03-28 08:30:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7dc8244e-1c4e-501d-a26f-aa8c8401d5b9 with identifier: UZ89311
2026-03-28 08:30:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7dc8244e-1c4e-501d-a26f-aa8c8401d5b9 with identifier: UZ89311
2026-03-28 08:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7dc8244e-1c4e-501d-a26f-aa8c8401d5b9 with identifier: UZ89311 to the API
2026-03-28 08:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:25:23Z',
'fuel_type': 'diesel',
'id': '7dc8244e-1c4e-501d-a26f-aa8c8401d5b9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ89311',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 253700,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-26',
'seller_name': None,
'title': 'BMW X3 xDrive 20d',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-28 08:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UZ89311%27 HTTP/1.1" 200 None
2026-03-28 08:30:51 [auto1.be] INFO: Saving data for UZ89311: {'auction_closing_time': 1774715123.0, 'created_time': 1773301814.222667, 'last_price_update_time': 1774686651.374233}
2026-03-28 08:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UZ89311') HTTP/1.1" 204 0
2026-03-28 08:30:51 [auto1.be] INFO: Found listing with ID: JR35998
2026-03-28 08:30:51 [auto1.be] INFO: Found listing with ID: PW65130
2026-03-28 08:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PW65130%27 HTTP/1.1" 200 None
2026-03-28 08:30:51 [auto1.be] INFO: Scrape type for PW65130: 0
2026-03-28 08:30:51 [auto1.be] INFO: Found listing with ID: JV80966
2026-03-28 08:30:51 [auto1.be] INFO: Found listing with ID: TW50978
2026-03-28 08:30:51 [auto1.be] INFO: Found listing with ID: ZM60414
2026-03-28 08:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM60414%27 HTTP/1.1" 200 None
2026-03-28 08:30:51 [auto1.be] INFO: Scrape type for ZM60414: 0
2026-03-28 08:30:51 [auto1.be] INFO: Found listing with ID: GE86423
2026-03-28 08:30:51 [auto1.be] INFO: Found listing with ID: BJ47720
2026-03-28 08:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ47720%27 HTTP/1.1" 200 None
2026-03-28 08:30:51 [auto1.be] INFO: Scrape type for BJ47720: 0
2026-03-28 08:30:51 [auto1.be] INFO: Found listing with ID: LM00165
2026-03-28 08:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM00165%27 HTTP/1.1" 200 None
2026-03-28 08:30:51 [auto1.be] INFO: Scrape type for LM00165: 0
2026-03-28 08:30:51 [auto1.be] INFO: Found listing with ID: AE10158
2026-03-28 08:30:51 [auto1.be] INFO: Found listing with ID: PW03008
2026-03-28 08:30:51 [auto1.be] INFO: Found listing with ID: DJ92015
2026-03-28 08:30:51 [auto1.be] INFO: Found listing with ID: RM94904
2026-03-28 08:30:51 [auto1.be] INFO: Found listing with ID: ML32022
2026-03-28 08:30:51 [auto1.be] INFO: Found listing with ID: YC12895
2026-03-28 08:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:30:52 [auto1.be] INFO: Channel: 24h | Page: 9 | totalHits: 1701 | hits on page: 40
2026-03-28 08:30:52 [auto1.be] INFO: Found listing with ID: DF46667
2026-03-28 08:30:52 [auto1.be] INFO: Found listing with ID: YC93311
2026-03-28 08:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC93311%27 HTTP/1.1" 200 None
2026-03-28 08:30:52 [auto1.be] INFO: Scrape type for YC93311: 2
2026-03-28 08:30:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 691dba07-01a7-5c02-8e45-6fe6a359e2c1 with identifier: YC93311
2026-03-28 08:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 691dba07-01a7-5c02-8e45-6fe6a359e2c1 with scrape type 2
2026-03-28 08:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 691dba07-01a7-5c02-8e45-6fe6a359e2c1 with scrape type 2
2026-03-28 08:30:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 691dba07-01a7-5c02-8e45-6fe6a359e2c1, identifier: YC93311
2026-03-28 08:30:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 691dba07-01a7-5c02-8e45-6fe6a359e2c1 with identifier: YC93311
2026-03-28 08:30:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 08:30:52 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-28 08:30:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 08:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 08:30:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 691dba07-01a7-5c02-8e45-6fe6a359e2c1 with identifier: YC93311
2026-03-28 08:30:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 691dba07-01a7-5c02-8e45-6fe6a359e2c1 with identifier: YC93311 to the API
2026-03-28 08:30:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-28T16:11:47Z',
'fuel_type': 'hybrid',
'id': '691dba07-01a7-5c02-8e45-6fe6a359e2c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC93311',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 76040,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-31',
'seller_name': None,
'title': 'Peugeot 3008 1.6 Hybrid Allure Pack',
'transmission': 'automatic',
'trim': 'Allure Pack',
'year': 2023}
2026-03-28 08:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC93311%27 HTTP/1.1" 200 None
2026-03-28 08:30:53 [auto1.be] INFO: Saving data for YC93311: {'auction_closing_time': 1774714307.0, 'created_time': 1774471350.988572, 'last_price_update_time': 1774686653.009811}
2026-03-28 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YC93311') HTTP/1.1" 204 0
2026-03-28 08:30:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:53 [auto1.be] INFO: Found listing with ID: GW94232
2026-03-28 08:30:53 [auto1.be] INFO: Found listing with ID: TD21641
2026-03-28 08:30:53 [auto1.be] INFO: Found listing with ID: BX24259
2026-03-28 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX24259%27 HTTP/1.1" 200 None
2026-03-28 08:30:53 [auto1.be] INFO: Scrape type for BX24259: 2
2026-03-28 08:30:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b319ca8-d278-5c87-a76f-aba82f8de1c7 with identifier: BX24259
2026-03-28 08:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b319ca8-d278-5c87-a76f-aba82f8de1c7 with scrape type 2
2026-03-28 08:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b319ca8-d278-5c87-a76f-aba82f8de1c7 with scrape type 2
2026-03-28 08:30:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9b319ca8-d278-5c87-a76f-aba82f8de1c7, identifier: BX24259
2026-03-28 08:30:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9b319ca8-d278-5c87-a76f-aba82f8de1c7 with identifier: BX24259
2026-03-28 08:30:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9b319ca8-d278-5c87-a76f-aba82f8de1c7 with identifier: BX24259
2026-03-28 08:30:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9b319ca8-d278-5c87-a76f-aba82f8de1c7 with identifier: BX24259 to the API
2026-03-28 08:30:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-28T16:31:02Z',
'fuel_type': 'petrol',
'id': '9b319ca8-d278-5c87-a76f-aba82f8de1c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX24259',
'listing': 'auction',
'make': 'Citroen',
'model': 'C1',
'odometer': 93972,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-18',
'seller_name': None,
'title': 'Citroen C1 1.2 VTi Feel Edition',
'transmission': 'manual',
'trim': 'Feel Edition',
'year': 2015}
2026-03-28 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX24259%27 HTTP/1.1" 200 None
2026-03-28 08:30:53 [auto1.be] INFO: Saving data for BX24259: {'auction_closing_time': 1774715462.0, 'created_time': 1774471356.077936, 'last_price_update_time': 1774686653.520814}
2026-03-28 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BX24259') HTTP/1.1" 204 0
2026-03-28 08:30:53 [auto1.be] INFO: Found listing with ID: LB55394
2026-03-28 08:30:53 [auto1.be] INFO: Found listing with ID: MN64395
2026-03-28 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MN64395%27 HTTP/1.1" 200 None
2026-03-28 08:30:53 [auto1.be] INFO: Scrape type for MN64395: 2
2026-03-28 08:30:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e53b66dc-ed59-5c78-851a-2172449e57e0 with identifier: MN64395
2026-03-28 08:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e53b66dc-ed59-5c78-851a-2172449e57e0 with scrape type 2
2026-03-28 08:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e53b66dc-ed59-5c78-851a-2172449e57e0 with scrape type 2
2026-03-28 08:30:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e53b66dc-ed59-5c78-851a-2172449e57e0, identifier: MN64395
2026-03-28 08:30:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e53b66dc-ed59-5c78-851a-2172449e57e0 with identifier: MN64395
2026-03-28 08:30:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e53b66dc-ed59-5c78-851a-2172449e57e0 with identifier: MN64395
2026-03-28 08:30:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e53b66dc-ed59-5c78-851a-2172449e57e0 with identifier: MN64395 to the API
2026-03-28 08:30:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:04:34Z',
'fuel_type': 'diesel',
'id': 'e53b66dc-ed59-5c78-851a-2172449e57e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN64395',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 178813,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-31',
'seller_name': None,
'title': 'BMW 5er 518d',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-28 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MN64395%27 HTTP/1.1" 200 None
2026-03-28 08:30:53 [auto1.be] INFO: Saving data for MN64395: {'auction_closing_time': 1774713874.0, 'created_time': 1774471282.093937, 'last_price_update_time': 1774686653.953688}
2026-03-28 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MN64395') HTTP/1.1" 204 0
2026-03-28 08:30:53 [auto1.be] INFO: Found listing with ID: AX27110
2026-03-28 08:30:53 [auto1.be] INFO: Found listing with ID: GB85934
2026-03-28 08:30:53 [auto1.be] INFO: Found listing with ID: CM40127
2026-03-28 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM40127%27 HTTP/1.1" 200 None
2026-03-28 08:30:53 [auto1.be] INFO: Scrape type for CM40127: 0
2026-03-28 08:30:53 [auto1.be] INFO: Found listing with ID: YH98972
2026-03-28 08:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH98972%27 HTTP/1.1" 200 None
2026-03-28 08:30:54 [auto1.be] INFO: Scrape type for YH98972: 0
2026-03-28 08:30:54 [auto1.be] INFO: Found listing with ID: YX66002
2026-03-28 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX66002%27 HTTP/1.1" 200 None
2026-03-28 08:30:54 [auto1.be] INFO: Scrape type for YX66002: 0
2026-03-28 08:30:54 [auto1.be] INFO: Found listing with ID: PR37992
2026-03-28 08:30:54 [auto1.be] INFO: Found listing with ID: MD92482
2026-03-28 08:30:54 [auto1.be] INFO: Found listing with ID: MC94265
2026-03-28 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC94265%27 HTTP/1.1" 200 None
2026-03-28 08:30:54 [auto1.be] INFO: Scrape type for MC94265: 0
2026-03-28 08:30:54 [auto1.be] INFO: Found listing with ID: HL89741
2026-03-28 08:30:54 [auto1.be] INFO: Found listing with ID: BA13225
2026-03-28 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA13225%27 HTTP/1.1" 200 None
2026-03-28 08:30:54 [auto1.be] INFO: Scrape type for BA13225: 0
2026-03-28 08:30:54 [auto1.be] INFO: Found listing with ID: EK41744
2026-03-28 08:30:54 [auto1.be] INFO: Found listing with ID: XE64009
2026-03-28 08:30:54 [auto1.be] INFO: Found listing with ID: ER13199
2026-03-28 08:30:54 [auto1.be] INFO: Found listing with ID: FM74317
2026-03-28 08:30:54 [auto1.be] INFO: Found listing with ID: FT07874
2026-03-28 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT07874%27 HTTP/1.1" 200 None
2026-03-28 08:30:54 [auto1.be] INFO: Scrape type for FT07874: 0
2026-03-28 08:30:54 [auto1.be] INFO: Found listing with ID: UN77217
2026-03-28 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UN77217%27 HTTP/1.1" 200 None
2026-03-28 08:30:54 [auto1.be] INFO: Scrape type for UN77217: 0
2026-03-28 08:30:54 [auto1.be] INFO: Found listing with ID: JW78855
2026-03-28 08:30:54 [auto1.be] INFO: Found listing with ID: PZ75244
2026-03-28 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PZ75244%27 HTTP/1.1" 200 None
2026-03-28 08:30:54 [auto1.be] INFO: Scrape type for PZ75244: 2
2026-03-28 08:30:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f913d74-9eb2-5299-9409-8bbe0ea98983 with identifier: PZ75244
2026-03-28 08:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f913d74-9eb2-5299-9409-8bbe0ea98983 with scrape type 2
2026-03-28 08:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f913d74-9eb2-5299-9409-8bbe0ea98983 with scrape type 2
2026-03-28 08:30:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9f913d74-9eb2-5299-9409-8bbe0ea98983, identifier: PZ75244
2026-03-28 08:30:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9f913d74-9eb2-5299-9409-8bbe0ea98983 with identifier: PZ75244
2026-03-28 08:30:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9f913d74-9eb2-5299-9409-8bbe0ea98983 with identifier: PZ75244
2026-03-28 08:30:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9f913d74-9eb2-5299-9409-8bbe0ea98983 with identifier: PZ75244 to the API
2026-03-28 08:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-28T16:10:06Z',
'fuel_type': 'gas',
'id': '9f913d74-9eb2-5299-9409-8bbe0ea98983',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ75244',
'listing': 'auction',
'make': 'Dacia',
'model': 'Jogger',
'odometer': 58242,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-02-18',
'seller_name': None,
'title': 'Dacia Jogger 1.0 TCe LPG Expression',
'transmission': 'manual',
'trim': 'Expression',
'year': 2024}
2026-03-28 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PZ75244%27 HTTP/1.1" 200 None
2026-03-28 08:30:54 [auto1.be] INFO: Saving data for PZ75244: {'auction_closing_time': 1774714206.0, 'created_time': 1774471334.504681, 'last_price_update_time': 1774686654.515164}
2026-03-28 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PZ75244') HTTP/1.1" 204 0
2026-03-28 08:30:54 [auto1.be] INFO: Found listing with ID: AJ68637
2026-03-28 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AJ68637%27 HTTP/1.1" 200 None
2026-03-28 08:30:54 [auto1.be] INFO: Scrape type for AJ68637: 0
2026-03-28 08:30:54 [auto1.be] INFO: Found listing with ID: UL09185
2026-03-28 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL09185%27 HTTP/1.1" 200 None
2026-03-28 08:30:54 [auto1.be] INFO: Scrape type for UL09185: 0
2026-03-28 08:30:54 [auto1.be] INFO: Found listing with ID: CE16850
2026-03-28 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE16850%27 HTTP/1.1" 200 None
2026-03-28 08:30:54 [auto1.be] INFO: Scrape type for CE16850: 2
2026-03-28 08:30:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 282ff8c6-b2be-5c9d-a351-67be96da63c9 with identifier: CE16850
2026-03-28 08:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 282ff8c6-b2be-5c9d-a351-67be96da63c9 with scrape type 2
2026-03-28 08:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 282ff8c6-b2be-5c9d-a351-67be96da63c9 with scrape type 2
2026-03-28 08:30:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 282ff8c6-b2be-5c9d-a351-67be96da63c9, identifier: CE16850
2026-03-28 08:30:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 282ff8c6-b2be-5c9d-a351-67be96da63c9 with identifier: CE16850
2026-03-28 08:30:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 282ff8c6-b2be-5c9d-a351-67be96da63c9 with identifier: CE16850
2026-03-28 08:30:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 282ff8c6-b2be-5c9d-a351-67be96da63c9 with identifier: CE16850 to the API
2026-03-28 08:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 177,
'expiration_date': '2026-03-28T16:05:29Z',
'fuel_type': 'diesel',
'id': '282ff8c6-b2be-5c9d-a351-67be96da63c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE16850',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Crafter',
'odometer': 203515,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-26',
'seller_name': None,
'title': 'Volkswagen Crafter 2.0 TDI Kasten 35 mittellang Hochdach FWD',
'transmission': 'automatic',
'trim': 'Kasten 35 mittellang Hochdach FWD',
'year': 2021}
2026-03-28 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE16850%27 HTTP/1.1" 200 None
2026-03-28 08:30:55 [auto1.be] INFO: Saving data for CE16850: {'auction_closing_time': 1774713929.0, 'created_time': 1773133697.225123, 'last_price_update_time': 1774686655.073433}
2026-03-28 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CE16850') HTTP/1.1" 204 0
2026-03-28 08:30:55 [auto1.be] INFO: Found listing with ID: YN70818
2026-03-28 08:30:55 [auto1.be] INFO: Found listing with ID: WR10172
2026-03-28 08:30:55 [auto1.be] INFO: Found listing with ID: DZ60295
2026-03-28 08:30:55 [auto1.be] INFO: Found listing with ID: TL07516
2026-03-28 08:30:55 [auto1.be] INFO: Found listing with ID: GW87029
2026-03-28 08:30:55 [auto1.be] INFO: Found listing with ID: YL95058
2026-03-28 08:30:55 [auto1.be] INFO: Found listing with ID: GV15800
2026-03-28 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV15800%27 HTTP/1.1" 200 None
2026-03-28 08:30:55 [auto1.be] INFO: Scrape type for GV15800: 2
2026-03-28 08:30:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7f39e1e-b2d0-5ccd-8869-7087a278e5cd with identifier: GV15800
2026-03-28 08:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7f39e1e-b2d0-5ccd-8869-7087a278e5cd with scrape type 2
2026-03-28 08:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7f39e1e-b2d0-5ccd-8869-7087a278e5cd with scrape type 2
2026-03-28 08:30:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e7f39e1e-b2d0-5ccd-8869-7087a278e5cd, identifier: GV15800
2026-03-28 08:30:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e7f39e1e-b2d0-5ccd-8869-7087a278e5cd with identifier: GV15800
2026-03-28 08:30:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e7f39e1e-b2d0-5ccd-8869-7087a278e5cd with identifier: GV15800
2026-03-28 08:30:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e7f39e1e-b2d0-5ccd-8869-7087a278e5cd with identifier: GV15800 to the API
2026-03-28 08:30:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:28:50Z',
'fuel_type': 'diesel',
'id': 'e7f39e1e-b2d0-5ccd-8869-7087a278e5cd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV15800',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 282877,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-08-09',
'seller_name': None,
'title': 'Renault Clio 1.5 dCi Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2010}
2026-03-28 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV15800%27 HTTP/1.1" 200 None
2026-03-28 08:30:55 [auto1.be] INFO: Saving data for GV15800: {'auction_closing_time': 1774715330.0, 'created_time': 1774471351.768738, 'last_price_update_time': 1774686655.517407}
2026-03-28 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GV15800') HTTP/1.1" 204 0
2026-03-28 08:30:55 [auto1.be] INFO: Found listing with ID: BY14138
2026-03-28 08:30:55 [auto1.be] INFO: Found listing with ID: EF17884
2026-03-28 08:30:55 [auto1.be] INFO: Found listing with ID: FY43318
2026-03-28 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY43318%27 HTTP/1.1" 200 None
2026-03-28 08:30:55 [auto1.be] INFO: Scrape type for FY43318: 0
2026-03-28 08:30:55 [auto1.be] INFO: Found listing with ID: RY85405
2026-03-28 08:30:55 [auto1.be] INFO: Found listing with ID: KG55279
2026-03-28 08:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:30:56 [auto1.be] INFO: Channel: 24h | Page: 10 | totalHits: 1701 | hits on page: 40
2026-03-28 08:30:56 [auto1.be] INFO: Found listing with ID: BC09650
2026-03-28 08:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC09650%27 HTTP/1.1" 200 None
2026-03-28 08:30:56 [auto1.be] INFO: Scrape type for BC09650: 0
2026-03-28 08:30:56 [auto1.be] INFO: Found listing with ID: CN66713
2026-03-28 08:30:56 [auto1.be] INFO: Found listing with ID: VU16052
2026-03-28 08:30:56 [auto1.be] INFO: Found listing with ID: EJ63633
2026-03-28 08:30:56 [auto1.be] INFO: Found listing with ID: PR27183
2026-03-28 08:30:56 [auto1.be] INFO: Found listing with ID: NN42853
2026-03-28 08:30:56 [auto1.be] INFO: Found listing with ID: PR44884
2026-03-28 08:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR44884%27 HTTP/1.1" 200 None
2026-03-28 08:30:56 [auto1.be] INFO: Scrape type for PR44884: 0
2026-03-28 08:30:56 [auto1.be] INFO: Found listing with ID: CV18687
2026-03-28 08:30:56 [auto1.be] INFO: Found listing with ID: ML35155
2026-03-28 08:30:56 [auto1.be] INFO: Found listing with ID: GF03232
2026-03-28 08:30:56 [auto1.be] INFO: Found listing with ID: NA97131
2026-03-28 08:30:56 [auto1.be] INFO: Found listing with ID: MG36975
2026-03-28 08:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG36975%27 HTTP/1.1" 200 None
2026-03-28 08:30:56 [auto1.be] INFO: Scrape type for MG36975: 2
2026-03-28 08:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b7d8b81-59f4-596f-b719-448aea1f25c4 with identifier: MG36975
2026-03-28 08:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b7d8b81-59f4-596f-b719-448aea1f25c4 with scrape type 2
2026-03-28 08:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b7d8b81-59f4-596f-b719-448aea1f25c4 with scrape type 2
2026-03-28 08:30:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9b7d8b81-59f4-596f-b719-448aea1f25c4, identifier: MG36975
2026-03-28 08:30:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9b7d8b81-59f4-596f-b719-448aea1f25c4 with identifier: MG36975
2026-03-28 08:30:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9b7d8b81-59f4-596f-b719-448aea1f25c4 with identifier: MG36975
2026-03-28 08:30:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9b7d8b81-59f4-596f-b719-448aea1f25c4 with identifier: MG36975 to the API
2026-03-28 08:30:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:24:29Z',
'fuel_type': 'diesel',
'id': '9b7d8b81-59f4-596f-b719-448aea1f25c4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG36975',
'listing': 'auction',
'make': 'Audi',
'model': 'A4',
'odometer': 148838,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-07',
'seller_name': None,
'title': 'Audi A4 2.0 TDI Ultra',
'transmission': 'manual',
'trim': 'Ultra',
'year': 2017}
2026-03-28 08:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG36975%27 HTTP/1.1" 200 None
2026-03-28 08:30:56 [auto1.be] INFO: Saving data for MG36975: {'auction_closing_time': 1774715069.0, 'created_time': 1774471380.528069, 'last_price_update_time': 1774686656.568608}
2026-03-28 08:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MG36975') HTTP/1.1" 204 0
2026-03-28 08:30:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:30:56 [auto1.be] INFO: Found listing with ID: FK29667
2026-03-28 08:30:56 [auto1.be] INFO: Found listing with ID: UL72077
2026-03-28 08:30:56 [auto1.be] INFO: Found listing with ID: PY81659
2026-03-28 08:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY81659%27 HTTP/1.1" 200 None
2026-03-28 08:30:56 [auto1.be] INFO: Scrape type for PY81659: 0
2026-03-28 08:30:56 [auto1.be] INFO: Found listing with ID: PE83293
2026-03-28 08:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE83293%27 HTTP/1.1" 200 None
2026-03-28 08:30:56 [auto1.be] INFO: Scrape type for PE83293: 0
2026-03-28 08:30:56 [auto1.be] INFO: Found listing with ID: CB57627
2026-03-28 08:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB57627%27 HTTP/1.1" 200 None
2026-03-28 08:30:56 [auto1.be] INFO: Scrape type for CB57627: 2
2026-03-28 08:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a3c649a-c473-5239-ae75-f018f7d6f2cc with identifier: CB57627
2026-03-28 08:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a3c649a-c473-5239-ae75-f018f7d6f2cc with scrape type 2
2026-03-28 08:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a3c649a-c473-5239-ae75-f018f7d6f2cc with scrape type 2
2026-03-28 08:30:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7a3c649a-c473-5239-ae75-f018f7d6f2cc, identifier: CB57627
2026-03-28 08:30:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7a3c649a-c473-5239-ae75-f018f7d6f2cc with identifier: CB57627
2026-03-28 08:30:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 08:30:56 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-28 08:30:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 08:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 08:30:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7a3c649a-c473-5239-ae75-f018f7d6f2cc with identifier: CB57627
2026-03-28 08:30:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7a3c649a-c473-5239-ae75-f018f7d6f2cc with identifier: CB57627 to the API
2026-03-28 08:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:29:24Z',
'fuel_type': 'petrol',
'id': '7a3c649a-c473-5239-ae75-f018f7d6f2cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB57627',
'listing': 'auction',
'make': 'Volvo',
'model': 'C30',
'odometer': 207719,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-03-31',
'seller_name': None,
'title': 'Volvo C30 1.8 Summum',
'transmission': 'manual',
'trim': 'Summum',
'year': 2008}
2026-03-28 08:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB57627%27 HTTP/1.1" 200 None
2026-03-28 08:30:57 [auto1.be] INFO: Saving data for CB57627: {'auction_closing_time': 1774715364.0, 'created_time': 1774471291.467922, 'last_price_update_time': 1774686657.357121}
2026-03-28 08:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CB57627') HTTP/1.1" 204 0
2026-03-28 08:30:57 [auto1.be] INFO: Found listing with ID: SW90596
2026-03-28 08:30:57 [auto1.be] INFO: Found listing with ID: ZW84802
2026-03-28 08:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZW84802%27 HTTP/1.1" 200 None
2026-03-28 08:30:57 [auto1.be] INFO: Scrape type for ZW84802: 0
2026-03-28 08:30:57 [auto1.be] INFO: Found listing with ID: HZ77507
2026-03-28 08:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ77507%27 HTTP/1.1" 200 None
2026-03-28 08:30:57 [auto1.be] INFO: Scrape type for HZ77507: 0
2026-03-28 08:30:57 [auto1.be] INFO: Found listing with ID: TM05069
2026-03-28 08:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM05069%27 HTTP/1.1" 200 None
2026-03-28 08:30:57 [auto1.be] INFO: Scrape type for TM05069: 0
2026-03-28 08:30:57 [auto1.be] INFO: Found listing with ID: EJ24025
2026-03-28 08:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ24025%27 HTTP/1.1" 200 None
2026-03-28 08:30:57 [auto1.be] INFO: Scrape type for EJ24025: 0
2026-03-28 08:30:57 [auto1.be] INFO: Found listing with ID: VJ27978
2026-03-28 08:30:57 [auto1.be] INFO: Found listing with ID: BY81514
2026-03-28 08:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY81514%27 HTTP/1.1" 200 None
2026-03-28 08:30:57 [auto1.be] INFO: Scrape type for BY81514: 2
2026-03-28 08:30:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bca4efb4-a30b-5b62-8206-21fa3a54dde9 with identifier: BY81514
2026-03-28 08:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bca4efb4-a30b-5b62-8206-21fa3a54dde9 with scrape type 2
2026-03-28 08:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bca4efb4-a30b-5b62-8206-21fa3a54dde9 with scrape type 2
2026-03-28 08:30:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bca4efb4-a30b-5b62-8206-21fa3a54dde9, identifier: BY81514
2026-03-28 08:30:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bca4efb4-a30b-5b62-8206-21fa3a54dde9 with identifier: BY81514
2026-03-28 08:30:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bca4efb4-a30b-5b62-8206-21fa3a54dde9 with identifier: BY81514
2026-03-28 08:30:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bca4efb4-a30b-5b62-8206-21fa3a54dde9 with identifier: BY81514 to the API
2026-03-28 08:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:33:22Z',
'fuel_type': 'diesel',
'id': 'bca4efb4-a30b-5b62-8206-21fa3a54dde9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY81514',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Picasso',
'odometer': 133271,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-30',
'seller_name': None,
'title': 'Citroen C4 Picasso 1.6 e-HDi Intensive',
'transmission': 'automatic',
'trim': 'Intensive',
'year': 2013}
2026-03-28 08:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY81514%27 HTTP/1.1" 200 None
2026-03-28 08:30:58 [auto1.be] INFO: Saving data for BY81514: {'auction_closing_time': 1774715602.0, 'created_time': 1774471036.66073, 'last_price_update_time': 1774686658.793283}
2026-03-28 08:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BY81514') HTTP/1.1" 204 0
2026-03-28 08:30:58 [auto1.be] INFO: Found listing with ID: PG30723
2026-03-28 08:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PG30723%27 HTTP/1.1" 200 None
2026-03-28 08:30:58 [auto1.be] INFO: Scrape type for PG30723: 2
2026-03-28 08:30:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f96fe90-c6e5-56a2-8287-812b751f7d0f with identifier: PG30723
2026-03-28 08:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f96fe90-c6e5-56a2-8287-812b751f7d0f with scrape type 2
2026-03-28 08:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f96fe90-c6e5-56a2-8287-812b751f7d0f with scrape type 2
2026-03-28 08:30:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9f96fe90-c6e5-56a2-8287-812b751f7d0f, identifier: PG30723
2026-03-28 08:30:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9f96fe90-c6e5-56a2-8287-812b751f7d0f with identifier: PG30723
2026-03-28 08:30:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9f96fe90-c6e5-56a2-8287-812b751f7d0f with identifier: PG30723
2026-03-28 08:30:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9f96fe90-c6e5-56a2-8287-812b751f7d0f with identifier: PG30723 to the API
2026-03-28 08:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:18:49Z',
'fuel_type': 'diesel',
'id': '9f96fe90-c6e5-56a2-8287-812b751f7d0f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG30723',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 170686,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-08-05',
'seller_name': None,
'title': 'Opel Corsa 1.3 CDTI Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2009}
2026-03-28 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PG30723%27 HTTP/1.1" 200 None
2026-03-28 08:30:59 [auto1.be] INFO: Saving data for PG30723: {'auction_closing_time': 1774714729.0, 'created_time': 1774471070.288656, 'last_price_update_time': 1774686659.344856}
2026-03-28 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PG30723') HTTP/1.1" 204 0
2026-03-28 08:30:59 [auto1.be] INFO: Found listing with ID: PL22892
2026-03-28 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL22892%27 HTTP/1.1" 200 None
2026-03-28 08:30:59 [auto1.be] INFO: Scrape type for PL22892: 0
2026-03-28 08:30:59 [auto1.be] INFO: Found listing with ID: AM99393
2026-03-28 08:30:59 [auto1.be] INFO: Found listing with ID: MS95161
2026-03-28 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS95161%27 HTTP/1.1" 200 None
2026-03-28 08:30:59 [auto1.be] INFO: Scrape type for MS95161: 0
2026-03-28 08:30:59 [auto1.be] INFO: Found listing with ID: SE96369
2026-03-28 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE96369%27 HTTP/1.1" 200 None
2026-03-28 08:30:59 [auto1.be] INFO: Scrape type for SE96369: 0
2026-03-28 08:30:59 [auto1.be] INFO: Found listing with ID: UV50609
2026-03-28 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV50609%27 HTTP/1.1" 200 None
2026-03-28 08:30:59 [auto1.be] INFO: Scrape type for UV50609: 0
2026-03-28 08:30:59 [auto1.be] INFO: Found listing with ID: XY49769
2026-03-28 08:30:59 [auto1.be] INFO: Found listing with ID: CX92013
2026-03-28 08:30:59 [auto1.be] INFO: Found listing with ID: JZ56411
2026-03-28 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ56411%27 HTTP/1.1" 200 None
2026-03-28 08:30:59 [auto1.be] INFO: Scrape type for JZ56411: 0
2026-03-28 08:30:59 [auto1.be] INFO: Found listing with ID: NY73004
2026-03-28 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY73004%27 HTTP/1.1" 200 None
2026-03-28 08:30:59 [auto1.be] INFO: Scrape type for NY73004: 2
2026-03-28 08:30:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aae5c759-451c-5959-a94a-4e69824834a8 with identifier: NY73004
2026-03-28 08:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aae5c759-451c-5959-a94a-4e69824834a8 with scrape type 2
2026-03-28 08:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aae5c759-451c-5959-a94a-4e69824834a8 with scrape type 2
2026-03-28 08:30:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: aae5c759-451c-5959-a94a-4e69824834a8, identifier: NY73004
2026-03-28 08:30:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: aae5c759-451c-5959-a94a-4e69824834a8 with identifier: NY73004
2026-03-28 08:30:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: aae5c759-451c-5959-a94a-4e69824834a8 with identifier: NY73004
2026-03-28 08:30:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: aae5c759-451c-5959-a94a-4e69824834a8 with identifier: NY73004 to the API
2026-03-28 08:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:30:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 200,
'expiration_date': '2026-03-28T16:49:40Z',
'fuel_type': 'diesel',
'id': 'aae5c759-451c-5959-a94a-4e69824834a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY73004',
'listing': 'auction',
'make': 'Renault',
'model': 'Espace',
'odometer': 73000,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-03',
'seller_name': None,
'title': 'Renault Espace 2.0 BLUE dCi Initiale Paris',
'transmission': 'automatic',
'trim': 'Initiale Paris',
'year': 2021}
2026-03-28 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY73004%27 HTTP/1.1" 200 None
2026-03-28 08:30:59 [auto1.be] INFO: Saving data for NY73004: {'auction_closing_time': 1774716580.0, 'created_time': 1774471316.111132, 'last_price_update_time': 1774686659.879315}
2026-03-28 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NY73004') HTTP/1.1" 204 0
2026-03-28 08:30:59 [auto1.be] INFO: Found listing with ID: VW08902
2026-03-28 08:30:59 [auto1.be] INFO: Found listing with ID: LG02466
2026-03-28 08:30:59 [auto1.be] INFO: Found listing with ID: JV95971
2026-03-28 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV95971%27 HTTP/1.1" 200 None
2026-03-28 08:30:59 [auto1.be] INFO: Scrape type for JV95971: 0
2026-03-28 08:30:59 [auto1.be] INFO: Found listing with ID: YB34897
2026-03-28 08:30:59 [auto1.be] INFO: Found listing with ID: DP88518
2026-03-28 08:30:59 [auto1.be] INFO: Found listing with ID: CB62754
2026-03-28 08:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:31:00 [auto1.be] INFO: Channel: 24h | Page: 11 | totalHits: 1701 | hits on page: 40
2026-03-28 08:31:00 [auto1.be] INFO: Found listing with ID: MT09894
2026-03-28 08:31:00 [auto1.be] INFO: Found listing with ID: AX58227
2026-03-28 08:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX58227%27 HTTP/1.1" 200 None
2026-03-28 08:31:00 [auto1.be] INFO: Scrape type for AX58227: 0
2026-03-28 08:31:00 [auto1.be] INFO: Found listing with ID: MD83963
2026-03-28 08:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD83963%27 HTTP/1.1" 200 None
2026-03-28 08:31:00 [auto1.be] INFO: Scrape type for MD83963: 2
2026-03-28 08:31:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d9e1c00-481d-58cf-9c4f-0132e904bc1f with identifier: MD83963
2026-03-28 08:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d9e1c00-481d-58cf-9c4f-0132e904bc1f with scrape type 2
2026-03-28 08:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d9e1c00-481d-58cf-9c4f-0132e904bc1f with scrape type 2
2026-03-28 08:31:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6d9e1c00-481d-58cf-9c4f-0132e904bc1f, identifier: MD83963
2026-03-28 08:31:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6d9e1c00-481d-58cf-9c4f-0132e904bc1f with identifier: MD83963
2026-03-28 08:31:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 08:31:00 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-28 08:31:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 08:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 08:31:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6d9e1c00-481d-58cf-9c4f-0132e904bc1f with identifier: MD83963
2026-03-28 08:31:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6d9e1c00-481d-58cf-9c4f-0132e904bc1f with identifier: MD83963 to the API
2026-03-28 08:31:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 179,
'expiration_date': '2026-03-28T16:19:37Z',
'fuel_type': 'diesel',
'id': '6d9e1c00-481d-58cf-9c4f-0132e904bc1f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD83963',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Expert',
'odometer': 183480,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-25',
'seller_name': None,
'title': 'Peugeot Expert 2.0 Blue-HDi Premium Pack Long',
'transmission': 'automatic',
'trim': 'Premium Pack Long',
'year': 2018}
2026-03-28 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD83963%27 HTTP/1.1" 200 None
2026-03-28 08:31:01 [auto1.be] INFO: Saving data for MD83963: {'auction_closing_time': 1774714777.0, 'created_time': 1774471385.426935, 'last_price_update_time': 1774686661.309935}
2026-03-28 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MD83963') HTTP/1.1" 204 0
2026-03-28 08:31:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:31:01 [auto1.be] INFO: Found listing with ID: KE03465
2026-03-28 08:31:01 [auto1.be] INFO: Found listing with ID: BR84534
2026-03-28 08:31:01 [auto1.be] INFO: Found listing with ID: TA85166
2026-03-28 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA85166%27 HTTP/1.1" 200 None
2026-03-28 08:31:01 [auto1.be] INFO: Scrape type for TA85166: 0
2026-03-28 08:31:01 [auto1.be] INFO: Found listing with ID: ZW31488
2026-03-28 08:31:01 [auto1.be] INFO: Found listing with ID: ET09366
2026-03-28 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET09366%27 HTTP/1.1" 200 None
2026-03-28 08:31:01 [auto1.be] INFO: Scrape type for ET09366: 0
2026-03-28 08:31:01 [auto1.be] INFO: Found listing with ID: JE01185
2026-03-28 08:31:01 [auto1.be] INFO: Found listing with ID: HU84368
2026-03-28 08:31:01 [auto1.be] INFO: Found listing with ID: CE95179
2026-03-28 08:31:01 [auto1.be] INFO: Found listing with ID: ZJ76170
2026-03-28 08:31:01 [auto1.be] INFO: Found listing with ID: YW00445
2026-03-28 08:31:01 [auto1.be] INFO: Found listing with ID: LJ80656
2026-03-28 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LJ80656%27 HTTP/1.1" 200 None
2026-03-28 08:31:01 [auto1.be] INFO: Scrape type for LJ80656: 0
2026-03-28 08:31:01 [auto1.be] INFO: Found listing with ID: GX61337
2026-03-28 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX61337%27 HTTP/1.1" 200 None
2026-03-28 08:31:01 [auto1.be] INFO: Scrape type for GX61337: 0
2026-03-28 08:31:01 [auto1.be] INFO: Found listing with ID: JT01513
2026-03-28 08:31:01 [auto1.be] INFO: Found listing with ID: XC64567
2026-03-28 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC64567%27 HTTP/1.1" 200 None
2026-03-28 08:31:01 [auto1.be] INFO: Scrape type for XC64567: 0
2026-03-28 08:31:01 [auto1.be] INFO: Found listing with ID: NG90127
2026-03-28 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG90127%27 HTTP/1.1" 200 None
2026-03-28 08:31:01 [auto1.be] INFO: Scrape type for NG90127: 0
2026-03-28 08:31:01 [auto1.be] INFO: Found listing with ID: TD99955
2026-03-28 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD99955%27 HTTP/1.1" 200 None
2026-03-28 08:31:01 [auto1.be] INFO: Scrape type for TD99955: 0
2026-03-28 08:31:01 [auto1.be] INFO: Found listing with ID: MW20724
2026-03-28 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW20724%27 HTTP/1.1" 200 None
2026-03-28 08:31:01 [auto1.be] INFO: Scrape type for MW20724: 0
2026-03-28 08:31:01 [auto1.be] INFO: Found listing with ID: ZH14526
2026-03-28 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH14526%27 HTTP/1.1" 200 None
2026-03-28 08:31:01 [auto1.be] INFO: Scrape type for ZH14526: 2
2026-03-28 08:31:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bed99c10-7331-5534-8234-f47d130c40f1 with identifier: ZH14526
2026-03-28 08:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bed99c10-7331-5534-8234-f47d130c40f1 with scrape type 2
2026-03-28 08:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bed99c10-7331-5534-8234-f47d130c40f1 with scrape type 2
2026-03-28 08:31:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bed99c10-7331-5534-8234-f47d130c40f1, identifier: ZH14526
2026-03-28 08:31:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bed99c10-7331-5534-8234-f47d130c40f1 with identifier: ZH14526
2026-03-28 08:31:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bed99c10-7331-5534-8234-f47d130c40f1 with identifier: ZH14526
2026-03-28 08:31:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bed99c10-7331-5534-8234-f47d130c40f1 with identifier: ZH14526 to the API
2026-03-28 08:31:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:41:06Z',
'fuel_type': 'petrol',
'id': 'bed99c10-7331-5534-8234-f47d130c40f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH14526',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 113735,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-03',
'seller_name': None,
'title': 'Volkswagen Caddy 1.2 TSI Trendline BlueMotion Tech.',
'transmission': 'manual',
'trim': 'Trendline BlueMotion Tech.',
'year': 2013}
2026-03-28 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH14526%27 HTTP/1.1" 200 None
2026-03-28 08:31:01 [auto1.be] INFO: Saving data for ZH14526: {'auction_closing_time': 1774716066.0, 'created_time': 1773301782.319062, 'last_price_update_time': 1774686661.962005}
2026-03-28 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZH14526') HTTP/1.1" 204 0
2026-03-28 08:31:02 [auto1.be] INFO: Found listing with ID: UA44051
2026-03-28 08:31:02 [auto1.be] INFO: Found listing with ID: GS68920
2026-03-28 08:31:02 [auto1.be] INFO: Found listing with ID: HW95173
2026-03-28 08:31:02 [auto1.be] INFO: Found listing with ID: TW64249
2026-03-28 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW64249%27 HTTP/1.1" 200 None
2026-03-28 08:31:02 [auto1.be] INFO: Scrape type for TW64249: 0
2026-03-28 08:31:02 [auto1.be] INFO: Found listing with ID: SD94146
2026-03-28 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD94146%27 HTTP/1.1" 200 None
2026-03-28 08:31:02 [auto1.be] INFO: Scrape type for SD94146: 0
2026-03-28 08:31:02 [auto1.be] INFO: Found listing with ID: KA04949
2026-03-28 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KA04949%27 HTTP/1.1" 200 None
2026-03-28 08:31:02 [auto1.be] INFO: Scrape type for KA04949: 0
2026-03-28 08:31:02 [auto1.be] INFO: Found listing with ID: CP45384
2026-03-28 08:31:02 [auto1.be] INFO: Found listing with ID: NK67799
2026-03-28 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK67799%27 HTTP/1.1" 200 None
2026-03-28 08:31:02 [auto1.be] INFO: Scrape type for NK67799: 0
2026-03-28 08:31:02 [auto1.be] INFO: Found listing with ID: AF68960
2026-03-28 08:31:02 [auto1.be] INFO: Found listing with ID: XX33825
2026-03-28 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XX33825%27 HTTP/1.1" 200 None
2026-03-28 08:31:02 [auto1.be] INFO: Scrape type for XX33825: 0
2026-03-28 08:31:02 [auto1.be] INFO: Found listing with ID: VH72500
2026-03-28 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VH72500%27 HTTP/1.1" 200 None
2026-03-28 08:31:02 [auto1.be] INFO: Scrape type for VH72500: 0
2026-03-28 08:31:02 [auto1.be] INFO: Found listing with ID: PT71351
2026-03-28 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PT71351%27 HTTP/1.1" 200 None
2026-03-28 08:31:02 [auto1.be] INFO: Scrape type for PT71351: 0
2026-03-28 08:31:02 [auto1.be] INFO: Found listing with ID: ZY41289
2026-03-28 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY41289%27 HTTP/1.1" 200 None
2026-03-28 08:31:02 [auto1.be] INFO: Scrape type for ZY41289: 2
2026-03-28 08:31:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7a8b9bf-6a15-5a2e-ba20-30041e4050e5 with identifier: ZY41289
2026-03-28 08:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7a8b9bf-6a15-5a2e-ba20-30041e4050e5 with scrape type 2
2026-03-28 08:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7a8b9bf-6a15-5a2e-ba20-30041e4050e5 with scrape type 2
2026-03-28 08:31:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d7a8b9bf-6a15-5a2e-ba20-30041e4050e5, identifier: ZY41289
2026-03-28 08:31:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d7a8b9bf-6a15-5a2e-ba20-30041e4050e5 with identifier: ZY41289
2026-03-28 08:31:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d7a8b9bf-6a15-5a2e-ba20-30041e4050e5 with identifier: ZY41289
2026-03-28 08:31:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d7a8b9bf-6a15-5a2e-ba20-30041e4050e5 with identifier: ZY41289 to the API
2026-03-28 08:31:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:19:05Z',
'fuel_type': 'petrol',
'id': 'd7a8b9bf-6a15-5a2e-ba20-30041e4050e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY41289',
'listing': 'auction',
'make': 'Audi',
'model': 'A1',
'odometer': 53439,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-16',
'seller_name': None,
'title': 'Audi A1 1.0 TFSI',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-03-28 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY41289%27 HTTP/1.1" 200 None
2026-03-28 08:31:02 [auto1.be] INFO: Saving data for ZY41289: {'auction_closing_time': 1774714745.0, 'created_time': 1774471323.378815, 'last_price_update_time': 1774686662.593864}
2026-03-28 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZY41289') HTTP/1.1" 204 0
2026-03-28 08:31:02 [auto1.be] INFO: Found listing with ID: UK54549
2026-03-28 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UK54549%27 HTTP/1.1" 200 None
2026-03-28 08:31:02 [auto1.be] INFO: Scrape type for UK54549: 0
2026-03-28 08:31:02 [auto1.be] INFO: Found listing with ID: NK28391
2026-03-28 08:31:02 [auto1.be] INFO: Found listing with ID: CW00167
2026-03-28 08:31:02 [auto1.be] INFO: Found listing with ID: BH52169
2026-03-28 08:31:02 [auto1.be] INFO: Found listing with ID: HY69206
2026-03-28 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY69206%27 HTTP/1.1" 200 None
2026-03-28 08:31:02 [auto1.be] INFO: Scrape type for HY69206: 0
2026-03-28 08:31:02 [auto1.be] INFO: Found listing with ID: KR25355
2026-03-28 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KR25355%27 HTTP/1.1" 200 None
2026-03-28 08:31:02 [auto1.be] INFO: Scrape type for KR25355: 2
2026-03-28 08:31:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a893f83a-9ecc-5fac-821e-477ee58961e9 with identifier: KR25355
2026-03-28 08:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a893f83a-9ecc-5fac-821e-477ee58961e9 with scrape type 2
2026-03-28 08:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a893f83a-9ecc-5fac-821e-477ee58961e9 with scrape type 2
2026-03-28 08:31:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a893f83a-9ecc-5fac-821e-477ee58961e9, identifier: KR25355
2026-03-28 08:31:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a893f83a-9ecc-5fac-821e-477ee58961e9 with identifier: KR25355
2026-03-28 08:31:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a893f83a-9ecc-5fac-821e-477ee58961e9 with identifier: KR25355
2026-03-28 08:31:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a893f83a-9ecc-5fac-821e-477ee58961e9 with identifier: KR25355 to the API
2026-03-28 08:31:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:26:17Z',
'fuel_type': 'petrol',
'id': 'a893f83a-9ecc-5fac-821e-477ee58961e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR25355',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 105073,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-10',
'seller_name': None,
'title': 'Volkswagen Touran 1.2 TSI Trendline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Trendline BlueMotion Tech',
'year': 2018}
2026-03-28 08:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KR25355%27 HTTP/1.1" 200 None
2026-03-28 08:31:03 [auto1.be] INFO: Saving data for KR25355: {'auction_closing_time': 1774715177.0, 'created_time': 1774471149.709426, 'last_price_update_time': 1774686663.311989}
2026-03-28 08:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KR25355') HTTP/1.1" 204 0
2026-03-28 08:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:31:04 [auto1.be] INFO: Channel: 24h | Page: 12 | totalHits: 1701 | hits on page: 40
2026-03-28 08:31:04 [auto1.be] INFO: Found listing with ID: ED19448
2026-03-28 08:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED19448%27 HTTP/1.1" 200 None
2026-03-28 08:31:04 [auto1.be] INFO: Scrape type for ED19448: 0
2026-03-28 08:31:04 [auto1.be] INFO: Found listing with ID: CS08088
2026-03-28 08:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS08088%27 HTTP/1.1" 200 None
2026-03-28 08:31:04 [auto1.be] INFO: Scrape type for CS08088: 0
2026-03-28 08:31:04 [auto1.be] INFO: Found listing with ID: NG88652
2026-03-28 08:31:04 [auto1.be] INFO: Found listing with ID: NP41015
2026-03-28 08:31:04 [auto1.be] INFO: Found listing with ID: YM99739
2026-03-28 08:31:04 [auto1.be] INFO: Found listing with ID: HU32534
2026-03-28 08:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU32534%27 HTTP/1.1" 200 None
2026-03-28 08:31:04 [auto1.be] INFO: Scrape type for HU32534: 0
2026-03-28 08:31:04 [auto1.be] INFO: Found listing with ID: BT94428
2026-03-28 08:31:04 [auto1.be] INFO: Found listing with ID: JS25395
2026-03-28 08:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS25395%27 HTTP/1.1" 200 None
2026-03-28 08:31:04 [auto1.be] INFO: Scrape type for JS25395: 0
2026-03-28 08:31:04 [auto1.be] INFO: Found listing with ID: TX28125
2026-03-28 08:31:04 [auto1.be] INFO: Found listing with ID: TT75307
2026-03-28 08:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT75307%27 HTTP/1.1" 200 None
2026-03-28 08:31:04 [auto1.be] INFO: Scrape type for TT75307: 0
2026-03-28 08:31:04 [auto1.be] INFO: Found listing with ID: GB32239
2026-03-28 08:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB32239%27 HTTP/1.1" 200 None
2026-03-28 08:31:04 [auto1.be] INFO: Scrape type for GB32239: 2
2026-03-28 08:31:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 568e9e3b-6df3-53eb-91a6-f8ea57e7e907 with identifier: GB32239
2026-03-28 08:31:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 568e9e3b-6df3-53eb-91a6-f8ea57e7e907 with scrape type 2
2026-03-28 08:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 568e9e3b-6df3-53eb-91a6-f8ea57e7e907 with scrape type 2
2026-03-28 08:31:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 568e9e3b-6df3-53eb-91a6-f8ea57e7e907, identifier: GB32239
2026-03-28 08:31:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 568e9e3b-6df3-53eb-91a6-f8ea57e7e907 with identifier: GB32239
2026-03-28 08:31:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 568e9e3b-6df3-53eb-91a6-f8ea57e7e907 with identifier: GB32239
2026-03-28 08:31:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 568e9e3b-6df3-53eb-91a6-f8ea57e7e907 with identifier: GB32239 to the API
2026-03-28 08:31:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:34:00Z',
'fuel_type': 'diesel',
'id': '568e9e3b-6df3-53eb-91a6-f8ea57e7e907',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB32239',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 201918,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-12',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion',
'transmission': 'automatic',
'trim': 'Sport & Style 4Motion',
'year': 2015}
2026-03-28 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB32239%27 HTTP/1.1" 200 None
2026-03-28 08:31:05 [auto1.be] INFO: Saving data for GB32239: {'auction_closing_time': 1774715640.0, 'created_time': 1774470958.557246, 'last_price_update_time': 1774686665.029573}
2026-03-28 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GB32239') HTTP/1.1" 204 0
2026-03-28 08:31:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:31:05 [auto1.be] INFO: Found listing with ID: SJ92859
2026-03-28 08:31:05 [auto1.be] INFO: Found listing with ID: SL08078
2026-03-28 08:31:05 [auto1.be] INFO: Found listing with ID: RB55358
2026-03-28 08:31:05 [auto1.be] INFO: Found listing with ID: SF38570
2026-03-28 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF38570%27 HTTP/1.1" 200 None
2026-03-28 08:31:05 [auto1.be] INFO: Scrape type for SF38570: 0
2026-03-28 08:31:05 [auto1.be] INFO: Found listing with ID: GF08223
2026-03-28 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF08223%27 HTTP/1.1" 200 None
2026-03-28 08:31:05 [auto1.be] INFO: Scrape type for GF08223: 0
2026-03-28 08:31:05 [auto1.be] INFO: Found listing with ID: PV92742
2026-03-28 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV92742%27 HTTP/1.1" 200 None
2026-03-28 08:31:05 [auto1.be] INFO: Scrape type for PV92742: 2
2026-03-28 08:31:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b2ad157-1100-5c5b-a2c6-03b134ea0c0e with identifier: PV92742
2026-03-28 08:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b2ad157-1100-5c5b-a2c6-03b134ea0c0e with scrape type 2
2026-03-28 08:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b2ad157-1100-5c5b-a2c6-03b134ea0c0e with scrape type 2
2026-03-28 08:31:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9b2ad157-1100-5c5b-a2c6-03b134ea0c0e, identifier: PV92742
2026-03-28 08:31:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9b2ad157-1100-5c5b-a2c6-03b134ea0c0e with identifier: PV92742
2026-03-28 08:31:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9b2ad157-1100-5c5b-a2c6-03b134ea0c0e with identifier: PV92742
2026-03-28 08:31:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9b2ad157-1100-5c5b-a2c6-03b134ea0c0e with identifier: PV92742 to the API
2026-03-28 08:31:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:18:30Z',
'fuel_type': 'petrol',
'id': '9b2ad157-1100-5c5b-a2c6-03b134ea0c0e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV92742',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 130841,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-18',
'seller_name': None,
'title': 'Audi A3 Sportback 1.0 TFSI',
'transmission': 'manual',
'trim': '',
'year': 2017}
2026-03-28 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV92742%27 HTTP/1.1" 200 None
2026-03-28 08:31:05 [auto1.be] INFO: Saving data for PV92742: {'auction_closing_time': 1774714710.0, 'created_time': 1774471052.104299, 'last_price_update_time': 1774686665.571221}
2026-03-28 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PV92742') HTTP/1.1" 204 0
2026-03-28 08:31:05 [auto1.be] INFO: Found listing with ID: TE49722
2026-03-28 08:31:05 [auto1.be] INFO: Found listing with ID: TH53375
2026-03-28 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH53375%27 HTTP/1.1" 200 None
2026-03-28 08:31:05 [auto1.be] INFO: Scrape type for TH53375: 0
2026-03-28 08:31:05 [auto1.be] INFO: Found listing with ID: KG19380
2026-03-28 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG19380%27 HTTP/1.1" 200 None
2026-03-28 08:31:05 [auto1.be] INFO: Scrape type for KG19380: 0
2026-03-28 08:31:05 [auto1.be] INFO: Found listing with ID: WY74767
2026-03-28 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WY74767%27 HTTP/1.1" 200 None
2026-03-28 08:31:05 [auto1.be] INFO: Scrape type for WY74767: 2
2026-03-28 08:31:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecb602af-262c-5240-919d-760232ce524d with identifier: WY74767
2026-03-28 08:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecb602af-262c-5240-919d-760232ce524d with scrape type 2
2026-03-28 08:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecb602af-262c-5240-919d-760232ce524d with scrape type 2
2026-03-28 08:31:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ecb602af-262c-5240-919d-760232ce524d, identifier: WY74767
2026-03-28 08:31:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ecb602af-262c-5240-919d-760232ce524d with identifier: WY74767
2026-03-28 08:31:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ecb602af-262c-5240-919d-760232ce524d with identifier: WY74767
2026-03-28 08:31:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ecb602af-262c-5240-919d-760232ce524d with identifier: WY74767 to the API
2026-03-28 08:31:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:17:42Z',
'fuel_type': 'petrol',
'id': 'ecb602af-262c-5240-919d-760232ce524d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY74767',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 160697,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-23',
'seller_name': None,
'title': 'Audi A3 Sportback 1.4 TGI Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2014}
2026-03-28 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WY74767%27 HTTP/1.1" 200 None
2026-03-28 08:31:06 [auto1.be] INFO: Saving data for WY74767: {'auction_closing_time': 1774714662.0, 'created_time': 1774470975.545637, 'last_price_update_time': 1774686666.870907}
2026-03-28 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WY74767') HTTP/1.1" 204 0
2026-03-28 08:31:06 [auto1.be] INFO: Found listing with ID: WA10715
2026-03-28 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA10715%27 HTTP/1.1" 200 None
2026-03-28 08:31:06 [auto1.be] INFO: Scrape type for WA10715: 0
2026-03-28 08:31:06 [auto1.be] INFO: Found listing with ID: PU36315
2026-03-28 08:31:06 [auto1.be] INFO: Found listing with ID: NN37079
2026-03-28 08:31:06 [auto1.be] INFO: Found listing with ID: SZ91004
2026-03-28 08:31:06 [auto1.be] INFO: Found listing with ID: UB84637
2026-03-28 08:31:06 [auto1.be] INFO: Found listing with ID: WZ44217
2026-03-28 08:31:06 [auto1.be] INFO: Found listing with ID: XJ95743
2026-03-28 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ95743%27 HTTP/1.1" 200 None
2026-03-28 08:31:06 [auto1.be] INFO: Scrape type for XJ95743: 0
2026-03-28 08:31:06 [auto1.be] INFO: Found listing with ID: EX12355
2026-03-28 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX12355%27 HTTP/1.1" 200 None
2026-03-28 08:31:06 [auto1.be] INFO: Scrape type for EX12355: 0
2026-03-28 08:31:06 [auto1.be] INFO: Found listing with ID: LB88275
2026-03-28 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB88275%27 HTTP/1.1" 200 None
2026-03-28 08:31:06 [auto1.be] INFO: Scrape type for LB88275: 0
2026-03-28 08:31:06 [auto1.be] INFO: Found listing with ID: NB29078
2026-03-28 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB29078%27 HTTP/1.1" 200 None
2026-03-28 08:31:06 [auto1.be] INFO: Scrape type for NB29078: 2
2026-03-28 08:31:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec796a85-1747-5cb2-9802-ba905635a0e2 with identifier: NB29078
2026-03-28 08:31:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec796a85-1747-5cb2-9802-ba905635a0e2 with scrape type 2
2026-03-28 08:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec796a85-1747-5cb2-9802-ba905635a0e2 with scrape type 2
2026-03-28 08:31:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ec796a85-1747-5cb2-9802-ba905635a0e2, identifier: NB29078
2026-03-28 08:31:07 [scrapy.extensions.logstats] INFO: Crawled 38 pages (at 38 pages/min), scraped 57 items (at 57 items/min)
2026-03-28 08:31:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 175MiB
2026-03-28 08:31:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ec796a85-1747-5cb2-9802-ba905635a0e2 with identifier: NB29078
2026-03-28 08:31:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ec796a85-1747-5cb2-9802-ba905635a0e2 with identifier: NB29078
2026-03-28 08:31:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ec796a85-1747-5cb2-9802-ba905635a0e2 with identifier: NB29078 to the API
2026-03-28 08:31:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:09:42Z',
'fuel_type': 'petrol',
'id': 'ec796a85-1747-5cb2-9802-ba905635a0e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB29078',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 18850,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-06',
'seller_name': None,
'title': 'Dacia Sandero 1.0 TCe Stepway Extreme+',
'transmission': 'manual',
'trim': 'Stepway Extreme+',
'year': 2023}
2026-03-28 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB29078%27 HTTP/1.1" 200 None
2026-03-28 08:31:07 [auto1.be] INFO: Saving data for NB29078: {'auction_closing_time': 1774714182.0, 'created_time': 1774471283.095662, 'last_price_update_time': 1774686667.405506}
2026-03-28 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NB29078') HTTP/1.1" 204 0
2026-03-28 08:31:07 [auto1.be] INFO: Found listing with ID: NR75863
2026-03-28 08:31:07 [auto1.be] INFO: Found listing with ID: VC37293
2026-03-28 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VC37293%27 HTTP/1.1" 200 None
2026-03-28 08:31:07 [auto1.be] INFO: Scrape type for VC37293: 0
2026-03-28 08:31:07 [auto1.be] INFO: Found listing with ID: GJ44725
2026-03-28 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ44725%27 HTTP/1.1" 200 None
2026-03-28 08:31:07 [auto1.be] INFO: Scrape type for GJ44725: 0
2026-03-28 08:31:07 [auto1.be] INFO: Found listing with ID: WW09549
2026-03-28 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW09549%27 HTTP/1.1" 200 None
2026-03-28 08:31:07 [auto1.be] INFO: Scrape type for WW09549: 0
2026-03-28 08:31:07 [auto1.be] INFO: Found listing with ID: VZ08217
2026-03-28 08:31:07 [auto1.be] INFO: Found listing with ID: PE70540
2026-03-28 08:31:07 [auto1.be] INFO: Found listing with ID: VW32861
2026-03-28 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW32861%27 HTTP/1.1" 200 None
2026-03-28 08:31:07 [auto1.be] INFO: Scrape type for VW32861: 0
2026-03-28 08:31:07 [auto1.be] INFO: Found listing with ID: JT16310
2026-03-28 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT16310%27 HTTP/1.1" 200 None
2026-03-28 08:31:07 [auto1.be] INFO: Scrape type for JT16310: 0
2026-03-28 08:31:07 [auto1.be] INFO: Found listing with ID: LK55982
2026-03-28 08:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:31:08 [auto1.be] INFO: Channel: 24h | Page: 13 | totalHits: 1701 | hits on page: 40
2026-03-28 08:31:08 [auto1.be] INFO: Found listing with ID: KZ62896
2026-03-28 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ62896%27 HTTP/1.1" 200 None
2026-03-28 08:31:08 [auto1.be] INFO: Scrape type for KZ62896: 0
2026-03-28 08:31:08 [auto1.be] INFO: Found listing with ID: SP19111
2026-03-28 08:31:08 [auto1.be] INFO: Found listing with ID: PM94019
2026-03-28 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM94019%27 HTTP/1.1" 200 None
2026-03-28 08:31:08 [auto1.be] INFO: Scrape type for PM94019: 0
2026-03-28 08:31:08 [auto1.be] INFO: Found listing with ID: BF62281
2026-03-28 08:31:08 [auto1.be] INFO: Found listing with ID: YU72813
2026-03-28 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU72813%27 HTTP/1.1" 200 None
2026-03-28 08:31:08 [auto1.be] INFO: Scrape type for YU72813: 0
2026-03-28 08:31:08 [auto1.be] INFO: Found listing with ID: KM06752
2026-03-28 08:31:08 [auto1.be] INFO: Found listing with ID: FY96081
2026-03-28 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY96081%27 HTTP/1.1" 200 None
2026-03-28 08:31:08 [auto1.be] INFO: Scrape type for FY96081: 2
2026-03-28 08:31:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fcc3468-d458-5a9b-a4e6-1ca21e75e027 with identifier: FY96081
2026-03-28 08:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fcc3468-d458-5a9b-a4e6-1ca21e75e027 with scrape type 2
2026-03-28 08:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fcc3468-d458-5a9b-a4e6-1ca21e75e027 with scrape type 2
2026-03-28 08:31:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5fcc3468-d458-5a9b-a4e6-1ca21e75e027, identifier: FY96081
2026-03-28 08:31:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5fcc3468-d458-5a9b-a4e6-1ca21e75e027 with identifier: FY96081
2026-03-28 08:31:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5fcc3468-d458-5a9b-a4e6-1ca21e75e027 with identifier: FY96081
2026-03-28 08:31:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5fcc3468-d458-5a9b-a4e6-1ca21e75e027 with identifier: FY96081 to the API
2026-03-28 08:31:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:48:38Z',
'fuel_type': 'diesel',
'id': '5fcc3468-d458-5a9b-a4e6-1ca21e75e027',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY96081',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 181847,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-12-10',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180 d BlueEfficiency Style',
'transmission': 'manual',
'trim': 'BlueEfficiency Style',
'year': 2016}
2026-03-28 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY96081%27 HTTP/1.1" 200 None
2026-03-28 08:31:08 [auto1.be] INFO: Saving data for FY96081: {'auction_closing_time': 1774716518.0, 'created_time': 1774471375.866478, 'last_price_update_time': 1774686668.872023}
2026-03-28 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FY96081') HTTP/1.1" 204 0
2026-03-28 08:31:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:31:08 [auto1.be] INFO: Found listing with ID: CP72825
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP72825%27 HTTP/1.1" 200 None
2026-03-28 08:31:09 [auto1.be] INFO: Scrape type for CP72825: 0
2026-03-28 08:31:09 [auto1.be] INFO: Found listing with ID: YF72267
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF72267%27 HTTP/1.1" 200 None
2026-03-28 08:31:09 [auto1.be] INFO: Scrape type for YF72267: 0
2026-03-28 08:31:09 [auto1.be] INFO: Found listing with ID: KZ21578
2026-03-28 08:31:09 [auto1.be] INFO: Found listing with ID: SZ23077
2026-03-28 08:31:09 [auto1.be] INFO: Found listing with ID: PS35692
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS35692%27 HTTP/1.1" 200 None
2026-03-28 08:31:09 [auto1.be] INFO: Scrape type for PS35692: 0
2026-03-28 08:31:09 [auto1.be] INFO: Found listing with ID: PJ29729
2026-03-28 08:31:09 [auto1.be] INFO: Found listing with ID: XT14784
2026-03-28 08:31:09 [auto1.be] INFO: Found listing with ID: SL54877
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL54877%27 HTTP/1.1" 200 None
2026-03-28 08:31:09 [auto1.be] INFO: Scrape type for SL54877: 2
2026-03-28 08:31:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a28a7f49-e122-5723-bff5-db8857b55564 with identifier: SL54877
2026-03-28 08:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a28a7f49-e122-5723-bff5-db8857b55564 with scrape type 2
2026-03-28 08:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a28a7f49-e122-5723-bff5-db8857b55564 with scrape type 2
2026-03-28 08:31:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a28a7f49-e122-5723-bff5-db8857b55564, identifier: SL54877
2026-03-28 08:31:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a28a7f49-e122-5723-bff5-db8857b55564 with identifier: SL54877
2026-03-28 08:31:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a28a7f49-e122-5723-bff5-db8857b55564 with identifier: SL54877
2026-03-28 08:31:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a28a7f49-e122-5723-bff5-db8857b55564 with identifier: SL54877 to the API
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:28:00Z',
'fuel_type': 'diesel',
'id': 'a28a7f49-e122-5723-bff5-db8857b55564',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL54877',
'listing': 'auction',
'make': 'DS Automobiles',
'model': 'DS7 Crossback',
'odometer': 115055,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-29',
'seller_name': None,
'title': 'DS Automobiles DS7 Crossback 1.5 Blue-HDi Performance Line',
'transmission': 'automatic',
'trim': 'Performance Line',
'year': 2020}
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL54877%27 HTTP/1.1" 200 None
2026-03-28 08:31:09 [auto1.be] INFO: Saving data for SL54877: {'auction_closing_time': 1774715280.0, 'created_time': 1774471278.40445, 'last_price_update_time': 1774686669.799438}
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SL54877') HTTP/1.1" 204 0
2026-03-28 08:31:09 [auto1.be] INFO: Found listing with ID: ZY27857
2026-03-28 08:31:09 [auto1.be] INFO: Found listing with ID: NX65189
2026-03-28 08:31:09 [auto1.be] INFO: Found listing with ID: CN29269
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN29269%27 HTTP/1.1" 200 None
2026-03-28 08:31:09 [auto1.be] INFO: Scrape type for CN29269: 0
2026-03-28 08:31:09 [auto1.be] INFO: Found listing with ID: NB01852
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB01852%27 HTTP/1.1" 200 None
2026-03-28 08:31:09 [auto1.be] INFO: Scrape type for NB01852: 0
2026-03-28 08:31:09 [auto1.be] INFO: Found listing with ID: RX86056
2026-03-28 08:31:09 [auto1.be] INFO: Found listing with ID: LD32822
2026-03-28 08:31:09 [auto1.be] INFO: Found listing with ID: KD01441
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD01441%27 HTTP/1.1" 200 None
2026-03-28 08:31:09 [auto1.be] INFO: Scrape type for KD01441: 0
2026-03-28 08:31:09 [auto1.be] INFO: Found listing with ID: WN30379
2026-03-28 08:31:09 [auto1.be] INFO: Found listing with ID: JX70748
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX70748%27 HTTP/1.1" 200 None
2026-03-28 08:31:09 [auto1.be] INFO: Scrape type for JX70748: 0
2026-03-28 08:31:09 [auto1.be] INFO: Found listing with ID: XD36076
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD36076%27 HTTP/1.1" 200 None
2026-03-28 08:31:09 [auto1.be] INFO: Scrape type for XD36076: 0
2026-03-28 08:31:09 [auto1.be] INFO: Found listing with ID: MX12092
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX12092%27 HTTP/1.1" 200 None
2026-03-28 08:31:09 [auto1.be] INFO: Scrape type for MX12092: 0
2026-03-28 08:31:09 [auto1.be] INFO: Found listing with ID: AX26323
2026-03-28 08:31:09 [auto1.be] INFO: Found listing with ID: TP88301
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP88301%27 HTTP/1.1" 200 None
2026-03-28 08:31:09 [auto1.be] INFO: Scrape type for TP88301: 0
2026-03-28 08:31:09 [auto1.be] INFO: Found listing with ID: DZ54195
2026-03-28 08:31:09 [auto1.be] INFO: Found listing with ID: FA45415
2026-03-28 08:31:09 [auto1.be] INFO: Found listing with ID: DS89988
2026-03-28 08:31:09 [auto1.be] INFO: Found listing with ID: XV14848
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XV14848%27 HTTP/1.1" 200 None
2026-03-28 08:31:09 [auto1.be] INFO: Scrape type for XV14848: 0
2026-03-28 08:31:09 [auto1.be] INFO: Found listing with ID: HY85639
2026-03-28 08:31:09 [auto1.be] INFO: Found listing with ID: RP50395
2026-03-28 08:31:09 [auto1.be] INFO: Found listing with ID: HK81119
2026-03-28 08:31:09 [auto1.be] INFO: Found listing with ID: VB86156
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB86156%27 HTTP/1.1" 200 None
2026-03-28 08:31:09 [auto1.be] INFO: Scrape type for VB86156: 0
2026-03-28 08:31:09 [auto1.be] INFO: Found listing with ID: XM97787
2026-03-28 08:31:09 [auto1.be] INFO: Found listing with ID: HV83812
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HV83812%27 HTTP/1.1" 200 None
2026-03-28 08:31:09 [auto1.be] INFO: Scrape type for HV83812: 2
2026-03-28 08:31:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebd0844b-0c70-5e21-b4e2-4b987f58a5e6 with identifier: HV83812
2026-03-28 08:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebd0844b-0c70-5e21-b4e2-4b987f58a5e6 with scrape type 2
2026-03-28 08:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebd0844b-0c70-5e21-b4e2-4b987f58a5e6 with scrape type 2
2026-03-28 08:31:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ebd0844b-0c70-5e21-b4e2-4b987f58a5e6, identifier: HV83812
2026-03-28 08:31:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ebd0844b-0c70-5e21-b4e2-4b987f58a5e6 with identifier: HV83812
2026-03-28 08:31:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ebd0844b-0c70-5e21-b4e2-4b987f58a5e6 with identifier: HV83812
2026-03-28 08:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ebd0844b-0c70-5e21-b4e2-4b987f58a5e6 with identifier: HV83812 to the API
2026-03-28 08:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:12:04Z',
'fuel_type': 'diesel',
'id': 'ebd0844b-0c70-5e21-b4e2-4b987f58a5e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV83812',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 182414,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-14',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2020}
2026-03-28 08:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HV83812%27 HTTP/1.1" 200 None
2026-03-28 08:31:10 [auto1.be] INFO: Saving data for HV83812: {'auction_closing_time': 1774714324.0, 'created_time': 1774471053.940989, 'last_price_update_time': 1774686670.392049}
2026-03-28 08:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HV83812') HTTP/1.1" 204 0
2026-03-28 08:31:10 [auto1.be] INFO: Found listing with ID: CA55783
2026-03-28 08:31:10 [auto1.be] INFO: Found listing with ID: TR57009
2026-03-28 08:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:31:11 [auto1.be] INFO: Channel: 24h | Page: 14 | totalHits: 1701 | hits on page: 40
2026-03-28 08:31:11 [auto1.be] INFO: Found listing with ID: FV70837
2026-03-28 08:31:11 [auto1.be] INFO: Found listing with ID: TB39644
2026-03-28 08:31:11 [auto1.be] INFO: Found listing with ID: UM90025
2026-03-28 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM90025%27 HTTP/1.1" 200 None
2026-03-28 08:31:11 [auto1.be] INFO: Scrape type for UM90025: 0
2026-03-28 08:31:11 [auto1.be] INFO: Found listing with ID: WE68493
2026-03-28 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE68493%27 HTTP/1.1" 200 None
2026-03-28 08:31:11 [auto1.be] INFO: Scrape type for WE68493: 0
2026-03-28 08:31:11 [auto1.be] INFO: Found listing with ID: KN95173
2026-03-28 08:31:11 [auto1.be] INFO: Found listing with ID: VP75874
2026-03-28 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP75874%27 HTTP/1.1" 200 None
2026-03-28 08:31:11 [auto1.be] INFO: Scrape type for VP75874: 0
2026-03-28 08:31:11 [auto1.be] INFO: Found listing with ID: TU34385
2026-03-28 08:31:11 [auto1.be] INFO: Found listing with ID: UT50756
2026-03-28 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT50756%27 HTTP/1.1" 200 None
2026-03-28 08:31:11 [auto1.be] INFO: Scrape type for UT50756: 0
2026-03-28 08:31:11 [auto1.be] INFO: Found listing with ID: RB21597
2026-03-28 08:31:11 [auto1.be] INFO: Found listing with ID: ZM96172
2026-03-28 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM96172%27 HTTP/1.1" 200 None
2026-03-28 08:31:11 [auto1.be] INFO: Scrape type for ZM96172: 0
2026-03-28 08:31:11 [auto1.be] INFO: Found listing with ID: YW29468
2026-03-28 08:31:11 [auto1.be] INFO: Found listing with ID: DC36147
2026-03-28 08:31:11 [auto1.be] INFO: Found listing with ID: TP45390
2026-03-28 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP45390%27 HTTP/1.1" 200 None
2026-03-28 08:31:11 [auto1.be] INFO: Scrape type for TP45390: 0
2026-03-28 08:31:11 [auto1.be] INFO: Found listing with ID: FS22519
2026-03-28 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS22519%27 HTTP/1.1" 200 None
2026-03-28 08:31:11 [auto1.be] INFO: Scrape type for FS22519: 2
2026-03-28 08:31:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0068432-1329-5c71-ab0e-33d1abe26be1 with identifier: FS22519
2026-03-28 08:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0068432-1329-5c71-ab0e-33d1abe26be1 with scrape type 2
2026-03-28 08:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0068432-1329-5c71-ab0e-33d1abe26be1 with scrape type 2
2026-03-28 08:31:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c0068432-1329-5c71-ab0e-33d1abe26be1, identifier: FS22519
2026-03-28 08:31:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c0068432-1329-5c71-ab0e-33d1abe26be1 with identifier: FS22519
2026-03-28 08:31:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c0068432-1329-5c71-ab0e-33d1abe26be1 with identifier: FS22519
2026-03-28 08:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c0068432-1329-5c71-ab0e-33d1abe26be1 with identifier: FS22519 to the API
2026-03-28 08:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:04:59Z',
'fuel_type': 'diesel',
'id': 'c0068432-1329-5c71-ab0e-33d1abe26be1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS22519',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Partner',
'odometer': 287812,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-18',
'seller_name': None,
'title': 'Peugeot Partner 1.6 HDi L1 Komfort Avantage',
'transmission': 'manual',
'trim': 'L1 Komfort Avantage',
'year': 2015}
2026-03-28 08:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS22519%27 HTTP/1.1" 200 None
2026-03-28 08:31:12 [auto1.be] INFO: Saving data for FS22519: {'auction_closing_time': 1774713899.0, 'created_time': 1774471274.448869, 'last_price_update_time': 1774686672.289063}
2026-03-28 08:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FS22519') HTTP/1.1" 204 0
2026-03-28 08:31:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:31:12 [auto1.be] INFO: Found listing with ID: PM47313
2026-03-28 08:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM47313%27 HTTP/1.1" 200 None
2026-03-28 08:31:12 [auto1.be] INFO: Scrape type for PM47313: 2
2026-03-28 08:31:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d73cbb1a-d4c1-5aec-9ffb-5e37701d499a with identifier: PM47313
2026-03-28 08:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d73cbb1a-d4c1-5aec-9ffb-5e37701d499a with scrape type 2
2026-03-28 08:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d73cbb1a-d4c1-5aec-9ffb-5e37701d499a with scrape type 2
2026-03-28 08:31:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d73cbb1a-d4c1-5aec-9ffb-5e37701d499a, identifier: PM47313
2026-03-28 08:31:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d73cbb1a-d4c1-5aec-9ffb-5e37701d499a with identifier: PM47313
2026-03-28 08:31:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d73cbb1a-d4c1-5aec-9ffb-5e37701d499a with identifier: PM47313
2026-03-28 08:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d73cbb1a-d4c1-5aec-9ffb-5e37701d499a with identifier: PM47313 to the API
2026-03-28 08:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-28T16:38:49Z',
'fuel_type': 'petrol',
'id': 'd73cbb1a-d4c1-5aec-9ffb-5e37701d499a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM47313',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 60925,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-28',
'seller_name': None,
'title': 'BMW 1er 118i M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2023}
2026-03-28 08:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM47313%27 HTTP/1.1" 200 None
2026-03-28 08:31:12 [auto1.be] INFO: Saving data for PM47313: {'auction_closing_time': 1774715929.0, 'created_time': 1774471111.480827, 'last_price_update_time': 1774686672.795689}
2026-03-28 08:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PM47313') HTTP/1.1" 204 0
2026-03-28 08:31:12 [auto1.be] INFO: Found listing with ID: FA19213
2026-03-28 08:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA19213%27 HTTP/1.1" 200 None
2026-03-28 08:31:12 [auto1.be] INFO: Scrape type for FA19213: 0
2026-03-28 08:31:12 [auto1.be] INFO: Found listing with ID: DC47068
2026-03-28 08:31:12 [auto1.be] INFO: Found listing with ID: TV03405
2026-03-28 08:31:12 [auto1.be] INFO: Found listing with ID: SJ45947
2026-03-28 08:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ45947%27 HTTP/1.1" 200 None
2026-03-28 08:31:12 [auto1.be] INFO: Scrape type for SJ45947: 0
2026-03-28 08:31:12 [auto1.be] INFO: Found listing with ID: PT93863
2026-03-28 08:31:12 [auto1.be] INFO: Found listing with ID: BP38818
2026-03-28 08:31:12 [auto1.be] INFO: Found listing with ID: DL13581
2026-03-28 08:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL13581%27 HTTP/1.1" 200 None
2026-03-28 08:31:12 [auto1.be] INFO: Scrape type for DL13581: 2
2026-03-28 08:31:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3c3753a-ae47-58f1-923e-7d8092dd3ad8 with identifier: DL13581
2026-03-28 08:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3c3753a-ae47-58f1-923e-7d8092dd3ad8 with scrape type 2
2026-03-28 08:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3c3753a-ae47-58f1-923e-7d8092dd3ad8 with scrape type 2
2026-03-28 08:31:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f3c3753a-ae47-58f1-923e-7d8092dd3ad8, identifier: DL13581
2026-03-28 08:31:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f3c3753a-ae47-58f1-923e-7d8092dd3ad8 with identifier: DL13581
2026-03-28 08:31:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f3c3753a-ae47-58f1-923e-7d8092dd3ad8 with identifier: DL13581
2026-03-28 08:31:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f3c3753a-ae47-58f1-923e-7d8092dd3ad8 with identifier: DL13581 to the API
2026-03-28 08:31:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:55:35Z',
'fuel_type': 'diesel',
'id': 'f3c3753a-ae47-58f1-923e-7d8092dd3ad8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL13581',
'listing': 'auction',
'make': 'Opel',
'model': 'Movano',
'odometer': 89805,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-18',
'seller_name': None,
'title': 'Opel Movano 2.3 Biturbo CDTI HKa L2H2 3,5t',
'transmission': 'manual',
'trim': 'HKa L2H2 3,5t',
'year': 2015}
2026-03-28 08:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL13581%27 HTTP/1.1" 200 None
2026-03-28 08:31:13 [auto1.be] INFO: Saving data for DL13581: {'auction_closing_time': 1774716935.0, 'created_time': 1773137136.836779, 'last_price_update_time': 1774686673.274418}
2026-03-28 08:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DL13581') HTTP/1.1" 204 0
2026-03-28 08:31:13 [auto1.be] INFO: Found listing with ID: UT96766
2026-03-28 08:31:13 [auto1.be] INFO: Found listing with ID: XM22406
2026-03-28 08:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM22406%27 HTTP/1.1" 200 None
2026-03-28 08:31:13 [auto1.be] INFO: Scrape type for XM22406: 2
2026-03-28 08:31:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 215bd3f8-50a9-57b0-8c42-40da0ef70881 with identifier: XM22406
2026-03-28 08:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 215bd3f8-50a9-57b0-8c42-40da0ef70881 with scrape type 2
2026-03-28 08:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 215bd3f8-50a9-57b0-8c42-40da0ef70881 with scrape type 2
2026-03-28 08:31:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 215bd3f8-50a9-57b0-8c42-40da0ef70881, identifier: XM22406
2026-03-28 08:31:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 215bd3f8-50a9-57b0-8c42-40da0ef70881 with identifier: XM22406
2026-03-28 08:31:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 215bd3f8-50a9-57b0-8c42-40da0ef70881 with identifier: XM22406
2026-03-28 08:31:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 215bd3f8-50a9-57b0-8c42-40da0ef70881 with identifier: XM22406 to the API
2026-03-28 08:31:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:29:27Z',
'fuel_type': 'petrol',
'id': '215bd3f8-50a9-57b0-8c42-40da0ef70881',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM22406',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Grand Picasso',
'odometer': 69000,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-25',
'seller_name': None,
'title': 'Citroen C4 Grand Picasso 1.2 PureTech Selection',
'transmission': 'automatic',
'trim': 'Selection',
'year': 2018}
2026-03-28 08:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM22406%27 HTTP/1.1" 200 None
2026-03-28 08:31:13 [auto1.be] INFO: Saving data for XM22406: {'auction_closing_time': 1774715367.0, 'created_time': 1774471337.041464, 'last_price_update_time': 1774686673.673665}
2026-03-28 08:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XM22406') HTTP/1.1" 204 0
2026-03-28 08:31:13 [auto1.be] INFO: Found listing with ID: XF11904
2026-03-28 08:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XF11904%27 HTTP/1.1" 200 None
2026-03-28 08:31:13 [auto1.be] INFO: Scrape type for XF11904: 0
2026-03-28 08:31:13 [auto1.be] INFO: Found listing with ID: WC57902
2026-03-28 08:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC57902%27 HTTP/1.1" 200 None
2026-03-28 08:31:13 [auto1.be] INFO: Scrape type for WC57902: 0
2026-03-28 08:31:13 [auto1.be] INFO: Found listing with ID: ER60484
2026-03-28 08:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER60484%27 HTTP/1.1" 200 None
2026-03-28 08:31:13 [auto1.be] INFO: Scrape type for ER60484: 2
2026-03-28 08:31:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01a57582-7b20-55e1-8848-ab1c74efcd23 with identifier: ER60484
2026-03-28 08:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01a57582-7b20-55e1-8848-ab1c74efcd23 with scrape type 2
2026-03-28 08:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01a57582-7b20-55e1-8848-ab1c74efcd23 with scrape type 2
2026-03-28 08:31:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 01a57582-7b20-55e1-8848-ab1c74efcd23, identifier: ER60484
2026-03-28 08:31:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 01a57582-7b20-55e1-8848-ab1c74efcd23 with identifier: ER60484
2026-03-28 08:31:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 01a57582-7b20-55e1-8848-ab1c74efcd23 with identifier: ER60484
2026-03-28 08:31:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 01a57582-7b20-55e1-8848-ab1c74efcd23 with identifier: ER60484 to the API
2026-03-28 08:31:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 60,
'expiration_date': '2026-03-28T16:22:37Z',
'fuel_type': 'petrol',
'id': '01a57582-7b20-55e1-8848-ab1c74efcd23',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER60484',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 151655,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-31',
'seller_name': None,
'title': 'Ford Fiesta 1.25 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2010}
2026-03-28 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER60484%27 HTTP/1.1" 200 None
2026-03-28 08:31:14 [auto1.be] INFO: Saving data for ER60484: {'auction_closing_time': 1774714957.0, 'created_time': 1774471321.092192, 'last_price_update_time': 1774686674.14471}
2026-03-28 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ER60484') HTTP/1.1" 204 0
2026-03-28 08:31:14 [auto1.be] INFO: Found listing with ID: MB05626
2026-03-28 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB05626%27 HTTP/1.1" 200 None
2026-03-28 08:31:14 [auto1.be] INFO: Scrape type for MB05626: 2
2026-03-28 08:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1ad33ac-afd3-55f9-883b-7e41b1dd1f6b with identifier: MB05626
2026-03-28 08:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1ad33ac-afd3-55f9-883b-7e41b1dd1f6b with scrape type 2
2026-03-28 08:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1ad33ac-afd3-55f9-883b-7e41b1dd1f6b with scrape type 2
2026-03-28 08:31:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d1ad33ac-afd3-55f9-883b-7e41b1dd1f6b, identifier: MB05626
2026-03-28 08:31:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d1ad33ac-afd3-55f9-883b-7e41b1dd1f6b with identifier: MB05626
2026-03-28 08:31:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d1ad33ac-afd3-55f9-883b-7e41b1dd1f6b with identifier: MB05626
2026-03-28 08:31:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d1ad33ac-afd3-55f9-883b-7e41b1dd1f6b with identifier: MB05626 to the API
2026-03-28 08:31:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:36:24Z',
'fuel_type': 'diesel',
'id': 'd1ad33ac-afd3-55f9-883b-7e41b1dd1f6b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB05626',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 246154,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-14',
'seller_name': None,
'title': 'Ford Fiesta 1.6 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2011}
2026-03-28 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB05626%27 HTTP/1.1" 200 None
2026-03-28 08:31:14 [auto1.be] INFO: Saving data for MB05626: {'auction_closing_time': 1774715784.0, 'created_time': 1773233585.665642, 'last_price_update_time': 1774686674.644277}
2026-03-28 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MB05626') HTTP/1.1" 204 0
2026-03-28 08:31:14 [auto1.be] INFO: Found listing with ID: ZG50395
2026-03-28 08:31:14 [auto1.be] INFO: Found listing with ID: NF63760
2026-03-28 08:31:14 [auto1.be] INFO: Found listing with ID: TC10006
2026-03-28 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC10006%27 HTTP/1.1" 200 None
2026-03-28 08:31:14 [auto1.be] INFO: Scrape type for TC10006: 0
2026-03-28 08:31:14 [auto1.be] INFO: Found listing with ID: MX90898
2026-03-28 08:31:14 [auto1.be] INFO: Found listing with ID: DD08232
2026-03-28 08:31:14 [auto1.be] INFO: Found listing with ID: HZ06807
2026-03-28 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ06807%27 HTTP/1.1" 200 None
2026-03-28 08:31:14 [auto1.be] INFO: Scrape type for HZ06807: 0
2026-03-28 08:31:14 [auto1.be] INFO: Found listing with ID: HU32342
2026-03-28 08:31:14 [auto1.be] INFO: Found listing with ID: HB89666
2026-03-28 08:31:14 [auto1.be] INFO: Found listing with ID: TC70277
2026-03-28 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC70277%27 HTTP/1.1" 200 None
2026-03-28 08:31:14 [auto1.be] INFO: Scrape type for TC70277: 0
2026-03-28 08:31:14 [auto1.be] INFO: Found listing with ID: RB45642
2026-03-28 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB45642%27 HTTP/1.1" 200 None
2026-03-28 08:31:14 [auto1.be] INFO: Scrape type for RB45642: 2
2026-03-28 08:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f2b3857-e4e3-54e2-985b-9512fd93634d with identifier: RB45642
2026-03-28 08:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f2b3857-e4e3-54e2-985b-9512fd93634d with scrape type 2
2026-03-28 08:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f2b3857-e4e3-54e2-985b-9512fd93634d with scrape type 2
2026-03-28 08:31:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1f2b3857-e4e3-54e2-985b-9512fd93634d, identifier: RB45642
2026-03-28 08:31:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1f2b3857-e4e3-54e2-985b-9512fd93634d with identifier: RB45642
2026-03-28 08:31:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1f2b3857-e4e3-54e2-985b-9512fd93634d with identifier: RB45642
2026-03-28 08:31:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1f2b3857-e4e3-54e2-985b-9512fd93634d with identifier: RB45642 to the API
2026-03-28 08:31:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-28T16:30:22Z',
'fuel_type': 'diesel',
'id': '1f2b3857-e4e3-54e2-985b-9512fd93634d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB45642',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Sports Tourer',
'odometer': 211729,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-01',
'seller_name': None,
'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
'transmission': 'manual',
'trim': 'Innovation',
'year': 2015}
2026-03-28 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB45642%27 HTTP/1.1" 200 None
2026-03-28 08:31:15 [auto1.be] INFO: Saving data for RB45642: {'auction_closing_time': 1774715422.0, 'created_time': 1774471347.635249, 'last_price_update_time': 1774686675.137103}
2026-03-28 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RB45642') HTTP/1.1" 204 0
2026-03-28 08:31:15 [auto1.be] INFO: Found listing with ID: HE95946
2026-03-28 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE95946%27 HTTP/1.1" 200 None
2026-03-28 08:31:15 [auto1.be] INFO: Scrape type for HE95946: 0
2026-03-28 08:31:15 [auto1.be] INFO: Found listing with ID: AD25511
2026-03-28 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD25511%27 HTTP/1.1" 200 None
2026-03-28 08:31:15 [auto1.be] INFO: Scrape type for AD25511: 2
2026-03-28 08:31:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b955e87a-7272-5d3e-81a4-3ded700c9eb2 with identifier: AD25511
2026-03-28 08:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b955e87a-7272-5d3e-81a4-3ded700c9eb2 with scrape type 2
2026-03-28 08:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b955e87a-7272-5d3e-81a4-3ded700c9eb2 with scrape type 2
2026-03-28 08:31:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b955e87a-7272-5d3e-81a4-3ded700c9eb2, identifier: AD25511
2026-03-28 08:31:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b955e87a-7272-5d3e-81a4-3ded700c9eb2 with identifier: AD25511
2026-03-28 08:31:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b955e87a-7272-5d3e-81a4-3ded700c9eb2 with identifier: AD25511
2026-03-28 08:31:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b955e87a-7272-5d3e-81a4-3ded700c9eb2 with identifier: AD25511 to the API
2026-03-28 08:31:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:07:02Z',
'fuel_type': 'petrol',
'id': 'b955e87a-7272-5d3e-81a4-3ded700c9eb2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD25511',
'listing': 'auction',
'make': 'Fiat',
'model': 'Punto',
'odometer': 38314,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-29',
'seller_name': None,
'title': 'Fiat Punto 1.2 MYSTYLE',
'transmission': 'manual',
'trim': 'MYSTYLE',
'year': 2015}
2026-03-28 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD25511%27 HTTP/1.1" 200 None
2026-03-28 08:31:15 [auto1.be] INFO: Saving data for AD25511: {'auction_closing_time': 1774714022.0, 'created_time': 1774471348.977896, 'last_price_update_time': 1774686675.657363}
2026-03-28 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AD25511') HTTP/1.1" 204 0
2026-03-28 08:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:31:16 [auto1.be] INFO: Channel: 24h | Page: 15 | totalHits: 1701 | hits on page: 40
2026-03-28 08:31:16 [auto1.be] INFO: Found listing with ID: DZ24480
2026-03-28 08:31:16 [auto1.be] INFO: Found listing with ID: MB15920
2026-03-28 08:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB15920%27 HTTP/1.1" 200 None
2026-03-28 08:31:16 [auto1.be] INFO: Scrape type for MB15920: 0
2026-03-28 08:31:16 [auto1.be] INFO: Found listing with ID: JD48468
2026-03-28 08:31:16 [auto1.be] INFO: Found listing with ID: MN54564
2026-03-28 08:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MN54564%27 HTTP/1.1" 200 None
2026-03-28 08:31:16 [auto1.be] INFO: Scrape type for MN54564: 0
2026-03-28 08:31:16 [auto1.be] INFO: Found listing with ID: CH83928
2026-03-28 08:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH83928%27 HTTP/1.1" 200 None
2026-03-28 08:31:16 [auto1.be] INFO: Scrape type for CH83928: 0
2026-03-28 08:31:16 [auto1.be] INFO: Found listing with ID: JR78742
2026-03-28 08:31:16 [auto1.be] INFO: Found listing with ID: UM95648
2026-03-28 08:31:16 [auto1.be] INFO: Found listing with ID: DF09339
2026-03-28 08:31:16 [auto1.be] INFO: Found listing with ID: AN55129
2026-03-28 08:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AN55129%27 HTTP/1.1" 200 None
2026-03-28 08:31:16 [auto1.be] INFO: Scrape type for AN55129: 0
2026-03-28 08:31:16 [auto1.be] INFO: Found listing with ID: TK17368
2026-03-28 08:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK17368%27 HTTP/1.1" 200 None
2026-03-28 08:31:16 [auto1.be] INFO: Scrape type for TK17368: 2
2026-03-28 08:31:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d550628b-0c86-5a81-9d49-b856d92814bd with identifier: TK17368
2026-03-28 08:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d550628b-0c86-5a81-9d49-b856d92814bd with scrape type 2
2026-03-28 08:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d550628b-0c86-5a81-9d49-b856d92814bd with scrape type 2
2026-03-28 08:31:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d550628b-0c86-5a81-9d49-b856d92814bd, identifier: TK17368
2026-03-28 08:31:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d550628b-0c86-5a81-9d49-b856d92814bd with identifier: TK17368
2026-03-28 08:31:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 08:31:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 08:31:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 08:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 08:31:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d550628b-0c86-5a81-9d49-b856d92814bd with identifier: TK17368
2026-03-28 08:31:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d550628b-0c86-5a81-9d49-b856d92814bd with identifier: TK17368 to the API
2026-03-28 08:31:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-28T16:09:49Z',
'fuel_type': 'petrol',
'id': 'd550628b-0c86-5a81-9d49-b856d92814bd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK17368',
'listing': 'auction',
'make': 'Citroen',
'model': 'C1',
'odometer': 144233,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-11',
'seller_name': None,
'title': 'Citroen C1 1.0 Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2012}
2026-03-28 08:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK17368%27 HTTP/1.1" 200 None
2026-03-28 08:31:16 [auto1.be] INFO: Saving data for TK17368: {'auction_closing_time': 1774714189.0, 'created_time': 1774471142.453537, 'last_price_update_time': 1774686676.953291}
2026-03-28 08:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TK17368') HTTP/1.1" 204 0
2026-03-28 08:31:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:31:17 [auto1.be] INFO: Found listing with ID: VD47423
2026-03-28 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VD47423%27 HTTP/1.1" 200 None
2026-03-28 08:31:17 [auto1.be] INFO: Scrape type for VD47423: 2
2026-03-28 08:31:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 938c6a05-e1c1-5356-96ef-6dd8db57b218 with identifier: VD47423
2026-03-28 08:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 938c6a05-e1c1-5356-96ef-6dd8db57b218 with scrape type 2
2026-03-28 08:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 938c6a05-e1c1-5356-96ef-6dd8db57b218 with scrape type 2
2026-03-28 08:31:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 938c6a05-e1c1-5356-96ef-6dd8db57b218, identifier: VD47423
2026-03-28 08:31:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 938c6a05-e1c1-5356-96ef-6dd8db57b218 with identifier: VD47423
2026-03-28 08:31:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 938c6a05-e1c1-5356-96ef-6dd8db57b218 with identifier: VD47423
2026-03-28 08:31:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 938c6a05-e1c1-5356-96ef-6dd8db57b218 with identifier: VD47423 to the API
2026-03-28 08:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:27:17Z',
'fuel_type': 'diesel',
'id': '938c6a05-e1c1-5356-96ef-6dd8db57b218',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD47423',
'listing': 'auction',
'make': 'Peugeot',
'model': '5008',
'odometer': 125508,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-27',
'seller_name': None,
'title': 'Peugeot 5008 1.5 Blue-HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2018}
2026-03-28 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VD47423%27 HTTP/1.1" 200 None
2026-03-28 08:31:17 [auto1.be] INFO: Saving data for VD47423: {'auction_closing_time': 1774715237.0, 'created_time': 1774038829.643451, 'last_price_update_time': 1774686677.457415}
2026-03-28 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VD47423') HTTP/1.1" 204 0
2026-03-28 08:31:17 [auto1.be] INFO: Found listing with ID: VK66376
2026-03-28 08:31:17 [auto1.be] INFO: Found listing with ID: HH31888
2026-03-28 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH31888%27 HTTP/1.1" 200 None
2026-03-28 08:31:17 [auto1.be] INFO: Scrape type for HH31888: 2
2026-03-28 08:31:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4165f300-e924-541a-8460-0ec01588eafd with identifier: HH31888
2026-03-28 08:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4165f300-e924-541a-8460-0ec01588eafd with scrape type 2
2026-03-28 08:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4165f300-e924-541a-8460-0ec01588eafd with scrape type 2
2026-03-28 08:31:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4165f300-e924-541a-8460-0ec01588eafd, identifier: HH31888
2026-03-28 08:31:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4165f300-e924-541a-8460-0ec01588eafd with identifier: HH31888
2026-03-28 08:31:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4165f300-e924-541a-8460-0ec01588eafd with identifier: HH31888
2026-03-28 08:31:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4165f300-e924-541a-8460-0ec01588eafd with identifier: HH31888 to the API
2026-03-28 08:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:05:48Z',
'fuel_type': 'diesel',
'id': '4165f300-e924-541a-8460-0ec01588eafd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH31888',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 100468,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-30',
'seller_name': None,
'title': 'Volkswagen Caddy 2.0 TDI Kasten BlueMotion',
'transmission': 'manual',
'trim': 'Kasten BlueMotion',
'year': 2018}
2026-03-28 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH31888%27 HTTP/1.1" 200 None
2026-03-28 08:31:17 [auto1.be] INFO: Saving data for HH31888: {'auction_closing_time': 1774713948.0, 'created_time': 1773834006.364428, 'last_price_update_time': 1774686677.869284}
2026-03-28 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HH31888') HTTP/1.1" 204 0
2026-03-28 08:31:17 [auto1.be] INFO: Found listing with ID: KK24955
2026-03-28 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KK24955%27 HTTP/1.1" 200 None
2026-03-28 08:31:17 [auto1.be] INFO: Scrape type for KK24955: 0
2026-03-28 08:31:17 [auto1.be] INFO: Found listing with ID: UA82763
2026-03-28 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA82763%27 HTTP/1.1" 200 None
2026-03-28 08:31:17 [auto1.be] INFO: Scrape type for UA82763: 0
2026-03-28 08:31:17 [auto1.be] INFO: Found listing with ID: FZ81347
2026-03-28 08:31:17 [auto1.be] INFO: Found listing with ID: RK42644
2026-03-28 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK42644%27 HTTP/1.1" 200 None
2026-03-28 08:31:17 [auto1.be] INFO: Scrape type for RK42644: 0
2026-03-28 08:31:17 [auto1.be] INFO: Found listing with ID: VE77274
2026-03-28 08:31:17 [auto1.be] INFO: Found listing with ID: WB76864
2026-03-28 08:31:17 [auto1.be] INFO: Found listing with ID: MA06269
2026-03-28 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA06269%27 HTTP/1.1" 200 None
2026-03-28 08:31:17 [auto1.be] INFO: Scrape type for MA06269: 0
2026-03-28 08:31:17 [auto1.be] INFO: Found listing with ID: TS87931
2026-03-28 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS87931%27 HTTP/1.1" 200 None
2026-03-28 08:31:17 [auto1.be] INFO: Scrape type for TS87931: 0
2026-03-28 08:31:17 [auto1.be] INFO: Found listing with ID: AN88473
2026-03-28 08:31:17 [auto1.be] INFO: Found listing with ID: DD10151
2026-03-28 08:31:17 [auto1.be] INFO: Found listing with ID: NJ59863
2026-03-28 08:31:17 [auto1.be] INFO: Found listing with ID: TH59922
2026-03-28 08:31:17 [auto1.be] INFO: Found listing with ID: VF82058
2026-03-28 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF82058%27 HTTP/1.1" 200 None
2026-03-28 08:31:17 [auto1.be] INFO: Scrape type for VF82058: 2
2026-03-28 08:31:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2f56253-f119-5e68-b9ba-3d0df791518a with identifier: VF82058
2026-03-28 08:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2f56253-f119-5e68-b9ba-3d0df791518a with scrape type 2
2026-03-28 08:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2f56253-f119-5e68-b9ba-3d0df791518a with scrape type 2
2026-03-28 08:31:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f2f56253-f119-5e68-b9ba-3d0df791518a, identifier: VF82058
2026-03-28 08:31:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f2f56253-f119-5e68-b9ba-3d0df791518a with identifier: VF82058
2026-03-28 08:31:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f2f56253-f119-5e68-b9ba-3d0df791518a with identifier: VF82058
2026-03-28 08:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f2f56253-f119-5e68-b9ba-3d0df791518a with identifier: VF82058 to the API
2026-03-28 08:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:26:00Z',
'fuel_type': 'diesel',
'id': 'f2f56253-f119-5e68-b9ba-3d0df791518a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF82058',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia',
'odometer': 242208,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-04',
'seller_name': None,
'title': 'Opel Insignia 2.0 CDTI Cosmo Pack',
'transmission': 'manual',
'trim': 'Cosmo Pack',
'year': 2013}
2026-03-28 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF82058%27 HTTP/1.1" 200 None
2026-03-28 08:31:18 [auto1.be] INFO: Saving data for VF82058: {'auction_closing_time': 1774715160.0, 'created_time': 1774471083.141536, 'last_price_update_time': 1774686678.389406}
2026-03-28 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VF82058') HTTP/1.1" 204 0
2026-03-28 08:31:18 [auto1.be] INFO: Found listing with ID: FP68376
2026-03-28 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP68376%27 HTTP/1.1" 200 None
2026-03-28 08:31:18 [auto1.be] INFO: Scrape type for FP68376: 0
2026-03-28 08:31:18 [auto1.be] INFO: Found listing with ID: ZU13483
2026-03-28 08:31:18 [auto1.be] INFO: Found listing with ID: CZ74735
2026-03-28 08:31:18 [auto1.be] INFO: Found listing with ID: EC58285
2026-03-28 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EC58285%27 HTTP/1.1" 200 None
2026-03-28 08:31:18 [auto1.be] INFO: Scrape type for EC58285: 0
2026-03-28 08:31:18 [auto1.be] INFO: Found listing with ID: FT96499
2026-03-28 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT96499%27 HTTP/1.1" 200 None
2026-03-28 08:31:18 [auto1.be] INFO: Scrape type for FT96499: 0
2026-03-28 08:31:18 [auto1.be] INFO: Found listing with ID: EX63844
2026-03-28 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX63844%27 HTTP/1.1" 200 None
2026-03-28 08:31:18 [auto1.be] INFO: Scrape type for EX63844: 0
2026-03-28 08:31:18 [auto1.be] INFO: Found listing with ID: HH62001
2026-03-28 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH62001%27 HTTP/1.1" 200 None
2026-03-28 08:31:18 [auto1.be] INFO: Scrape type for HH62001: 0
2026-03-28 08:31:18 [auto1.be] INFO: Found listing with ID: UR73275
2026-03-28 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR73275%27 HTTP/1.1" 200 None
2026-03-28 08:31:18 [auto1.be] INFO: Scrape type for UR73275: 0
2026-03-28 08:31:18 [auto1.be] INFO: Found listing with ID: RF74485
2026-03-28 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF74485%27 HTTP/1.1" 200 None
2026-03-28 08:31:18 [auto1.be] INFO: Scrape type for RF74485: 0
2026-03-28 08:31:18 [auto1.be] INFO: Found listing with ID: ZM59718
2026-03-28 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM59718%27 HTTP/1.1" 200 None
2026-03-28 08:31:18 [auto1.be] INFO: Scrape type for ZM59718: 2
2026-03-28 08:31:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7d42ed9-b190-5364-8057-99e82cee8fd5 with identifier: ZM59718
2026-03-28 08:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7d42ed9-b190-5364-8057-99e82cee8fd5 with scrape type 2
2026-03-28 08:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7d42ed9-b190-5364-8057-99e82cee8fd5 with scrape type 2
2026-03-28 08:31:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c7d42ed9-b190-5364-8057-99e82cee8fd5, identifier: ZM59718
2026-03-28 08:31:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c7d42ed9-b190-5364-8057-99e82cee8fd5 with identifier: ZM59718
2026-03-28 08:31:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c7d42ed9-b190-5364-8057-99e82cee8fd5 with identifier: ZM59718
2026-03-28 08:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c7d42ed9-b190-5364-8057-99e82cee8fd5 with identifier: ZM59718 to the API
2026-03-28 08:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 180,
'expiration_date': '2026-03-28T16:27:21Z',
'fuel_type': 'petrol',
'id': 'c7d42ed9-b190-5364-8057-99e82cee8fd5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM59718',
'listing': 'auction',
'make': 'Volvo',
'model': 'S80',
'odometer': 242053,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-26',
'seller_name': None,
'title': 'Volvo S80 1.6 T4 Summum',
'transmission': 'manual',
'trim': 'Summum',
'year': 2012}
2026-03-28 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM59718%27 HTTP/1.1" 200 None
2026-03-28 08:31:19 [auto1.be] INFO: Saving data for ZM59718: {'auction_closing_time': 1774715241.0, 'created_time': 1774471373.300294, 'last_price_update_time': 1774686679.036967}
2026-03-28 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZM59718') HTTP/1.1" 204 0
2026-03-28 08:31:19 [auto1.be] INFO: Found listing with ID: YZ90167
2026-03-28 08:31:19 [auto1.be] INFO: Found listing with ID: HT59149
2026-03-28 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT59149%27 HTTP/1.1" 200 None
2026-03-28 08:31:19 [auto1.be] INFO: Scrape type for HT59149: 0
2026-03-28 08:31:19 [auto1.be] INFO: Found listing with ID: RV20515
2026-03-28 08:31:19 [auto1.be] INFO: Found listing with ID: VS47672
2026-03-28 08:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:31:19 [auto1.be] INFO: Channel: 24h | Page: 16 | totalHits: 1701 | hits on page: 40
2026-03-28 08:31:19 [auto1.be] INFO: Found listing with ID: AA49507
2026-03-28 08:31:19 [auto1.be] INFO: Found listing with ID: BZ90658
2026-03-28 08:31:19 [auto1.be] INFO: Found listing with ID: FW88759
2026-03-28 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW88759%27 HTTP/1.1" 200 None
2026-03-28 08:31:19 [auto1.be] INFO: Scrape type for FW88759: 0
2026-03-28 08:31:19 [auto1.be] INFO: Found listing with ID: HN52312
2026-03-28 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HN52312%27 HTTP/1.1" 200 None
2026-03-28 08:31:19 [auto1.be] INFO: Scrape type for HN52312: 2
2026-03-28 08:31:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 038816bd-2a50-5c0b-8adb-9e9c9ea38add with identifier: HN52312
2026-03-28 08:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 038816bd-2a50-5c0b-8adb-9e9c9ea38add with scrape type 2
2026-03-28 08:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 038816bd-2a50-5c0b-8adb-9e9c9ea38add with scrape type 2
2026-03-28 08:31:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 038816bd-2a50-5c0b-8adb-9e9c9ea38add, identifier: HN52312
2026-03-28 08:31:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 038816bd-2a50-5c0b-8adb-9e9c9ea38add with identifier: HN52312
2026-03-28 08:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 038816bd-2a50-5c0b-8adb-9e9c9ea38add with identifier: HN52312
2026-03-28 08:31:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 038816bd-2a50-5c0b-8adb-9e9c9ea38add with identifier: HN52312 to the API
2026-03-28 08:31:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:24:24Z',
'fuel_type': 'petrol',
'id': '038816bd-2a50-5c0b-8adb-9e9c9ea38add',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN52312',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 111672,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-09',
'seller_name': None,
'title': 'Peugeot 308 1.2 e-THP Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2019}
2026-03-28 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HN52312%27 HTTP/1.1" 200 None
2026-03-28 08:31:20 [auto1.be] INFO: Saving data for HN52312: {'auction_closing_time': 1774715064.0, 'created_time': 1774471333.32704, 'last_price_update_time': 1774686680.303646}
2026-03-28 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HN52312') HTTP/1.1" 204 0
2026-03-28 08:31:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:31:20 [auto1.be] INFO: Found listing with ID: CA69556
2026-03-28 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA69556%27 HTTP/1.1" 200 None
2026-03-28 08:31:20 [auto1.be] INFO: Scrape type for CA69556: 0
2026-03-28 08:31:20 [auto1.be] INFO: Found listing with ID: BP57356
2026-03-28 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP57356%27 HTTP/1.1" 200 None
2026-03-28 08:31:20 [auto1.be] INFO: Scrape type for BP57356: 2
2026-03-28 08:31:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc9637ce-5c94-577c-a2cd-fc4b62238749 with identifier: BP57356
2026-03-28 08:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc9637ce-5c94-577c-a2cd-fc4b62238749 with scrape type 2
2026-03-28 08:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc9637ce-5c94-577c-a2cd-fc4b62238749 with scrape type 2
2026-03-28 08:31:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fc9637ce-5c94-577c-a2cd-fc4b62238749, identifier: BP57356
2026-03-28 08:31:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fc9637ce-5c94-577c-a2cd-fc4b62238749 with identifier: BP57356
2026-03-28 08:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fc9637ce-5c94-577c-a2cd-fc4b62238749 with identifier: BP57356
2026-03-28 08:31:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fc9637ce-5c94-577c-a2cd-fc4b62238749 with identifier: BP57356 to the API
2026-03-28 08:31:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:46:08Z',
'fuel_type': 'diesel',
'id': 'fc9637ce-5c94-577c-a2cd-fc4b62238749',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP57356',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 151584,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'BMW 2er 218d M Sport',
'transmission': 'manual',
'trim': 'M Sport',
'year': 2018}
2026-03-28 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP57356%27 HTTP/1.1" 200 None
2026-03-28 08:31:20 [auto1.be] INFO: Saving data for BP57356: {'auction_closing_time': 1774716368.0, 'created_time': 1774470940.972392, 'last_price_update_time': 1774686680.814799}
2026-03-28 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BP57356') HTTP/1.1" 204 0
2026-03-28 08:31:20 [auto1.be] INFO: Found listing with ID: JZ31869
2026-03-28 08:31:20 [auto1.be] INFO: Found listing with ID: ZG73435
2026-03-28 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG73435%27 HTTP/1.1" 200 None
2026-03-28 08:31:20 [auto1.be] INFO: Scrape type for ZG73435: 0
2026-03-28 08:31:20 [auto1.be] INFO: Found listing with ID: YK49914
2026-03-28 08:31:20 [auto1.be] INFO: Found listing with ID: LT47332
2026-03-28 08:31:20 [auto1.be] INFO: Found listing with ID: TG38013
2026-03-28 08:31:20 [auto1.be] INFO: Found listing with ID: BN53670
2026-03-28 08:31:20 [auto1.be] INFO: Found listing with ID: ET01802
2026-03-28 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET01802%27 HTTP/1.1" 200 None
2026-03-28 08:31:20 [auto1.be] INFO: Scrape type for ET01802: 0
2026-03-28 08:31:20 [auto1.be] INFO: Found listing with ID: NN42676
2026-03-28 08:31:20 [auto1.be] INFO: Found listing with ID: SD53912
2026-03-28 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD53912%27 HTTP/1.1" 200 None
2026-03-28 08:31:20 [auto1.be] INFO: Scrape type for SD53912: 0
2026-03-28 08:31:20 [auto1.be] INFO: Found listing with ID: GC32489
2026-03-28 08:31:20 [auto1.be] INFO: Found listing with ID: YW10235
2026-03-28 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW10235%27 HTTP/1.1" 200 None
2026-03-28 08:31:20 [auto1.be] INFO: Scrape type for YW10235: 2
2026-03-28 08:31:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 563c2779-3e68-5a61-af0c-4e0f0d23a4d8 with identifier: YW10235
2026-03-28 08:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 563c2779-3e68-5a61-af0c-4e0f0d23a4d8 with scrape type 2
2026-03-28 08:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 563c2779-3e68-5a61-af0c-4e0f0d23a4d8 with scrape type 2
2026-03-28 08:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 563c2779-3e68-5a61-af0c-4e0f0d23a4d8, identifier: YW10235
2026-03-28 08:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 563c2779-3e68-5a61-af0c-4e0f0d23a4d8 with identifier: YW10235
2026-03-28 08:31:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 563c2779-3e68-5a61-af0c-4e0f0d23a4d8 with identifier: YW10235
2026-03-28 08:31:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 563c2779-3e68-5a61-af0c-4e0f0d23a4d8 with identifier: YW10235 to the API
2026-03-28 08:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:27:09Z',
'fuel_type': 'diesel',
'id': '563c2779-3e68-5a61-af0c-4e0f0d23a4d8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW10235',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 105281,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-18',
'seller_name': None,
'title': 'Ford Mondeo 1.5 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2017}
2026-03-28 08:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW10235%27 HTTP/1.1" 200 None
2026-03-28 08:31:21 [auto1.be] INFO: Saving data for YW10235: {'auction_closing_time': 1774715229.0, 'created_time': 1774471186.728795, 'last_price_update_time': 1774686681.364353}
2026-03-28 08:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YW10235') HTTP/1.1" 204 0
2026-03-28 08:31:21 [auto1.be] INFO: Found listing with ID: PP48497
2026-03-28 08:31:21 [auto1.be] INFO: Found listing with ID: WP70532
2026-03-28 08:31:21 [auto1.be] INFO: Found listing with ID: AN69845
2026-03-28 08:31:21 [auto1.be] INFO: Found listing with ID: MS53866
2026-03-28 08:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS53866%27 HTTP/1.1" 200 None
2026-03-28 08:31:21 [auto1.be] INFO: Scrape type for MS53866: 0
2026-03-28 08:31:21 [auto1.be] INFO: Found listing with ID: MG81689
2026-03-28 08:31:21 [auto1.be] INFO: Found listing with ID: WG15817
2026-03-28 08:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG15817%27 HTTP/1.1" 200 None
2026-03-28 08:31:21 [auto1.be] INFO: Scrape type for WG15817: 2
2026-03-28 08:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8906bb36-92e9-546b-84cd-438359ab8f2d with identifier: WG15817
2026-03-28 08:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8906bb36-92e9-546b-84cd-438359ab8f2d with scrape type 2
2026-03-28 08:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8906bb36-92e9-546b-84cd-438359ab8f2d with scrape type 2
2026-03-28 08:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8906bb36-92e9-546b-84cd-438359ab8f2d, identifier: WG15817
2026-03-28 08:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8906bb36-92e9-546b-84cd-438359ab8f2d with identifier: WG15817
2026-03-28 08:31:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8906bb36-92e9-546b-84cd-438359ab8f2d with identifier: WG15817
2026-03-28 08:31:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8906bb36-92e9-546b-84cd-438359ab8f2d with identifier: WG15817 to the API
2026-03-28 08:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-28T16:27:40Z',
'fuel_type': 'diesel',
'id': '8906bb36-92e9-546b-84cd-438359ab8f2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG15817',
'listing': 'auction',
'make': 'BMW',
'model': 'X4',
'odometer': 233817,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-26',
'seller_name': None,
'title': 'BMW X4 xDrive 20d',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-28 08:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG15817%27 HTTP/1.1" 200 None
2026-03-28 08:31:21 [auto1.be] INFO: Saving data for WG15817: {'auction_closing_time': 1774715260.0, 'created_time': 1773233771.223036, 'last_price_update_time': 1774686681.898929}
2026-03-28 08:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WG15817') HTTP/1.1" 204 0
2026-03-28 08:31:21 [auto1.be] INFO: Found listing with ID: JA16064
2026-03-28 08:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JA16064%27 HTTP/1.1" 200 None
2026-03-28 08:31:21 [auto1.be] INFO: Scrape type for JA16064: 0
2026-03-28 08:31:21 [auto1.be] INFO: Found listing with ID: JU85415
2026-03-28 08:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU85415%27 HTTP/1.1" 200 None
2026-03-28 08:31:21 [auto1.be] INFO: Scrape type for JU85415: 2
2026-03-28 08:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19a2f725-7ce7-568b-840c-1b85e8df4446 with identifier: JU85415
2026-03-28 08:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19a2f725-7ce7-568b-840c-1b85e8df4446 with scrape type 2
2026-03-28 08:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19a2f725-7ce7-568b-840c-1b85e8df4446 with scrape type 2
2026-03-28 08:31:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 19a2f725-7ce7-568b-840c-1b85e8df4446, identifier: JU85415
2026-03-28 08:31:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 19a2f725-7ce7-568b-840c-1b85e8df4446 with identifier: JU85415
2026-03-28 08:31:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 19a2f725-7ce7-568b-840c-1b85e8df4446 with identifier: JU85415
2026-03-28 08:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 19a2f725-7ce7-568b-840c-1b85e8df4446 with identifier: JU85415 to the API
2026-03-28 08:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:11:56Z',
'fuel_type': 'diesel',
'id': '19a2f725-7ce7-568b-840c-1b85e8df4446',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU85415',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat CC',
'odometer': 203178,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-07-31',
'seller_name': None,
'title': 'Volkswagen Passat CC 2.0 TDI 4Motion BlueMotion',
'transmission': 'automatic',
'trim': '4Motion BlueMotion',
'year': 2011}
2026-03-28 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU85415%27 HTTP/1.1" 200 None
2026-03-28 08:31:22 [auto1.be] INFO: Saving data for JU85415: {'auction_closing_time': 1774714316.0, 'created_time': 1774506732.954355, 'last_price_update_time': 1774686682.336939}
2026-03-28 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JU85415') HTTP/1.1" 204 0
2026-03-28 08:31:22 [auto1.be] INFO: Found listing with ID: BF20284
2026-03-28 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BF20284%27 HTTP/1.1" 200 None
2026-03-28 08:31:22 [auto1.be] INFO: Scrape type for BF20284: 2
2026-03-28 08:31:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e34f81a2-1012-5daa-9ac7-6ec08213912f with identifier: BF20284
2026-03-28 08:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e34f81a2-1012-5daa-9ac7-6ec08213912f with scrape type 2
2026-03-28 08:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e34f81a2-1012-5daa-9ac7-6ec08213912f with scrape type 2
2026-03-28 08:31:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e34f81a2-1012-5daa-9ac7-6ec08213912f, identifier: BF20284
2026-03-28 08:31:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e34f81a2-1012-5daa-9ac7-6ec08213912f with identifier: BF20284
2026-03-28 08:31:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e34f81a2-1012-5daa-9ac7-6ec08213912f with identifier: BF20284
2026-03-28 08:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e34f81a2-1012-5daa-9ac7-6ec08213912f with identifier: BF20284 to the API
2026-03-28 08:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:40:02Z',
'fuel_type': 'petrol',
'id': 'e34f81a2-1012-5daa-9ac7-6ec08213912f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF20284',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i30',
'odometer': 182640,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-07-19',
'seller_name': None,
'title': 'Hyundai i30 1.6 GDI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2015}
2026-03-28 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BF20284%27 HTTP/1.1" 200 None
2026-03-28 08:31:22 [auto1.be] INFO: Saving data for BF20284: {'auction_closing_time': 1774716002.0, 'created_time': 1774471296.553862, 'last_price_update_time': 1774686682.756994}
2026-03-28 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BF20284') HTTP/1.1" 204 0
2026-03-28 08:31:22 [auto1.be] INFO: Found listing with ID: BY76075
2026-03-28 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY76075%27 HTTP/1.1" 200 None
2026-03-28 08:31:22 [auto1.be] INFO: Scrape type for BY76075: 2
2026-03-28 08:31:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80223218-a136-5525-b5cd-05feac05290c with identifier: BY76075
2026-03-28 08:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80223218-a136-5525-b5cd-05feac05290c with scrape type 2
2026-03-28 08:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80223218-a136-5525-b5cd-05feac05290c with scrape type 2
2026-03-28 08:31:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 80223218-a136-5525-b5cd-05feac05290c, identifier: BY76075
2026-03-28 08:31:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 80223218-a136-5525-b5cd-05feac05290c with identifier: BY76075
2026-03-28 08:31:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 80223218-a136-5525-b5cd-05feac05290c with identifier: BY76075
2026-03-28 08:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 80223218-a136-5525-b5cd-05feac05290c with identifier: BY76075 to the API
2026-03-28 08:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:53:58Z',
'fuel_type': 'diesel',
'id': '80223218-a136-5525-b5cd-05feac05290c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY76075',
'listing': 'auction',
'make': 'Citroen',
'model': 'C6',
'odometer': 264905,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-17',
'seller_name': None,
'title': 'Citroen C6 2.2 HDi Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2010}
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY76075%27 HTTP/1.1" 200 None
2026-03-28 08:31:23 [auto1.be] INFO: Saving data for BY76075: {'auction_closing_time': 1774716838.0, 'created_time': 1774471307.944899, 'last_price_update_time': 1774686683.19392}
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BY76075') HTTP/1.1" 204 0
2026-03-28 08:31:23 [auto1.be] INFO: Found listing with ID: UE43146
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE43146%27 HTTP/1.1" 200 None
2026-03-28 08:31:23 [auto1.be] INFO: Scrape type for UE43146: 0
2026-03-28 08:31:23 [auto1.be] INFO: Found listing with ID: MU18005
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MU18005%27 HTTP/1.1" 200 None
2026-03-28 08:31:23 [auto1.be] INFO: Scrape type for MU18005: 0
2026-03-28 08:31:23 [auto1.be] INFO: Found listing with ID: NG50909
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG50909%27 HTTP/1.1" 200 None
2026-03-28 08:31:23 [auto1.be] INFO: Scrape type for NG50909: 0
2026-03-28 08:31:23 [auto1.be] INFO: Found listing with ID: JT25813
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT25813%27 HTTP/1.1" 200 None
2026-03-28 08:31:23 [auto1.be] INFO: Scrape type for JT25813: 0
2026-03-28 08:31:23 [auto1.be] INFO: Found listing with ID: LE58292
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE58292%27 HTTP/1.1" 200 None
2026-03-28 08:31:23 [auto1.be] INFO: Scrape type for LE58292: 0
2026-03-28 08:31:23 [auto1.be] INFO: Found listing with ID: TV14945
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV14945%27 HTTP/1.1" 200 None
2026-03-28 08:31:23 [auto1.be] INFO: Scrape type for TV14945: 0
2026-03-28 08:31:23 [auto1.be] INFO: Found listing with ID: WE56106
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE56106%27 HTTP/1.1" 200 None
2026-03-28 08:31:23 [auto1.be] INFO: Scrape type for WE56106: 0
2026-03-28 08:31:23 [auto1.be] INFO: Found listing with ID: RW49064
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW49064%27 HTTP/1.1" 200 None
2026-03-28 08:31:23 [auto1.be] INFO: Scrape type for RW49064: 0
2026-03-28 08:31:23 [auto1.be] INFO: Found listing with ID: AH50870
2026-03-28 08:31:23 [auto1.be] INFO: Found listing with ID: LY58233
2026-03-28 08:31:23 [auto1.be] INFO: Found listing with ID: TF91319
2026-03-28 08:31:23 [auto1.be] INFO: Found listing with ID: ZP07177
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP07177%27 HTTP/1.1" 200 None
2026-03-28 08:31:23 [auto1.be] INFO: Scrape type for ZP07177: 0
2026-03-28 08:31:23 [auto1.be] INFO: Found listing with ID: HS23763
2026-03-28 08:31:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:31:23 [auto1.be] INFO: Channel: 24h | Page: 17 | totalHits: 1701 | hits on page: 40
2026-03-28 08:31:23 [auto1.be] INFO: Found listing with ID: KU12802
2026-03-28 08:31:23 [auto1.be] INFO: Found listing with ID: VE53331
2026-03-28 08:31:23 [auto1.be] INFO: Found listing with ID: KS30497
2026-03-28 08:31:23 [auto1.be] INFO: Found listing with ID: WJ28865
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ28865%27 HTTP/1.1" 200 None
2026-03-28 08:31:23 [auto1.be] INFO: Scrape type for WJ28865: 0
2026-03-28 08:31:23 [auto1.be] INFO: Found listing with ID: SA78346
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA78346%27 HTTP/1.1" 200 None
2026-03-28 08:31:23 [auto1.be] INFO: Scrape type for SA78346: 0
2026-03-28 08:31:23 [auto1.be] INFO: Found listing with ID: EB09170
2026-03-28 08:31:23 [auto1.be] INFO: Found listing with ID: HB59251
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB59251%27 HTTP/1.1" 200 None
2026-03-28 08:31:23 [auto1.be] INFO: Scrape type for HB59251: 0
2026-03-28 08:31:23 [auto1.be] INFO: Found listing with ID: GU08447
2026-03-28 08:31:23 [auto1.be] INFO: Found listing with ID: SE01545
2026-03-28 08:31:23 [auto1.be] INFO: Found listing with ID: YS62292
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS62292%27 HTTP/1.1" 200 None
2026-03-28 08:31:23 [auto1.be] INFO: Scrape type for YS62292: 0
2026-03-28 08:31:23 [auto1.be] INFO: Found listing with ID: JF05397
2026-03-28 08:31:23 [auto1.be] INFO: Found listing with ID: GG74067
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG74067%27 HTTP/1.1" 200 None
2026-03-28 08:31:23 [auto1.be] INFO: Scrape type for GG74067: 0
2026-03-28 08:31:23 [auto1.be] INFO: Found listing with ID: PZ19137
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PZ19137%27 HTTP/1.1" 200 None
2026-03-28 08:31:23 [auto1.be] INFO: Scrape type for PZ19137: 2
2026-03-28 08:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c041fce-eadf-5881-ae9d-c4a51dcef0a8 with identifier: PZ19137
2026-03-28 08:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c041fce-eadf-5881-ae9d-c4a51dcef0a8 with scrape type 2
2026-03-28 08:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c041fce-eadf-5881-ae9d-c4a51dcef0a8 with scrape type 2
2026-03-28 08:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8c041fce-eadf-5881-ae9d-c4a51dcef0a8, identifier: PZ19137
2026-03-28 08:31:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8c041fce-eadf-5881-ae9d-c4a51dcef0a8 with identifier: PZ19137
2026-03-28 08:31:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8c041fce-eadf-5881-ae9d-c4a51dcef0a8 with identifier: PZ19137
2026-03-28 08:31:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8c041fce-eadf-5881-ae9d-c4a51dcef0a8 with identifier: PZ19137 to the API
2026-03-28 08:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:15:38Z',
'fuel_type': 'petrol',
'id': '8c041fce-eadf-5881-ae9d-c4a51dcef0a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ19137',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 51294,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-06-13',
'seller_name': None,
'title': 'BMW 1er 118i Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2019}
2026-03-28 08:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PZ19137%27 HTTP/1.1" 200 None
2026-03-28 08:31:24 [auto1.be] INFO: Saving data for PZ19137: {'auction_closing_time': 1774714538.0, 'created_time': 1774471309.465563, 'last_price_update_time': 1774686684.649744}
2026-03-28 08:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PZ19137') HTTP/1.1" 204 0
2026-03-28 08:31:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:31:24 [auto1.be] INFO: Found listing with ID: ZV64637
2026-03-28 08:31:24 [auto1.be] INFO: Found listing with ID: JS12412
2026-03-28 08:31:24 [auto1.be] INFO: Found listing with ID: YW35122
2026-03-28 08:31:24 [auto1.be] INFO: Found listing with ID: VP65458
2026-03-28 08:31:24 [auto1.be] INFO: Found listing with ID: BU16802
2026-03-28 08:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU16802%27 HTTP/1.1" 200 None
2026-03-28 08:31:24 [auto1.be] INFO: Scrape type for BU16802: 0
2026-03-28 08:31:24 [auto1.be] INFO: Found listing with ID: XK31036
2026-03-28 08:31:24 [auto1.be] INFO: Found listing with ID: CS98471
2026-03-28 08:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS98471%27 HTTP/1.1" 200 None
2026-03-28 08:31:24 [auto1.be] INFO: Scrape type for CS98471: 0
2026-03-28 08:31:24 [auto1.be] INFO: Found listing with ID: XJ82974
2026-03-28 08:31:24 [auto1.be] INFO: Found listing with ID: RB53949
2026-03-28 08:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB53949%27 HTTP/1.1" 200 None
2026-03-28 08:31:24 [auto1.be] INFO: Scrape type for RB53949: 0
2026-03-28 08:31:24 [auto1.be] INFO: Found listing with ID: LB84163
2026-03-28 08:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB84163%27 HTTP/1.1" 200 None
2026-03-28 08:31:24 [auto1.be] INFO: Scrape type for LB84163: 2
2026-03-28 08:31:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc5b66b6-b926-5757-b59b-4994e029d891 with identifier: LB84163
2026-03-28 08:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc5b66b6-b926-5757-b59b-4994e029d891 with scrape type 2
2026-03-28 08:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc5b66b6-b926-5757-b59b-4994e029d891 with scrape type 2
2026-03-28 08:31:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cc5b66b6-b926-5757-b59b-4994e029d891, identifier: LB84163
2026-03-28 08:31:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cc5b66b6-b926-5757-b59b-4994e029d891 with identifier: LB84163
2026-03-28 08:31:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cc5b66b6-b926-5757-b59b-4994e029d891 with identifier: LB84163
2026-03-28 08:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cc5b66b6-b926-5757-b59b-4994e029d891 with identifier: LB84163 to the API
2026-03-28 08:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:24:23Z',
'fuel_type': 'petrol',
'id': 'cc5b66b6-b926-5757-b59b-4994e029d891',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB84163',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 223037,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-18',
'seller_name': None,
'title': 'Ford Kuga 1.6 EcoBoost Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2013}
2026-03-28 08:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB84163%27 HTTP/1.1" 200 None
2026-03-28 08:31:25 [auto1.be] INFO: Saving data for LB84163: {'auction_closing_time': 1774715063.0, 'created_time': 1774471175.105652, 'last_price_update_time': 1774686685.219269}
2026-03-28 08:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LB84163') HTTP/1.1" 204 0
2026-03-28 08:31:25 [auto1.be] INFO: Found listing with ID: XG51748
2026-03-28 08:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG51748%27 HTTP/1.1" 200 None
2026-03-28 08:31:25 [auto1.be] INFO: Scrape type for XG51748: 2
2026-03-28 08:31:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf9e25e0-0f18-57a0-b15a-7bb868603a19 with identifier: XG51748
2026-03-28 08:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf9e25e0-0f18-57a0-b15a-7bb868603a19 with scrape type 2
2026-03-28 08:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf9e25e0-0f18-57a0-b15a-7bb868603a19 with scrape type 2
2026-03-28 08:31:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cf9e25e0-0f18-57a0-b15a-7bb868603a19, identifier: XG51748
2026-03-28 08:31:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cf9e25e0-0f18-57a0-b15a-7bb868603a19 with identifier: XG51748
2026-03-28 08:31:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cf9e25e0-0f18-57a0-b15a-7bb868603a19 with identifier: XG51748
2026-03-28 08:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cf9e25e0-0f18-57a0-b15a-7bb868603a19 with identifier: XG51748 to the API
2026-03-28 08:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:28:24Z',
'fuel_type': 'diesel',
'id': 'cf9e25e0-0f18-57a0-b15a-7bb868603a19',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG51748',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 130578,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-22',
'seller_name': None,
'title': 'Land Rover Evoque 2.0 Td4 SE',
'transmission': 'manual',
'trim': 'SE',
'year': 2017}
2026-03-28 08:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG51748%27 HTTP/1.1" 200 None
2026-03-28 08:31:25 [auto1.be] INFO: Saving data for XG51748: {'auction_closing_time': 1774715304.0, 'created_time': 1773301626.202454, 'last_price_update_time': 1774686685.706488}
2026-03-28 08:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XG51748') HTTP/1.1" 204 0
2026-03-28 08:31:25 [auto1.be] INFO: Found listing with ID: TH69152
2026-03-28 08:31:25 [auto1.be] INFO: Found listing with ID: UM09750
2026-03-28 08:31:25 [auto1.be] INFO: Found listing with ID: WP96232
2026-03-28 08:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP96232%27 HTTP/1.1" 200 None
2026-03-28 08:31:25 [auto1.be] INFO: Scrape type for WP96232: 0
2026-03-28 08:31:25 [auto1.be] INFO: Found listing with ID: XP29569
2026-03-28 08:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XP29569%27 HTTP/1.1" 200 None
2026-03-28 08:31:25 [auto1.be] INFO: Scrape type for XP29569: 2
2026-03-28 08:31:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f1ab8ce-eac0-58b3-ab63-da47cb01a241 with identifier: XP29569
2026-03-28 08:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f1ab8ce-eac0-58b3-ab63-da47cb01a241 with scrape type 2
2026-03-28 08:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f1ab8ce-eac0-58b3-ab63-da47cb01a241 with scrape type 2
2026-03-28 08:31:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2f1ab8ce-eac0-58b3-ab63-da47cb01a241, identifier: XP29569
2026-03-28 08:31:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2f1ab8ce-eac0-58b3-ab63-da47cb01a241 with identifier: XP29569
2026-03-28 08:31:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2f1ab8ce-eac0-58b3-ab63-da47cb01a241 with identifier: XP29569
2026-03-28 08:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2f1ab8ce-eac0-58b3-ab63-da47cb01a241 with identifier: XP29569 to the API
2026-03-28 08:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 170,
'expiration_date': '2026-03-28T16:57:16Z',
'fuel_type': 'diesel',
'id': '2f1ab8ce-eac0-58b3-ab63-da47cb01a241',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP29569',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit',
'odometer': 69738,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-25',
'seller_name': None,
'title': 'Ford Transit 2.0 TDCi 340 L1 Trend',
'transmission': 'manual',
'trim': '340 L1 Trend',
'year': 2017}
2026-03-28 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XP29569%27 HTTP/1.1" 200 None
2026-03-28 08:31:26 [auto1.be] INFO: Saving data for XP29569: {'auction_closing_time': 1774717036.0, 'created_time': 1774471326.524707, 'last_price_update_time': 1774686686.222482}
2026-03-28 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XP29569') HTTP/1.1" 204 0
2026-03-28 08:31:26 [auto1.be] INFO: Found listing with ID: KM78271
2026-03-28 08:31:26 [auto1.be] INFO: Found listing with ID: HS59761
2026-03-28 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS59761%27 HTTP/1.1" 200 None
2026-03-28 08:31:26 [auto1.be] INFO: Scrape type for HS59761: 0
2026-03-28 08:31:26 [auto1.be] INFO: Found listing with ID: SD69002
2026-03-28 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD69002%27 HTTP/1.1" 200 None
2026-03-28 08:31:26 [auto1.be] INFO: Scrape type for SD69002: 2
2026-03-28 08:31:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7955b4ee-a5e0-5a7c-9d4a-05b68ecdf77f with identifier: SD69002
2026-03-28 08:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7955b4ee-a5e0-5a7c-9d4a-05b68ecdf77f with scrape type 2
2026-03-28 08:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7955b4ee-a5e0-5a7c-9d4a-05b68ecdf77f with scrape type 2
2026-03-28 08:31:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7955b4ee-a5e0-5a7c-9d4a-05b68ecdf77f, identifier: SD69002
2026-03-28 08:31:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7955b4ee-a5e0-5a7c-9d4a-05b68ecdf77f with identifier: SD69002
2026-03-28 08:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7955b4ee-a5e0-5a7c-9d4a-05b68ecdf77f with identifier: SD69002
2026-03-28 08:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7955b4ee-a5e0-5a7c-9d4a-05b68ecdf77f with identifier: SD69002 to the API
2026-03-28 08:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-28T16:25:21Z',
'fuel_type': 'diesel',
'id': '7955b4ee-a5e0-5a7c-9d4a-05b68ecdf77f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD69002',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 211324,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-17',
'seller_name': None,
'title': 'Volkswagen Caddy 1.6 TDI Maxi Trendline',
'transmission': 'manual',
'trim': 'Maxi Trendline',
'year': 2015}
2026-03-28 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD69002%27 HTTP/1.1" 200 None
2026-03-28 08:31:26 [auto1.be] INFO: Saving data for SD69002: {'auction_closing_time': 1774715121.0, 'created_time': 1774470939.148712, 'last_price_update_time': 1774686686.660573}
2026-03-28 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SD69002') HTTP/1.1" 204 0
2026-03-28 08:31:26 [auto1.be] INFO: Found listing with ID: RK05604
2026-03-28 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK05604%27 HTTP/1.1" 200 None
2026-03-28 08:31:26 [auto1.be] INFO: Scrape type for RK05604: 0
2026-03-28 08:31:26 [auto1.be] INFO: Found listing with ID: EV46077
2026-03-28 08:31:26 [auto1.be] INFO: Found listing with ID: XZ27909
2026-03-28 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ27909%27 HTTP/1.1" 200 None
2026-03-28 08:31:26 [auto1.be] INFO: Scrape type for XZ27909: 0
2026-03-28 08:31:26 [auto1.be] INFO: Found listing with ID: ET07668
2026-03-28 08:31:26 [auto1.be] INFO: Found listing with ID: CS90165
2026-03-28 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS90165%27 HTTP/1.1" 200 None
2026-03-28 08:31:26 [auto1.be] INFO: Scrape type for CS90165: 0
2026-03-28 08:31:26 [auto1.be] INFO: Found listing with ID: WE24792
2026-03-28 08:31:26 [auto1.be] INFO: Found listing with ID: SP41494
2026-03-28 08:31:26 [auto1.be] INFO: Found listing with ID: YA31821
2026-03-28 08:31:26 [auto1.be] INFO: Found listing with ID: GA09150
2026-03-28 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GA09150%27 HTTP/1.1" 200 None
2026-03-28 08:31:26 [auto1.be] INFO: Scrape type for GA09150: 0
2026-03-28 08:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:31:28 [auto1.be] INFO: Channel: 24h | Page: 18 | totalHits: 1701 | hits on page: 40
2026-03-28 08:31:28 [auto1.be] INFO: Found listing with ID: XC10139
2026-03-28 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC10139%27 HTTP/1.1" 200 None
2026-03-28 08:31:28 [auto1.be] INFO: Scrape type for XC10139: 0
2026-03-28 08:31:28 [auto1.be] INFO: Found listing with ID: DF44974
2026-03-28 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF44974%27 HTTP/1.1" 200 None
2026-03-28 08:31:28 [auto1.be] INFO: Scrape type for DF44974: 0
2026-03-28 08:31:28 [auto1.be] INFO: Found listing with ID: RJ01486
2026-03-28 08:31:28 [auto1.be] INFO: Found listing with ID: SD62634
2026-03-28 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD62634%27 HTTP/1.1" 200 None
2026-03-28 08:31:28 [auto1.be] INFO: Scrape type for SD62634: 2
2026-03-28 08:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c51b55b9-ebdb-5abe-be92-74c5dd1424fa with identifier: SD62634
2026-03-28 08:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c51b55b9-ebdb-5abe-be92-74c5dd1424fa with scrape type 2
2026-03-28 08:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c51b55b9-ebdb-5abe-be92-74c5dd1424fa with scrape type 2
2026-03-28 08:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c51b55b9-ebdb-5abe-be92-74c5dd1424fa, identifier: SD62634
2026-03-28 08:31:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c51b55b9-ebdb-5abe-be92-74c5dd1424fa with identifier: SD62634
2026-03-28 08:31:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c51b55b9-ebdb-5abe-be92-74c5dd1424fa with identifier: SD62634
2026-03-28 08:31:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c51b55b9-ebdb-5abe-be92-74c5dd1424fa with identifier: SD62634 to the API
2026-03-28 08:31:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:44:43Z',
'fuel_type': 'diesel',
'id': 'c51b55b9-ebdb-5abe-be92-74c5dd1424fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD62634',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Grand Picasso',
'odometer': 114707,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-22',
'seller_name': None,
'title': 'Citroen C4 Grand Picasso 1.6 Blue-HDi Business Class',
'transmission': 'automatic',
'trim': 'Business Class',
'year': 2018}
2026-03-28 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD62634%27 HTTP/1.1" 200 None
2026-03-28 08:31:28 [auto1.be] INFO: Saving data for SD62634: {'auction_closing_time': 1774716283.0, 'created_time': 1774471178.503578, 'last_price_update_time': 1774686688.586363}
2026-03-28 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SD62634') HTTP/1.1" 204 0
2026-03-28 08:31:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:31:28 [auto1.be] INFO: Found listing with ID: FP33108
2026-03-28 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP33108%27 HTTP/1.1" 200 None
2026-03-28 08:31:28 [auto1.be] INFO: Scrape type for FP33108: 2
2026-03-28 08:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3f9aed1-c0a2-5458-87be-2bf3a6e01f32 with identifier: FP33108
2026-03-28 08:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3f9aed1-c0a2-5458-87be-2bf3a6e01f32 with scrape type 2
2026-03-28 08:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3f9aed1-c0a2-5458-87be-2bf3a6e01f32 with scrape type 2
2026-03-28 08:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b3f9aed1-c0a2-5458-87be-2bf3a6e01f32, identifier: FP33108
2026-03-28 08:31:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b3f9aed1-c0a2-5458-87be-2bf3a6e01f32 with identifier: FP33108
2026-03-28 08:31:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b3f9aed1-c0a2-5458-87be-2bf3a6e01f32 with identifier: FP33108
2026-03-28 08:31:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b3f9aed1-c0a2-5458-87be-2bf3a6e01f32 with identifier: FP33108 to the API
2026-03-28 08:31:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:29:03Z',
'fuel_type': 'diesel',
'id': 'b3f9aed1-c0a2-5458-87be-2bf3a6e01f32',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP33108',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 281617,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-09',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 d T BlueTEC Avantgarde',
'transmission': 'manual',
'trim': 'T BlueTEC Avantgarde',
'year': 2015}
2026-03-28 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP33108%27 HTTP/1.1" 200 None
2026-03-28 08:31:29 [auto1.be] INFO: Saving data for FP33108: {'auction_closing_time': 1774715343.0, 'created_time': 1774471325.200212, 'last_price_update_time': 1774686689.095508}
2026-03-28 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FP33108') HTTP/1.1" 204 0
2026-03-28 08:31:29 [auto1.be] INFO: Found listing with ID: GS48835
2026-03-28 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS48835%27 HTTP/1.1" 200 None
2026-03-28 08:31:29 [auto1.be] INFO: Scrape type for GS48835: 0
2026-03-28 08:31:29 [auto1.be] INFO: Found listing with ID: JM27578
2026-03-28 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM27578%27 HTTP/1.1" 200 None
2026-03-28 08:31:29 [auto1.be] INFO: Scrape type for JM27578: 0
2026-03-28 08:31:29 [auto1.be] INFO: Found listing with ID: MS83423
2026-03-28 08:31:29 [auto1.be] INFO: Found listing with ID: RM99520
2026-03-28 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM99520%27 HTTP/1.1" 200 None
2026-03-28 08:31:29 [auto1.be] INFO: Scrape type for RM99520: 0
2026-03-28 08:31:29 [auto1.be] INFO: Found listing with ID: CY81530
2026-03-28 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY81530%27 HTTP/1.1" 200 None
2026-03-28 08:31:29 [auto1.be] INFO: Scrape type for CY81530: 2
2026-03-28 08:31:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3b00f41-c491-5c04-9146-6419f85dfd79 with identifier: CY81530
2026-03-28 08:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3b00f41-c491-5c04-9146-6419f85dfd79 with scrape type 2
2026-03-28 08:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3b00f41-c491-5c04-9146-6419f85dfd79 with scrape type 2
2026-03-28 08:31:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f3b00f41-c491-5c04-9146-6419f85dfd79, identifier: CY81530
2026-03-28 08:31:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f3b00f41-c491-5c04-9146-6419f85dfd79 with identifier: CY81530
2026-03-28 08:31:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f3b00f41-c491-5c04-9146-6419f85dfd79 with identifier: CY81530
2026-03-28 08:31:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f3b00f41-c491-5c04-9146-6419f85dfd79 with identifier: CY81530 to the API
2026-03-28 08:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:10:38Z',
'fuel_type': 'diesel',
'id': 'f3b00f41-c491-5c04-9146-6419f85dfd79',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY81530',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 208845,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-11',
'seller_name': None,
'title': 'BMW 2er 216d Active Tourer Advantage',
'transmission': 'manual',
'trim': 'Advantage',
'year': 2016}
2026-03-28 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY81530%27 HTTP/1.1" 200 None
2026-03-28 08:31:29 [auto1.be] INFO: Saving data for CY81530: {'auction_closing_time': 1774714238.0, 'created_time': 1773223801.483309, 'last_price_update_time': 1774686689.584511}
2026-03-28 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CY81530') HTTP/1.1" 204 0
2026-03-28 08:31:29 [auto1.be] INFO: Found listing with ID: RJ35563
2026-03-28 08:31:29 [auto1.be] INFO: Found listing with ID: HP15544
2026-03-28 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP15544%27 HTTP/1.1" 200 None
2026-03-28 08:31:29 [auto1.be] INFO: Scrape type for HP15544: 0
2026-03-28 08:31:29 [auto1.be] INFO: Found listing with ID: NJ53644
2026-03-28 08:31:29 [auto1.be] INFO: Found listing with ID: TX85632
2026-03-28 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX85632%27 HTTP/1.1" 200 None
2026-03-28 08:31:29 [auto1.be] INFO: Scrape type for TX85632: 0
2026-03-28 08:31:29 [auto1.be] INFO: Found listing with ID: HY35953
2026-03-28 08:31:29 [auto1.be] INFO: Found listing with ID: VY02593
2026-03-28 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VY02593%27 HTTP/1.1" 200 None
2026-03-28 08:31:29 [auto1.be] INFO: Scrape type for VY02593: 2
2026-03-28 08:31:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52095e27-2f31-5d46-a74b-baa3ffa1efd6 with identifier: VY02593
2026-03-28 08:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52095e27-2f31-5d46-a74b-baa3ffa1efd6 with scrape type 2
2026-03-28 08:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52095e27-2f31-5d46-a74b-baa3ffa1efd6 with scrape type 2
2026-03-28 08:31:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 52095e27-2f31-5d46-a74b-baa3ffa1efd6, identifier: VY02593
2026-03-28 08:31:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 52095e27-2f31-5d46-a74b-baa3ffa1efd6 with identifier: VY02593
2026-03-28 08:31:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 52095e27-2f31-5d46-a74b-baa3ffa1efd6 with identifier: VY02593
2026-03-28 08:31:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 52095e27-2f31-5d46-a74b-baa3ffa1efd6 with identifier: VY02593 to the API
2026-03-28 08:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:45:33Z',
'fuel_type': 'diesel',
'id': '52095e27-2f31-5d46-a74b-baa3ffa1efd6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY02593',
'listing': 'auction',
'make': 'Peugeot',
'model': '807',
'odometer': 285389,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-03',
'seller_name': None,
'title': 'Peugeot 807 2.0 HDi Tendance',
'transmission': 'manual',
'trim': 'Tendance',
'year': 2014}
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VY02593%27 HTTP/1.1" 200 None
2026-03-28 08:31:30 [auto1.be] INFO: Saving data for VY02593: {'auction_closing_time': 1774716333.0, 'created_time': 1774471314.175609, 'last_price_update_time': 1774686690.021044}
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VY02593') HTTP/1.1" 204 0
2026-03-28 08:31:30 [auto1.be] INFO: Found listing with ID: LW74134
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW74134%27 HTTP/1.1" 200 None
2026-03-28 08:31:30 [auto1.be] INFO: Scrape type for LW74134: 0
2026-03-28 08:31:30 [auto1.be] INFO: Found listing with ID: GW69223
2026-03-28 08:31:30 [auto1.be] INFO: Found listing with ID: KW54495
2026-03-28 08:31:30 [auto1.be] INFO: Found listing with ID: HK96372
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK96372%27 HTTP/1.1" 200 None
2026-03-28 08:31:30 [auto1.be] INFO: Scrape type for HK96372: 0
2026-03-28 08:31:30 [auto1.be] INFO: Found listing with ID: AK54797
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK54797%27 HTTP/1.1" 200 None
2026-03-28 08:31:30 [auto1.be] INFO: Scrape type for AK54797: 0
2026-03-28 08:31:30 [auto1.be] INFO: Found listing with ID: UW48678
2026-03-28 08:31:30 [auto1.be] INFO: Found listing with ID: SN36947
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN36947%27 HTTP/1.1" 200 None
2026-03-28 08:31:30 [auto1.be] INFO: Scrape type for SN36947: 2
2026-03-28 08:31:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9ae0eee-8b20-5434-ba6b-b11142b3d8a4 with identifier: SN36947
2026-03-28 08:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9ae0eee-8b20-5434-ba6b-b11142b3d8a4 with scrape type 2
2026-03-28 08:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9ae0eee-8b20-5434-ba6b-b11142b3d8a4 with scrape type 2
2026-03-28 08:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f9ae0eee-8b20-5434-ba6b-b11142b3d8a4, identifier: SN36947
2026-03-28 08:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f9ae0eee-8b20-5434-ba6b-b11142b3d8a4 with identifier: SN36947
2026-03-28 08:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f9ae0eee-8b20-5434-ba6b-b11142b3d8a4 with identifier: SN36947
2026-03-28 08:31:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f9ae0eee-8b20-5434-ba6b-b11142b3d8a4 with identifier: SN36947 to the API
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:15:21Z',
'fuel_type': 'diesel',
'id': 'f9ae0eee-8b20-5434-ba6b-b11142b3d8a4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN36947',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 193499,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-02-06',
'seller_name': None,
'title': 'BMW 5er 520d',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN36947%27 HTTP/1.1" 200 None
2026-03-28 08:31:30 [auto1.be] INFO: Saving data for SN36947: {'auction_closing_time': 1774714521.0, 'created_time': 1774471084.814297, 'last_price_update_time': 1774686690.582879}
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SN36947') HTTP/1.1" 204 0
2026-03-28 08:31:30 [auto1.be] INFO: Found listing with ID: WW33850
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW33850%27 HTTP/1.1" 200 None
2026-03-28 08:31:30 [auto1.be] INFO: Scrape type for WW33850: 0
2026-03-28 08:31:30 [auto1.be] INFO: Found listing with ID: EW19960
2026-03-28 08:31:30 [auto1.be] INFO: Found listing with ID: YS48127
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS48127%27 HTTP/1.1" 200 None
2026-03-28 08:31:30 [auto1.be] INFO: Scrape type for YS48127: 0
2026-03-28 08:31:30 [auto1.be] INFO: Found listing with ID: VL30706
2026-03-28 08:31:30 [auto1.be] INFO: Found listing with ID: DT44813
2026-03-28 08:31:30 [auto1.be] INFO: Found listing with ID: NA83535
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA83535%27 HTTP/1.1" 200 None
2026-03-28 08:31:30 [auto1.be] INFO: Scrape type for NA83535: 0
2026-03-28 08:31:30 [auto1.be] INFO: Found listing with ID: RW15578
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW15578%27 HTTP/1.1" 200 None
2026-03-28 08:31:30 [auto1.be] INFO: Scrape type for RW15578: 0
2026-03-28 08:31:30 [auto1.be] INFO: Found listing with ID: MR56300
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR56300%27 HTTP/1.1" 200 None
2026-03-28 08:31:30 [auto1.be] INFO: Scrape type for MR56300: 0
2026-03-28 08:31:30 [auto1.be] INFO: Found listing with ID: BN63741
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BN63741%27 HTTP/1.1" 200 None
2026-03-28 08:31:30 [auto1.be] INFO: Scrape type for BN63741: 0
2026-03-28 08:31:30 [auto1.be] INFO: Found listing with ID: GS77634
2026-03-28 08:31:30 [auto1.be] INFO: Found listing with ID: NH29158
2026-03-28 08:31:30 [auto1.be] INFO: Found listing with ID: DY53822
2026-03-28 08:31:30 [auto1.be] INFO: Found listing with ID: TX50004
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX50004%27 HTTP/1.1" 200 None
2026-03-28 08:31:30 [auto1.be] INFO: Scrape type for TX50004: 2
2026-03-28 08:31:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12051f86-b367-5619-81cb-e094b7db4dbc with identifier: TX50004
2026-03-28 08:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12051f86-b367-5619-81cb-e094b7db4dbc with scrape type 2
2026-03-28 08:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12051f86-b367-5619-81cb-e094b7db4dbc with scrape type 2
2026-03-28 08:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 12051f86-b367-5619-81cb-e094b7db4dbc, identifier: TX50004
2026-03-28 08:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 12051f86-b367-5619-81cb-e094b7db4dbc with identifier: TX50004
2026-03-28 08:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 12051f86-b367-5619-81cb-e094b7db4dbc with identifier: TX50004
2026-03-28 08:31:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 12051f86-b367-5619-81cb-e094b7db4dbc with identifier: TX50004 to the API
2026-03-28 08:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:35:51Z',
'fuel_type': 'diesel',
'id': '12051f86-b367-5619-81cb-e094b7db4dbc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX50004',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 192925,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-16',
'seller_name': None,
'title': 'BMW 1er 116d EfficientDynamics Edition',
'transmission': 'manual',
'trim': 'EfficientDynamics Edition',
'year': 2014}
2026-03-28 08:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX50004%27 HTTP/1.1" 200 None
2026-03-28 08:31:31 [auto1.be] INFO: Saving data for TX50004: {'auction_closing_time': 1774715751.0, 'created_time': 1773135186.38362, 'last_price_update_time': 1774686691.450722}
2026-03-28 08:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TX50004') HTTP/1.1" 204 0
2026-03-28 08:31:31 [auto1.be] INFO: Found listing with ID: KS43499
2026-03-28 08:31:31 [auto1.be] INFO: Found listing with ID: FK81343
2026-03-28 08:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK81343%27 HTTP/1.1" 200 None
2026-03-28 08:31:31 [auto1.be] INFO: Scrape type for FK81343: 0
2026-03-28 08:31:31 [auto1.be] INFO: Found listing with ID: ZC67013
2026-03-28 08:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC67013%27 HTTP/1.1" 200 None
2026-03-28 08:31:31 [auto1.be] INFO: Scrape type for ZC67013: 0
2026-03-28 08:31:31 [auto1.be] INFO: Found listing with ID: RA35148
2026-03-28 08:31:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:31:31 [auto1.be] INFO: Channel: 24h | Page: 19 | totalHits: 1701 | hits on page: 40
2026-03-28 08:31:31 [auto1.be] INFO: Found listing with ID: GF59002
2026-03-28 08:31:31 [auto1.be] INFO: Found listing with ID: WC10504
2026-03-28 08:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC10504%27 HTTP/1.1" 200 None
2026-03-28 08:31:31 [auto1.be] INFO: Scrape type for WC10504: 0
2026-03-28 08:31:31 [auto1.be] INFO: Found listing with ID: VF97683
2026-03-28 08:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF97683%27 HTTP/1.1" 200 None
2026-03-28 08:31:31 [auto1.be] INFO: Scrape type for VF97683: 0
2026-03-28 08:31:31 [auto1.be] INFO: Found listing with ID: RZ67143
2026-03-28 08:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ67143%27 HTTP/1.1" 200 None
2026-03-28 08:31:31 [auto1.be] INFO: Scrape type for RZ67143: 0
2026-03-28 08:31:31 [auto1.be] INFO: Found listing with ID: FL89669
2026-03-28 08:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL89669%27 HTTP/1.1" 200 None
2026-03-28 08:31:31 [auto1.be] INFO: Scrape type for FL89669: 0
2026-03-28 08:31:31 [auto1.be] INFO: Found listing with ID: HJ68089
2026-03-28 08:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ68089%27 HTTP/1.1" 200 None
2026-03-28 08:31:31 [auto1.be] INFO: Scrape type for HJ68089: 0
2026-03-28 08:31:31 [auto1.be] INFO: Found listing with ID: XM10489
2026-03-28 08:31:31 [auto1.be] INFO: Found listing with ID: TK63545
2026-03-28 08:31:31 [auto1.be] INFO: Found listing with ID: ZH14429
2026-03-28 08:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH14429%27 HTTP/1.1" 200 None
2026-03-28 08:31:31 [auto1.be] INFO: Scrape type for ZH14429: 0
2026-03-28 08:31:31 [auto1.be] INFO: Found listing with ID: RF80171
2026-03-28 08:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF80171%27 HTTP/1.1" 200 None
2026-03-28 08:31:31 [auto1.be] INFO: Scrape type for RF80171: 0
2026-03-28 08:31:31 [auto1.be] INFO: Found listing with ID: EB43323
2026-03-28 08:31:31 [auto1.be] INFO: Found listing with ID: PV35906
2026-03-28 08:31:31 [auto1.be] INFO: Found listing with ID: SR71847
2026-03-28 08:31:31 [auto1.be] INFO: Found listing with ID: MS70949
2026-03-28 08:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS70949%27 HTTP/1.1" 200 None
2026-03-28 08:31:31 [auto1.be] INFO: Scrape type for MS70949: 2
2026-03-28 08:31:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eef08dc3-532a-570b-a0e9-9ed604ffe588 with identifier: MS70949
2026-03-28 08:31:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eef08dc3-532a-570b-a0e9-9ed604ffe588 with scrape type 2
2026-03-28 08:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eef08dc3-532a-570b-a0e9-9ed604ffe588 with scrape type 2
2026-03-28 08:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: eef08dc3-532a-570b-a0e9-9ed604ffe588, identifier: MS70949
2026-03-28 08:31:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: eef08dc3-532a-570b-a0e9-9ed604ffe588 with identifier: MS70949
2026-03-28 08:31:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: eef08dc3-532a-570b-a0e9-9ed604ffe588 with identifier: MS70949
2026-03-28 08:31:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: eef08dc3-532a-570b-a0e9-9ed604ffe588 with identifier: MS70949 to the API
2026-03-28 08:31:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:36:52Z',
'fuel_type': 'diesel',
'id': 'eef08dc3-532a-570b-a0e9-9ed604ffe588',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS70949',
'listing': 'auction',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 172288,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-08',
'seller_name': None,
'title': 'Renault Kadjar 1.6 dCi Energy XMOD',
'transmission': 'manual',
'trim': 'XMOD',
'year': 2017}
2026-03-28 08:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS70949%27 HTTP/1.1" 200 None
2026-03-28 08:31:32 [auto1.be] INFO: Saving data for MS70949: {'auction_closing_time': 1774715812.0, 'created_time': 1773131981.571896, 'last_price_update_time': 1774686692.364363}
2026-03-28 08:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MS70949') HTTP/1.1" 204 0
2026-03-28 08:31:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:31:32 [auto1.be] INFO: Found listing with ID: US70780
2026-03-28 08:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27US70780%27 HTTP/1.1" 200 None
2026-03-28 08:31:32 [auto1.be] INFO: Scrape type for US70780: 0
2026-03-28 08:31:32 [auto1.be] INFO: Found listing with ID: LE21271
2026-03-28 08:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE21271%27 HTTP/1.1" 200 None
2026-03-28 08:31:32 [auto1.be] INFO: Scrape type for LE21271: 0
2026-03-28 08:31:32 [auto1.be] INFO: Found listing with ID: LL17745
2026-03-28 08:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LL17745%27 HTTP/1.1" 200 None
2026-03-28 08:31:32 [auto1.be] INFO: Scrape type for LL17745: 0
2026-03-28 08:31:32 [auto1.be] INFO: Found listing with ID: JH06099
2026-03-28 08:31:32 [auto1.be] INFO: Found listing with ID: GG92230
2026-03-28 08:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG92230%27 HTTP/1.1" 200 None
2026-03-28 08:31:32 [auto1.be] INFO: Scrape type for GG92230: 0
2026-03-28 08:31:32 [auto1.be] INFO: Found listing with ID: WJ27954
2026-03-28 08:31:32 [auto1.be] INFO: Found listing with ID: CM55843
2026-03-28 08:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM55843%27 HTTP/1.1" 200 None
2026-03-28 08:31:32 [auto1.be] INFO: Scrape type for CM55843: 0
2026-03-28 08:31:32 [auto1.be] INFO: Found listing with ID: AA14466
2026-03-28 08:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AA14466%27 HTTP/1.1" 200 None
2026-03-28 08:31:32 [auto1.be] INFO: Scrape type for AA14466: 0
2026-03-28 08:31:32 [auto1.be] INFO: Found listing with ID: JS61863
2026-03-28 08:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS61863%27 HTTP/1.1" 200 None
2026-03-28 08:31:32 [auto1.be] INFO: Scrape type for JS61863: 2
2026-03-28 08:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de43edfa-0b7e-50bf-81e5-50b969364b2f with identifier: JS61863
2026-03-28 08:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de43edfa-0b7e-50bf-81e5-50b969364b2f with scrape type 2
2026-03-28 08:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de43edfa-0b7e-50bf-81e5-50b969364b2f with scrape type 2
2026-03-28 08:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: de43edfa-0b7e-50bf-81e5-50b969364b2f, identifier: JS61863
2026-03-28 08:31:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: de43edfa-0b7e-50bf-81e5-50b969364b2f with identifier: JS61863
2026-03-28 08:31:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: de43edfa-0b7e-50bf-81e5-50b969364b2f with identifier: JS61863
2026-03-28 08:31:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: de43edfa-0b7e-50bf-81e5-50b969364b2f with identifier: JS61863 to the API
2026-03-28 08:31:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:08:18Z',
'fuel_type': 'diesel',
'id': 'de43edfa-0b7e-50bf-81e5-50b969364b2f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS61863',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 134186,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-29',
'seller_name': None,
'title': 'Skoda Fabia 1.9 TDI Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2010}
2026-03-28 08:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS61863%27 HTTP/1.1" 200 None
2026-03-28 08:31:32 [auto1.be] INFO: Saving data for JS61863: {'auction_closing_time': 1774714098.0, 'created_time': 1774471358.168841, 'last_price_update_time': 1774686692.96362}
2026-03-28 08:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JS61863') HTTP/1.1" 204 0
2026-03-28 08:31:32 [auto1.be] INFO: Found listing with ID: MZ96160
2026-03-28 08:31:32 [auto1.be] INFO: Found listing with ID: TR58381
2026-03-28 08:31:32 [auto1.be] INFO: Found listing with ID: WM08929
2026-03-28 08:31:32 [auto1.be] INFO: Found listing with ID: YN20871
2026-03-28 08:31:32 [auto1.be] INFO: Found listing with ID: HJ85146
2026-03-28 08:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ85146%27 HTTP/1.1" 200 None
2026-03-28 08:31:32 [auto1.be] INFO: Scrape type for HJ85146: 0
2026-03-28 08:31:32 [auto1.be] INFO: Found listing with ID: HS04385
2026-03-28 08:31:32 [auto1.be] INFO: Found listing with ID: RH88749
2026-03-28 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH88749%27 HTTP/1.1" 200 None
2026-03-28 08:31:33 [auto1.be] INFO: Scrape type for RH88749: 0
2026-03-28 08:31:33 [auto1.be] INFO: Found listing with ID: FV41606
2026-03-28 08:31:33 [auto1.be] INFO: Found listing with ID: YN50786
2026-03-28 08:31:33 [auto1.be] INFO: Found listing with ID: CM09652
2026-03-28 08:31:33 [auto1.be] INFO: Found listing with ID: CB51818
2026-03-28 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB51818%27 HTTP/1.1" 200 None
2026-03-28 08:31:33 [auto1.be] INFO: Scrape type for CB51818: 0
2026-03-28 08:31:33 [auto1.be] INFO: Found listing with ID: CH75684
2026-03-28 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH75684%27 HTTP/1.1" 200 None
2026-03-28 08:31:33 [auto1.be] INFO: Scrape type for CH75684: 2
2026-03-28 08:31:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11820e00-8b5b-5602-a248-bb74fbc89537 with identifier: CH75684
2026-03-28 08:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11820e00-8b5b-5602-a248-bb74fbc89537 with scrape type 2
2026-03-28 08:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11820e00-8b5b-5602-a248-bb74fbc89537 with scrape type 2
2026-03-28 08:31:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 11820e00-8b5b-5602-a248-bb74fbc89537, identifier: CH75684
2026-03-28 08:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 11820e00-8b5b-5602-a248-bb74fbc89537 with identifier: CH75684
2026-03-28 08:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 11820e00-8b5b-5602-a248-bb74fbc89537 with identifier: CH75684
2026-03-28 08:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 11820e00-8b5b-5602-a248-bb74fbc89537 with identifier: CH75684 to the API
2026-03-28 08:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-28T16:36:19Z',
'fuel_type': 'petrol',
'id': '11820e00-8b5b-5602-a248-bb74fbc89537',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH75684',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 29810,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-05',
'seller_name': None,
'title': 'Peugeot 3008 1.2 PureTech Allure Pack',
'transmission': 'automatic',
'trim': 'Allure Pack',
'year': 2023}
2026-03-28 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH75684%27 HTTP/1.1" 200 None
2026-03-28 08:31:33 [auto1.be] INFO: Saving data for CH75684: {'auction_closing_time': 1774715779.0, 'created_time': 1774471352.41585, 'last_price_update_time': 1774686693.432801}
2026-03-28 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CH75684') HTTP/1.1" 204 0
2026-03-28 08:31:33 [auto1.be] INFO: Found listing with ID: XR84470
2026-03-28 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR84470%27 HTTP/1.1" 200 None
2026-03-28 08:31:33 [auto1.be] INFO: Scrape type for XR84470: 0
2026-03-28 08:31:33 [auto1.be] INFO: Found listing with ID: JW06840
2026-03-28 08:31:33 [auto1.be] INFO: Found listing with ID: KW80684
2026-03-28 08:31:33 [auto1.be] INFO: Found listing with ID: TL97420
2026-03-28 08:31:33 [auto1.be] INFO: Found listing with ID: WP12382
2026-03-28 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP12382%27 HTTP/1.1" 200 None
2026-03-28 08:31:33 [auto1.be] INFO: Scrape type for WP12382: 0
2026-03-28 08:31:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:31:34 [auto1.be] INFO: Channel: 24h | Page: 20 | totalHits: 1701 | hits on page: 40
2026-03-28 08:31:34 [auto1.be] INFO: Found listing with ID: CS46874
2026-03-28 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS46874%27 HTTP/1.1" 200 None
2026-03-28 08:31:34 [auto1.be] INFO: Scrape type for CS46874: 0
2026-03-28 08:31:34 [auto1.be] INFO: Found listing with ID: YC89583
2026-03-28 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC89583%27 HTTP/1.1" 200 None
2026-03-28 08:31:34 [auto1.be] INFO: Scrape type for YC89583: 0
2026-03-28 08:31:34 [auto1.be] INFO: Found listing with ID: SU72836
2026-03-28 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU72836%27 HTTP/1.1" 200 None
2026-03-28 08:31:34 [auto1.be] INFO: Scrape type for SU72836: 0
2026-03-28 08:31:34 [auto1.be] INFO: Found listing with ID: GS05336
2026-03-28 08:31:34 [auto1.be] INFO: Found listing with ID: XB71990
2026-03-28 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB71990%27 HTTP/1.1" 200 None
2026-03-28 08:31:34 [auto1.be] INFO: Scrape type for XB71990: 0
2026-03-28 08:31:34 [auto1.be] INFO: Found listing with ID: JE75068
2026-03-28 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JE75068%27 HTTP/1.1" 200 None
2026-03-28 08:31:34 [auto1.be] INFO: Scrape type for JE75068: 0
2026-03-28 08:31:34 [auto1.be] INFO: Found listing with ID: JU70188
2026-03-28 08:31:34 [auto1.be] INFO: Found listing with ID: EB16456
2026-03-28 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB16456%27 HTTP/1.1" 200 None
2026-03-28 08:31:34 [auto1.be] INFO: Scrape type for EB16456: 0
2026-03-28 08:31:34 [auto1.be] INFO: Found listing with ID: DW89258
2026-03-28 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW89258%27 HTTP/1.1" 200 None
2026-03-28 08:31:34 [auto1.be] INFO: Scrape type for DW89258: 0
2026-03-28 08:31:34 [auto1.be] INFO: Found listing with ID: EU07402
2026-03-28 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EU07402%27 HTTP/1.1" 200 None
2026-03-28 08:31:34 [auto1.be] INFO: Scrape type for EU07402: 0
2026-03-28 08:31:34 [auto1.be] INFO: Found listing with ID: YK96520
2026-03-28 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK96520%27 HTTP/1.1" 200 None
2026-03-28 08:31:34 [auto1.be] INFO: Scrape type for YK96520: 2
2026-03-28 08:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b84b858-9a50-5863-a92e-ca246e612ac7 with identifier: YK96520
2026-03-28 08:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b84b858-9a50-5863-a92e-ca246e612ac7 with scrape type 2
2026-03-28 08:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b84b858-9a50-5863-a92e-ca246e612ac7 with scrape type 2
2026-03-28 08:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7b84b858-9a50-5863-a92e-ca246e612ac7, identifier: YK96520
2026-03-28 08:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7b84b858-9a50-5863-a92e-ca246e612ac7 with identifier: YK96520
2026-03-28 08:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7b84b858-9a50-5863-a92e-ca246e612ac7 with identifier: YK96520
2026-03-28 08:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7b84b858-9a50-5863-a92e-ca246e612ac7 with identifier: YK96520 to the API
2026-03-28 08:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:10:36Z',
'fuel_type': 'diesel',
'id': '7b84b858-9a50-5863-a92e-ca246e612ac7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK96520',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 184870,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-16',
'seller_name': None,
'title': 'Audi A3 Sportback 1.6 TDI S line Sportpaket',
'transmission': 'manual',
'trim': 'S line Sportpaket',
'year': 2016}
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK96520%27 HTTP/1.1" 200 None
2026-03-28 08:31:35 [auto1.be] INFO: Saving data for YK96520: {'auction_closing_time': 1774714236.0, 'created_time': 1774471266.344126, 'last_price_update_time': 1774686695.151902}
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YK96520') HTTP/1.1" 204 0
2026-03-28 08:31:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:31:35 [auto1.be] INFO: Found listing with ID: UJ88717
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ88717%27 HTTP/1.1" 200 None
2026-03-28 08:31:35 [auto1.be] INFO: Scrape type for UJ88717: 0
2026-03-28 08:31:35 [auto1.be] INFO: Found listing with ID: LK29098
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK29098%27 HTTP/1.1" 200 None
2026-03-28 08:31:35 [auto1.be] INFO: Scrape type for LK29098: 0
2026-03-28 08:31:35 [auto1.be] INFO: Found listing with ID: UV91092
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV91092%27 HTTP/1.1" 200 None
2026-03-28 08:31:35 [auto1.be] INFO: Scrape type for UV91092: 0
2026-03-28 08:31:35 [auto1.be] INFO: Found listing with ID: TT89669
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT89669%27 HTTP/1.1" 200 None
2026-03-28 08:31:35 [auto1.be] INFO: Scrape type for TT89669: 2
2026-03-28 08:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f9199ff-98b7-57fe-b0a8-17a4b318bca1 with identifier: TT89669
2026-03-28 08:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f9199ff-98b7-57fe-b0a8-17a4b318bca1 with scrape type 2
2026-03-28 08:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f9199ff-98b7-57fe-b0a8-17a4b318bca1 with scrape type 2
2026-03-28 08:31:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8f9199ff-98b7-57fe-b0a8-17a4b318bca1, identifier: TT89669
2026-03-28 08:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8f9199ff-98b7-57fe-b0a8-17a4b318bca1 with identifier: TT89669
2026-03-28 08:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8f9199ff-98b7-57fe-b0a8-17a4b318bca1 with identifier: TT89669
2026-03-28 08:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8f9199ff-98b7-57fe-b0a8-17a4b318bca1 with identifier: TT89669 to the API
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:40:56Z',
'fuel_type': 'diesel',
'id': '8f9199ff-98b7-57fe-b0a8-17a4b318bca1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT89669',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 233552,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-04-14',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 TDI United',
'transmission': 'manual',
'trim': 'United',
'year': 2009}
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT89669%27 HTTP/1.1" 200 None
2026-03-28 08:31:35 [auto1.be] INFO: Saving data for TT89669: {'auction_closing_time': 1774716056.0, 'created_time': 1774471286.883025, 'last_price_update_time': 1774686695.72316}
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TT89669') HTTP/1.1" 204 0
2026-03-28 08:31:35 [auto1.be] INFO: Found listing with ID: CF04837
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF04837%27 HTTP/1.1" 200 None
2026-03-28 08:31:35 [auto1.be] INFO: Scrape type for CF04837: 0
2026-03-28 08:31:35 [auto1.be] INFO: Found listing with ID: EV01420
2026-03-28 08:31:35 [auto1.be] INFO: Found listing with ID: RK84429
2026-03-28 08:31:35 [auto1.be] INFO: Found listing with ID: DK31159
2026-03-28 08:31:35 [auto1.be] INFO: Found listing with ID: ZA01438
2026-03-28 08:31:35 [auto1.be] INFO: Found listing with ID: CP91867
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP91867%27 HTTP/1.1" 200 None
2026-03-28 08:31:35 [auto1.be] INFO: Scrape type for CP91867: 0
2026-03-28 08:31:35 [auto1.be] INFO: Found listing with ID: GR78986
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR78986%27 HTTP/1.1" 200 None
2026-03-28 08:31:35 [auto1.be] INFO: Scrape type for GR78986: 0
2026-03-28 08:31:35 [auto1.be] INFO: Found listing with ID: DV43116
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DV43116%27 HTTP/1.1" 200 None
2026-03-28 08:31:35 [auto1.be] INFO: Scrape type for DV43116: 0
2026-03-28 08:31:35 [auto1.be] INFO: Found listing with ID: UA36562
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA36562%27 HTTP/1.1" 200 None
2026-03-28 08:31:35 [auto1.be] INFO: Scrape type for UA36562: 0
2026-03-28 08:31:35 [auto1.be] INFO: Found listing with ID: SV05686
2026-03-28 08:31:35 [auto1.be] INFO: Found listing with ID: RZ47312
2026-03-28 08:31:35 [auto1.be] INFO: Found listing with ID: KV94769
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV94769%27 HTTP/1.1" 200 None
2026-03-28 08:31:35 [auto1.be] INFO: Scrape type for KV94769: 0
2026-03-28 08:31:35 [auto1.be] INFO: Found listing with ID: NS73936
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS73936%27 HTTP/1.1" 200 None
2026-03-28 08:31:35 [auto1.be] INFO: Scrape type for NS73936: 0
2026-03-28 08:31:35 [auto1.be] INFO: Found listing with ID: DU38710
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DU38710%27 HTTP/1.1" 200 None
2026-03-28 08:31:35 [auto1.be] INFO: Scrape type for DU38710: 0
2026-03-28 08:31:35 [auto1.be] INFO: Found listing with ID: CF07146
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF07146%27 HTTP/1.1" 200 None
2026-03-28 08:31:35 [auto1.be] INFO: Scrape type for CF07146: 0
2026-03-28 08:31:35 [auto1.be] INFO: Found listing with ID: MU76581
2026-03-28 08:31:35 [auto1.be] INFO: Found listing with ID: GJ15610
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ15610%27 HTTP/1.1" 200 None
2026-03-28 08:31:35 [auto1.be] INFO: Scrape type for GJ15610: 2
2026-03-28 08:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b47c8c2-9d32-593d-8a51-53f253ff1380 with identifier: GJ15610
2026-03-28 08:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b47c8c2-9d32-593d-8a51-53f253ff1380 with scrape type 2
2026-03-28 08:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b47c8c2-9d32-593d-8a51-53f253ff1380 with scrape type 2
2026-03-28 08:31:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1b47c8c2-9d32-593d-8a51-53f253ff1380, identifier: GJ15610
2026-03-28 08:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1b47c8c2-9d32-593d-8a51-53f253ff1380 with identifier: GJ15610
2026-03-28 08:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1b47c8c2-9d32-593d-8a51-53f253ff1380 with identifier: GJ15610
2026-03-28 08:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1b47c8c2-9d32-593d-8a51-53f253ff1380 with identifier: GJ15610 to the API
2026-03-28 08:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:36:59Z',
'fuel_type': 'diesel',
'id': '1b47c8c2-9d32-593d-8a51-53f253ff1380',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ15610',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 240573,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-26',
'seller_name': None,
'title': 'Volkswagen Golf VI 1.6 TDI Trendline BlueMotion',
'transmission': 'manual',
'trim': 'Trendline BlueMotion',
'year': 2010}
2026-03-28 08:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ15610%27 HTTP/1.1" 200 None
2026-03-28 08:31:36 [auto1.be] INFO: Saving data for GJ15610: {'auction_closing_time': 1774715819.0, 'created_time': 1773136425.151893, 'last_price_update_time': 1774686696.296091}
2026-03-28 08:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GJ15610') HTTP/1.1" 204 0
2026-03-28 08:31:36 [auto1.be] INFO: Found listing with ID: MG19472
2026-03-28 08:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG19472%27 HTTP/1.1" 200 None
2026-03-28 08:31:36 [auto1.be] INFO: Scrape type for MG19472: 0
2026-03-28 08:31:36 [auto1.be] INFO: Found listing with ID: VP91071
2026-03-28 08:31:36 [auto1.be] INFO: Found listing with ID: KP16725
2026-03-28 08:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP16725%27 HTTP/1.1" 200 None
2026-03-28 08:31:36 [auto1.be] INFO: Scrape type for KP16725: 0
2026-03-28 08:31:36 [auto1.be] INFO: Found listing with ID: MR50383
2026-03-28 08:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR50383%27 HTTP/1.1" 200 None
2026-03-28 08:31:36 [auto1.be] INFO: Scrape type for MR50383: 2
2026-03-28 08:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd7b376b-c713-5abc-9b94-4d12058f41d4 with identifier: MR50383
2026-03-28 08:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd7b376b-c713-5abc-9b94-4d12058f41d4 with scrape type 2
2026-03-28 08:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd7b376b-c713-5abc-9b94-4d12058f41d4 with scrape type 2
2026-03-28 08:31:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cd7b376b-c713-5abc-9b94-4d12058f41d4, identifier: MR50383
2026-03-28 08:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cd7b376b-c713-5abc-9b94-4d12058f41d4 with identifier: MR50383
2026-03-28 08:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cd7b376b-c713-5abc-9b94-4d12058f41d4 with identifier: MR50383
2026-03-28 08:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cd7b376b-c713-5abc-9b94-4d12058f41d4 with identifier: MR50383 to the API
2026-03-28 08:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:31:57Z',
'fuel_type': 'diesel',
'id': 'cd7b376b-c713-5abc-9b94-4d12058f41d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR50383',
'listing': 'auction',
'make': 'Skoda',
'model': 'Roomster',
'odometer': 146084,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-13',
'seller_name': None,
'title': 'Skoda Roomster 1.6 TDI Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2012}
2026-03-28 08:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR50383%27 HTTP/1.1" 200 None
2026-03-28 08:31:36 [auto1.be] INFO: Saving data for MR50383: {'auction_closing_time': 1774715517.0, 'created_time': 1773822670.245188, 'last_price_update_time': 1774686696.856375}
2026-03-28 08:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MR50383') HTTP/1.1" 204 0
2026-03-28 08:31:36 [auto1.be] INFO: Found listing with ID: EJ45818
2026-03-28 08:31:36 [auto1.be] INFO: Found listing with ID: WX63908
2026-03-28 08:31:36 [auto1.be] INFO: Found listing with ID: RL53364
2026-03-28 08:31:36 [auto1.be] INFO: Found listing with ID: VZ37622
2026-03-28 08:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ37622%27 HTTP/1.1" 200 None
2026-03-28 08:31:36 [auto1.be] INFO: Scrape type for VZ37622: 2
2026-03-28 08:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b96bc07-78a9-561b-9413-3b9ba7d04a71 with identifier: VZ37622
2026-03-28 08:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b96bc07-78a9-561b-9413-3b9ba7d04a71 with scrape type 2
2026-03-28 08:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b96bc07-78a9-561b-9413-3b9ba7d04a71 with scrape type 2
2026-03-28 08:31:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6b96bc07-78a9-561b-9413-3b9ba7d04a71, identifier: VZ37622
2026-03-28 08:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6b96bc07-78a9-561b-9413-3b9ba7d04a71 with identifier: VZ37622
2026-03-28 08:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6b96bc07-78a9-561b-9413-3b9ba7d04a71 with identifier: VZ37622
2026-03-28 08:31:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6b96bc07-78a9-561b-9413-3b9ba7d04a71 with identifier: VZ37622 to the API
2026-03-28 08:31:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 143,
'expiration_date': '2026-03-28T16:40:30Z',
'fuel_type': 'diesel',
'id': '6b96bc07-78a9-561b-9413-3b9ba7d04a71',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ37622',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 270136,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-03-24',
'seller_name': None,
'title': 'BMW 3er 318d',
'transmission': 'manual',
'trim': '',
'year': 2008}
2026-03-28 08:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ37622%27 HTTP/1.1" 200 None
2026-03-28 08:31:37 [auto1.be] INFO: Saving data for VZ37622: {'auction_closing_time': 1774716030.0, 'created_time': 1773301742.961218, 'last_price_update_time': 1774686697.27499}
2026-03-28 08:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VZ37622') HTTP/1.1" 204 0
2026-03-28 08:31:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:31:38 [auto1.be] INFO: Channel: 24h | Page: 21 | totalHits: 1701 | hits on page: 40
2026-03-28 08:31:38 [auto1.be] INFO: Found listing with ID: NM48533
2026-03-28 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM48533%27 HTTP/1.1" 200 None
2026-03-28 08:31:38 [auto1.be] INFO: Scrape type for NM48533: 0
2026-03-28 08:31:38 [auto1.be] INFO: Found listing with ID: CS76215
2026-03-28 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS76215%27 HTTP/1.1" 200 None
2026-03-28 08:31:38 [auto1.be] INFO: Scrape type for CS76215: 0
2026-03-28 08:31:38 [auto1.be] INFO: Found listing with ID: WH07577
2026-03-28 08:31:38 [auto1.be] INFO: Found listing with ID: SM52966
2026-03-28 08:31:38 [auto1.be] INFO: Found listing with ID: NC57966
2026-03-28 08:31:38 [auto1.be] INFO: Found listing with ID: WL68728
2026-03-28 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL68728%27 HTTP/1.1" 200 None
2026-03-28 08:31:38 [auto1.be] INFO: Scrape type for WL68728: 0
2026-03-28 08:31:38 [auto1.be] INFO: Found listing with ID: WV71876
2026-03-28 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV71876%27 HTTP/1.1" 200 None
2026-03-28 08:31:38 [auto1.be] INFO: Scrape type for WV71876: 0
2026-03-28 08:31:38 [auto1.be] INFO: Found listing with ID: SX01610
2026-03-28 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX01610%27 HTTP/1.1" 200 None
2026-03-28 08:31:38 [auto1.be] INFO: Scrape type for SX01610: 2
2026-03-28 08:31:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d59f8421-9c41-51c1-82fe-608611f7300e with identifier: SX01610
2026-03-28 08:31:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d59f8421-9c41-51c1-82fe-608611f7300e with scrape type 2
2026-03-28 08:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d59f8421-9c41-51c1-82fe-608611f7300e with scrape type 2
2026-03-28 08:31:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d59f8421-9c41-51c1-82fe-608611f7300e, identifier: SX01610
2026-03-28 08:31:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d59f8421-9c41-51c1-82fe-608611f7300e with identifier: SX01610
2026-03-28 08:31:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d59f8421-9c41-51c1-82fe-608611f7300e with identifier: SX01610
2026-03-28 08:31:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d59f8421-9c41-51c1-82fe-608611f7300e with identifier: SX01610 to the API
2026-03-28 08:31:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:52:27Z',
'fuel_type': 'diesel',
'id': 'd59f8421-9c41-51c1-82fe-608611f7300e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX01610',
'listing': 'auction',
'make': 'Ford',
'model': 'Kuga',
'odometer': 209593,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-19',
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2011}
2026-03-28 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX01610%27 HTTP/1.1" 200 None
2026-03-28 08:31:38 [auto1.be] INFO: Saving data for SX01610: {'auction_closing_time': 1774716747.0, 'created_time': 1774471047.884128, 'last_price_update_time': 1774686698.656167}
2026-03-28 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SX01610') HTTP/1.1" 204 0
2026-03-28 08:31:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:31:38 [auto1.be] INFO: Found listing with ID: FR59063
2026-03-28 08:31:38 [auto1.be] INFO: Found listing with ID: UT85674
2026-03-28 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT85674%27 HTTP/1.1" 200 None
2026-03-28 08:31:38 [auto1.be] INFO: Scrape type for UT85674: 2
2026-03-28 08:31:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 491c72d8-c1c9-5c90-b315-bca2756e74d0 with identifier: UT85674
2026-03-28 08:31:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 491c72d8-c1c9-5c90-b315-bca2756e74d0 with scrape type 2
2026-03-28 08:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 491c72d8-c1c9-5c90-b315-bca2756e74d0 with scrape type 2
2026-03-28 08:31:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 491c72d8-c1c9-5c90-b315-bca2756e74d0, identifier: UT85674
2026-03-28 08:31:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 491c72d8-c1c9-5c90-b315-bca2756e74d0 with identifier: UT85674
2026-03-28 08:31:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 491c72d8-c1c9-5c90-b315-bca2756e74d0 with identifier: UT85674
2026-03-28 08:31:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 491c72d8-c1c9-5c90-b315-bca2756e74d0 with identifier: UT85674 to the API
2026-03-28 08:31:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:34:49Z',
'fuel_type': 'petrol',
'id': '491c72d8-c1c9-5c90-b315-bca2756e74d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT85674',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 40197,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-27',
'seller_name': None,
'title': 'Dacia Sandero 0.9 TCe Stepway Prestige',
'transmission': 'automatic',
'trim': 'Stepway Prestige',
'year': 2020}
2026-03-28 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT85674%27 HTTP/1.1" 200 None
2026-03-28 08:31:39 [auto1.be] INFO: Saving data for UT85674: {'auction_closing_time': 1774715689.0, 'created_time': 1774471353.485082, 'last_price_update_time': 1774686699.19917}
2026-03-28 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UT85674') HTTP/1.1" 204 0
2026-03-28 08:31:39 [auto1.be] INFO: Found listing with ID: BZ82774
2026-03-28 08:31:39 [auto1.be] INFO: Found listing with ID: RR37378
2026-03-28 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR37378%27 HTTP/1.1" 200 None
2026-03-28 08:31:39 [auto1.be] INFO: Scrape type for RR37378: 2
2026-03-28 08:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 475c1f59-3601-59de-8357-ff4fa011da53 with identifier: RR37378
2026-03-28 08:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 475c1f59-3601-59de-8357-ff4fa011da53 with scrape type 2
2026-03-28 08:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 475c1f59-3601-59de-8357-ff4fa011da53 with scrape type 2
2026-03-28 08:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 475c1f59-3601-59de-8357-ff4fa011da53, identifier: RR37378
2026-03-28 08:31:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 475c1f59-3601-59de-8357-ff4fa011da53 with identifier: RR37378
2026-03-28 08:31:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 475c1f59-3601-59de-8357-ff4fa011da53 with identifier: RR37378
2026-03-28 08:31:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 475c1f59-3601-59de-8357-ff4fa011da53 with identifier: RR37378 to the API
2026-03-28 08:31:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:04:22Z',
'fuel_type': 'diesel',
'id': '475c1f59-3601-59de-8357-ff4fa011da53',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR37378',
'listing': 'auction',
'make': 'Volvo',
'model': 'V40 Cross Country',
'odometer': 221684,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-02-08',
'seller_name': None,
'title': 'Volvo V40 Cross Country 1.6 D2 Momentum',
'transmission': 'manual',
'trim': 'Momentum',
'year': 2015}
2026-03-28 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR37378%27 HTTP/1.1" 200 None
2026-03-28 08:31:39 [auto1.be] INFO: Saving data for RR37378: {'auction_closing_time': 1774713862.0, 'created_time': 1774471276.418107, 'last_price_update_time': 1774686699.629469}
2026-03-28 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RR37378') HTTP/1.1" 204 0
2026-03-28 08:31:39 [auto1.be] INFO: Found listing with ID: KS18318
2026-03-28 08:31:39 [auto1.be] INFO: Found listing with ID: MZ55081
2026-03-28 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ55081%27 HTTP/1.1" 200 None
2026-03-28 08:31:39 [auto1.be] INFO: Scrape type for MZ55081: 0
2026-03-28 08:31:39 [auto1.be] INFO: Found listing with ID: EE45657
2026-03-28 08:31:39 [auto1.be] INFO: Found listing with ID: MW21160
2026-03-28 08:31:39 [auto1.be] INFO: Found listing with ID: WG20951
2026-03-28 08:31:39 [auto1.be] INFO: Found listing with ID: FK67306
2026-03-28 08:31:39 [auto1.be] INFO: Found listing with ID: DE33834
2026-03-28 08:31:39 [auto1.be] INFO: Found listing with ID: UA67521
2026-03-28 08:31:39 [auto1.be] INFO: Found listing with ID: TF58036
2026-03-28 08:31:39 [auto1.be] INFO: Found listing with ID: ET32561
2026-03-28 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET32561%27 HTTP/1.1" 200 None
2026-03-28 08:31:39 [auto1.be] INFO: Scrape type for ET32561: 2
2026-03-28 08:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 961576a5-03f3-5954-ac2e-ceab759a4c78 with identifier: ET32561
2026-03-28 08:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 961576a5-03f3-5954-ac2e-ceab759a4c78 with scrape type 2
2026-03-28 08:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 961576a5-03f3-5954-ac2e-ceab759a4c78 with scrape type 2
2026-03-28 08:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 961576a5-03f3-5954-ac2e-ceab759a4c78, identifier: ET32561
2026-03-28 08:31:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 961576a5-03f3-5954-ac2e-ceab759a4c78 with identifier: ET32561
2026-03-28 08:31:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 961576a5-03f3-5954-ac2e-ceab759a4c78 with identifier: ET32561
2026-03-28 08:31:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 961576a5-03f3-5954-ac2e-ceab759a4c78 with identifier: ET32561 to the API
2026-03-28 08:31:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:48:45Z',
'fuel_type': 'petrol',
'id': '961576a5-03f3-5954-ac2e-ceab759a4c78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET32561',
'listing': 'auction',
'make': 'DS Automobiles',
'model': 'DS4 Crossback',
'odometer': 167500,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-29',
'seller_name': None,
'title': 'DS Automobiles DS4 Crossback 1.2 PureTech SportChic',
'transmission': 'manual',
'trim': 'SportChic',
'year': 2017}
2026-03-28 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET32561%27 HTTP/1.1" 200 None
2026-03-28 08:31:40 [auto1.be] INFO: Saving data for ET32561: {'auction_closing_time': 1774716525.0, 'created_time': 1773995471.370157, 'last_price_update_time': 1774686700.054994}
2026-03-28 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ET32561') HTTP/1.1" 204 0
2026-03-28 08:31:40 [auto1.be] INFO: Found listing with ID: KE17510
2026-03-28 08:31:40 [auto1.be] INFO: Found listing with ID: DH21315
2026-03-28 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH21315%27 HTTP/1.1" 200 None
2026-03-28 08:31:40 [auto1.be] INFO: Scrape type for DH21315: 0
2026-03-28 08:31:40 [auto1.be] INFO: Found listing with ID: TV92859
2026-03-28 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV92859%27 HTTP/1.1" 200 None
2026-03-28 08:31:40 [auto1.be] INFO: Scrape type for TV92859: 0
2026-03-28 08:31:40 [auto1.be] INFO: Found listing with ID: CS46585
2026-03-28 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS46585%27 HTTP/1.1" 200 None
2026-03-28 08:31:40 [auto1.be] INFO: Scrape type for CS46585: 0
2026-03-28 08:31:40 [auto1.be] INFO: Found listing with ID: TS12124
2026-03-28 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS12124%27 HTTP/1.1" 200 None
2026-03-28 08:31:40 [auto1.be] INFO: Scrape type for TS12124: 0
2026-03-28 08:31:40 [auto1.be] INFO: Found listing with ID: CM71971
2026-03-28 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM71971%27 HTTP/1.1" 200 None
2026-03-28 08:31:40 [auto1.be] INFO: Scrape type for CM71971: 2
2026-03-28 08:31:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0f9bcab-5950-5941-b3cd-d076d2d4c700 with identifier: CM71971
2026-03-28 08:31:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0f9bcab-5950-5941-b3cd-d076d2d4c700 with scrape type 2
2026-03-28 08:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0f9bcab-5950-5941-b3cd-d076d2d4c700 with scrape type 2
2026-03-28 08:31:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b0f9bcab-5950-5941-b3cd-d076d2d4c700, identifier: CM71971
2026-03-28 08:31:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b0f9bcab-5950-5941-b3cd-d076d2d4c700 with identifier: CM71971
2026-03-28 08:31:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b0f9bcab-5950-5941-b3cd-d076d2d4c700 with identifier: CM71971
2026-03-28 08:31:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b0f9bcab-5950-5941-b3cd-d076d2d4c700 with identifier: CM71971 to the API
2026-03-28 08:31:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:09:34Z',
'fuel_type': 'diesel',
'id': 'b0f9bcab-5950-5941-b3cd-d076d2d4c700',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM71971',
'listing': 'auction',
'make': 'Opel',
'model': 'Antara',
'odometer': 140573,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-21',
'seller_name': None,
'title': 'Opel Antara 2.0 CDTI Edition 4x2',
'transmission': 'manual',
'trim': 'Edition 4x2',
'year': 2009}
2026-03-28 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM71971%27 HTTP/1.1" 200 None
2026-03-28 08:31:40 [auto1.be] INFO: Saving data for CM71971: {'auction_closing_time': 1774714174.0, 'created_time': 1774471322.533252, 'last_price_update_time': 1774686700.625442}
2026-03-28 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CM71971') HTTP/1.1" 204 0
2026-03-28 08:31:40 [auto1.be] INFO: Found listing with ID: DY95002
2026-03-28 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY95002%27 HTTP/1.1" 200 None
2026-03-28 08:31:40 [auto1.be] INFO: Scrape type for DY95002: 0
2026-03-28 08:31:40 [auto1.be] INFO: Found listing with ID: CH34151
2026-03-28 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH34151%27 HTTP/1.1" 200 None
2026-03-28 08:31:40 [auto1.be] INFO: Scrape type for CH34151: 0
2026-03-28 08:31:40 [auto1.be] INFO: Found listing with ID: BC32945
2026-03-28 08:31:40 [auto1.be] INFO: Found listing with ID: TK93480
2026-03-28 08:31:40 [auto1.be] INFO: Found listing with ID: VY13057
2026-03-28 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VY13057%27 HTTP/1.1" 200 None
2026-03-28 08:31:40 [auto1.be] INFO: Scrape type for VY13057: 0
2026-03-28 08:31:40 [auto1.be] INFO: Found listing with ID: FG30090
2026-03-28 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG30090%27 HTTP/1.1" 200 None
2026-03-28 08:31:40 [auto1.be] INFO: Scrape type for FG30090: 2
2026-03-28 08:31:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84c312ec-e999-5c97-b86f-46322771cde8 with identifier: FG30090
2026-03-28 08:31:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84c312ec-e999-5c97-b86f-46322771cde8 with scrape type 2
2026-03-28 08:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84c312ec-e999-5c97-b86f-46322771cde8 with scrape type 2
2026-03-28 08:31:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 84c312ec-e999-5c97-b86f-46322771cde8, identifier: FG30090
2026-03-28 08:31:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 84c312ec-e999-5c97-b86f-46322771cde8 with identifier: FG30090
2026-03-28 08:31:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 84c312ec-e999-5c97-b86f-46322771cde8 with identifier: FG30090
2026-03-28 08:31:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 84c312ec-e999-5c97-b86f-46322771cde8 with identifier: FG30090 to the API
2026-03-28 08:31:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-28T16:00:16Z',
'fuel_type': 'petrol',
'id': '84c312ec-e999-5c97-b86f-46322771cde8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG30090',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3 Aircross',
'odometer': 59600,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-24',
'seller_name': None,
'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
'transmission': 'automatic',
'trim': 'Shine',
'year': 2021}
2026-03-28 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG30090%27 HTTP/1.1" 200 None
2026-03-28 08:31:41 [auto1.be] INFO: Saving data for FG30090: {'auction_closing_time': 1774713616.0, 'created_time': 1774471044.626022, 'last_price_update_time': 1774686701.097726}
2026-03-28 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FG30090') HTTP/1.1" 204 0
2026-03-28 08:31:41 [auto1.be] INFO: Found listing with ID: UC23117
2026-03-28 08:31:41 [auto1.be] INFO: Found listing with ID: MK11042
2026-03-28 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK11042%27 HTTP/1.1" 200 None
2026-03-28 08:31:41 [auto1.be] INFO: Scrape type for MK11042: 0
2026-03-28 08:31:41 [auto1.be] INFO: Found listing with ID: PD86825
2026-03-28 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD86825%27 HTTP/1.1" 200 None
2026-03-28 08:31:41 [auto1.be] INFO: Scrape type for PD86825: 0
2026-03-28 08:31:41 [auto1.be] INFO: Found listing with ID: WS17719
2026-03-28 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WS17719%27 HTTP/1.1" 200 None
2026-03-28 08:31:41 [auto1.be] INFO: Scrape type for WS17719: 0
2026-03-28 08:31:41 [auto1.be] INFO: Found listing with ID: MJ84457
2026-03-28 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ84457%27 HTTP/1.1" 200 None
2026-03-28 08:31:41 [auto1.be] INFO: Scrape type for MJ84457: 2
2026-03-28 08:31:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c07b09d7-7d91-52cb-a704-3655260765a5 with identifier: MJ84457
2026-03-28 08:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c07b09d7-7d91-52cb-a704-3655260765a5 with scrape type 2
2026-03-28 08:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c07b09d7-7d91-52cb-a704-3655260765a5 with scrape type 2
2026-03-28 08:31:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c07b09d7-7d91-52cb-a704-3655260765a5, identifier: MJ84457
2026-03-28 08:31:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c07b09d7-7d91-52cb-a704-3655260765a5 with identifier: MJ84457
2026-03-28 08:31:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c07b09d7-7d91-52cb-a704-3655260765a5 with identifier: MJ84457
2026-03-28 08:31:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c07b09d7-7d91-52cb-a704-3655260765a5 with identifier: MJ84457 to the API
2026-03-28 08:31:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:13:00Z',
'fuel_type': 'diesel',
'id': 'c07b09d7-7d91-52cb-a704-3655260765a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ84457',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 82493,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-05',
'seller_name': None,
'title': 'Peugeot 3008 1.6 HDi Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2012}
2026-03-28 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ84457%27 HTTP/1.1" 200 None
2026-03-28 08:31:41 [auto1.be] INFO: Saving data for MJ84457: {'auction_closing_time': 1774714380.0, 'created_time': 1774471032.55758, 'last_price_update_time': 1774686701.6649}
2026-03-28 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MJ84457') HTTP/1.1" 204 0
2026-03-28 08:31:41 [auto1.be] INFO: Found listing with ID: HJ27727
2026-03-28 08:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:31:42 [auto1.be] INFO: Channel: 24h | Page: 22 | totalHits: 1701 | hits on page: 40
2026-03-28 08:31:42 [auto1.be] INFO: Found listing with ID: AP97194
2026-03-28 08:31:42 [auto1.be] INFO: Found listing with ID: LT43988
2026-03-28 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT43988%27 HTTP/1.1" 200 None
2026-03-28 08:31:42 [auto1.be] INFO: Scrape type for LT43988: 0
2026-03-28 08:31:42 [auto1.be] INFO: Found listing with ID: GV95180
2026-03-28 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV95180%27 HTTP/1.1" 200 None
2026-03-28 08:31:42 [auto1.be] INFO: Scrape type for GV95180: 2
2026-03-28 08:31:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3760efa3-2d9b-5949-93f4-fee7724decbe with identifier: GV95180
2026-03-28 08:31:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3760efa3-2d9b-5949-93f4-fee7724decbe with scrape type 2
2026-03-28 08:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3760efa3-2d9b-5949-93f4-fee7724decbe with scrape type 2
2026-03-28 08:31:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3760efa3-2d9b-5949-93f4-fee7724decbe, identifier: GV95180
2026-03-28 08:31:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3760efa3-2d9b-5949-93f4-fee7724decbe with identifier: GV95180
2026-03-28 08:31:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3760efa3-2d9b-5949-93f4-fee7724decbe with identifier: GV95180
2026-03-28 08:31:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3760efa3-2d9b-5949-93f4-fee7724decbe with identifier: GV95180 to the API
2026-03-28 08:31:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-28T16:02:39Z',
'fuel_type': 'diesel',
'id': '3760efa3-2d9b-5949-93f4-fee7724decbe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV95180',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 151491,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-10',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2019}
2026-03-28 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV95180%27 HTTP/1.1" 200 None
2026-03-28 08:31:42 [auto1.be] INFO: Saving data for GV95180: {'auction_closing_time': 1774713759.0, 'created_time': 1774471008.994891, 'last_price_update_time': 1774686702.944804}
2026-03-28 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GV95180') HTTP/1.1" 204 0
2026-03-28 08:31:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:31:42 [auto1.be] INFO: Found listing with ID: TP87063
2026-03-28 08:31:42 [auto1.be] INFO: Found listing with ID: DY90857
2026-03-28 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY90857%27 HTTP/1.1" 200 None
2026-03-28 08:31:42 [auto1.be] INFO: Scrape type for DY90857: 0
2026-03-28 08:31:42 [auto1.be] INFO: Found listing with ID: BF21618
2026-03-28 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BF21618%27 HTTP/1.1" 200 None
2026-03-28 08:31:42 [auto1.be] INFO: Scrape type for BF21618: 0
2026-03-28 08:31:42 [auto1.be] INFO: Found listing with ID: TX99790
2026-03-28 08:31:42 [auto1.be] INFO: Found listing with ID: BZ65544
2026-03-28 08:31:42 [auto1.be] INFO: Found listing with ID: JL40552
2026-03-28 08:31:42 [auto1.be] INFO: Found listing with ID: ZC05502
2026-03-28 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC05502%27 HTTP/1.1" 200 None
2026-03-28 08:31:43 [auto1.be] INFO: Scrape type for ZC05502: 0
2026-03-28 08:31:43 [auto1.be] INFO: Found listing with ID: EL40372
2026-03-28 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL40372%27 HTTP/1.1" 200 None
2026-03-28 08:31:43 [auto1.be] INFO: Scrape type for EL40372: 0
2026-03-28 08:31:43 [auto1.be] INFO: Found listing with ID: NA79982
2026-03-28 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA79982%27 HTTP/1.1" 200 None
2026-03-28 08:31:43 [auto1.be] INFO: Scrape type for NA79982: 0
2026-03-28 08:31:43 [auto1.be] INFO: Found listing with ID: CA12532
2026-03-28 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA12532%27 HTTP/1.1" 200 None
2026-03-28 08:31:43 [auto1.be] INFO: Scrape type for CA12532: 2
2026-03-28 08:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fba4bd05-a566-54a0-b768-aec089ca6446 with identifier: CA12532
2026-03-28 08:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fba4bd05-a566-54a0-b768-aec089ca6446 with scrape type 2
2026-03-28 08:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fba4bd05-a566-54a0-b768-aec089ca6446 with scrape type 2
2026-03-28 08:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fba4bd05-a566-54a0-b768-aec089ca6446, identifier: CA12532
2026-03-28 08:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fba4bd05-a566-54a0-b768-aec089ca6446 with identifier: CA12532
2026-03-28 08:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fba4bd05-a566-54a0-b768-aec089ca6446 with identifier: CA12532
2026-03-28 08:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fba4bd05-a566-54a0-b768-aec089ca6446 with identifier: CA12532 to the API
2026-03-28 08:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-28T16:12:34Z',
'fuel_type': 'diesel',
'id': 'fba4bd05-a566-54a0-b768-aec089ca6446',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA12532',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 239739,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-25',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180 CDI',
'transmission': 'manual',
'trim': '',
'year': 2009}
2026-03-28 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA12532%27 HTTP/1.1" 200 None
2026-03-28 08:31:43 [auto1.be] INFO: Saving data for CA12532: {'auction_closing_time': 1774714354.0, 'created_time': 1774471354.649827, 'last_price_update_time': 1774686703.451166}
2026-03-28 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CA12532') HTTP/1.1" 204 0
2026-03-28 08:31:43 [auto1.be] INFO: Found listing with ID: AB89489
2026-03-28 08:31:43 [auto1.be] INFO: Found listing with ID: JF41683
2026-03-28 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF41683%27 HTTP/1.1" 200 None
2026-03-28 08:31:43 [auto1.be] INFO: Scrape type for JF41683: 0
2026-03-28 08:31:43 [auto1.be] INFO: Found listing with ID: FR80699
2026-03-28 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR80699%27 HTTP/1.1" 200 None
2026-03-28 08:31:43 [auto1.be] INFO: Scrape type for FR80699: 0
2026-03-28 08:31:43 [auto1.be] INFO: Found listing with ID: SE23508
2026-03-28 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE23508%27 HTTP/1.1" 200 None
2026-03-28 08:31:43 [auto1.be] INFO: Scrape type for SE23508: 0
2026-03-28 08:31:43 [auto1.be] INFO: Found listing with ID: YS56392
2026-03-28 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS56392%27 HTTP/1.1" 200 None
2026-03-28 08:31:43 [auto1.be] INFO: Scrape type for YS56392: 0
2026-03-28 08:31:43 [auto1.be] INFO: Found listing with ID: AF35218
2026-03-28 08:31:43 [auto1.be] INFO: Found listing with ID: WG25655
2026-03-28 08:31:43 [auto1.be] INFO: Found listing with ID: CX21788
2026-03-28 08:31:43 [auto1.be] INFO: Found listing with ID: MG71639
2026-03-28 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG71639%27 HTTP/1.1" 200 None
2026-03-28 08:31:43 [auto1.be] INFO: Scrape type for MG71639: 0
2026-03-28 08:31:43 [auto1.be] INFO: Found listing with ID: XT74022
2026-03-28 08:31:43 [auto1.be] INFO: Found listing with ID: XE18058
2026-03-28 08:31:43 [auto1.be] INFO: Found listing with ID: XC37877
2026-03-28 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC37877%27 HTTP/1.1" 200 None
2026-03-28 08:31:43 [auto1.be] INFO: Scrape type for XC37877: 0
2026-03-28 08:31:43 [auto1.be] INFO: Found listing with ID: PN62826
2026-03-28 08:31:43 [auto1.be] INFO: Found listing with ID: BR44079
2026-03-28 08:31:43 [auto1.be] INFO: Found listing with ID: CT30439
2026-03-28 08:31:43 [auto1.be] INFO: Found listing with ID: KN27020
2026-03-28 08:31:43 [auto1.be] INFO: Found listing with ID: KP60973
2026-03-28 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP60973%27 HTTP/1.1" 200 None
2026-03-28 08:31:43 [auto1.be] INFO: Scrape type for KP60973: 2
2026-03-28 08:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7a62807-3026-5d6e-a301-9c8a81b65444 with identifier: KP60973
2026-03-28 08:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7a62807-3026-5d6e-a301-9c8a81b65444 with scrape type 2
2026-03-28 08:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7a62807-3026-5d6e-a301-9c8a81b65444 with scrape type 2
2026-03-28 08:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d7a62807-3026-5d6e-a301-9c8a81b65444, identifier: KP60973
2026-03-28 08:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d7a62807-3026-5d6e-a301-9c8a81b65444 with identifier: KP60973
2026-03-28 08:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d7a62807-3026-5d6e-a301-9c8a81b65444 with identifier: KP60973
2026-03-28 08:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d7a62807-3026-5d6e-a301-9c8a81b65444 with identifier: KP60973 to the API
2026-03-28 08:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:58:20Z',
'fuel_type': 'diesel',
'id': 'd7a62807-3026-5d6e-a301-9c8a81b65444',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP60973',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 309593,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-07',
'seller_name': None,
'title': 'Skoda Octavia 1.6 TDI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2019}
2026-03-28 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP60973%27 HTTP/1.1" 200 None
2026-03-28 08:31:44 [auto1.be] INFO: Saving data for KP60973: {'auction_closing_time': 1774717100.0, 'created_time': 1774471289.101005, 'last_price_update_time': 1774686704.054554}
2026-03-28 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KP60973') HTTP/1.1" 204 0
2026-03-28 08:31:44 [auto1.be] INFO: Found listing with ID: NK66135
2026-03-28 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK66135%27 HTTP/1.1" 200 None
2026-03-28 08:31:44 [auto1.be] INFO: Scrape type for NK66135: 0
2026-03-28 08:31:44 [auto1.be] INFO: Found listing with ID: BK01349
2026-03-28 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BK01349%27 HTTP/1.1" 200 None
2026-03-28 08:31:44 [auto1.be] INFO: Scrape type for BK01349: 0
2026-03-28 08:31:44 [auto1.be] INFO: Found listing with ID: JY55711
2026-03-28 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY55711%27 HTTP/1.1" 200 None
2026-03-28 08:31:44 [auto1.be] INFO: Scrape type for JY55711: 2
2026-03-28 08:31:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3943addc-84f6-5c3f-ad12-71d1c7e84e1c with identifier: JY55711
2026-03-28 08:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3943addc-84f6-5c3f-ad12-71d1c7e84e1c with scrape type 2
2026-03-28 08:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3943addc-84f6-5c3f-ad12-71d1c7e84e1c with scrape type 2
2026-03-28 08:31:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3943addc-84f6-5c3f-ad12-71d1c7e84e1c, identifier: JY55711
2026-03-28 08:31:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3943addc-84f6-5c3f-ad12-71d1c7e84e1c with identifier: JY55711
2026-03-28 08:31:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3943addc-84f6-5c3f-ad12-71d1c7e84e1c with identifier: JY55711
2026-03-28 08:31:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3943addc-84f6-5c3f-ad12-71d1c7e84e1c with identifier: JY55711 to the API
2026-03-28 08:31:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:22:06Z',
'fuel_type': 'diesel',
'id': '3943addc-84f6-5c3f-ad12-71d1c7e84e1c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY55711',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 141895,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-02-11',
'seller_name': None,
'title': 'Skoda Octavia 1.9 TDI Ambiente',
'transmission': 'automatic',
'trim': 'Ambiente',
'year': 2007}
2026-03-28 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY55711%27 HTTP/1.1" 200 None
2026-03-28 08:31:44 [auto1.be] INFO: Saving data for JY55711: {'auction_closing_time': 1774714926.0, 'created_time': 1774471350.324953, 'last_price_update_time': 1774686704.592359}
2026-03-28 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JY55711') HTTP/1.1" 204 0
2026-03-28 08:31:44 [auto1.be] INFO: Found listing with ID: NP40379
2026-03-28 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP40379%27 HTTP/1.1" 200 None
2026-03-28 08:31:44 [auto1.be] INFO: Scrape type for NP40379: 0
2026-03-28 08:31:44 [auto1.be] INFO: Found listing with ID: RX78624
2026-03-28 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX78624%27 HTTP/1.1" 200 None
2026-03-28 08:31:44 [auto1.be] INFO: Scrape type for RX78624: 0
2026-03-28 08:31:44 [auto1.be] INFO: Found listing with ID: AC35394
2026-03-28 08:31:44 [auto1.be] INFO: Found listing with ID: RK82839
2026-03-28 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK82839%27 HTTP/1.1" 200 None
2026-03-28 08:31:44 [auto1.be] INFO: Scrape type for RK82839: 0
2026-03-28 08:31:44 [auto1.be] INFO: Found listing with ID: CD06973
2026-03-28 08:31:44 [auto1.be] INFO: Found listing with ID: JX10335
2026-03-28 08:31:44 [auto1.be] INFO: Found listing with ID: TL70885
2026-03-28 08:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:31:45 [auto1.be] INFO: Channel: 24h | Page: 23 | totalHits: 1701 | hits on page: 40
2026-03-28 08:31:45 [auto1.be] INFO: Found listing with ID: TW22956
2026-03-28 08:31:45 [auto1.be] INFO: Found listing with ID: MN41841
2026-03-28 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MN41841%27 HTTP/1.1" 200 None
2026-03-28 08:31:45 [auto1.be] INFO: Scrape type for MN41841: 0
2026-03-28 08:31:45 [auto1.be] INFO: Found listing with ID: HM70865
2026-03-28 08:31:45 [auto1.be] INFO: Found listing with ID: RR60731
2026-03-28 08:31:45 [auto1.be] INFO: Found listing with ID: VW71513
2026-03-28 08:31:45 [auto1.be] INFO: Found listing with ID: KM93600
2026-03-28 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM93600%27 HTTP/1.1" 200 None
2026-03-28 08:31:45 [auto1.be] INFO: Scrape type for KM93600: 0
2026-03-28 08:31:45 [auto1.be] INFO: Found listing with ID: HD23270
2026-03-28 08:31:45 [auto1.be] INFO: Found listing with ID: DH79590
2026-03-28 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH79590%27 HTTP/1.1" 200 None
2026-03-28 08:31:45 [auto1.be] INFO: Scrape type for DH79590: 2
2026-03-28 08:31:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69ee43ef-0ec5-5060-84ad-fbbc2d070582 with identifier: DH79590
2026-03-28 08:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69ee43ef-0ec5-5060-84ad-fbbc2d070582 with scrape type 2
2026-03-28 08:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69ee43ef-0ec5-5060-84ad-fbbc2d070582 with scrape type 2
2026-03-28 08:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 69ee43ef-0ec5-5060-84ad-fbbc2d070582, identifier: DH79590
2026-03-28 08:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 69ee43ef-0ec5-5060-84ad-fbbc2d070582 with identifier: DH79590
2026-03-28 08:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 69ee43ef-0ec5-5060-84ad-fbbc2d070582 with identifier: DH79590
2026-03-28 08:31:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 69ee43ef-0ec5-5060-84ad-fbbc2d070582 with identifier: DH79590 to the API
2026-03-28 08:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:56:24Z',
'fuel_type': 'petrol',
'id': '69ee43ef-0ec5-5060-84ad-fbbc2d070582',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH79590',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 183890,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-31',
'seller_name': None,
'title': 'Dacia Sandero 1.2 Ambiance',
'transmission': 'manual',
'trim': 'Ambiance',
'year': 2015}
2026-03-28 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH79590%27 HTTP/1.1" 200 None
2026-03-28 08:31:45 [auto1.be] INFO: Saving data for DH79590: {'auction_closing_time': 1774716984.0, 'created_time': 1774471277.818564, 'last_price_update_time': 1774686705.925276}
2026-03-28 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DH79590') HTTP/1.1" 204 0
2026-03-28 08:31:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:31:46 [auto1.be] INFO: Found listing with ID: ZH69808
2026-03-28 08:31:46 [auto1.be] INFO: Found listing with ID: WP21428
2026-03-28 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP21428%27 HTTP/1.1" 200 None
2026-03-28 08:31:46 [auto1.be] INFO: Scrape type for WP21428: 0
2026-03-28 08:31:46 [auto1.be] INFO: Found listing with ID: SD12606
2026-03-28 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD12606%27 HTTP/1.1" 200 None
2026-03-28 08:31:46 [auto1.be] INFO: Scrape type for SD12606: 0
2026-03-28 08:31:46 [auto1.be] INFO: Found listing with ID: NZ68355
2026-03-28 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ68355%27 HTTP/1.1" 200 None
2026-03-28 08:31:46 [auto1.be] INFO: Scrape type for NZ68355: 2
2026-03-28 08:31:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faf6518a-ff1e-5a9a-88ec-d1907daa5424 with identifier: NZ68355
2026-03-28 08:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faf6518a-ff1e-5a9a-88ec-d1907daa5424 with scrape type 2
2026-03-28 08:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item faf6518a-ff1e-5a9a-88ec-d1907daa5424 with scrape type 2
2026-03-28 08:31:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: faf6518a-ff1e-5a9a-88ec-d1907daa5424, identifier: NZ68355
2026-03-28 08:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: faf6518a-ff1e-5a9a-88ec-d1907daa5424 with identifier: NZ68355
2026-03-28 08:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: faf6518a-ff1e-5a9a-88ec-d1907daa5424 with identifier: NZ68355
2026-03-28 08:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: faf6518a-ff1e-5a9a-88ec-d1907daa5424 with identifier: NZ68355 to the API
2026-03-28 08:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-28T16:05:05Z',
'fuel_type': 'diesel',
'id': 'faf6518a-ff1e-5a9a-88ec-d1907daa5424',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ68355',
'listing': 'auction',
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 128940,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-11',
'seller_name': None,
'title': 'Audi A3 Sportback 1.6 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2019}
2026-03-28 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ68355%27 HTTP/1.1" 200 None
2026-03-28 08:31:46 [auto1.be] INFO: Saving data for NZ68355: {'auction_closing_time': 1774713905.0, 'created_time': 1774471382.200671, 'last_price_update_time': 1774686706.487174}
2026-03-28 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NZ68355') HTTP/1.1" 204 0
2026-03-28 08:31:46 [auto1.be] INFO: Found listing with ID: EM34677
2026-03-28 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM34677%27 HTTP/1.1" 200 None
2026-03-28 08:31:46 [auto1.be] INFO: Scrape type for EM34677: 0
2026-03-28 08:31:46 [auto1.be] INFO: Found listing with ID: UF35860
2026-03-28 08:31:46 [auto1.be] INFO: Found listing with ID: MR16317
2026-03-28 08:31:46 [auto1.be] INFO: Found listing with ID: CP38880
2026-03-28 08:31:46 [auto1.be] INFO: Found listing with ID: VW93174
2026-03-28 08:31:46 [auto1.be] INFO: Found listing with ID: SJ72272
2026-03-28 08:31:46 [auto1.be] INFO: Found listing with ID: SW05863
2026-03-28 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW05863%27 HTTP/1.1" 200 None
2026-03-28 08:31:46 [auto1.be] INFO: Scrape type for SW05863: 0
2026-03-28 08:31:46 [auto1.be] INFO: Found listing with ID: ZB89914
2026-03-28 08:31:46 [auto1.be] INFO: Found listing with ID: EW28397
2026-03-28 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EW28397%27 HTTP/1.1" 200 None
2026-03-28 08:31:46 [auto1.be] INFO: Scrape type for EW28397: 0
2026-03-28 08:31:46 [auto1.be] INFO: Found listing with ID: CZ35254
2026-03-28 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CZ35254%27 HTTP/1.1" 200 None
2026-03-28 08:31:46 [auto1.be] INFO: Scrape type for CZ35254: 0
2026-03-28 08:31:46 [auto1.be] INFO: Found listing with ID: XU40393
2026-03-28 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU40393%27 HTTP/1.1" 200 None
2026-03-28 08:31:46 [auto1.be] INFO: Scrape type for XU40393: 0
2026-03-28 08:31:46 [auto1.be] INFO: Found listing with ID: DK36221
2026-03-28 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK36221%27 HTTP/1.1" 200 None
2026-03-28 08:31:46 [auto1.be] INFO: Scrape type for DK36221: 2
2026-03-28 08:31:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7b3d222-93cc-595b-84a5-b13a85ca0d55 with identifier: DK36221
2026-03-28 08:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7b3d222-93cc-595b-84a5-b13a85ca0d55 with scrape type 2
2026-03-28 08:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7b3d222-93cc-595b-84a5-b13a85ca0d55 with scrape type 2
2026-03-28 08:31:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b7b3d222-93cc-595b-84a5-b13a85ca0d55, identifier: DK36221
2026-03-28 08:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b7b3d222-93cc-595b-84a5-b13a85ca0d55 with identifier: DK36221
2026-03-28 08:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b7b3d222-93cc-595b-84a5-b13a85ca0d55 with identifier: DK36221
2026-03-28 08:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b7b3d222-93cc-595b-84a5-b13a85ca0d55 with identifier: DK36221 to the API
2026-03-28 08:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 200,
'expiration_date': '2026-03-28T16:52:56Z',
'fuel_type': 'diesel',
'id': 'b7b3d222-93cc-595b-84a5-b13a85ca0d55',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK36221',
'listing': 'auction',
'make': 'Ford',
'model': 'Ranger',
'odometer': 64401,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-31',
'seller_name': None,
'title': 'Ford Ranger 3.2 TDCi Doppelkabine Limited 4x4',
'transmission': 'automatic',
'trim': 'Doppelkabine Limited 4x4',
'year': 2020}
2026-03-28 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK36221%27 HTTP/1.1" 200 None
2026-03-28 08:31:47 [auto1.be] INFO: Saving data for DK36221: {'auction_closing_time': 1774716776.0, 'created_time': 1774471327.851849, 'last_price_update_time': 1774686707.061192}
2026-03-28 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DK36221') HTTP/1.1" 204 0
2026-03-28 08:31:47 [auto1.be] INFO: Found listing with ID: RS16246
2026-03-28 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS16246%27 HTTP/1.1" 200 None
2026-03-28 08:31:47 [auto1.be] INFO: Scrape type for RS16246: 0
2026-03-28 08:31:47 [auto1.be] INFO: Found listing with ID: ZC75548
2026-03-28 08:31:47 [auto1.be] INFO: Found listing with ID: CW36552
2026-03-28 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW36552%27 HTTP/1.1" 200 None
2026-03-28 08:31:47 [auto1.be] INFO: Scrape type for CW36552: 0
2026-03-28 08:31:47 [auto1.be] INFO: Found listing with ID: XC31503
2026-03-28 08:31:47 [auto1.be] INFO: Found listing with ID: CB02189
2026-03-28 08:31:47 [auto1.be] INFO: Found listing with ID: FJ85398
2026-03-28 08:31:47 [auto1.be] INFO: Found listing with ID: EN96756
2026-03-28 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN96756%27 HTTP/1.1" 200 None
2026-03-28 08:31:47 [auto1.be] INFO: Scrape type for EN96756: 2
2026-03-28 08:31:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e85cd92-d353-5043-a8ec-8f604c4c8bbe with identifier: EN96756
2026-03-28 08:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e85cd92-d353-5043-a8ec-8f604c4c8bbe with scrape type 2
2026-03-28 08:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e85cd92-d353-5043-a8ec-8f604c4c8bbe with scrape type 2
2026-03-28 08:31:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9e85cd92-d353-5043-a8ec-8f604c4c8bbe, identifier: EN96756
2026-03-28 08:31:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9e85cd92-d353-5043-a8ec-8f604c4c8bbe with identifier: EN96756
2026-03-28 08:31:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9e85cd92-d353-5043-a8ec-8f604c4c8bbe with identifier: EN96756
2026-03-28 08:31:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9e85cd92-d353-5043-a8ec-8f604c4c8bbe with identifier: EN96756 to the API
2026-03-28 08:31:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:04:37Z',
'fuel_type': 'petrol',
'id': '9e85cd92-d353-5043-a8ec-8f604c4c8bbe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN96756',
'listing': 'auction',
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 78578,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-10',
'seller_name': None,
'title': 'Audi A1 Sportback 1.0 TFSI Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2018}
2026-03-28 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN96756%27 HTTP/1.1" 200 None
2026-03-28 08:31:47 [auto1.be] INFO: Saving data for EN96756: {'auction_closing_time': 1774713877.0, 'created_time': 1774471321.830817, 'last_price_update_time': 1774686707.618424}
2026-03-28 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EN96756') HTTP/1.1" 204 0
2026-03-28 08:31:47 [auto1.be] INFO: Found listing with ID: RG16696
2026-03-28 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RG16696%27 HTTP/1.1" 200 None
2026-03-28 08:31:47 [auto1.be] INFO: Scrape type for RG16696: 0
2026-03-28 08:31:47 [auto1.be] INFO: Found listing with ID: PC39555
2026-03-28 08:31:47 [auto1.be] INFO: Found listing with ID: FD01860
2026-03-28 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FD01860%27 HTTP/1.1" 200 None
2026-03-28 08:31:47 [auto1.be] INFO: Scrape type for FD01860: 0
2026-03-28 08:31:47 [auto1.be] INFO: Found listing with ID: PE06051
2026-03-28 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE06051%27 HTTP/1.1" 200 None
2026-03-28 08:31:47 [auto1.be] INFO: Scrape type for PE06051: 0
2026-03-28 08:31:47 [auto1.be] INFO: Found listing with ID: GN71373
2026-03-28 08:31:47 [auto1.be] INFO: Found listing with ID: KV01738
2026-03-28 08:31:47 [auto1.be] INFO: Found listing with ID: XN84271
2026-03-28 08:31:47 [auto1.be] INFO: Found listing with ID: PH78267
2026-03-28 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH78267%27 HTTP/1.1" 200 None
2026-03-28 08:31:47 [auto1.be] INFO: Scrape type for PH78267: 0
2026-03-28 08:31:47 [auto1.be] INFO: Found listing with ID: NN99297
2026-03-28 08:31:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:31:48 [auto1.be] INFO: Channel: 24h | Page: 24 | totalHits: 1701 | hits on page: 40
2026-03-28 08:31:48 [auto1.be] INFO: Found listing with ID: YS23980
2026-03-28 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS23980%27 HTTP/1.1" 200 None
2026-03-28 08:31:48 [auto1.be] INFO: Scrape type for YS23980: 0
2026-03-28 08:31:48 [auto1.be] INFO: Found listing with ID: HW03040
2026-03-28 08:31:48 [auto1.be] INFO: Found listing with ID: HZ19238
2026-03-28 08:31:48 [auto1.be] INFO: Found listing with ID: SU19738
2026-03-28 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU19738%27 HTTP/1.1" 200 None
2026-03-28 08:31:48 [auto1.be] INFO: Scrape type for SU19738: 0
2026-03-28 08:31:48 [auto1.be] INFO: Found listing with ID: XN65088
2026-03-28 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN65088%27 HTTP/1.1" 200 None
2026-03-28 08:31:48 [auto1.be] INFO: Scrape type for XN65088: 0
2026-03-28 08:31:48 [auto1.be] INFO: Found listing with ID: YH93162
2026-03-28 08:31:48 [auto1.be] INFO: Found listing with ID: FB63888
2026-03-28 08:31:48 [auto1.be] INFO: Found listing with ID: YW61664
2026-03-28 08:31:48 [auto1.be] INFO: Found listing with ID: MB61651
2026-03-28 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB61651%27 HTTP/1.1" 200 None
2026-03-28 08:31:48 [auto1.be] INFO: Scrape type for MB61651: 0
2026-03-28 08:31:48 [auto1.be] INFO: Found listing with ID: JL90308
2026-03-28 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JL90308%27 HTTP/1.1" 200 None
2026-03-28 08:31:48 [auto1.be] INFO: Scrape type for JL90308: 2
2026-03-28 08:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51f4a086-2f2b-518c-9e3d-24ccbc9575af with identifier: JL90308
2026-03-28 08:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51f4a086-2f2b-518c-9e3d-24ccbc9575af with scrape type 2
2026-03-28 08:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51f4a086-2f2b-518c-9e3d-24ccbc9575af with scrape type 2
2026-03-28 08:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 51f4a086-2f2b-518c-9e3d-24ccbc9575af, identifier: JL90308
2026-03-28 08:31:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 51f4a086-2f2b-518c-9e3d-24ccbc9575af with identifier: JL90308
2026-03-28 08:31:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 51f4a086-2f2b-518c-9e3d-24ccbc9575af with identifier: JL90308
2026-03-28 08:31:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 51f4a086-2f2b-518c-9e3d-24ccbc9575af with identifier: JL90308 to the API
2026-03-28 08:31:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-28T16:52:36Z',
'fuel_type': 'diesel',
'id': '51f4a086-2f2b-518c-9e3d-24ccbc9575af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL90308',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 89253,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-03-31',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 CDI Avantgarde',
'transmission': 'manual',
'trim': 'Avantgarde',
'year': 2009}
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JL90308%27 HTTP/1.1" 200 None
2026-03-28 08:31:49 [auto1.be] INFO: Saving data for JL90308: {'auction_closing_time': 1774716756.0, 'created_time': 1774471305.608304, 'last_price_update_time': 1774686709.036209}
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JL90308') HTTP/1.1" 204 0
2026-03-28 08:31:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:31:49 [auto1.be] INFO: Found listing with ID: TR87241
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR87241%27 HTTP/1.1" 200 None
2026-03-28 08:31:49 [auto1.be] INFO: Scrape type for TR87241: 0
2026-03-28 08:31:49 [auto1.be] INFO: Found listing with ID: ZC87174
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC87174%27 HTTP/1.1" 200 None
2026-03-28 08:31:49 [auto1.be] INFO: Scrape type for ZC87174: 0
2026-03-28 08:31:49 [auto1.be] INFO: Found listing with ID: GX95713
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX95713%27 HTTP/1.1" 200 None
2026-03-28 08:31:49 [auto1.be] INFO: Scrape type for GX95713: 2
2026-03-28 08:31:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68522ad8-1c55-536b-b074-ae3f2ba84700 with identifier: GX95713
2026-03-28 08:31:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68522ad8-1c55-536b-b074-ae3f2ba84700 with scrape type 2
2026-03-28 08:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68522ad8-1c55-536b-b074-ae3f2ba84700 with scrape type 2
2026-03-28 08:31:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 68522ad8-1c55-536b-b074-ae3f2ba84700, identifier: GX95713
2026-03-28 08:31:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 68522ad8-1c55-536b-b074-ae3f2ba84700 with identifier: GX95713
2026-03-28 08:31:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 68522ad8-1c55-536b-b074-ae3f2ba84700 with identifier: GX95713
2026-03-28 08:31:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 68522ad8-1c55-536b-b074-ae3f2ba84700 with identifier: GX95713 to the API
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:29:55Z',
'fuel_type': 'diesel',
'id': '68522ad8-1c55-536b-b074-ae3f2ba84700',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX95713',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 212922,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-07-16',
'seller_name': None,
'title': 'Ford Focus 1.5 TDCi Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2017}
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX95713%27 HTTP/1.1" 200 None
2026-03-28 08:31:49 [auto1.be] INFO: Saving data for GX95713: {'auction_closing_time': 1774715395.0, 'created_time': 1774471226.865133, 'last_price_update_time': 1774686709.604408}
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GX95713') HTTP/1.1" 204 0
2026-03-28 08:31:49 [auto1.be] INFO: Found listing with ID: HE27589
2026-03-28 08:31:49 [auto1.be] INFO: Found listing with ID: XJ49438
2026-03-28 08:31:49 [auto1.be] INFO: Found listing with ID: FF99790
2026-03-28 08:31:49 [auto1.be] INFO: Found listing with ID: LT97220
2026-03-28 08:31:49 [auto1.be] INFO: Found listing with ID: MA95611
2026-03-28 08:31:49 [auto1.be] INFO: Found listing with ID: VP73114
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP73114%27 HTTP/1.1" 200 None
2026-03-28 08:31:49 [auto1.be] INFO: Scrape type for VP73114: 0
2026-03-28 08:31:49 [auto1.be] INFO: Found listing with ID: TC02969
2026-03-28 08:31:49 [auto1.be] INFO: Found listing with ID: YN67239
2026-03-28 08:31:49 [auto1.be] INFO: Found listing with ID: PF50688
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF50688%27 HTTP/1.1" 200 None
2026-03-28 08:31:49 [auto1.be] INFO: Scrape type for PF50688: 0
2026-03-28 08:31:49 [auto1.be] INFO: Found listing with ID: UF75491
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF75491%27 HTTP/1.1" 200 None
2026-03-28 08:31:49 [auto1.be] INFO: Scrape type for UF75491: 0
2026-03-28 08:31:49 [auto1.be] INFO: Found listing with ID: ZF78419
2026-03-28 08:31:49 [auto1.be] INFO: Found listing with ID: KW79847
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW79847%27 HTTP/1.1" 200 None
2026-03-28 08:31:49 [auto1.be] INFO: Scrape type for KW79847: 0
2026-03-28 08:31:49 [auto1.be] INFO: Found listing with ID: UL34611
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL34611%27 HTTP/1.1" 200 None
2026-03-28 08:31:49 [auto1.be] INFO: Scrape type for UL34611: 0
2026-03-28 08:31:49 [auto1.be] INFO: Found listing with ID: RW46644
2026-03-28 08:31:49 [auto1.be] INFO: Found listing with ID: BT09121
2026-03-28 08:31:49 [auto1.be] INFO: Found listing with ID: SD60477
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD60477%27 HTTP/1.1" 200 None
2026-03-28 08:31:49 [auto1.be] INFO: Scrape type for SD60477: 0
2026-03-28 08:31:49 [auto1.be] INFO: Found listing with ID: SM94010
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SM94010%27 HTTP/1.1" 200 None
2026-03-28 08:31:49 [auto1.be] INFO: Scrape type for SM94010: 0
2026-03-28 08:31:49 [auto1.be] INFO: Found listing with ID: RE48196
2026-03-28 08:31:49 [auto1.be] INFO: Found listing with ID: PS48856
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS48856%27 HTTP/1.1" 200 None
2026-03-28 08:31:49 [auto1.be] INFO: Scrape type for PS48856: 0
2026-03-28 08:31:49 [auto1.be] INFO: Found listing with ID: MS47880
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS47880%27 HTTP/1.1" 200 None
2026-03-28 08:31:49 [auto1.be] INFO: Scrape type for MS47880: 0
2026-03-28 08:31:49 [auto1.be] INFO: Found listing with ID: LH74784
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH74784%27 HTTP/1.1" 200 None
2026-03-28 08:31:49 [auto1.be] INFO: Scrape type for LH74784: 2
2026-03-28 08:31:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ef29622-ec3c-5765-91cc-fa1e173a2e92 with identifier: LH74784
2026-03-28 08:31:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ef29622-ec3c-5765-91cc-fa1e173a2e92 with scrape type 2
2026-03-28 08:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ef29622-ec3c-5765-91cc-fa1e173a2e92 with scrape type 2
2026-03-28 08:31:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3ef29622-ec3c-5765-91cc-fa1e173a2e92, identifier: LH74784
2026-03-28 08:31:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3ef29622-ec3c-5765-91cc-fa1e173a2e92 with identifier: LH74784
2026-03-28 08:31:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3ef29622-ec3c-5765-91cc-fa1e173a2e92 with identifier: LH74784
2026-03-28 08:31:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3ef29622-ec3c-5765-91cc-fa1e173a2e92 with identifier: LH74784 to the API
2026-03-28 08:31:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:43:38Z',
'fuel_type': 'diesel',
'id': '3ef29622-ec3c-5765-91cc-fa1e173a2e92',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH74784',
'listing': 'auction',
'make': 'Ford',
'model': 'S-Max',
'odometer': 162874,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-22',
'seller_name': None,
'title': 'Ford S-Max 2.0 TDCi EcoBlue Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2019}
2026-03-28 08:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH74784%27 HTTP/1.1" 200 None
2026-03-28 08:31:50 [auto1.be] INFO: Saving data for LH74784: {'auction_closing_time': 1774716218.0, 'created_time': 1774471372.626068, 'last_price_update_time': 1774686710.169078}
2026-03-28 08:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LH74784') HTTP/1.1" 204 0
2026-03-28 08:31:50 [auto1.be] INFO: Found listing with ID: CR21244
2026-03-28 08:31:50 [auto1.be] INFO: Found listing with ID: VA87646
2026-03-28 08:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA87646%27 HTTP/1.1" 200 None
2026-03-28 08:31:50 [auto1.be] INFO: Scrape type for VA87646: 0
2026-03-28 08:31:50 [auto1.be] INFO: Found listing with ID: NF55706
2026-03-28 08:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NF55706%27 HTTP/1.1" 200 None
2026-03-28 08:31:50 [auto1.be] INFO: Scrape type for NF55706: 0
2026-03-28 08:31:50 [auto1.be] INFO: Found listing with ID: PD78607
2026-03-28 08:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD78607%27 HTTP/1.1" 200 None
2026-03-28 08:31:50 [auto1.be] INFO: Scrape type for PD78607: 0
2026-03-28 08:31:50 [auto1.be] INFO: Found listing with ID: ZX58483
2026-03-28 08:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX58483%27 HTTP/1.1" 200 None
2026-03-28 08:31:50 [auto1.be] INFO: Scrape type for ZX58483: 0
2026-03-28 08:31:50 [auto1.be] INFO: Found listing with ID: KM67426
2026-03-28 08:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:31:51 [auto1.be] INFO: Channel: 24h | Page: 25 | totalHits: 1701 | hits on page: 40
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: GX65351
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX65351%27 HTTP/1.1" 200 None
2026-03-28 08:31:51 [auto1.be] INFO: Scrape type for GX65351: 0
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: ZM46816
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM46816%27 HTTP/1.1" 200 None
2026-03-28 08:31:51 [auto1.be] INFO: Scrape type for ZM46816: 0
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: XL43279
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: LM94739
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: HS55716
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: MJ01257
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: KG32291
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG32291%27 HTTP/1.1" 200 None
2026-03-28 08:31:51 [auto1.be] INFO: Scrape type for KG32291: 0
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: UB82847
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: TS87416
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS87416%27 HTTP/1.1" 200 None
2026-03-28 08:31:51 [auto1.be] INFO: Scrape type for TS87416: 0
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: HR21590
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: WG39475
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG39475%27 HTTP/1.1" 200 None
2026-03-28 08:31:51 [auto1.be] INFO: Scrape type for WG39475: 0
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: GT11330
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GT11330%27 HTTP/1.1" 200 None
2026-03-28 08:31:51 [auto1.be] INFO: Scrape type for GT11330: 0
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: NE31569
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: KS62440
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS62440%27 HTTP/1.1" 200 None
2026-03-28 08:31:51 [auto1.be] INFO: Scrape type for KS62440: 0
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: CL62340
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CL62340%27 HTTP/1.1" 200 None
2026-03-28 08:31:51 [auto1.be] INFO: Scrape type for CL62340: 0
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: HM84114
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM84114%27 HTTP/1.1" 200 None
2026-03-28 08:31:51 [auto1.be] INFO: Scrape type for HM84114: 0
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: TF25932
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: ND85214
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND85214%27 HTTP/1.1" 200 None
2026-03-28 08:31:51 [auto1.be] INFO: Scrape type for ND85214: 0
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: BD17756
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: EA67135
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA67135%27 HTTP/1.1" 200 None
2026-03-28 08:31:51 [auto1.be] INFO: Scrape type for EA67135: 0
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: MB15455
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: XK75143
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: WT96819
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: GE05105
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: BE11259
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BE11259%27 HTTP/1.1" 200 None
2026-03-28 08:31:51 [auto1.be] INFO: Scrape type for BE11259: 0
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: XM85548
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: LH22912
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: EP73132
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: YN92139
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: WP33906
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP33906%27 HTTP/1.1" 200 None
2026-03-28 08:31:51 [auto1.be] INFO: Scrape type for WP33906: 0
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: VU67376
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU67376%27 HTTP/1.1" 200 None
2026-03-28 08:31:51 [auto1.be] INFO: Scrape type for VU67376: 0
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: VH38978
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VH38978%27 HTTP/1.1" 200 None
2026-03-28 08:31:51 [auto1.be] INFO: Scrape type for VH38978: 0
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: YK21410
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: HN48415
2026-03-28 08:31:51 [auto1.be] INFO: Found listing with ID: TZ53898
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TZ53898%27 HTTP/1.1" 200 None
2026-03-28 08:31:51 [auto1.be] INFO: Scrape type for TZ53898: 2
2026-03-28 08:31:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3803234f-1c01-59eb-9bc3-193cbc9b8acf with identifier: TZ53898
2026-03-28 08:31:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3803234f-1c01-59eb-9bc3-193cbc9b8acf with scrape type 2
2026-03-28 08:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3803234f-1c01-59eb-9bc3-193cbc9b8acf with scrape type 2
2026-03-28 08:31:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3803234f-1c01-59eb-9bc3-193cbc9b8acf, identifier: TZ53898
2026-03-28 08:31:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3803234f-1c01-59eb-9bc3-193cbc9b8acf with identifier: TZ53898
2026-03-28 08:31:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3803234f-1c01-59eb-9bc3-193cbc9b8acf with identifier: TZ53898
2026-03-28 08:31:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3803234f-1c01-59eb-9bc3-193cbc9b8acf with identifier: TZ53898 to the API
2026-03-28 08:31:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-28T16:14:39Z',
'fuel_type': 'hybrid',
'id': '3803234f-1c01-59eb-9bc3-193cbc9b8acf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ53898',
'listing': 'auction',
'make': 'Toyota',
'model': 'Yaris',
'odometer': 46845,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-04',
'seller_name': None,
'title': 'Toyota Yaris 1.5 Hybrid Cyan Edition',
'transmission': 'automatic',
'trim': 'Cyan Edition',
'year': 2021}
2026-03-28 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TZ53898%27 HTTP/1.1" 200 None
2026-03-28 08:31:52 [auto1.be] INFO: Saving data for TZ53898: {'auction_closing_time': 1774714479.0, 'created_time': 1774471229.412737, 'last_price_update_time': 1774686712.180196}
2026-03-28 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TZ53898') HTTP/1.1" 204 0
2026-03-28 08:31:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:31:52 [auto1.be] INFO: Found listing with ID: WR41774
2026-03-28 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WR41774%27 HTTP/1.1" 200 None
2026-03-28 08:31:52 [auto1.be] INFO: Scrape type for WR41774: 0
2026-03-28 08:31:52 [auto1.be] INFO: Found listing with ID: ZX75796
2026-03-28 08:31:52 [auto1.be] INFO: Found listing with ID: WN00182
2026-03-28 08:31:52 [auto1.be] INFO: Found listing with ID: TU47744
2026-03-28 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU47744%27 HTTP/1.1" 200 None
2026-03-28 08:31:52 [auto1.be] INFO: Scrape type for TU47744: 0
2026-03-28 08:31:52 [auto1.be] INFO: Found listing with ID: ZK51287
2026-03-28 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK51287%27 HTTP/1.1" 200 None
2026-03-28 08:31:52 [auto1.be] INFO: Scrape type for ZK51287: 0
2026-03-28 08:31:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:31:53 [auto1.be] INFO: Channel: 24h | Page: 26 | totalHits: 1701 | hits on page: 40
2026-03-28 08:31:53 [auto1.be] INFO: Found listing with ID: RK77715
2026-03-28 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK77715%27 HTTP/1.1" 200 None
2026-03-28 08:31:53 [auto1.be] INFO: Scrape type for RK77715: 0
2026-03-28 08:31:53 [auto1.be] INFO: Found listing with ID: RS16623
2026-03-28 08:31:53 [auto1.be] INFO: Found listing with ID: PS28625
2026-03-28 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS28625%27 HTTP/1.1" 200 None
2026-03-28 08:31:53 [auto1.be] INFO: Scrape type for PS28625: 0
2026-03-28 08:31:53 [auto1.be] INFO: Found listing with ID: HF21497
2026-03-28 08:31:53 [auto1.be] INFO: Found listing with ID: CK03982
2026-03-28 08:31:53 [auto1.be] INFO: Found listing with ID: CH15441
2026-03-28 08:31:53 [auto1.be] INFO: Found listing with ID: LF23330
2026-03-28 08:31:53 [auto1.be] INFO: Found listing with ID: DF96327
2026-03-28 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF96327%27 HTTP/1.1" 200 None
2026-03-28 08:31:53 [auto1.be] INFO: Scrape type for DF96327: 0
2026-03-28 08:31:53 [auto1.be] INFO: Found listing with ID: SZ65946
2026-03-28 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ65946%27 HTTP/1.1" 200 None
2026-03-28 08:31:53 [auto1.be] INFO: Scrape type for SZ65946: 0
2026-03-28 08:31:53 [auto1.be] INFO: Found listing with ID: YC19133
2026-03-28 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC19133%27 HTTP/1.1" 200 None
2026-03-28 08:31:53 [auto1.be] INFO: Scrape type for YC19133: 0
2026-03-28 08:31:53 [auto1.be] INFO: Found listing with ID: AB27373
2026-03-28 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB27373%27 HTTP/1.1" 200 None
2026-03-28 08:31:53 [auto1.be] INFO: Scrape type for AB27373: 0
2026-03-28 08:31:53 [auto1.be] INFO: Found listing with ID: HM28534
2026-03-28 08:31:53 [auto1.be] INFO: Found listing with ID: YN58260
2026-03-28 08:31:53 [auto1.be] INFO: Found listing with ID: ZC53588
2026-03-28 08:31:53 [auto1.be] INFO: Found listing with ID: WG60858
2026-03-28 08:31:53 [auto1.be] INFO: Found listing with ID: PA07784
2026-03-28 08:31:53 [auto1.be] INFO: Found listing with ID: DC51589
2026-03-28 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC51589%27 HTTP/1.1" 200 None
2026-03-28 08:31:53 [auto1.be] INFO: Scrape type for DC51589: 0
2026-03-28 08:31:53 [auto1.be] INFO: Found listing with ID: GH28824
2026-03-28 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH28824%27 HTTP/1.1" 200 None
2026-03-28 08:31:53 [auto1.be] INFO: Scrape type for GH28824: 2
2026-03-28 08:31:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35b6d369-69ea-5f97-81b3-ec2034363c52 with identifier: GH28824
2026-03-28 08:31:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35b6d369-69ea-5f97-81b3-ec2034363c52 with scrape type 2
2026-03-28 08:31:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35b6d369-69ea-5f97-81b3-ec2034363c52 with scrape type 2
2026-03-28 08:31:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 35b6d369-69ea-5f97-81b3-ec2034363c52, identifier: GH28824
2026-03-28 08:31:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 35b6d369-69ea-5f97-81b3-ec2034363c52 with identifier: GH28824
2026-03-28 08:31:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 35b6d369-69ea-5f97-81b3-ec2034363c52 with identifier: GH28824
2026-03-28 08:31:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 35b6d369-69ea-5f97-81b3-ec2034363c52 with identifier: GH28824 to the API
2026-03-28 08:31:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:44:19Z',
'fuel_type': 'petrol',
'id': '35b6d369-69ea-5f97-81b3-ec2034363c52',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH28824',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 56431,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-05-31',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 Comfortline',
'transmission': 'automatic',
'trim': 'Comfortline',
'year': 2006}
2026-03-28 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH28824%27 HTTP/1.1" 200 None
2026-03-28 08:31:53 [auto1.be] INFO: Saving data for GH28824: {'auction_closing_time': 1774716259.0, 'created_time': 1774471340.061063, 'last_price_update_time': 1774686713.952944}
2026-03-28 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GH28824') HTTP/1.1" 204 0
2026-03-28 08:31:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:31:54 [auto1.be] INFO: Found listing with ID: MM41011
2026-03-28 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MM41011%27 HTTP/1.1" 200 None
2026-03-28 08:31:54 [auto1.be] INFO: Scrape type for MM41011: 0
2026-03-28 08:31:54 [auto1.be] INFO: Found listing with ID: LP97900
2026-03-28 08:31:54 [auto1.be] INFO: Found listing with ID: JL24574
2026-03-28 08:31:54 [auto1.be] INFO: Found listing with ID: NM84060
2026-03-28 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM84060%27 HTTP/1.1" 200 None
2026-03-28 08:31:54 [auto1.be] INFO: Scrape type for NM84060: 0
2026-03-28 08:31:54 [auto1.be] INFO: Found listing with ID: SD20873
2026-03-28 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD20873%27 HTTP/1.1" 200 None
2026-03-28 08:31:54 [auto1.be] INFO: Scrape type for SD20873: 0
2026-03-28 08:31:54 [auto1.be] INFO: Found listing with ID: VU61418
2026-03-28 08:31:54 [auto1.be] INFO: Found listing with ID: GB18331
2026-03-28 08:31:54 [auto1.be] INFO: Found listing with ID: NB44505
2026-03-28 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB44505%27 HTTP/1.1" 200 None
2026-03-28 08:31:54 [auto1.be] INFO: Scrape type for NB44505: 2
2026-03-28 08:31:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6aa6598b-0171-5d3f-8ad4-f547830097c1 with identifier: NB44505
2026-03-28 08:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6aa6598b-0171-5d3f-8ad4-f547830097c1 with scrape type 2
2026-03-28 08:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6aa6598b-0171-5d3f-8ad4-f547830097c1 with scrape type 2
2026-03-28 08:31:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6aa6598b-0171-5d3f-8ad4-f547830097c1, identifier: NB44505
2026-03-28 08:31:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6aa6598b-0171-5d3f-8ad4-f547830097c1 with identifier: NB44505
2026-03-28 08:31:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6aa6598b-0171-5d3f-8ad4-f547830097c1 with identifier: NB44505
2026-03-28 08:31:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6aa6598b-0171-5d3f-8ad4-f547830097c1 with identifier: NB44505 to the API
2026-03-28 08:31:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 145,
'expiration_date': '2026-03-28T16:22:23Z',
'fuel_type': 'petrol',
'id': '6aa6598b-0171-5d3f-8ad4-f547830097c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB44505',
'listing': 'auction',
'make': 'Opel',
'model': 'Omega',
'odometer': 169575,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-04-22',
'seller_name': None,
'title': 'Opel Omega 2.2 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2003}
2026-03-28 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB44505%27 HTTP/1.1" 200 None
2026-03-28 08:31:54 [auto1.be] INFO: Saving data for NB44505: {'auction_closing_time': 1774714943.0, 'created_time': 1773833680.246701, 'last_price_update_time': 1774686714.513169}
2026-03-28 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NB44505') HTTP/1.1" 204 0
2026-03-28 08:31:54 [auto1.be] INFO: Found listing with ID: ZJ69289
2026-03-28 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ69289%27 HTTP/1.1" 200 None
2026-03-28 08:31:54 [auto1.be] INFO: Scrape type for ZJ69289: 2
2026-03-28 08:31:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3dd09c41-1539-5829-b1b9-404b9d532049 with identifier: ZJ69289
2026-03-28 08:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3dd09c41-1539-5829-b1b9-404b9d532049 with scrape type 2
2026-03-28 08:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3dd09c41-1539-5829-b1b9-404b9d532049 with scrape type 2
2026-03-28 08:31:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3dd09c41-1539-5829-b1b9-404b9d532049, identifier: ZJ69289
2026-03-28 08:31:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3dd09c41-1539-5829-b1b9-404b9d532049 with identifier: ZJ69289
2026-03-28 08:31:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3dd09c41-1539-5829-b1b9-404b9d532049 with identifier: ZJ69289
2026-03-28 08:31:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3dd09c41-1539-5829-b1b9-404b9d532049 with identifier: ZJ69289 to the API
2026-03-28 08:31:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 105,
'expiration_date': '2026-03-28T16:24:06Z',
'fuel_type': 'diesel',
'id': '3dd09c41-1539-5829-b1b9-404b9d532049',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ69289',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Jetta',
'odometer': 96467,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-04-20',
'seller_name': None,
'title': 'Volkswagen Jetta 1.6 TDI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2010}
2026-03-28 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ69289%27 HTTP/1.1" 200 None
2026-03-28 08:31:54 [auto1.be] INFO: Saving data for ZJ69289: {'auction_closing_time': 1774715046.0, 'created_time': 1774471284.432549, 'last_price_update_time': 1774686714.941686}
2026-03-28 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZJ69289') HTTP/1.1" 204 0
2026-03-28 08:31:54 [auto1.be] INFO: Found listing with ID: CC56747
2026-03-28 08:31:54 [auto1.be] INFO: Found listing with ID: HJ12403
2026-03-28 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ12403%27 HTTP/1.1" 200 None
2026-03-28 08:31:54 [auto1.be] INFO: Scrape type for HJ12403: 0
2026-03-28 08:31:54 [auto1.be] INFO: Found listing with ID: GP50240
2026-03-28 08:31:54 [auto1.be] INFO: Found listing with ID: RE83981
2026-03-28 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE83981%27 HTTP/1.1" 200 None
2026-03-28 08:31:54 [auto1.be] INFO: Scrape type for RE83981: 0
2026-03-28 08:31:54 [auto1.be] INFO: Found listing with ID: EM39704
2026-03-28 08:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM39704%27 HTTP/1.1" 200 None
2026-03-28 08:31:55 [auto1.be] INFO: Scrape type for EM39704: 0
2026-03-28 08:31:55 [auto1.be] INFO: Found listing with ID: RM46702
2026-03-28 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM46702%27 HTTP/1.1" 200 None
2026-03-28 08:31:55 [auto1.be] INFO: Scrape type for RM46702: 0
2026-03-28 08:31:55 [auto1.be] INFO: Found listing with ID: RJ65357
2026-03-28 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ65357%27 HTTP/1.1" 200 None
2026-03-28 08:31:55 [auto1.be] INFO: Scrape type for RJ65357: 0
2026-03-28 08:31:55 [auto1.be] INFO: Found listing with ID: YL67549
2026-03-28 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL67549%27 HTTP/1.1" 200 None
2026-03-28 08:31:55 [auto1.be] INFO: Scrape type for YL67549: 0
2026-03-28 08:31:55 [auto1.be] INFO: Found listing with ID: GE98600
2026-03-28 08:31:55 [auto1.be] INFO: Found listing with ID: XT89751
2026-03-28 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT89751%27 HTTP/1.1" 200 None
2026-03-28 08:31:55 [auto1.be] INFO: Scrape type for XT89751: 2
2026-03-28 08:31:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1d4adc5-eeff-51b1-a4ee-2b2ceb58f0e3 with identifier: XT89751
2026-03-28 08:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1d4adc5-eeff-51b1-a4ee-2b2ceb58f0e3 with scrape type 2
2026-03-28 08:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1d4adc5-eeff-51b1-a4ee-2b2ceb58f0e3 with scrape type 2
2026-03-28 08:31:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f1d4adc5-eeff-51b1-a4ee-2b2ceb58f0e3, identifier: XT89751
2026-03-28 08:31:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f1d4adc5-eeff-51b1-a4ee-2b2ceb58f0e3 with identifier: XT89751
2026-03-28 08:31:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f1d4adc5-eeff-51b1-a4ee-2b2ceb58f0e3 with identifier: XT89751
2026-03-28 08:31:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f1d4adc5-eeff-51b1-a4ee-2b2ceb58f0e3 with identifier: XT89751 to the API
2026-03-28 08:31:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:48:44Z',
'fuel_type': 'diesel',
'id': 'f1d4adc5-eeff-51b1-a4ee-2b2ceb58f0e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT89751',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3',
'odometer': 205779,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-05',
'seller_name': None,
'title': 'Audi Q3 35 TDI S Line',
'transmission': 'automatic',
'trim': 'S Line',
'year': 2020}
2026-03-28 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT89751%27 HTTP/1.1" 200 None
2026-03-28 08:31:55 [auto1.be] INFO: Saving data for XT89751: {'auction_closing_time': 1774716524.0, 'created_time': 1773301662.886003, 'last_price_update_time': 1774686715.482407}
2026-03-28 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XT89751') HTTP/1.1" 204 0
2026-03-28 08:31:55 [auto1.be] INFO: Found listing with ID: UM50519
2026-03-28 08:31:55 [auto1.be] INFO: Found listing with ID: WA39171
2026-03-28 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA39171%27 HTTP/1.1" 200 None
2026-03-28 08:31:55 [auto1.be] INFO: Scrape type for WA39171: 0
2026-03-28 08:31:55 [auto1.be] INFO: Found listing with ID: LC40144
2026-03-28 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LC40144%27 HTTP/1.1" 200 None
2026-03-28 08:31:55 [auto1.be] INFO: Scrape type for LC40144: 0
2026-03-28 08:31:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:31:56 [auto1.be] INFO: Channel: 24h | Page: 27 | totalHits: 1701 | hits on page: 40
2026-03-28 08:31:56 [auto1.be] INFO: Found listing with ID: RR05667
2026-03-28 08:31:56 [auto1.be] INFO: Found listing with ID: DZ47511
2026-03-28 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ47511%27 HTTP/1.1" 200 None
2026-03-28 08:31:56 [auto1.be] INFO: Scrape type for DZ47511: 0
2026-03-28 08:31:56 [auto1.be] INFO: Found listing with ID: KZ95632
2026-03-28 08:31:56 [auto1.be] INFO: Found listing with ID: HX42019
2026-03-28 08:31:56 [auto1.be] INFO: Found listing with ID: PR67057
2026-03-28 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR67057%27 HTTP/1.1" 200 None
2026-03-28 08:31:56 [auto1.be] INFO: Scrape type for PR67057: 0
2026-03-28 08:31:56 [auto1.be] INFO: Found listing with ID: TS78695
2026-03-28 08:31:56 [auto1.be] INFO: Found listing with ID: VB51630
2026-03-28 08:31:56 [auto1.be] INFO: Found listing with ID: UL98118
2026-03-28 08:31:56 [auto1.be] INFO: Found listing with ID: AY48728
2026-03-28 08:31:56 [auto1.be] INFO: Found listing with ID: VL86303
2026-03-28 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL86303%27 HTTP/1.1" 200 None
2026-03-28 08:31:56 [auto1.be] INFO: Scrape type for VL86303: 2
2026-03-28 08:31:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eec0fd90-44ee-5a2f-853d-e1d42e072335 with identifier: VL86303
2026-03-28 08:31:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eec0fd90-44ee-5a2f-853d-e1d42e072335 with scrape type 2
2026-03-28 08:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eec0fd90-44ee-5a2f-853d-e1d42e072335 with scrape type 2
2026-03-28 08:31:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: eec0fd90-44ee-5a2f-853d-e1d42e072335, identifier: VL86303
2026-03-28 08:31:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: eec0fd90-44ee-5a2f-853d-e1d42e072335 with identifier: VL86303
2026-03-28 08:31:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: eec0fd90-44ee-5a2f-853d-e1d42e072335 with identifier: VL86303
2026-03-28 08:31:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: eec0fd90-44ee-5a2f-853d-e1d42e072335 with identifier: VL86303 to the API
2026-03-28 08:31:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:57:16Z',
'fuel_type': 'diesel',
'id': 'eec0fd90-44ee-5a2f-853d-e1d42e072335',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL86303',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 207610,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-24',
'seller_name': None,
'title': 'Ford Focus 1.6 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2012}
2026-03-28 08:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL86303%27 HTTP/1.1" 200 None
2026-03-28 08:31:57 [auto1.be] INFO: Saving data for VL86303: {'auction_closing_time': 1774717036.0, 'created_time': 1773137544.01723, 'last_price_update_time': 1774686717.292302}
2026-03-28 08:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VL86303') HTTP/1.1" 204 0
2026-03-28 08:31:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:31:57 [auto1.be] INFO: Found listing with ID: DT02833
2026-03-28 08:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT02833%27 HTTP/1.1" 200 None
2026-03-28 08:31:57 [auto1.be] INFO: Scrape type for DT02833: 2
2026-03-28 08:31:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 193bba3a-4ff0-5341-acd6-c6a5d5391ca7 with identifier: DT02833
2026-03-28 08:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 193bba3a-4ff0-5341-acd6-c6a5d5391ca7 with scrape type 2
2026-03-28 08:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 193bba3a-4ff0-5341-acd6-c6a5d5391ca7 with scrape type 2
2026-03-28 08:31:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 193bba3a-4ff0-5341-acd6-c6a5d5391ca7, identifier: DT02833
2026-03-28 08:31:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 193bba3a-4ff0-5341-acd6-c6a5d5391ca7 with identifier: DT02833
2026-03-28 08:31:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 193bba3a-4ff0-5341-acd6-c6a5d5391ca7 with identifier: DT02833
2026-03-28 08:31:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 193bba3a-4ff0-5341-acd6-c6a5d5391ca7 with identifier: DT02833 to the API
2026-03-28 08:31:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-28T16:14:44Z',
'fuel_type': 'petrol',
'id': '193bba3a-4ff0-5341-acd6-c6a5d5391ca7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT02833',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 264797,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-02-26',
'seller_name': None,
'title': 'BMW 3er 328i',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-28 08:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT02833%27 HTTP/1.1" 200 None
2026-03-28 08:31:57 [auto1.be] INFO: Saving data for DT02833: {'auction_closing_time': 1774714484.0, 'created_time': 1773238412.724078, 'last_price_update_time': 1774686717.840086}
2026-03-28 08:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DT02833') HTTP/1.1" 204 0
2026-03-28 08:31:57 [auto1.be] INFO: Found listing with ID: MG56126
2026-03-28 08:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG56126%27 HTTP/1.1" 200 None
2026-03-28 08:31:57 [auto1.be] INFO: Scrape type for MG56126: 0
2026-03-28 08:31:57 [auto1.be] INFO: Found listing with ID: KW49487
2026-03-28 08:31:57 [auto1.be] INFO: Found listing with ID: JC58807
2026-03-28 08:31:57 [auto1.be] INFO: Found listing with ID: YU69949
2026-03-28 08:31:57 [auto1.be] INFO: Found listing with ID: PA01247
2026-03-28 08:31:57 [auto1.be] INFO: Found listing with ID: RK12486
2026-03-28 08:31:57 [auto1.be] INFO: Found listing with ID: FJ18494
2026-03-28 08:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ18494%27 HTTP/1.1" 200 None
2026-03-28 08:31:57 [auto1.be] INFO: Scrape type for FJ18494: 0
2026-03-28 08:31:57 [auto1.be] INFO: Found listing with ID: LE69229
2026-03-28 08:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE69229%27 HTTP/1.1" 200 None
2026-03-28 08:31:57 [auto1.be] INFO: Scrape type for LE69229: 0
2026-03-28 08:31:57 [auto1.be] INFO: Found listing with ID: NV96305
2026-03-28 08:31:57 [auto1.be] INFO: Found listing with ID: MC77569
2026-03-28 08:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC77569%27 HTTP/1.1" 200 None
2026-03-28 08:31:57 [auto1.be] INFO: Scrape type for MC77569: 0
2026-03-28 08:31:57 [auto1.be] INFO: Found listing with ID: PN32726
2026-03-28 08:31:57 [auto1.be] INFO: Found listing with ID: MR13936
2026-03-28 08:31:57 [auto1.be] INFO: Found listing with ID: FR29123
2026-03-28 08:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR29123%27 HTTP/1.1" 200 None
2026-03-28 08:31:57 [auto1.be] INFO: Scrape type for FR29123: 0
2026-03-28 08:31:57 [auto1.be] INFO: Found listing with ID: TX71438
2026-03-28 08:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX71438%27 HTTP/1.1" 200 None
2026-03-28 08:31:57 [auto1.be] INFO: Scrape type for TX71438: 0
2026-03-28 08:31:57 [auto1.be] INFO: Found listing with ID: VK27252
2026-03-28 08:31:57 [auto1.be] INFO: Found listing with ID: ZL06267
2026-03-28 08:31:57 [auto1.be] INFO: Found listing with ID: KY96002
2026-03-28 08:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KY96002%27 HTTP/1.1" 200 None
2026-03-28 08:31:57 [auto1.be] INFO: Scrape type for KY96002: 0
2026-03-28 08:31:57 [auto1.be] INFO: Found listing with ID: GR79063
2026-03-28 08:31:57 [auto1.be] INFO: Found listing with ID: ZU65660
2026-03-28 08:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU65660%27 HTTP/1.1" 200 None
2026-03-28 08:31:58 [auto1.be] INFO: Scrape type for ZU65660: 0
2026-03-28 08:31:58 [auto1.be] INFO: Found listing with ID: TY50069
2026-03-28 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY50069%27 HTTP/1.1" 200 None
2026-03-28 08:31:58 [auto1.be] INFO: Scrape type for TY50069: 0
2026-03-28 08:31:58 [auto1.be] INFO: Found listing with ID: YN26679
2026-03-28 08:31:58 [auto1.be] INFO: Found listing with ID: LH83403
2026-03-28 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH83403%27 HTTP/1.1" 200 None
2026-03-28 08:31:58 [auto1.be] INFO: Scrape type for LH83403: 0
2026-03-28 08:31:58 [auto1.be] INFO: Found listing with ID: HP77494
2026-03-28 08:31:58 [auto1.be] INFO: Found listing with ID: WV42280
2026-03-28 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV42280%27 HTTP/1.1" 200 None
2026-03-28 08:31:58 [auto1.be] INFO: Scrape type for WV42280: 0
2026-03-28 08:31:58 [auto1.be] INFO: Found listing with ID: YK73361
2026-03-28 08:31:58 [auto1.be] INFO: Found listing with ID: HJ67440
2026-03-28 08:31:58 [auto1.be] INFO: Found listing with ID: UR96395
2026-03-28 08:31:58 [auto1.be] INFO: Found listing with ID: JW86952
2026-03-28 08:31:58 [auto1.be] INFO: Found listing with ID: XH74025
2026-03-28 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH74025%27 HTTP/1.1" 200 None
2026-03-28 08:31:58 [auto1.be] INFO: Scrape type for XH74025: 0
2026-03-28 08:31:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:31:59 [auto1.be] INFO: Channel: 24h | Page: 28 | totalHits: 1701 | hits on page: 40
2026-03-28 08:31:59 [auto1.be] INFO: Found listing with ID: LM10661
2026-03-28 08:31:59 [auto1.be] INFO: Found listing with ID: DS23322
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DS23322%27 HTTP/1.1" 200 None
2026-03-28 08:31:59 [auto1.be] INFO: Scrape type for DS23322: 0
2026-03-28 08:31:59 [auto1.be] INFO: Found listing with ID: GA94606
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GA94606%27 HTTP/1.1" 200 None
2026-03-28 08:31:59 [auto1.be] INFO: Scrape type for GA94606: 2
2026-03-28 08:31:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a9b4689-1a2a-5051-a6b0-d9ec0709fe8c with identifier: GA94606
2026-03-28 08:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a9b4689-1a2a-5051-a6b0-d9ec0709fe8c with scrape type 2
2026-03-28 08:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a9b4689-1a2a-5051-a6b0-d9ec0709fe8c with scrape type 2
2026-03-28 08:31:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4a9b4689-1a2a-5051-a6b0-d9ec0709fe8c, identifier: GA94606
2026-03-28 08:31:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4a9b4689-1a2a-5051-a6b0-d9ec0709fe8c with identifier: GA94606
2026-03-28 08:31:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4a9b4689-1a2a-5051-a6b0-d9ec0709fe8c with identifier: GA94606
2026-03-28 08:31:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4a9b4689-1a2a-5051-a6b0-d9ec0709fe8c with identifier: GA94606 to the API
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:31:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 91,
'expiration_date': '2026-03-28T16:51:55Z',
'fuel_type': 'petrol',
'id': '4a9b4689-1a2a-5051-a6b0-d9ec0709fe8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA94606',
'listing': 'auction',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 57857,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-06',
'seller_name': None,
'title': 'Dacia Sandero 1.0 TCe Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2022}
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GA94606%27 HTTP/1.1" 200 None
2026-03-28 08:31:59 [auto1.be] INFO: Saving data for GA94606: {'auction_closing_time': 1774716715.0, 'created_time': 1774471368.000296, 'last_price_update_time': 1774686719.586461}
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GA94606') HTTP/1.1" 204 0
2026-03-28 08:31:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:31:59 [auto1.be] INFO: Found listing with ID: WJ73148
2026-03-28 08:31:59 [auto1.be] INFO: Found listing with ID: UD69238
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD69238%27 HTTP/1.1" 200 None
2026-03-28 08:31:59 [auto1.be] INFO: Scrape type for UD69238: 0
2026-03-28 08:31:59 [auto1.be] INFO: Found listing with ID: UD97693
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD97693%27 HTTP/1.1" 200 None
2026-03-28 08:31:59 [auto1.be] INFO: Scrape type for UD97693: 0
2026-03-28 08:31:59 [auto1.be] INFO: Found listing with ID: XN45926
2026-03-28 08:31:59 [auto1.be] INFO: Found listing with ID: YG22909
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG22909%27 HTTP/1.1" 200 None
2026-03-28 08:31:59 [auto1.be] INFO: Scrape type for YG22909: 0
2026-03-28 08:31:59 [auto1.be] INFO: Found listing with ID: PE30752
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE30752%27 HTTP/1.1" 200 None
2026-03-28 08:31:59 [auto1.be] INFO: Scrape type for PE30752: 0
2026-03-28 08:31:59 [auto1.be] INFO: Found listing with ID: LX91228
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LX91228%27 HTTP/1.1" 200 None
2026-03-28 08:31:59 [auto1.be] INFO: Scrape type for LX91228: 0
2026-03-28 08:31:59 [auto1.be] INFO: Found listing with ID: NN41814
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN41814%27 HTTP/1.1" 200 None
2026-03-28 08:31:59 [auto1.be] INFO: Scrape type for NN41814: 0
2026-03-28 08:31:59 [auto1.be] INFO: Found listing with ID: UB59400
2026-03-28 08:31:59 [auto1.be] INFO: Found listing with ID: JW19159
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW19159%27 HTTP/1.1" 200 None
2026-03-28 08:31:59 [auto1.be] INFO: Scrape type for JW19159: 0
2026-03-28 08:31:59 [auto1.be] INFO: Found listing with ID: FV38279
2026-03-28 08:31:59 [auto1.be] INFO: Found listing with ID: XH16695
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH16695%27 HTTP/1.1" 200 None
2026-03-28 08:31:59 [auto1.be] INFO: Scrape type for XH16695: 0
2026-03-28 08:31:59 [auto1.be] INFO: Found listing with ID: EY06710
2026-03-28 08:31:59 [auto1.be] INFO: Found listing with ID: RX67951
2026-03-28 08:31:59 [auto1.be] INFO: Found listing with ID: RB45450
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB45450%27 HTTP/1.1" 200 None
2026-03-28 08:31:59 [auto1.be] INFO: Scrape type for RB45450: 0
2026-03-28 08:31:59 [auto1.be] INFO: Found listing with ID: MP38676
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MP38676%27 HTTP/1.1" 200 None
2026-03-28 08:31:59 [auto1.be] INFO: Scrape type for MP38676: 0
2026-03-28 08:31:59 [auto1.be] INFO: Found listing with ID: VA35443
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA35443%27 HTTP/1.1" 200 None
2026-03-28 08:31:59 [auto1.be] INFO: Scrape type for VA35443: 0
2026-03-28 08:31:59 [auto1.be] INFO: Found listing with ID: UB84592
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB84592%27 HTTP/1.1" 200 None
2026-03-28 08:31:59 [auto1.be] INFO: Scrape type for UB84592: 0
2026-03-28 08:31:59 [auto1.be] INFO: Found listing with ID: ZM98751
2026-03-28 08:31:59 [auto1.be] INFO: Found listing with ID: AT11769
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AT11769%27 HTTP/1.1" 200 None
2026-03-28 08:31:59 [auto1.be] INFO: Scrape type for AT11769: 0
2026-03-28 08:31:59 [auto1.be] INFO: Found listing with ID: TA16395
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA16395%27 HTTP/1.1" 200 None
2026-03-28 08:31:59 [auto1.be] INFO: Scrape type for TA16395: 0
2026-03-28 08:31:59 [auto1.be] INFO: Found listing with ID: YU29895
2026-03-28 08:31:59 [auto1.be] INFO: Found listing with ID: BD79780
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD79780%27 HTTP/1.1" 200 None
2026-03-28 08:31:59 [auto1.be] INFO: Scrape type for BD79780: 0
2026-03-28 08:31:59 [auto1.be] INFO: Found listing with ID: WW25551
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW25551%27 HTTP/1.1" 200 None
2026-03-28 08:31:59 [auto1.be] INFO: Scrape type for WW25551: 0
2026-03-28 08:31:59 [auto1.be] INFO: Found listing with ID: PC47788
2026-03-28 08:31:59 [auto1.be] INFO: Found listing with ID: PC06950
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC06950%27 HTTP/1.1" 200 None
2026-03-28 08:31:59 [auto1.be] INFO: Scrape type for PC06950: 0
2026-03-28 08:31:59 [auto1.be] INFO: Found listing with ID: XJ17204
2026-03-28 08:31:59 [auto1.be] INFO: Found listing with ID: WT61211
2026-03-28 08:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT61211%27 HTTP/1.1" 200 None
2026-03-28 08:32:00 [auto1.be] INFO: Scrape type for WT61211: 0
2026-03-28 08:32:00 [auto1.be] INFO: Found listing with ID: YY54111
2026-03-28 08:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YY54111%27 HTTP/1.1" 200 None
2026-03-28 08:32:00 [auto1.be] INFO: Scrape type for YY54111: 0
2026-03-28 08:32:00 [auto1.be] INFO: Found listing with ID: JX95723
2026-03-28 08:32:00 [auto1.be] INFO: Found listing with ID: JP70611
2026-03-28 08:32:00 [auto1.be] INFO: Found listing with ID: BY20411
2026-03-28 08:32:00 [auto1.be] INFO: Found listing with ID: UK22118
2026-03-28 08:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UK22118%27 HTTP/1.1" 200 None
2026-03-28 08:32:00 [auto1.be] INFO: Scrape type for UK22118: 0
2026-03-28 08:32:00 [auto1.be] INFO: Found listing with ID: GM27988
2026-03-28 08:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM27988%27 HTTP/1.1" 200 None
2026-03-28 08:32:00 [auto1.be] INFO: Scrape type for GM27988: 0
2026-03-28 08:32:00 [auto1.be] INFO: Found listing with ID: ED46000
2026-03-28 08:32:00 [auto1.be] INFO: Found listing with ID: MU65745
2026-03-28 08:32:00 [auto1.be] INFO: Found listing with ID: RK66755
2026-03-28 08:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK66755%27 HTTP/1.1" 200 None
2026-03-28 08:32:00 [auto1.be] INFO: Scrape type for RK66755: 0
2026-03-28 08:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:32:01 [auto1.be] INFO: Channel: 24h | Page: 29 | totalHits: 1701 | hits on page: 40
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: KU14362
2026-03-28 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU14362%27 HTTP/1.1" 200 None
2026-03-28 08:32:01 [auto1.be] INFO: Scrape type for KU14362: 0
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: CK52379
2026-03-28 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK52379%27 HTTP/1.1" 200 None
2026-03-28 08:32:01 [auto1.be] INFO: Scrape type for CK52379: 0
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: ED08551
2026-03-28 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED08551%27 HTTP/1.1" 200 None
2026-03-28 08:32:01 [auto1.be] INFO: Scrape type for ED08551: 0
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: UL77551
2026-03-28 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL77551%27 HTTP/1.1" 200 None
2026-03-28 08:32:01 [auto1.be] INFO: Scrape type for UL77551: 0
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: UV66357
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: PL62845
2026-03-28 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL62845%27 HTTP/1.1" 200 None
2026-03-28 08:32:01 [auto1.be] INFO: Scrape type for PL62845: 0
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: DD15930
2026-03-28 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD15930%27 HTTP/1.1" 200 None
2026-03-28 08:32:01 [auto1.be] INFO: Scrape type for DD15930: 0
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: CY27099
2026-03-28 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY27099%27 HTTP/1.1" 200 None
2026-03-28 08:32:01 [auto1.be] INFO: Scrape type for CY27099: 0
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: XU96332
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: GS41207
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: RJ05295
2026-03-28 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ05295%27 HTTP/1.1" 200 None
2026-03-28 08:32:01 [auto1.be] INFO: Scrape type for RJ05295: 0
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: SU53193
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: EG72902
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: YC45178
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: WJ68976
2026-03-28 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ68976%27 HTTP/1.1" 200 None
2026-03-28 08:32:01 [auto1.be] INFO: Scrape type for WJ68976: 0
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: DM59351
2026-03-28 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM59351%27 HTTP/1.1" 200 None
2026-03-28 08:32:01 [auto1.be] INFO: Scrape type for DM59351: 0
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: ZU26363
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: ZJ61910
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: FP51010
2026-03-28 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP51010%27 HTTP/1.1" 200 None
2026-03-28 08:32:01 [auto1.be] INFO: Scrape type for FP51010: 0
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: CH15764
2026-03-28 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH15764%27 HTTP/1.1" 200 None
2026-03-28 08:32:01 [auto1.be] INFO: Scrape type for CH15764: 0
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: PH02429
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: BV41613
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: MZ51776
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: JJ27182
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: SD77902
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: PK93774
2026-03-28 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK93774%27 HTTP/1.1" 200 None
2026-03-28 08:32:01 [auto1.be] INFO: Scrape type for PK93774: 0
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: RK22486
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: ZM54686
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: YS95861
2026-03-28 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS95861%27 HTTP/1.1" 200 None
2026-03-28 08:32:01 [auto1.be] INFO: Scrape type for YS95861: 0
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: BV56621
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: HM47736
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: AB44644
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: SR93497
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: SR49598
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: MG12074
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: SP17871
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: AM54260
2026-03-28 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM54260%27 HTTP/1.1" 200 None
2026-03-28 08:32:01 [auto1.be] INFO: Scrape type for AM54260: 0
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: SS18683
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: LJ62513
2026-03-28 08:32:01 [auto1.be] INFO: Found listing with ID: EA25293
2026-03-28 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA25293%27 HTTP/1.1" 200 None
2026-03-28 08:32:01 [auto1.be] INFO: Scrape type for EA25293: 0
2026-03-28 08:32:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:32:02 [auto1.be] INFO: Channel: 24h | Page: 30 | totalHits: 1701 | hits on page: 40
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: HU58936
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: YB94076
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB94076%27 HTTP/1.1" 200 None
2026-03-28 08:32:02 [auto1.be] INFO: Scrape type for YB94076: 0
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: PT26763
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PT26763%27 HTTP/1.1" 200 None
2026-03-28 08:32:02 [auto1.be] INFO: Scrape type for PT26763: 0
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: KW15988
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW15988%27 HTTP/1.1" 200 None
2026-03-28 08:32:02 [auto1.be] INFO: Scrape type for KW15988: 0
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: MJ87524
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ87524%27 HTTP/1.1" 200 None
2026-03-28 08:32:02 [auto1.be] INFO: Scrape type for MJ87524: 0
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: EY95319
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EY95319%27 HTTP/1.1" 200 None
2026-03-28 08:32:02 [auto1.be] INFO: Scrape type for EY95319: 0
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: YB47559
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB47559%27 HTTP/1.1" 200 None
2026-03-28 08:32:02 [auto1.be] INFO: Scrape type for YB47559: 0
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: HS77940
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS77940%27 HTTP/1.1" 200 None
2026-03-28 08:32:02 [auto1.be] INFO: Scrape type for HS77940: 0
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: NU98421
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: CX99155
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX99155%27 HTTP/1.1" 200 None
2026-03-28 08:32:02 [auto1.be] INFO: Scrape type for CX99155: 0
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: JC96921
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC96921%27 HTTP/1.1" 200 None
2026-03-28 08:32:02 [auto1.be] INFO: Scrape type for JC96921: 0
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: LP39108
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP39108%27 HTTP/1.1" 200 None
2026-03-28 08:32:02 [auto1.be] INFO: Scrape type for LP39108: 0
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: PK56681
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: NB55851
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB55851%27 HTTP/1.1" 200 None
2026-03-28 08:32:02 [auto1.be] INFO: Scrape type for NB55851: 0
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: YV05904
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV05904%27 HTTP/1.1" 200 None
2026-03-28 08:32:02 [auto1.be] INFO: Scrape type for YV05904: 0
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: ED29224
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED29224%27 HTTP/1.1" 200 None
2026-03-28 08:32:02 [auto1.be] INFO: Scrape type for ED29224: 0
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: TT40798
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT40798%27 HTTP/1.1" 200 None
2026-03-28 08:32:02 [auto1.be] INFO: Scrape type for TT40798: 0
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: VE25219
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: BY03378
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY03378%27 HTTP/1.1" 200 None
2026-03-28 08:32:02 [auto1.be] INFO: Scrape type for BY03378: 0
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: DL69403
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL69403%27 HTTP/1.1" 200 None
2026-03-28 08:32:02 [auto1.be] INFO: Scrape type for DL69403: 0
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: BW39031
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: UF59925
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: TC19196
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: ZC14202
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC14202%27 HTTP/1.1" 200 None
2026-03-28 08:32:02 [auto1.be] INFO: Scrape type for ZC14202: 0
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: ET18736
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: AB96361
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB96361%27 HTTP/1.1" 200 None
2026-03-28 08:32:02 [auto1.be] INFO: Scrape type for AB96361: 0
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: BF15536
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: PC04988
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: YG09924
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG09924%27 HTTP/1.1" 200 None
2026-03-28 08:32:02 [auto1.be] INFO: Scrape type for YG09924: 0
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: BD95571
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: TG48894
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TG48894%27 HTTP/1.1" 200 None
2026-03-28 08:32:02 [auto1.be] INFO: Scrape type for TG48894: 0
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: HY14348
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: MJ44397
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ44397%27 HTTP/1.1" 200 None
2026-03-28 08:32:02 [auto1.be] INFO: Scrape type for MJ44397: 0
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: EA81543
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA81543%27 HTTP/1.1" 200 None
2026-03-28 08:32:02 [auto1.be] INFO: Scrape type for EA81543: 0
2026-03-28 08:32:02 [auto1.be] INFO: Found listing with ID: XT36171
2026-03-28 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT36171%27 HTTP/1.1" 200 None
2026-03-28 08:32:03 [auto1.be] INFO: Scrape type for XT36171: 0
2026-03-28 08:32:03 [auto1.be] INFO: Found listing with ID: UU52750
2026-03-28 08:32:03 [auto1.be] INFO: Found listing with ID: RA83369
2026-03-28 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA83369%27 HTTP/1.1" 200 None
2026-03-28 08:32:03 [auto1.be] INFO: Scrape type for RA83369: 0
2026-03-28 08:32:03 [auto1.be] INFO: Found listing with ID: GE95300
2026-03-28 08:32:03 [auto1.be] INFO: Found listing with ID: DB21184
2026-03-28 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB21184%27 HTTP/1.1" 200 None
2026-03-28 08:32:03 [auto1.be] INFO: Scrape type for DB21184: 0
2026-03-28 08:32:03 [auto1.be] INFO: Found listing with ID: XN79579
2026-03-28 08:32:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:32:06 [scrapy.extensions.logstats] INFO: Crawled 56 pages (at 18 pages/min), scraped 126 items (at 69 items/min)
2026-03-28 08:32:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 175MiB
2026-03-28 08:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:32:34 [auto1.be] INFO: Channel: 24h | Page: 31 | totalHits: 1701 | hits on page: 40
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: WF25377
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WF25377%27 HTTP/1.1" 200 None
2026-03-28 08:32:34 [auto1.be] INFO: Scrape type for WF25377: 0
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: UB54556
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB54556%27 HTTP/1.1" 200 None
2026-03-28 08:32:34 [auto1.be] INFO: Scrape type for UB54556: 0
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: RA52713
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: UP37204
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UP37204%27 HTTP/1.1" 200 None
2026-03-28 08:32:34 [auto1.be] INFO: Scrape type for UP37204: 0
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: YF30387
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF30387%27 HTTP/1.1" 200 None
2026-03-28 08:32:34 [auto1.be] INFO: Scrape type for YF30387: 0
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: TP34819
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: MV25434
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: EZ95206
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ95206%27 HTTP/1.1" 200 None
2026-03-28 08:32:34 [auto1.be] INFO: Scrape type for EZ95206: 0
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: XZ13946
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: JC83971
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: AG12322
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG12322%27 HTTP/1.1" 200 None
2026-03-28 08:32:34 [auto1.be] INFO: Scrape type for AG12322: 0
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: VJ63338
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: MX26890
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: SE12861
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE12861%27 HTTP/1.1" 200 None
2026-03-28 08:32:34 [auto1.be] INFO: Scrape type for SE12861: 0
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: AW74184
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AW74184%27 HTTP/1.1" 200 None
2026-03-28 08:32:34 [auto1.be] INFO: Scrape type for AW74184: 0
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: KT11413
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: WN35442
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN35442%27 HTTP/1.1" 200 None
2026-03-28 08:32:34 [auto1.be] INFO: Scrape type for WN35442: 0
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: HY09771
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: WJ85942
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: LB74355
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LB74355%27 HTTP/1.1" 200 None
2026-03-28 08:32:34 [auto1.be] INFO: Scrape type for LB74355: 0
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: FY16186
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY16186%27 HTTP/1.1" 200 None
2026-03-28 08:32:34 [auto1.be] INFO: Scrape type for FY16186: 0
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: YD33796
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YD33796%27 HTTP/1.1" 200 None
2026-03-28 08:32:34 [auto1.be] INFO: Scrape type for YD33796: 0
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: MA85452
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA85452%27 HTTP/1.1" 200 None
2026-03-28 08:32:34 [auto1.be] INFO: Scrape type for MA85452: 0
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: LE91648
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE91648%27 HTTP/1.1" 200 None
2026-03-28 08:32:34 [auto1.be] INFO: Scrape type for LE91648: 0
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: ZX91910
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: FH50113
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH50113%27 HTTP/1.1" 200 None
2026-03-28 08:32:34 [auto1.be] INFO: Scrape type for FH50113: 0
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: UJ35064
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ35064%27 HTTP/1.1" 200 None
2026-03-28 08:32:34 [auto1.be] INFO: Scrape type for UJ35064: 0
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: FJ75207
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: EL87249
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: TV22564
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV22564%27 HTTP/1.1" 200 None
2026-03-28 08:32:34 [auto1.be] INFO: Scrape type for TV22564: 0
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: FR50529
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: UD25678
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD25678%27 HTTP/1.1" 200 None
2026-03-28 08:32:34 [auto1.be] INFO: Scrape type for UD25678: 0
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: ME81448
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ME81448%27 HTTP/1.1" 200 None
2026-03-28 08:32:34 [auto1.be] INFO: Scrape type for ME81448: 0
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: XN92471
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN92471%27 HTTP/1.1" 200 None
2026-03-28 08:32:34 [auto1.be] INFO: Scrape type for XN92471: 0
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: VV25356
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: HH24769
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH24769%27 HTTP/1.1" 200 None
2026-03-28 08:32:34 [auto1.be] INFO: Scrape type for HH24769: 0
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: VS70966
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: PJ82537
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: NP17382
2026-03-28 08:32:34 [auto1.be] INFO: Found listing with ID: DM52841
2026-03-28 08:32:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:32:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:32:36 [auto1.be] INFO: Channel: 24h | Page: 32 | totalHits: 1701 | hits on page: 40
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: LR03762
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: RG44645
2026-03-28 08:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RG44645%27 HTTP/1.1" 200 None
2026-03-28 08:32:36 [auto1.be] INFO: Scrape type for RG44645: 0
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: JC93215
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: RM32931
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: KG53590
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: VK87411
2026-03-28 08:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK87411%27 HTTP/1.1" 200 None
2026-03-28 08:32:36 [auto1.be] INFO: Scrape type for VK87411: 0
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: TD70367
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: SK81997
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: ZT52703
2026-03-28 08:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZT52703%27 HTTP/1.1" 200 None
2026-03-28 08:32:36 [auto1.be] INFO: Scrape type for ZT52703: 0
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: RK68346
2026-03-28 08:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK68346%27 HTTP/1.1" 200 None
2026-03-28 08:32:36 [auto1.be] INFO: Scrape type for RK68346: 0
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: ZX32272
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: JB70681
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: PS72966
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: CC85070
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: HH43502
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: WE70666
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: FS38787
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: ZL81412
2026-03-28 08:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL81412%27 HTTP/1.1" 200 None
2026-03-28 08:32:36 [auto1.be] INFO: Scrape type for ZL81412: 0
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: ZZ47044
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: DL17322
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: CE21828
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: JR17508
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: FE52220
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: YL00049
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: HD96937
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: YP74524
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: TX40265
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: RK20492
2026-03-28 08:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK20492%27 HTTP/1.1" 200 None
2026-03-28 08:32:36 [auto1.be] INFO: Scrape type for RK20492: 0
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: RM51088
2026-03-28 08:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM51088%27 HTTP/1.1" 200 None
2026-03-28 08:32:36 [auto1.be] INFO: Scrape type for RM51088: 0
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: LF48909
2026-03-28 08:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF48909%27 HTTP/1.1" 200 None
2026-03-28 08:32:36 [auto1.be] INFO: Scrape type for LF48909: 0
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: FS62191
2026-03-28 08:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS62191%27 HTTP/1.1" 200 None
2026-03-28 08:32:36 [auto1.be] INFO: Scrape type for FS62191: 0
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: CK64923
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: RK88808
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: MS34473
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: XC82229
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: FA30680
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: MF52944
2026-03-28 08:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MF52944%27 HTTP/1.1" 200 None
2026-03-28 08:32:36 [auto1.be] INFO: Scrape type for MF52944: 0
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: EF70909
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: NY99560
2026-03-28 08:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY99560%27 HTTP/1.1" 200 None
2026-03-28 08:32:36 [auto1.be] INFO: Scrape type for NY99560: 0
2026-03-28 08:32:36 [auto1.be] INFO: Found listing with ID: RU10603
2026-03-28 08:32:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:32:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:32:37 [auto1.be] INFO: Channel: 24h | Page: 33 | totalHits: 1701 | hits on page: 40
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: LJ91533
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LJ91533%27 HTTP/1.1" 200 None
2026-03-28 08:32:37 [auto1.be] INFO: Scrape type for LJ91533: 0
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: VB55746
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: VZ78935
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: AF71611
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF71611%27 HTTP/1.1" 200 None
2026-03-28 08:32:37 [auto1.be] INFO: Scrape type for AF71611: 0
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: NW54949
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: LG48907
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: JY53618
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: UU12218
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU12218%27 HTTP/1.1" 200 None
2026-03-28 08:32:37 [auto1.be] INFO: Scrape type for UU12218: 0
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: KZ70715
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ70715%27 HTTP/1.1" 200 None
2026-03-28 08:32:37 [auto1.be] INFO: Scrape type for KZ70715: 0
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: AY47657
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: FE88671
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: WW24606
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: WU43595
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU43595%27 HTTP/1.1" 200 None
2026-03-28 08:32:37 [auto1.be] INFO: Scrape type for WU43595: 0
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: HG61894
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HG61894%27 HTTP/1.1" 200 None
2026-03-28 08:32:37 [auto1.be] INFO: Scrape type for HG61894: 0
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: VF96553
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: TR55859
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: FE56390
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: EX56301
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX56301%27 HTTP/1.1" 200 None
2026-03-28 08:32:37 [auto1.be] INFO: Scrape type for EX56301: 0
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: CU87114
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: SL68944
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: LE66186
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE66186%27 HTTP/1.1" 200 None
2026-03-28 08:32:37 [auto1.be] INFO: Scrape type for LE66186: 0
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: UW52037
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: RS46918
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: LA76788
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA76788%27 HTTP/1.1" 200 None
2026-03-28 08:32:37 [auto1.be] INFO: Scrape type for LA76788: 0
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: XL87749
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL87749%27 HTTP/1.1" 200 None
2026-03-28 08:32:37 [auto1.be] INFO: Scrape type for XL87749: 0
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: VV55176
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VV55176%27 HTTP/1.1" 200 None
2026-03-28 08:32:37 [auto1.be] INFO: Scrape type for VV55176: 0
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: CY69823
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY69823%27 HTTP/1.1" 200 None
2026-03-28 08:32:37 [auto1.be] INFO: Scrape type for CY69823: 0
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: BV68544
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV68544%27 HTTP/1.1" 200 None
2026-03-28 08:32:37 [auto1.be] INFO: Scrape type for BV68544: 0
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: CP59959
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: MV82025
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV82025%27 HTTP/1.1" 200 None
2026-03-28 08:32:37 [auto1.be] INFO: Scrape type for MV82025: 0
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: ZJ47299
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: ZU40891
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: JZ16543
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: PM95515
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: HT10085
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: VA32651
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: CS20047
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS20047%27 HTTP/1.1" 200 None
2026-03-28 08:32:37 [auto1.be] INFO: Scrape type for CS20047: 0
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: HS49836
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS49836%27 HTTP/1.1" 200 None
2026-03-28 08:32:37 [auto1.be] INFO: Scrape type for HS49836: 0
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: DY69036
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY69036%27 HTTP/1.1" 200 None
2026-03-28 08:32:37 [auto1.be] INFO: Scrape type for DY69036: 0
2026-03-28 08:32:37 [auto1.be] INFO: Found listing with ID: YT15018
2026-03-28 08:32:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:32:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:32:38 [auto1.be] INFO: Channel: 24h | Page: 34 | totalHits: 1701 | hits on page: 40
2026-03-28 08:32:38 [auto1.be] INFO: Found listing with ID: DB02418
2026-03-28 08:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB02418%27 HTTP/1.1" 200 None
2026-03-28 08:32:38 [auto1.be] INFO: Scrape type for DB02418: 0
2026-03-28 08:32:38 [auto1.be] INFO: Found listing with ID: MA13965
2026-03-28 08:32:38 [auto1.be] INFO: Found listing with ID: RB98158
2026-03-28 08:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB98158%27 HTTP/1.1" 200 None
2026-03-28 08:32:38 [auto1.be] INFO: Scrape type for RB98158: 0
2026-03-28 08:32:38 [auto1.be] INFO: Found listing with ID: XL31605
2026-03-28 08:32:38 [auto1.be] INFO: Found listing with ID: KC19835
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC19835%27 HTTP/1.1" 200 None
2026-03-28 08:32:39 [auto1.be] INFO: Scrape type for KC19835: 0
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: MZ83142
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ83142%27 HTTP/1.1" 200 None
2026-03-28 08:32:39 [auto1.be] INFO: Scrape type for MZ83142: 0
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: WD81319
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD81319%27 HTTP/1.1" 200 None
2026-03-28 08:32:39 [auto1.be] INFO: Scrape type for WD81319: 0
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: MC08958
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC08958%27 HTTP/1.1" 200 None
2026-03-28 08:32:39 [auto1.be] INFO: Scrape type for MC08958: 0
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: NU46591
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU46591%27 HTTP/1.1" 200 None
2026-03-28 08:32:39 [auto1.be] INFO: Scrape type for NU46591: 0
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: LZ48262
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LZ48262%27 HTTP/1.1" 200 None
2026-03-28 08:32:39 [auto1.be] INFO: Scrape type for LZ48262: 0
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: DY96127
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: TY52799
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY52799%27 HTTP/1.1" 200 None
2026-03-28 08:32:39 [auto1.be] INFO: Scrape type for TY52799: 0
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: XB11874
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: RA46458
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA46458%27 HTTP/1.1" 200 None
2026-03-28 08:32:39 [auto1.be] INFO: Scrape type for RA46458: 0
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: ET79377
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET79377%27 HTTP/1.1" 200 None
2026-03-28 08:32:39 [auto1.be] INFO: Scrape type for ET79377: 0
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: YG62523
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: DP96261
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: XZ48466
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: BA52354
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: CK14854
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK14854%27 HTTP/1.1" 200 None
2026-03-28 08:32:39 [auto1.be] INFO: Scrape type for CK14854: 0
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: RY14212
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: AM57328
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: KF59500
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF59500%27 HTTP/1.1" 200 None
2026-03-28 08:32:39 [auto1.be] INFO: Scrape type for KF59500: 0
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: DW87206
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW87206%27 HTTP/1.1" 200 None
2026-03-28 08:32:39 [auto1.be] INFO: Scrape type for DW87206: 0
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: FV08195
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: ZR52684
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR52684%27 HTTP/1.1" 200 None
2026-03-28 08:32:39 [auto1.be] INFO: Scrape type for ZR52684: 0
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: PW35881
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: ZG24921
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: GC38550
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: KT14369
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT14369%27 HTTP/1.1" 200 None
2026-03-28 08:32:39 [auto1.be] INFO: Scrape type for KT14369: 0
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: TH87974
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: BE30662
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BE30662%27 HTTP/1.1" 200 None
2026-03-28 08:32:39 [auto1.be] INFO: Scrape type for BE30662: 0
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: XL16576
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: DB28782
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB28782%27 HTTP/1.1" 200 None
2026-03-28 08:32:39 [auto1.be] INFO: Scrape type for DB28782: 0
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: SP13149
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP13149%27 HTTP/1.1" 200 None
2026-03-28 08:32:39 [auto1.be] INFO: Scrape type for SP13149: 0
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: LF90651
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: SV23823
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV23823%27 HTTP/1.1" 200 None
2026-03-28 08:32:39 [auto1.be] INFO: Scrape type for SV23823: 0
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: MD04738
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: CW40114
2026-03-28 08:32:39 [auto1.be] INFO: Found listing with ID: ST31185
2026-03-28 08:32:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:32:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:32:50 [auto1.be] INFO: Channel: 24h | Page: 35 | totalHits: 1701 | hits on page: 40
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: HT96077
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT96077%27 HTTP/1.1" 200 None
2026-03-28 08:32:50 [auto1.be] INFO: Scrape type for HT96077: 0
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: WT92928
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: XJ24324
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: CR22525
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CR22525%27 HTTP/1.1" 200 None
2026-03-28 08:32:50 [auto1.be] INFO: Scrape type for CR22525: 0
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: GS99704
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: BC69430
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC69430%27 HTTP/1.1" 200 None
2026-03-28 08:32:50 [auto1.be] INFO: Scrape type for BC69430: 0
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: CD53749
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: VT14549
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: WG79733
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: ZF81780
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: NN67810
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: BB02902
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB02902%27 HTTP/1.1" 200 None
2026-03-28 08:32:50 [auto1.be] INFO: Scrape type for BB02902: 0
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: AX12673
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX12673%27 HTTP/1.1" 200 None
2026-03-28 08:32:50 [auto1.be] INFO: Scrape type for AX12673: 0
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: HY58683
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY58683%27 HTTP/1.1" 200 None
2026-03-28 08:32:50 [auto1.be] INFO: Scrape type for HY58683: 0
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: GH94733
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: CG91643
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG91643%27 HTTP/1.1" 200 None
2026-03-28 08:32:50 [auto1.be] INFO: Scrape type for CG91643: 0
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: KC33551
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: GF24104
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: HT09098
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT09098%27 HTTP/1.1" 200 None
2026-03-28 08:32:50 [auto1.be] INFO: Scrape type for HT09098: 0
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: GB76910
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: HP74170
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: WF72066
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: PB25162
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB25162%27 HTTP/1.1" 200 None
2026-03-28 08:32:50 [auto1.be] INFO: Scrape type for PB25162: 0
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: RR14818
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: SC59712
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: SD15124
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD15124%27 HTTP/1.1" 200 None
2026-03-28 08:32:50 [auto1.be] INFO: Scrape type for SD15124: 0
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: YJ00240
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ00240%27 HTTP/1.1" 200 None
2026-03-28 08:32:50 [auto1.be] INFO: Scrape type for YJ00240: 0
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: WL65720
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: BB40778
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: VM57702
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: YV36261
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: WG23357
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: RC34183
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: YL56745
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL56745%27 HTTP/1.1" 200 None
2026-03-28 08:32:50 [auto1.be] INFO: Scrape type for YL56745: 0
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: ZW68449
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZW68449%27 HTTP/1.1" 200 None
2026-03-28 08:32:50 [auto1.be] INFO: Scrape type for ZW68449: 0
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: VZ41655
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: ME80219
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ME80219%27 HTTP/1.1" 200 None
2026-03-28 08:32:50 [auto1.be] INFO: Scrape type for ME80219: 0
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: VT00410
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VT00410%27 HTTP/1.1" 200 None
2026-03-28 08:32:50 [auto1.be] INFO: Scrape type for VT00410: 0
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: WG89987
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG89987%27 HTTP/1.1" 200 None
2026-03-28 08:32:50 [auto1.be] INFO: Scrape type for WG89987: 0
2026-03-28 08:32:50 [auto1.be] INFO: Found listing with ID: KE26750
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE26750%27 HTTP/1.1" 200 None
2026-03-28 08:32:50 [auto1.be] INFO: Scrape type for KE26750: 0
2026-03-28 08:32:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:32:51 [auto1.be] INFO: Channel: 24h | Page: 36 | totalHits: 1701 | hits on page: 40
2026-03-28 08:32:51 [auto1.be] INFO: Found listing with ID: NM33768
2026-03-28 08:32:51 [auto1.be] INFO: Found listing with ID: TY10971
2026-03-28 08:32:51 [auto1.be] INFO: Found listing with ID: ZM54310
2026-03-28 08:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM54310%27 HTTP/1.1" 200 None
2026-03-28 08:32:51 [auto1.be] INFO: Scrape type for ZM54310: 0
2026-03-28 08:32:51 [auto1.be] INFO: Found listing with ID: VP90118
2026-03-28 08:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP90118%27 HTTP/1.1" 200 None
2026-03-28 08:32:51 [auto1.be] INFO: Scrape type for VP90118: 0
2026-03-28 08:32:51 [auto1.be] INFO: Found listing with ID: RW14221
2026-03-28 08:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW14221%27 HTTP/1.1" 200 None
2026-03-28 08:32:51 [auto1.be] INFO: Scrape type for RW14221: 0
2026-03-28 08:32:51 [auto1.be] INFO: Found listing with ID: VB04696
2026-03-28 08:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB04696%27 HTTP/1.1" 200 None
2026-03-28 08:32:51 [auto1.be] INFO: Scrape type for VB04696: 0
2026-03-28 08:32:51 [auto1.be] INFO: Found listing with ID: DB11071
2026-03-28 08:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB11071%27 HTTP/1.1" 200 None
2026-03-28 08:32:51 [auto1.be] INFO: Scrape type for DB11071: 0
2026-03-28 08:32:51 [auto1.be] INFO: Found listing with ID: UA98228
2026-03-28 08:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA98228%27 HTTP/1.1" 200 None
2026-03-28 08:32:51 [auto1.be] INFO: Scrape type for UA98228: 0
2026-03-28 08:32:51 [auto1.be] INFO: Found listing with ID: WH33984
2026-03-28 08:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH33984%27 HTTP/1.1" 200 None
2026-03-28 08:32:51 [auto1.be] INFO: Scrape type for WH33984: 0
2026-03-28 08:32:51 [auto1.be] INFO: Found listing with ID: DP96573
2026-03-28 08:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP96573%27 HTTP/1.1" 200 None
2026-03-28 08:32:51 [auto1.be] INFO: Scrape type for DP96573: 0
2026-03-28 08:32:51 [auto1.be] INFO: Found listing with ID: BD22160
2026-03-28 08:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD22160%27 HTTP/1.1" 200 None
2026-03-28 08:32:51 [auto1.be] INFO: Scrape type for BD22160: 0
2026-03-28 08:32:51 [auto1.be] INFO: Found listing with ID: BU27000
2026-03-28 08:32:51 [auto1.be] INFO: Found listing with ID: MP28046
2026-03-28 08:32:51 [auto1.be] INFO: Found listing with ID: SL51907
2026-03-28 08:32:51 [auto1.be] INFO: Found listing with ID: LE04651
2026-03-28 08:32:52 [auto1.be] INFO: Found listing with ID: DL37030
2026-03-28 08:32:52 [auto1.be] INFO: Found listing with ID: ZL15279
2026-03-28 08:32:52 [auto1.be] INFO: Found listing with ID: NB03494
2026-03-28 08:32:52 [auto1.be] INFO: Found listing with ID: TS47815
2026-03-28 08:32:52 [auto1.be] INFO: Found listing with ID: KD31542
2026-03-28 08:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD31542%27 HTTP/1.1" 200 None
2026-03-28 08:32:52 [auto1.be] INFO: Scrape type for KD31542: 0
2026-03-28 08:32:52 [auto1.be] INFO: Found listing with ID: LE55631
2026-03-28 08:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE55631%27 HTTP/1.1" 200 None
2026-03-28 08:32:52 [auto1.be] INFO: Scrape type for LE55631: 0
2026-03-28 08:32:52 [auto1.be] INFO: Found listing with ID: KB74591
2026-03-28 08:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KB74591%27 HTTP/1.1" 200 None
2026-03-28 08:32:52 [auto1.be] INFO: Scrape type for KB74591: 0
2026-03-28 08:32:52 [auto1.be] INFO: Found listing with ID: SZ60181
2026-03-28 08:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ60181%27 HTTP/1.1" 200 None
2026-03-28 08:32:52 [auto1.be] INFO: Scrape type for SZ60181: 0
2026-03-28 08:32:52 [auto1.be] INFO: Found listing with ID: PY12122
2026-03-28 08:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY12122%27 HTTP/1.1" 200 None
2026-03-28 08:32:52 [auto1.be] INFO: Scrape type for PY12122: 0
2026-03-28 08:32:52 [auto1.be] INFO: Found listing with ID: DE21401
2026-03-28 08:32:52 [auto1.be] INFO: Found listing with ID: YH09444
2026-03-28 08:32:52 [auto1.be] INFO: Found listing with ID: UW21644
2026-03-28 08:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW21644%27 HTTP/1.1" 200 None
2026-03-28 08:32:52 [auto1.be] INFO: Scrape type for UW21644: 0
2026-03-28 08:32:52 [auto1.be] INFO: Found listing with ID: SC85120
2026-03-28 08:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC85120%27 HTTP/1.1" 200 None
2026-03-28 08:32:52 [auto1.be] INFO: Scrape type for SC85120: 0
2026-03-28 08:32:52 [auto1.be] INFO: Found listing with ID: BU79691
2026-03-28 08:32:52 [auto1.be] INFO: Found listing with ID: MC44479
2026-03-28 08:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC44479%27 HTTP/1.1" 200 None
2026-03-28 08:32:52 [auto1.be] INFO: Scrape type for MC44479: 0
2026-03-28 08:32:52 [auto1.be] INFO: Found listing with ID: CP42003
2026-03-28 08:32:52 [auto1.be] INFO: Found listing with ID: LY80968
2026-03-28 08:32:52 [auto1.be] INFO: Found listing with ID: WH41445
2026-03-28 08:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH41445%27 HTTP/1.1" 200 None
2026-03-28 08:32:52 [auto1.be] INFO: Scrape type for WH41445: 0
2026-03-28 08:32:52 [auto1.be] INFO: Found listing with ID: XC97675
2026-03-28 08:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC97675%27 HTTP/1.1" 200 None
2026-03-28 08:32:52 [auto1.be] INFO: Scrape type for XC97675: 0
2026-03-28 08:32:52 [auto1.be] INFO: Found listing with ID: JS91211
2026-03-28 08:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS91211%27 HTTP/1.1" 200 None
2026-03-28 08:32:52 [auto1.be] INFO: Scrape type for JS91211: 0
2026-03-28 08:32:52 [auto1.be] INFO: Found listing with ID: XT90325
2026-03-28 08:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT90325%27 HTTP/1.1" 200 None
2026-03-28 08:32:52 [auto1.be] INFO: Scrape type for XT90325: 0
2026-03-28 08:32:52 [auto1.be] INFO: Found listing with ID: ZK00678
2026-03-28 08:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK00678%27 HTTP/1.1" 200 None
2026-03-28 08:32:52 [auto1.be] INFO: Scrape type for ZK00678: 0
2026-03-28 08:32:52 [auto1.be] INFO: Found listing with ID: WP77061
2026-03-28 08:32:52 [auto1.be] INFO: Found listing with ID: ED59297
2026-03-28 08:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED59297%27 HTTP/1.1" 200 None
2026-03-28 08:32:52 [auto1.be] INFO: Scrape type for ED59297: 0
2026-03-28 08:32:52 [auto1.be] INFO: Found listing with ID: TU68669
2026-03-28 08:32:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:32:54 [auto1.be] INFO: Channel: 24h | Page: 37 | totalHits: 1701 | hits on page: 40
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: WD60187
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD60187%27 HTTP/1.1" 200 None
2026-03-28 08:32:54 [auto1.be] INFO: Scrape type for WD60187: 0
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: CC17071
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC17071%27 HTTP/1.1" 200 None
2026-03-28 08:32:54 [auto1.be] INFO: Scrape type for CC17071: 0
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: EP09858
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP09858%27 HTTP/1.1" 200 None
2026-03-28 08:32:54 [auto1.be] INFO: Scrape type for EP09858: 0
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: MF96479
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MF96479%27 HTTP/1.1" 200 None
2026-03-28 08:32:54 [auto1.be] INFO: Scrape type for MF96479: 0
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: KA88762
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KA88762%27 HTTP/1.1" 200 None
2026-03-28 08:32:54 [auto1.be] INFO: Scrape type for KA88762: 0
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: ET95220
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET95220%27 HTTP/1.1" 200 None
2026-03-28 08:32:54 [auto1.be] INFO: Scrape type for ET95220: 0
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: KF52558
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF52558%27 HTTP/1.1" 200 None
2026-03-28 08:32:54 [auto1.be] INFO: Scrape type for KF52558: 0
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: JM34078
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: UJ89543
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ89543%27 HTTP/1.1" 200 None
2026-03-28 08:32:54 [auto1.be] INFO: Scrape type for UJ89543: 0
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: UX94260
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX94260%27 HTTP/1.1" 200 None
2026-03-28 08:32:54 [auto1.be] INFO: Scrape type for UX94260: 0
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: FA63464
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA63464%27 HTTP/1.1" 200 None
2026-03-28 08:32:54 [auto1.be] INFO: Scrape type for FA63464: 0
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: WA92632
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA92632%27 HTTP/1.1" 200 None
2026-03-28 08:32:54 [auto1.be] INFO: Scrape type for WA92632: 0
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: FN16517
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN16517%27 HTTP/1.1" 200 None
2026-03-28 08:32:54 [auto1.be] INFO: Scrape type for FN16517: 0
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: PS61885
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS61885%27 HTTP/1.1" 200 None
2026-03-28 08:32:54 [auto1.be] INFO: Scrape type for PS61885: 0
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: KW38150
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW38150%27 HTTP/1.1" 200 None
2026-03-28 08:32:54 [auto1.be] INFO: Scrape type for KW38150: 0
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: CU40853
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU40853%27 HTTP/1.1" 200 None
2026-03-28 08:32:54 [auto1.be] INFO: Scrape type for CU40853: 0
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: KH63709
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH63709%27 HTTP/1.1" 200 None
2026-03-28 08:32:54 [auto1.be] INFO: Scrape type for KH63709: 0
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: RK79502
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: YL38834
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL38834%27 HTTP/1.1" 200 None
2026-03-28 08:32:54 [auto1.be] INFO: Scrape type for YL38834: 0
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: EN18719
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: MW76341
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW76341%27 HTTP/1.1" 200 None
2026-03-28 08:32:54 [auto1.be] INFO: Scrape type for MW76341: 0
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: NP69529
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: GF63829
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF63829%27 HTTP/1.1" 200 None
2026-03-28 08:32:54 [auto1.be] INFO: Scrape type for GF63829: 0
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: GH45635
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: SC04496
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC04496%27 HTTP/1.1" 200 None
2026-03-28 08:32:54 [auto1.be] INFO: Scrape type for SC04496: 0
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: UY90554
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY90554%27 HTTP/1.1" 200 None
2026-03-28 08:32:54 [auto1.be] INFO: Scrape type for UY90554: 0
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: ZR45530
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: GW63299
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW63299%27 HTTP/1.1" 200 None
2026-03-28 08:32:54 [auto1.be] INFO: Scrape type for GW63299: 0
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: MC66522
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC66522%27 HTTP/1.1" 200 None
2026-03-28 08:32:54 [auto1.be] INFO: Scrape type for MC66522: 0
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: LX45606
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: LC46636
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: RN56335
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RN56335%27 HTTP/1.1" 200 None
2026-03-28 08:32:54 [auto1.be] INFO: Scrape type for RN56335: 0
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: AS01915
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: ZK51965
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK51965%27 HTTP/1.1" 200 None
2026-03-28 08:32:54 [auto1.be] INFO: Scrape type for ZK51965: 0
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: MS23670
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS23670%27 HTTP/1.1" 200 None
2026-03-28 08:32:54 [auto1.be] INFO: Scrape type for MS23670: 0
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: DC17534
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC17534%27 HTTP/1.1" 200 None
2026-03-28 08:32:54 [auto1.be] INFO: Scrape type for DC17534: 0
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: EJ45470
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ45470%27 HTTP/1.1" 200 None
2026-03-28 08:32:54 [auto1.be] INFO: Scrape type for EJ45470: 0
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: TU11660
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU11660%27 HTTP/1.1" 200 None
2026-03-28 08:32:54 [auto1.be] INFO: Scrape type for TU11660: 0
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: RA65802
2026-03-28 08:32:54 [auto1.be] INFO: Found listing with ID: JH99432
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH99432%27 HTTP/1.1" 200 None
2026-03-28 08:32:54 [auto1.be] INFO: Scrape type for JH99432: 0
2026-03-28 08:32:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:32:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:32:56 [auto1.be] INFO: Channel: 24h | Page: 38 | totalHits: 1701 | hits on page: 40
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: FR21473
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: PY40839
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY40839%27 HTTP/1.1" 200 None
2026-03-28 08:32:56 [auto1.be] INFO: Scrape type for PY40839: 0
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: HL14568
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: AV28567
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV28567%27 HTTP/1.1" 200 None
2026-03-28 08:32:56 [auto1.be] INFO: Scrape type for AV28567: 0
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: BR84638
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: BW89679
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: XB17770
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB17770%27 HTTP/1.1" 200 None
2026-03-28 08:32:56 [auto1.be] INFO: Scrape type for XB17770: 0
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: NV81106
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: JV18684
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: LP07116
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP07116%27 HTTP/1.1" 200 None
2026-03-28 08:32:56 [auto1.be] INFO: Scrape type for LP07116: 0
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: CE65833
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE65833%27 HTTP/1.1" 200 None
2026-03-28 08:32:56 [auto1.be] INFO: Scrape type for CE65833: 0
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: RH07818
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: VP78411
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP78411%27 HTTP/1.1" 200 None
2026-03-28 08:32:56 [auto1.be] INFO: Scrape type for VP78411: 0
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: KV58178
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: TP16646
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: ES19550
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: HB98543
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB98543%27 HTTP/1.1" 200 None
2026-03-28 08:32:56 [auto1.be] INFO: Scrape type for HB98543: 0
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: JX31629
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX31629%27 HTTP/1.1" 200 None
2026-03-28 08:32:56 [auto1.be] INFO: Scrape type for JX31629: 0
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: UU07035
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU07035%27 HTTP/1.1" 200 None
2026-03-28 08:32:56 [auto1.be] INFO: Scrape type for UU07035: 0
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: EM18277
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: KX60472
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: YK80434
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK80434%27 HTTP/1.1" 200 None
2026-03-28 08:32:56 [auto1.be] INFO: Scrape type for YK80434: 0
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: HM69306
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: FG26500
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: GF65026
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF65026%27 HTTP/1.1" 200 None
2026-03-28 08:32:56 [auto1.be] INFO: Scrape type for GF65026: 0
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: UN53703
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: WF76478
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WF76478%27 HTTP/1.1" 200 None
2026-03-28 08:32:56 [auto1.be] INFO: Scrape type for WF76478: 0
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: GG55355
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: AL21659
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AL21659%27 HTTP/1.1" 200 None
2026-03-28 08:32:56 [auto1.be] INFO: Scrape type for AL21659: 0
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: SC36479
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC36479%27 HTTP/1.1" 200 None
2026-03-28 08:32:56 [auto1.be] INFO: Scrape type for SC36479: 0
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: JX62848
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX62848%27 HTTP/1.1" 200 None
2026-03-28 08:32:56 [auto1.be] INFO: Scrape type for JX62848: 0
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: EG19315
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: CP13942
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: DY20434
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY20434%27 HTTP/1.1" 200 None
2026-03-28 08:32:56 [auto1.be] INFO: Scrape type for DY20434: 0
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: CB53563
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: XC12599
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: JH02802
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH02802%27 HTTP/1.1" 200 None
2026-03-28 08:32:56 [auto1.be] INFO: Scrape type for JH02802: 0
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: CG84069
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: GV27154
2026-03-28 08:32:56 [auto1.be] INFO: Found listing with ID: LW38679
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW38679%27 HTTP/1.1" 200 None
2026-03-28 08:32:56 [auto1.be] INFO: Scrape type for LW38679: 0
2026-03-28 08:32:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:32:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:32:58 [auto1.be] INFO: Channel: 24h | Page: 39 | totalHits: 1701 | hits on page: 40
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: MV28568
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV28568%27 HTTP/1.1" 200 None
2026-03-28 08:32:58 [auto1.be] INFO: Scrape type for MV28568: 0
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: HY77866
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: DT24627
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT24627%27 HTTP/1.1" 200 None
2026-03-28 08:32:58 [auto1.be] INFO: Scrape type for DT24627: 0
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: RL32581
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL32581%27 HTTP/1.1" 200 None
2026-03-28 08:32:58 [auto1.be] INFO: Scrape type for RL32581: 0
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: ZS27075
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: AE13452
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: YA85838
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: JW58136
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW58136%27 HTTP/1.1" 200 None
2026-03-28 08:32:58 [auto1.be] INFO: Scrape type for JW58136: 0
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: DG02903
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DG02903%27 HTTP/1.1" 200 None
2026-03-28 08:32:58 [auto1.be] INFO: Scrape type for DG02903: 0
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: DK43204
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: WU38196
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: AK84541
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: NB09051
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: FM00077
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM00077%27 HTTP/1.1" 200 None
2026-03-28 08:32:58 [auto1.be] INFO: Scrape type for FM00077: 0
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: KP74596
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP74596%27 HTTP/1.1" 200 None
2026-03-28 08:32:58 [auto1.be] INFO: Scrape type for KP74596: 0
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: PB67516
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB67516%27 HTTP/1.1" 200 None
2026-03-28 08:32:58 [auto1.be] INFO: Scrape type for PB67516: 0
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: YJ60132
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: WE53696
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: FC28046
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC28046%27 HTTP/1.1" 200 None
2026-03-28 08:32:58 [auto1.be] INFO: Scrape type for FC28046: 0
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: AV34296
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: YJ44532
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: GL29646
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GL29646%27 HTTP/1.1" 200 None
2026-03-28 08:32:58 [auto1.be] INFO: Scrape type for GL29646: 0
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: LH25651
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: ZR23499
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR23499%27 HTTP/1.1" 200 None
2026-03-28 08:32:58 [auto1.be] INFO: Scrape type for ZR23499: 0
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: FJ69250
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: CG39340
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG39340%27 HTTP/1.1" 200 None
2026-03-28 08:32:58 [auto1.be] INFO: Scrape type for CG39340: 0
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: RU19747
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU19747%27 HTTP/1.1" 200 None
2026-03-28 08:32:58 [auto1.be] INFO: Scrape type for RU19747: 0
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: ZR56949
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR56949%27 HTTP/1.1" 200 None
2026-03-28 08:32:58 [auto1.be] INFO: Scrape type for ZR56949: 0
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: RP30975
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RP30975%27 HTTP/1.1" 200 None
2026-03-28 08:32:58 [auto1.be] INFO: Scrape type for RP30975: 0
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: WB95668
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB95668%27 HTTP/1.1" 200 None
2026-03-28 08:32:58 [auto1.be] INFO: Scrape type for WB95668: 0
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: RX75304
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX75304%27 HTTP/1.1" 200 None
2026-03-28 08:32:58 [auto1.be] INFO: Scrape type for RX75304: 0
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: VM12927
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: TM97404
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: CB60498
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: NP23299
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP23299%27 HTTP/1.1" 200 None
2026-03-28 08:32:58 [auto1.be] INFO: Scrape type for NP23299: 0
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: VE52917
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: RU48742
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: YU75052
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU75052%27 HTTP/1.1" 200 None
2026-03-28 08:32:58 [auto1.be] INFO: Scrape type for YU75052: 0
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: YF28674
2026-03-28 08:32:58 [auto1.be] INFO: Found listing with ID: KU11213
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU11213%27 HTTP/1.1" 200 None
2026-03-28 08:32:58 [auto1.be] INFO: Scrape type for KU11213: 0
2026-03-28 08:32:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:33:01 [auto1.be] INFO: Channel: 24h | Page: 40 | totalHits: 1701 | hits on page: 40
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: XH49609
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: BP14655
2026-03-28 08:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP14655%27 HTTP/1.1" 200 None
2026-03-28 08:33:01 [auto1.be] INFO: Scrape type for BP14655: 0
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: BS55977
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: BX96549
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: PJ20685
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: GJ23391
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: XH30316
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: FG88533
2026-03-28 08:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG88533%27 HTTP/1.1" 200 None
2026-03-28 08:33:01 [auto1.be] INFO: Scrape type for FG88533: 0
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: KG87325
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: EL84394
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: PB96026
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: RA81540
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: RW94228
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: EK72945
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: FV97066
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: NC04706
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: LU38585
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: XE73160
2026-03-28 08:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE73160%27 HTTP/1.1" 200 None
2026-03-28 08:33:01 [auto1.be] INFO: Scrape type for XE73160: 0
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: PC96861
2026-03-28 08:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC96861%27 HTTP/1.1" 200 None
2026-03-28 08:33:01 [auto1.be] INFO: Scrape type for PC96861: 0
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: AE23838
2026-03-28 08:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE23838%27 HTTP/1.1" 200 None
2026-03-28 08:33:01 [auto1.be] INFO: Scrape type for AE23838: 0
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: HP14917
2026-03-28 08:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP14917%27 HTTP/1.1" 200 None
2026-03-28 08:33:01 [auto1.be] INFO: Scrape type for HP14917: 0
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: ZD51863
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: HB19534
2026-03-28 08:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB19534%27 HTTP/1.1" 200 None
2026-03-28 08:33:01 [auto1.be] INFO: Scrape type for HB19534: 0
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: ND89972
2026-03-28 08:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND89972%27 HTTP/1.1" 200 None
2026-03-28 08:33:01 [auto1.be] INFO: Scrape type for ND89972: 0
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: CB86664
2026-03-28 08:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB86664%27 HTTP/1.1" 200 None
2026-03-28 08:33:01 [auto1.be] INFO: Scrape type for CB86664: 0
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: HL95749
2026-03-28 08:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL95749%27 HTTP/1.1" 200 None
2026-03-28 08:33:01 [auto1.be] INFO: Scrape type for HL95749: 0
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: UT04463
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: BJ27729
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: CA72484
2026-03-28 08:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA72484%27 HTTP/1.1" 200 None
2026-03-28 08:33:01 [auto1.be] INFO: Scrape type for CA72484: 0
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: LG37246
2026-03-28 08:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG37246%27 HTTP/1.1" 200 None
2026-03-28 08:33:01 [auto1.be] INFO: Scrape type for LG37246: 0
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: PF95077
2026-03-28 08:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF95077%27 HTTP/1.1" 200 None
2026-03-28 08:33:01 [auto1.be] INFO: Scrape type for PF95077: 0
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: GC03502
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: NC25574
2026-03-28 08:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC25574%27 HTTP/1.1" 200 None
2026-03-28 08:33:01 [auto1.be] INFO: Scrape type for NC25574: 0
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: FC28385
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: MD39375
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: ZJ33794
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: KF50538
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: GP69185
2026-03-28 08:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP69185%27 HTTP/1.1" 200 None
2026-03-28 08:33:01 [auto1.be] INFO: Scrape type for GP69185: 0
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: PM96543
2026-03-28 08:33:01 [auto1.be] INFO: Found listing with ID: WP69561
2026-03-28 08:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP69561%27 HTTP/1.1" 200 None
2026-03-28 08:33:01 [auto1.be] INFO: Scrape type for WP69561: 0
2026-03-28 08:33:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:33:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:33:02 [auto1.be] INFO: Channel: 24h | Page: 41 | totalHits: 1701 | hits on page: 40
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: YX48939
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX48939%27 HTTP/1.1" 200 None
2026-03-28 08:33:02 [auto1.be] INFO: Scrape type for YX48939: 0
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: TH19224
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH19224%27 HTTP/1.1" 200 None
2026-03-28 08:33:02 [auto1.be] INFO: Scrape type for TH19224: 0
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: XM93272
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM93272%27 HTTP/1.1" 200 None
2026-03-28 08:33:02 [auto1.be] INFO: Scrape type for XM93272: 0
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: XJ47711
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ47711%27 HTTP/1.1" 200 None
2026-03-28 08:33:02 [auto1.be] INFO: Scrape type for XJ47711: 0
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: DB63111
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB63111%27 HTTP/1.1" 200 None
2026-03-28 08:33:02 [auto1.be] INFO: Scrape type for DB63111: 0
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: KF81819
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: JS91755
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: NM63028
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM63028%27 HTTP/1.1" 200 None
2026-03-28 08:33:02 [auto1.be] INFO: Scrape type for NM63028: 0
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: EP14144
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP14144%27 HTTP/1.1" 200 None
2026-03-28 08:33:02 [auto1.be] INFO: Scrape type for EP14144: 0
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: SA79242
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA79242%27 HTTP/1.1" 200 None
2026-03-28 08:33:02 [auto1.be] INFO: Scrape type for SA79242: 0
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: KP16038
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: RR03336
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR03336%27 HTTP/1.1" 200 None
2026-03-28 08:33:02 [auto1.be] INFO: Scrape type for RR03336: 0
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: PH64665
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: SJ78748
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ78748%27 HTTP/1.1" 200 None
2026-03-28 08:33:02 [auto1.be] INFO: Scrape type for SJ78748: 0
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: ZN76480
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN76480%27 HTTP/1.1" 200 None
2026-03-28 08:33:02 [auto1.be] INFO: Scrape type for ZN76480: 0
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: ZN66630
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: BD10300
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD10300%27 HTTP/1.1" 200 None
2026-03-28 08:33:02 [auto1.be] INFO: Scrape type for BD10300: 0
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: GH94077
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: SB45161
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: XE15288
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE15288%27 HTTP/1.1" 200 None
2026-03-28 08:33:02 [auto1.be] INFO: Scrape type for XE15288: 0
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: JJ10339
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: BU90061
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: AX51995
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX51995%27 HTTP/1.1" 200 None
2026-03-28 08:33:02 [auto1.be] INFO: Scrape type for AX51995: 0
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: SR34780
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR34780%27 HTTP/1.1" 200 None
2026-03-28 08:33:02 [auto1.be] INFO: Scrape type for SR34780: 0
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: KN88676
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: HW65369
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: WG62431
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: UH14890
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: SC73086
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: WK50026
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK50026%27 HTTP/1.1" 200 None
2026-03-28 08:33:02 [auto1.be] INFO: Scrape type for WK50026: 0
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: CP91123
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP91123%27 HTTP/1.1" 200 None
2026-03-28 08:33:02 [auto1.be] INFO: Scrape type for CP91123: 0
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: ZR84759
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR84759%27 HTTP/1.1" 200 None
2026-03-28 08:33:02 [auto1.be] INFO: Scrape type for ZR84759: 0
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: GD11285
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GD11285%27 HTTP/1.1" 200 None
2026-03-28 08:33:02 [auto1.be] INFO: Scrape type for GD11285: 0
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: SA37733
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA37733%27 HTTP/1.1" 200 None
2026-03-28 08:33:02 [auto1.be] INFO: Scrape type for SA37733: 0
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: WK14396
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK14396%27 HTTP/1.1" 200 None
2026-03-28 08:33:02 [auto1.be] INFO: Scrape type for WK14396: 0
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: DY28234
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY28234%27 HTTP/1.1" 200 None
2026-03-28 08:33:02 [auto1.be] INFO: Scrape type for DY28234: 0
2026-03-28 08:33:02 [auto1.be] INFO: Found listing with ID: ED70069
2026-03-28 08:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED70069%27 HTTP/1.1" 200 None
2026-03-28 08:33:03 [auto1.be] INFO: Scrape type for ED70069: 0
2026-03-28 08:33:03 [auto1.be] INFO: Found listing with ID: ST89131
2026-03-28 08:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST89131%27 HTTP/1.1" 200 None
2026-03-28 08:33:03 [auto1.be] INFO: Scrape type for ST89131: 0
2026-03-28 08:33:03 [auto1.be] INFO: Found listing with ID: VV01116
2026-03-28 08:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VV01116%27 HTTP/1.1" 200 None
2026-03-28 08:33:03 [auto1.be] INFO: Scrape type for VV01116: 0
2026-03-28 08:33:03 [auto1.be] INFO: Found listing with ID: FJ79675
2026-03-28 08:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ79675%27 HTTP/1.1" 200 None
2026-03-28 08:33:03 [auto1.be] INFO: Scrape type for FJ79675: 0
2026-03-28 08:33:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:33:04 [auto1.be] INFO: Channel: 24h | Page: 42 | totalHits: 1701 | hits on page: 40
2026-03-28 08:33:04 [auto1.be] INFO: Found listing with ID: NK56969
2026-03-28 08:33:04 [auto1.be] INFO: Found listing with ID: WC98842
2026-03-28 08:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC98842%27 HTTP/1.1" 200 None
2026-03-28 08:33:04 [auto1.be] INFO: Scrape type for WC98842: 0
2026-03-28 08:33:04 [auto1.be] INFO: Found listing with ID: NY53837
2026-03-28 08:33:04 [auto1.be] INFO: Found listing with ID: FH97290
2026-03-28 08:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH97290%27 HTTP/1.1" 200 None
2026-03-28 08:33:04 [auto1.be] INFO: Scrape type for FH97290: 0
2026-03-28 08:33:04 [auto1.be] INFO: Found listing with ID: JA34397
2026-03-28 08:33:04 [auto1.be] INFO: Found listing with ID: JS18374
2026-03-28 08:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS18374%27 HTTP/1.1" 200 None
2026-03-28 08:33:04 [auto1.be] INFO: Scrape type for JS18374: 0
2026-03-28 08:33:04 [auto1.be] INFO: Found listing with ID: VF88831
2026-03-28 08:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF88831%27 HTTP/1.1" 200 None
2026-03-28 08:33:04 [auto1.be] INFO: Scrape type for VF88831: 0
2026-03-28 08:33:04 [auto1.be] INFO: Found listing with ID: BC49055
2026-03-28 08:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC49055%27 HTTP/1.1" 200 None
2026-03-28 08:33:04 [auto1.be] INFO: Scrape type for BC49055: 2
2026-03-28 08:33:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9b88e7b-80c5-5158-8670-f261c41b45fc with identifier: BC49055
2026-03-28 08:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9b88e7b-80c5-5158-8670-f261c41b45fc with scrape type 2
2026-03-28 08:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9b88e7b-80c5-5158-8670-f261c41b45fc with scrape type 2
2026-03-28 08:33:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c9b88e7b-80c5-5158-8670-f261c41b45fc, identifier: BC49055
2026-03-28 08:33:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c9b88e7b-80c5-5158-8670-f261c41b45fc with identifier: BC49055
2026-03-28 08:33:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c9b88e7b-80c5-5158-8670-f261c41b45fc with identifier: BC49055
2026-03-28 08:33:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c9b88e7b-80c5-5158-8670-f261c41b45fc with identifier: BC49055 to the API
2026-03-28 08:33:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:33:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:33:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:33:55Z',
'fuel_type': 'petrol',
'id': 'c9b88e7b-80c5-5158-8670-f261c41b45fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC49055',
'listing': 'auction',
'make': 'Opel',
'model': 'Tigra',
'odometer': 144720,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-07-10',
'seller_name': None,
'title': 'Opel Tigra 1.4 Enjoy',
'transmission': 'manual',
'trim': 'Enjoy',
'year': 2005}
2026-03-28 08:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC49055%27 HTTP/1.1" 200 None
2026-03-28 08:33:05 [auto1.be] INFO: Saving data for BC49055: {'auction_closing_time': 1774715635.0, 'created_time': 1774600271.352348, 'last_price_update_time': 1774686785.571615}
2026-03-28 08:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BC49055') HTTP/1.1" 204 0
2026-03-28 08:33:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:33:05 [auto1.be] INFO: Found listing with ID: TF03002
2026-03-28 08:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF03002%27 HTTP/1.1" 200 None
2026-03-28 08:33:05 [auto1.be] INFO: Scrape type for TF03002: 2
2026-03-28 08:33:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 045185d6-ec84-53e2-bef2-8b5b975effb3 with identifier: TF03002
2026-03-28 08:33:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 045185d6-ec84-53e2-bef2-8b5b975effb3 with scrape type 2
2026-03-28 08:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 045185d6-ec84-53e2-bef2-8b5b975effb3 with scrape type 2
2026-03-28 08:33:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 045185d6-ec84-53e2-bef2-8b5b975effb3, identifier: TF03002
2026-03-28 08:33:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 045185d6-ec84-53e2-bef2-8b5b975effb3 with identifier: TF03002
2026-03-28 08:33:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 045185d6-ec84-53e2-bef2-8b5b975effb3 with identifier: TF03002
2026-03-28 08:33:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 045185d6-ec84-53e2-bef2-8b5b975effb3 with identifier: TF03002 to the API
2026-03-28 08:33:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:33:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:33:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 85,
'expiration_date': '2026-03-28T16:40:40Z',
'fuel_type': 'petrol',
'id': '045185d6-ec84-53e2-bef2-8b5b975effb3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF03002',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 199816,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-27',
'seller_name': None,
'title': 'Volkswagen Polo 1.4 FSI Match',
'transmission': 'manual',
'trim': 'Match',
'year': 2013}
2026-03-28 08:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF03002%27 HTTP/1.1" 200 None
2026-03-28 08:33:07 [auto1.be] INFO: Saving data for TF03002: {'auction_closing_time': 1774716040.0, 'created_time': 1774600275.066094, 'last_price_update_time': 1774686787.831113}
2026-03-28 08:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TF03002') HTTP/1.1" 204 0
2026-03-28 08:33:07 [auto1.be] INFO: Found listing with ID: TZ99758
2026-03-28 08:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TZ99758%27 HTTP/1.1" 200 None
2026-03-28 08:33:07 [auto1.be] INFO: Scrape type for TZ99758: 2
2026-03-28 08:33:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e26ae23-3dfe-5205-8b2f-9f7e92de5b18 with identifier: TZ99758
2026-03-28 08:33:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e26ae23-3dfe-5205-8b2f-9f7e92de5b18 with scrape type 2
2026-03-28 08:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e26ae23-3dfe-5205-8b2f-9f7e92de5b18 with scrape type 2
2026-03-28 08:33:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2e26ae23-3dfe-5205-8b2f-9f7e92de5b18, identifier: TZ99758
2026-03-28 08:33:07 [scrapy.extensions.logstats] INFO: Crawled 68 pages (at 12 pages/min), scraped 128 items (at 2 items/min)
2026-03-28 08:33:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 175MiB
2026-03-28 08:33:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2e26ae23-3dfe-5205-8b2f-9f7e92de5b18 with identifier: TZ99758
2026-03-28 08:33:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2e26ae23-3dfe-5205-8b2f-9f7e92de5b18 with identifier: TZ99758
2026-03-28 08:33:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2e26ae23-3dfe-5205-8b2f-9f7e92de5b18 with identifier: TZ99758 to the API
2026-03-28 08:33:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:33:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:33:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-28T16:07:55Z',
'fuel_type': 'diesel',
'id': '2e26ae23-3dfe-5205-8b2f-9f7e92de5b18',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ99758',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 95081,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-31',
'seller_name': None,
'title': 'Land Rover Evoque D165 Mild-Hybrid R-Dynamic S',
'transmission': 'automatic',
'trim': 'R-Dynamic S',
'year': 2021}
2026-03-28 08:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TZ99758%27 HTTP/1.1" 200 None
2026-03-28 08:33:08 [auto1.be] INFO: Saving data for TZ99758: {'auction_closing_time': 1774714075.0, 'created_time': 1774600286.277373, 'last_price_update_time': 1774686788.221719}
2026-03-28 08:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TZ99758') HTTP/1.1" 204 0
2026-03-28 08:33:08 [auto1.be] INFO: Found listing with ID: WW99205
2026-03-28 08:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW99205%27 HTTP/1.1" 200 None
2026-03-28 08:33:08 [auto1.be] INFO: Scrape type for WW99205: 2
2026-03-28 08:33:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 952fc525-855c-5468-94f2-9f1dc66a8654 with identifier: WW99205
2026-03-28 08:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 952fc525-855c-5468-94f2-9f1dc66a8654 with scrape type 2
2026-03-28 08:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 952fc525-855c-5468-94f2-9f1dc66a8654 with scrape type 2
2026-03-28 08:33:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 952fc525-855c-5468-94f2-9f1dc66a8654, identifier: WW99205
2026-03-28 08:33:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 952fc525-855c-5468-94f2-9f1dc66a8654 with identifier: WW99205
2026-03-28 08:33:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 08:33:08 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-28 08:33:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 08:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 08:33:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 952fc525-855c-5468-94f2-9f1dc66a8654 with identifier: WW99205
2026-03-28 08:33:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 952fc525-855c-5468-94f2-9f1dc66a8654 with identifier: WW99205 to the API
2026-03-28 08:33:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:33:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:33:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'violet',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-28T16:56:58Z',
'fuel_type': 'diesel',
'id': '952fc525-855c-5468-94f2-9f1dc66a8654',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW99205',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 157448,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-11-19',
'seller_name': None,
'title': 'Ford Fiesta 1.6 TDCi ECOnetic',
'transmission': 'manual',
'trim': 'ECOnetic',
'year': 2009}
2026-03-28 08:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW99205%27 HTTP/1.1" 200 None
2026-03-28 08:33:08 [auto1.be] INFO: Saving data for WW99205: {'auction_closing_time': 1774717018.0, 'created_time': 1774600266.092938, 'last_price_update_time': 1774686788.737089}
2026-03-28 08:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WW99205') HTTP/1.1" 204 0
2026-03-28 08:33:08 [auto1.be] INFO: Found listing with ID: FV40639
2026-03-28 08:33:08 [auto1.be] INFO: Found listing with ID: UX15937
2026-03-28 08:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX15937%27 HTTP/1.1" 200 None
2026-03-28 08:33:08 [auto1.be] INFO: Scrape type for UX15937: 2
2026-03-28 08:33:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1450a068-55de-5e8d-814a-11cfb726c7d8 with identifier: UX15937
2026-03-28 08:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1450a068-55de-5e8d-814a-11cfb726c7d8 with scrape type 2
2026-03-28 08:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1450a068-55de-5e8d-814a-11cfb726c7d8 with scrape type 2
2026-03-28 08:33:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1450a068-55de-5e8d-814a-11cfb726c7d8, identifier: UX15937
2026-03-28 08:33:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1450a068-55de-5e8d-814a-11cfb726c7d8 with identifier: UX15937
2026-03-28 08:33:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1450a068-55de-5e8d-814a-11cfb726c7d8 with identifier: UX15937
2026-03-28 08:33:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1450a068-55de-5e8d-814a-11cfb726c7d8 with identifier: UX15937 to the API
2026-03-28 08:33:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:33:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:30:07Z',
'fuel_type': 'petrol',
'id': '1450a068-55de-5e8d-814a-11cfb726c7d8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX15937',
'listing': 'auction',
'make': 'Fiat',
'model': '500X',
'odometer': 165373,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-02',
'seller_name': None,
'title': 'Fiat 500X 1.0 Turbo City Cross',
'transmission': 'manual',
'trim': 'City Cross',
'year': 2019}
2026-03-28 08:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX15937%27 HTTP/1.1" 200 None
2026-03-28 08:33:09 [auto1.be] INFO: Saving data for UX15937: {'auction_closing_time': 1774715407.0, 'created_time': 1773237862.379495, 'last_price_update_time': 1774686789.166097}
2026-03-28 08:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UX15937') HTTP/1.1" 204 0
2026-03-28 08:33:09 [auto1.be] INFO: Found listing with ID: MJ08102
2026-03-28 08:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ08102%27 HTTP/1.1" 200 None
2026-03-28 08:33:09 [auto1.be] INFO: Scrape type for MJ08102: 2
2026-03-28 08:33:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00232223-a846-5900-9a5b-3db495a38efc with identifier: MJ08102
2026-03-28 08:33:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00232223-a846-5900-9a5b-3db495a38efc with scrape type 2
2026-03-28 08:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00232223-a846-5900-9a5b-3db495a38efc with scrape type 2
2026-03-28 08:33:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 00232223-a846-5900-9a5b-3db495a38efc, identifier: MJ08102
2026-03-28 08:33:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 00232223-a846-5900-9a5b-3db495a38efc with identifier: MJ08102
2026-03-28 08:33:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 00232223-a846-5900-9a5b-3db495a38efc with identifier: MJ08102
2026-03-28 08:33:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 00232223-a846-5900-9a5b-3db495a38efc with identifier: MJ08102 to the API
2026-03-28 08:33:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:33:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-28T16:14:13Z',
'fuel_type': 'diesel',
'id': '00232223-a846-5900-9a5b-3db495a38efc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ08102',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4',
'odometer': 320259,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-12',
'seller_name': None,
'title': 'Citroen C4 1.6 Blue-HDi Selection',
'transmission': 'manual',
'trim': 'Selection',
'year': 2017}
2026-03-28 08:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ08102%27 HTTP/1.1" 200 None
2026-03-28 08:33:09 [auto1.be] INFO: Saving data for MJ08102: {'auction_closing_time': 1774714453.0, 'created_time': 1774600269.800273, 'last_price_update_time': 1774686789.549717}
2026-03-28 08:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MJ08102') HTTP/1.1" 204 0
2026-03-28 08:33:09 [auto1.be] INFO: Found listing with ID: CX83686
2026-03-28 08:33:09 [auto1.be] INFO: Found listing with ID: JU84298
2026-03-28 08:33:09 [auto1.be] INFO: Found listing with ID: JZ88652
2026-03-28 08:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ88652%27 HTTP/1.1" 200 None
2026-03-28 08:33:09 [auto1.be] INFO: Scrape type for JZ88652: 2
2026-03-28 08:33:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b991e6f-1d23-5887-a345-1c2d47850084 with identifier: JZ88652
2026-03-28 08:33:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b991e6f-1d23-5887-a345-1c2d47850084 with scrape type 2
2026-03-28 08:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b991e6f-1d23-5887-a345-1c2d47850084 with scrape type 2
2026-03-28 08:33:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3b991e6f-1d23-5887-a345-1c2d47850084, identifier: JZ88652
2026-03-28 08:33:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3b991e6f-1d23-5887-a345-1c2d47850084 with identifier: JZ88652
2026-03-28 08:33:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 08:33:09 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-28 08:33:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 08:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 08:33:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3b991e6f-1d23-5887-a345-1c2d47850084 with identifier: JZ88652
2026-03-28 08:33:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3b991e6f-1d23-5887-a345-1c2d47850084 with identifier: JZ88652 to the API
2026-03-28 08:33:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:33:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:33:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-28T16:24:45Z',
'fuel_type': 'diesel',
'id': '3b991e6f-1d23-5887-a345-1c2d47850084',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ88652',
'listing': 'auction',
'make': 'Kia',
'model': 'XCeed',
'odometer': 162300,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-13',
'seller_name': None,
'title': 'Kia XCeed 1.6 CRDi Platinum Edition',
'transmission': 'automatic',
'trim': 'Platinum Edition',
'year': 2020}
2026-03-28 08:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ88652%27 HTTP/1.1" 200 None
2026-03-28 08:33:10 [auto1.be] INFO: Saving data for JZ88652: {'auction_closing_time': 1774715085.0, 'created_time': 1773909034.86822, 'last_price_update_time': 1774686790.080396}
2026-03-28 08:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JZ88652') HTTP/1.1" 204 0
2026-03-28 08:33:10 [auto1.be] INFO: Found listing with ID: WP32655
2026-03-28 08:33:10 [auto1.be] INFO: Found listing with ID: JX00156
2026-03-28 08:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX00156%27 HTTP/1.1" 200 None
2026-03-28 08:33:10 [auto1.be] INFO: Scrape type for JX00156: 2
2026-03-28 08:33:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9b2242d-16f1-5264-84f4-9db8b53e18c0 with identifier: JX00156
2026-03-28 08:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9b2242d-16f1-5264-84f4-9db8b53e18c0 with scrape type 2
2026-03-28 08:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9b2242d-16f1-5264-84f4-9db8b53e18c0 with scrape type 2
2026-03-28 08:33:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f9b2242d-16f1-5264-84f4-9db8b53e18c0, identifier: JX00156
2026-03-28 08:33:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f9b2242d-16f1-5264-84f4-9db8b53e18c0 with identifier: JX00156
2026-03-28 08:33:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f9b2242d-16f1-5264-84f4-9db8b53e18c0 with identifier: JX00156
2026-03-28 08:33:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f9b2242d-16f1-5264-84f4-9db8b53e18c0 with identifier: JX00156 to the API
2026-03-28 08:33:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:33:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:33:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 125,
'expiration_date': '2026-03-28T16:03:36Z',
'fuel_type': 'petrol',
'id': 'f9b2242d-16f1-5264-84f4-9db8b53e18c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX00156',
'listing': 'auction',
'make': 'Hyundai',
'model': 'ix20',
'odometer': 76795,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-02',
'seller_name': None,
'title': 'Hyundai ix20 1.6 Comfort Blue',
'transmission': 'manual',
'trim': 'Comfort Blue',
'year': 2012}
2026-03-28 08:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX00156%27 HTTP/1.1" 200 None
2026-03-28 08:33:10 [auto1.be] INFO: Saving data for JX00156: {'auction_closing_time': 1774713816.0, 'created_time': 1774600271.716595, 'last_price_update_time': 1774686790.45682}
2026-03-28 08:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JX00156') HTTP/1.1" 204 0
2026-03-28 08:33:10 [auto1.be] INFO: Found listing with ID: FY33898
2026-03-28 08:33:10 [auto1.be] INFO: Found listing with ID: EG14798
2026-03-28 08:33:10 [auto1.be] INFO: Found listing with ID: NZ84501
2026-03-28 08:33:10 [auto1.be] INFO: Found listing with ID: RA68631
2026-03-28 08:33:10 [auto1.be] INFO: Found listing with ID: EW63431
2026-03-28 08:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EW63431%27 HTTP/1.1" 200 None
2026-03-28 08:33:10 [auto1.be] INFO: Scrape type for EW63431: 2
2026-03-28 08:33:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8766d71c-f005-5ad6-a607-4b5d5ed7d704 with identifier: EW63431
2026-03-28 08:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8766d71c-f005-5ad6-a607-4b5d5ed7d704 with scrape type 2
2026-03-28 08:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8766d71c-f005-5ad6-a607-4b5d5ed7d704 with scrape type 2
2026-03-28 08:33:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8766d71c-f005-5ad6-a607-4b5d5ed7d704, identifier: EW63431
2026-03-28 08:33:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8766d71c-f005-5ad6-a607-4b5d5ed7d704 with identifier: EW63431
2026-03-28 08:33:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8766d71c-f005-5ad6-a607-4b5d5ed7d704 with identifier: EW63431
2026-03-28 08:33:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8766d71c-f005-5ad6-a607-4b5d5ed7d704 with identifier: EW63431 to the API
2026-03-28 08:33:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:33:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:33:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 185,
'expiration_date': '2026-03-28T16:38:01Z',
'fuel_type': 'diesel',
'id': '8766d71c-f005-5ad6-a607-4b5d5ed7d704',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW63431',
'listing': 'auction',
'make': 'BMW',
'model': '5er',
'odometer': 177017,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-11-22',
'seller_name': None,
'title': 'BMW 5er 520d',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-28 08:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EW63431%27 HTTP/1.1" 200 None
2026-03-28 08:33:10 [auto1.be] INFO: Saving data for EW63431: {'auction_closing_time': 1774715881.0, 'created_time': 1773693466.514536, 'last_price_update_time': 1774686790.934455}
2026-03-28 08:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EW63431') HTTP/1.1" 204 0
2026-03-28 08:33:10 [auto1.be] INFO: Found listing with ID: BC23353
2026-03-28 08:33:10 [auto1.be] INFO: Found listing with ID: BJ55526
2026-03-28 08:33:10 [auto1.be] INFO: Found listing with ID: JB98140
2026-03-28 08:33:10 [auto1.be] INFO: Found listing with ID: WC70774
2026-03-28 08:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC70774%27 HTTP/1.1" 200 None
2026-03-28 08:33:10 [auto1.be] INFO: Scrape type for WC70774: 2
2026-03-28 08:33:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 994a53f0-63c9-5d90-828b-531fc466f0cf with identifier: WC70774
2026-03-28 08:33:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 994a53f0-63c9-5d90-828b-531fc466f0cf with scrape type 2
2026-03-28 08:33:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 994a53f0-63c9-5d90-828b-531fc466f0cf with scrape type 2
2026-03-28 08:33:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 994a53f0-63c9-5d90-828b-531fc466f0cf, identifier: WC70774
2026-03-28 08:33:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 994a53f0-63c9-5d90-828b-531fc466f0cf with identifier: WC70774
2026-03-28 08:33:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 994a53f0-63c9-5d90-828b-531fc466f0cf with identifier: WC70774
2026-03-28 08:33:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 994a53f0-63c9-5d90-828b-531fc466f0cf with identifier: WC70774 to the API
2026-03-28 08:33:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:33:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:33:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-28T16:08:07Z',
'fuel_type': 'petrol',
'id': '994a53f0-63c9-5d90-828b-531fc466f0cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC70774',
'listing': 'auction',
'make': 'Citroen',
'model': 'C1',
'odometer': 77848,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-03-31',
'seller_name': None,
'title': 'Citroen C1 1.0 Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2008}
2026-03-28 08:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC70774%27 HTTP/1.1" 200 None
2026-03-28 08:33:11 [auto1.be] INFO: Saving data for WC70774: {'auction_closing_time': 1774714087.0, 'created_time': 1773909038.233836, 'last_price_update_time': 1774686791.307014}
2026-03-28 08:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WC70774') HTTP/1.1" 204 0
2026-03-28 08:33:11 [auto1.be] INFO: Found listing with ID: XK61886
2026-03-28 08:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK61886%27 HTTP/1.1" 200 None
2026-03-28 08:33:11 [auto1.be] INFO: Scrape type for XK61886: 2
2026-03-28 08:33:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18dafbc4-2a81-5a8c-9d11-0f297476e6af with identifier: XK61886
2026-03-28 08:33:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18dafbc4-2a81-5a8c-9d11-0f297476e6af with scrape type 2
2026-03-28 08:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18dafbc4-2a81-5a8c-9d11-0f297476e6af with scrape type 2
2026-03-28 08:33:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 18dafbc4-2a81-5a8c-9d11-0f297476e6af, identifier: XK61886
2026-03-28 08:33:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 18dafbc4-2a81-5a8c-9d11-0f297476e6af with identifier: XK61886
2026-03-28 08:33:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 18dafbc4-2a81-5a8c-9d11-0f297476e6af with identifier: XK61886
2026-03-28 08:33:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 18dafbc4-2a81-5a8c-9d11-0f297476e6af with identifier: XK61886 to the API
2026-03-28 08:33:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:33:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:33:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:44:25Z',
'fuel_type': 'petrol',
'id': '18dafbc4-2a81-5a8c-9d11-0f297476e6af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK61886',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 98987,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-09-13',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 150',
'transmission': 'manual',
'trim': '',
'year': 2007}
2026-03-28 08:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK61886%27 HTTP/1.1" 200 None
2026-03-28 08:33:11 [auto1.be] INFO: Saving data for XK61886: {'auction_closing_time': 1774716265.0, 'created_time': 1773952979.905587, 'last_price_update_time': 1774686791.684185}
2026-03-28 08:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XK61886') HTTP/1.1" 204 0
2026-03-28 08:33:11 [auto1.be] INFO: Found listing with ID: FN69818
2026-03-28 08:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN69818%27 HTTP/1.1" 200 None
2026-03-28 08:33:11 [auto1.be] INFO: Scrape type for FN69818: 2
2026-03-28 08:33:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b67b4f29-ca49-576f-a62e-965446bc3ed3 with identifier: FN69818
2026-03-28 08:33:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b67b4f29-ca49-576f-a62e-965446bc3ed3 with scrape type 2
2026-03-28 08:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b67b4f29-ca49-576f-a62e-965446bc3ed3 with scrape type 2
2026-03-28 08:33:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b67b4f29-ca49-576f-a62e-965446bc3ed3, identifier: FN69818
2026-03-28 08:33:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b67b4f29-ca49-576f-a62e-965446bc3ed3 with identifier: FN69818
2026-03-28 08:33:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b67b4f29-ca49-576f-a62e-965446bc3ed3 with identifier: FN69818
2026-03-28 08:33:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b67b4f29-ca49-576f-a62e-965446bc3ed3 with identifier: FN69818 to the API
2026-03-28 08:33:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:33:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:33:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 305,
'expiration_date': '2026-03-28T16:01:42Z',
'fuel_type': 'diesel',
'id': 'b67b4f29-ca49-576f-a62e-965446bc3ed3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN69818',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Range Rover Sport',
'odometer': 122497,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-31',
'seller_name': None,
'title': 'Land Rover Range Rover Sport 3.0 SD V6 HSE',
'transmission': 'automatic',
'trim': 'HSE',
'year': 2015}
2026-03-28 08:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN69818%27 HTTP/1.1" 200 None
2026-03-28 08:33:12 [auto1.be] INFO: Saving data for FN69818: {'auction_closing_time': 1774713702.0, 'created_time': 1774600274.114139, 'last_price_update_time': 1774686792.078276}
2026-03-28 08:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FN69818') HTTP/1.1" 204 0
2026-03-28 08:33:12 [auto1.be] INFO: Found listing with ID: RL41837
2026-03-28 08:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL41837%27 HTTP/1.1" 200 None
2026-03-28 08:33:12 [auto1.be] INFO: Scrape type for RL41837: 2
2026-03-28 08:33:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbe37247-21da-5042-b6cc-7f14259cd7f8 with identifier: RL41837
2026-03-28 08:33:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbe37247-21da-5042-b6cc-7f14259cd7f8 with scrape type 2
2026-03-28 08:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbe37247-21da-5042-b6cc-7f14259cd7f8 with scrape type 2
2026-03-28 08:33:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cbe37247-21da-5042-b6cc-7f14259cd7f8, identifier: RL41837
2026-03-28 08:33:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cbe37247-21da-5042-b6cc-7f14259cd7f8 with identifier: RL41837
2026-03-28 08:33:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cbe37247-21da-5042-b6cc-7f14259cd7f8 with identifier: RL41837
2026-03-28 08:33:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cbe37247-21da-5042-b6cc-7f14259cd7f8 with identifier: RL41837 to the API
2026-03-28 08:33:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:33:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:33:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:17:21Z',
'fuel_type': 'diesel',
'id': 'cbe37247-21da-5042-b6cc-7f14259cd7f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL41837',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 205973,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-26',
'seller_name': None,
'title': 'Volkswagen Passat 1.6 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2016}
2026-03-28 08:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL41837%27 HTTP/1.1" 200 None
2026-03-28 08:33:12 [auto1.be] INFO: Saving data for RL41837: {'auction_closing_time': 1774714641.0, 'created_time': 1774600272.063464, 'last_price_update_time': 1774686792.551092}
2026-03-28 08:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RL41837') HTTP/1.1" 204 0
2026-03-28 08:33:12 [auto1.be] INFO: Found listing with ID: VZ63754
2026-03-28 08:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ63754%27 HTTP/1.1" 200 None
2026-03-28 08:33:12 [auto1.be] INFO: Scrape type for VZ63754: 2
2026-03-28 08:33:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b64282ab-f6df-5cfe-9a69-a4be1e74ae50 with identifier: VZ63754
2026-03-28 08:33:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b64282ab-f6df-5cfe-9a69-a4be1e74ae50 with scrape type 2
2026-03-28 08:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b64282ab-f6df-5cfe-9a69-a4be1e74ae50 with scrape type 2
2026-03-28 08:33:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b64282ab-f6df-5cfe-9a69-a4be1e74ae50, identifier: VZ63754
2026-03-28 08:33:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b64282ab-f6df-5cfe-9a69-a4be1e74ae50 with identifier: VZ63754
2026-03-28 08:33:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b64282ab-f6df-5cfe-9a69-a4be1e74ae50 with identifier: VZ63754
2026-03-28 08:33:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b64282ab-f6df-5cfe-9a69-a4be1e74ae50 with identifier: VZ63754 to the API
2026-03-28 08:33:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:33:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:33:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-28T16:08:51Z',
'fuel_type': 'diesel',
'id': 'b64282ab-f6df-5cfe-9a69-a4be1e74ae50',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ63754',
'listing': 'auction',
'make': 'Volvo',
'model': 'V70',
'odometer': 265866,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-11-30',
'seller_name': None,
'title': 'Volvo V70 2.0 D4 Kinetic',
'transmission': 'manual',
'trim': 'Kinetic',
'year': 2014}
2026-03-28 08:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ63754%27 HTTP/1.1" 200 None
2026-03-28 08:33:12 [auto1.be] INFO: Saving data for VZ63754: {'auction_closing_time': 1774714131.0, 'created_time': 1774600273.578802, 'last_price_update_time': 1774686792.947697}
2026-03-28 08:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VZ63754') HTTP/1.1" 204 0
2026-03-28 08:33:12 [auto1.be] INFO: Found listing with ID: DB52098
2026-03-28 08:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB52098%27 HTTP/1.1" 200 None
2026-03-28 08:33:12 [auto1.be] INFO: Scrape type for DB52098: 2
2026-03-28 08:33:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d732551d-9fad-5592-9419-977aebc076ed with identifier: DB52098
2026-03-28 08:33:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d732551d-9fad-5592-9419-977aebc076ed with scrape type 2
2026-03-28 08:33:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d732551d-9fad-5592-9419-977aebc076ed with scrape type 2
2026-03-28 08:33:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d732551d-9fad-5592-9419-977aebc076ed, identifier: DB52098
2026-03-28 08:33:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d732551d-9fad-5592-9419-977aebc076ed with identifier: DB52098
2026-03-28 08:33:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d732551d-9fad-5592-9419-977aebc076ed with identifier: DB52098
2026-03-28 08:33:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d732551d-9fad-5592-9419-977aebc076ed with identifier: DB52098 to the API
2026-03-28 08:33:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:33:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:33:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 128,
'expiration_date': '2026-03-28T16:09:30Z',
'fuel_type': 'diesel',
'id': 'd732551d-9fad-5592-9419-977aebc076ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB52098',
'listing': 'auction',
'make': 'Toyota',
'model': 'ProAce',
'odometer': 99267,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-13',
'seller_name': None,
'title': 'Toyota ProAce 2.0 D-4D L2H1 Kasten Comfort',
'transmission': 'manual',
'trim': 'L2H1 Kasten Comfort',
'year': 2017}
2026-03-28 08:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB52098%27 HTTP/1.1" 200 None
2026-03-28 08:33:13 [auto1.be] INFO: Saving data for DB52098: {'auction_closing_time': 1774714170.0, 'created_time': 1774600270.281558, 'last_price_update_time': 1774686793.3465}
2026-03-28 08:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DB52098') HTTP/1.1" 204 0
2026-03-28 08:33:13 [auto1.be] INFO: Found listing with ID: PR84870
2026-03-28 08:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR84870%27 HTTP/1.1" 200 None
2026-03-28 08:33:13 [auto1.be] INFO: Scrape type for PR84870: 2
2026-03-28 08:33:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a517ed1f-1c9d-5773-a919-908f7dae6a5b with identifier: PR84870
2026-03-28 08:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a517ed1f-1c9d-5773-a919-908f7dae6a5b with scrape type 2
2026-03-28 08:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a517ed1f-1c9d-5773-a919-908f7dae6a5b with scrape type 2
2026-03-28 08:33:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a517ed1f-1c9d-5773-a919-908f7dae6a5b, identifier: PR84870
2026-03-28 08:33:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:33:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a517ed1f-1c9d-5773-a919-908f7dae6a5b with identifier: PR84870
2026-03-28 08:33:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a517ed1f-1c9d-5773-a919-908f7dae6a5b with identifier: PR84870
2026-03-28 08:33:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a517ed1f-1c9d-5773-a919-908f7dae6a5b with identifier: PR84870 to the API
2026-03-28 08:33:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:33:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:33:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:05:21Z',
'fuel_type': 'diesel',
'id': 'a517ed1f-1c9d-5773-a919-908f7dae6a5b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR84870',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 93347,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-09-30',
'seller_name': None,
'title': 'Nissan Qashqai 2.0 dCi Tekna 4x4',
'transmission': 'automatic',
'trim': 'Tekna 4x4',
'year': 2011}
2026-03-28 08:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR84870%27 HTTP/1.1" 200 None
2026-03-28 08:33:13 [auto1.be] INFO: Saving data for PR84870: {'auction_closing_time': 1774713921.0, 'created_time': 1773909033.045151, 'last_price_update_time': 1774686793.716423}
2026-03-28 08:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PR84870') HTTP/1.1" 204 0
2026-03-28 08:33:13 [auto1.be] INFO: Found listing with ID: NM84983
2026-03-28 08:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM84983%27 HTTP/1.1" 200 None
2026-03-28 08:33:13 [auto1.be] INFO: Scrape type for NM84983: 2
2026-03-28 08:33:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dcc062f-890e-5772-bb6f-f6bb67d24a8d with identifier: NM84983
2026-03-28 08:33:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dcc062f-890e-5772-bb6f-f6bb67d24a8d with scrape type 2
2026-03-28 08:33:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7dcc062f-890e-5772-bb6f-f6bb67d24a8d with scrape type 2
2026-03-28 08:33:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7dcc062f-890e-5772-bb6f-f6bb67d24a8d, identifier: NM84983
2026-03-28 08:33:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7dcc062f-890e-5772-bb6f-f6bb67d24a8d with identifier: NM84983
2026-03-28 08:33:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7dcc062f-890e-5772-bb6f-f6bb67d24a8d with identifier: NM84983
2026-03-28 08:33:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7dcc062f-890e-5772-bb6f-f6bb67d24a8d with identifier: NM84983 to the API
2026-03-28 08:33:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:33:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:33:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-28T16:10:11Z',
'fuel_type': 'diesel',
'id': '7dcc062f-890e-5772-bb6f-f6bb67d24a8d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM84983',
'listing': 'auction',
'make': 'Opel',
'model': 'Combo Life',
'odometer': 98436,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-24',
'seller_name': None,
'title': 'Opel Combo Life 1.5 CDTI Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2021}
2026-03-28 08:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM84983%27 HTTP/1.1" 200 None
2026-03-28 08:33:14 [auto1.be] INFO: Saving data for NM84983: {'auction_closing_time': 1774714211.0, 'created_time': 1774600295.375123, 'last_price_update_time': 1774686794.09741}
2026-03-28 08:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NM84983') HTTP/1.1" 204 0
2026-03-28 08:33:14 [auto1.be] INFO: Found listing with ID: TD45447
2026-03-28 08:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD45447%27 HTTP/1.1" 200 None
2026-03-28 08:33:14 [auto1.be] INFO: Scrape type for TD45447: 2
2026-03-28 08:33:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9edfe8cc-b539-55e2-b74a-12b8cc76213b with identifier: TD45447
2026-03-28 08:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9edfe8cc-b539-55e2-b74a-12b8cc76213b with scrape type 2
2026-03-28 08:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9edfe8cc-b539-55e2-b74a-12b8cc76213b with scrape type 2
2026-03-28 08:33:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9edfe8cc-b539-55e2-b74a-12b8cc76213b, identifier: TD45447
2026-03-28 08:33:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9edfe8cc-b539-55e2-b74a-12b8cc76213b with identifier: TD45447
2026-03-28 08:33:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9edfe8cc-b539-55e2-b74a-12b8cc76213b with identifier: TD45447
2026-03-28 08:33:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9edfe8cc-b539-55e2-b74a-12b8cc76213b with identifier: TD45447 to the API
2026-03-28 08:33:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:33:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:33:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-28T16:31:26Z',
'fuel_type': 'diesel',
'id': '9edfe8cc-b539-55e2-b74a-12b8cc76213b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD45447',
'listing': 'auction',
'make': 'Opel',
'model': 'Meriva',
'odometer': 215335,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-08',
'seller_name': None,
'title': 'Opel Meriva 1.3 CDTI Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2012}
2026-03-28 08:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD45447%27 HTTP/1.1" 200 None
2026-03-28 08:33:14 [auto1.be] INFO: Saving data for TD45447: {'auction_closing_time': 1774715486.0, 'created_time': 1774600275.396538, 'last_price_update_time': 1774686794.472829}
2026-03-28 08:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TD45447') HTTP/1.1" 204 0
2026-03-28 08:33:14 [auto1.be] INFO: Channel: 24h | Page: 43 | totalHits: 1701 | hits on page: 21
2026-03-28 08:33:14 [auto1.be] INFO: Found listing with ID: MB97201
2026-03-28 08:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB97201%27 HTTP/1.1" 200 None
2026-03-28 08:33:14 [auto1.be] INFO: Scrape type for MB97201: 2
2026-03-28 08:33:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f18c7267-146b-5088-ac00-572fe9134c1a with identifier: MB97201
2026-03-28 08:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f18c7267-146b-5088-ac00-572fe9134c1a with scrape type 2
2026-03-28 08:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f18c7267-146b-5088-ac00-572fe9134c1a with scrape type 2
2026-03-28 08:33:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f18c7267-146b-5088-ac00-572fe9134c1a, identifier: MB97201
2026-03-28 08:33:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f18c7267-146b-5088-ac00-572fe9134c1a with identifier: MB97201
2026-03-28 08:33:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f18c7267-146b-5088-ac00-572fe9134c1a with identifier: MB97201
2026-03-28 08:33:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f18c7267-146b-5088-ac00-572fe9134c1a with identifier: MB97201 to the API
2026-03-28 08:33:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:33:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:33:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 120,
'expiration_date': '2026-03-28T16:02:29Z',
'fuel_type': 'diesel',
'id': 'f18c7267-146b-5088-ac00-572fe9134c1a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB97201',
'listing': 'auction',
'make': 'Fiat',
'model': 'Talento',
'odometer': 67555,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-21',
'seller_name': None,
'title': 'Fiat Talento 1.6 Turbodiesel Multijet L1H1 1,0t SX',
'transmission': 'manual',
'trim': 'L1H1 1,0t SX',
'year': 2019}
2026-03-28 08:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB97201%27 HTTP/1.1" 200 None
2026-03-28 08:33:14 [auto1.be] INFO: Saving data for MB97201: {'auction_closing_time': 1774713749.0, 'created_time': 1774600276.351914, 'last_price_update_time': 1774686794.844581}
2026-03-28 08:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MB97201') HTTP/1.1" 204 0
2026-03-28 08:33:14 [auto1.be] INFO: Found listing with ID: GN38450
2026-03-28 08:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN38450%27 HTTP/1.1" 200 None
2026-03-28 08:33:14 [auto1.be] INFO: Scrape type for GN38450: 2
2026-03-28 08:33:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d41dba6f-7c76-5341-8ed0-f8799aaf7c4d with identifier: GN38450
2026-03-28 08:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d41dba6f-7c76-5341-8ed0-f8799aaf7c4d with scrape type 2
2026-03-28 08:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d41dba6f-7c76-5341-8ed0-f8799aaf7c4d with scrape type 2
2026-03-28 08:33:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d41dba6f-7c76-5341-8ed0-f8799aaf7c4d, identifier: GN38450
2026-03-28 08:33:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 08:33:14 [auto1.be] INFO: Found listing with ID: JF18972
2026-03-28 08:33:14 [auto1.be] INFO: Found listing with ID: FA61625
2026-03-28 08:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA61625%27 HTTP/1.1" 200 None
2026-03-28 08:33:14 [auto1.be] INFO: Scrape type for FA61625: 2
2026-03-28 08:33:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca60800a-cbc0-5456-8454-e5f8f0299db8 with identifier: FA61625
2026-03-28 08:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca60800a-cbc0-5456-8454-e5f8f0299db8 with scrape type 2
2026-03-28 08:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca60800a-cbc0-5456-8454-e5f8f0299db8 with scrape type 2
2026-03-28 08:33:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ca60800a-cbc0-5456-8454-e5f8f0299db8, identifier: FA61625
2026-03-28 08:33:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d41dba6f-7c76-5341-8ed0-f8799aaf7c4d with identifier: GN38450
2026-03-28 08:33:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d41dba6f-7c76-5341-8ed0-f8799aaf7c4d with identifier: GN38450
2026-03-28 08:33:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d41dba6f-7c76-5341-8ed0-f8799aaf7c4d with identifier: GN38450 to the API
2026-03-28 08:33:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:33:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:33:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-28T16:43:43Z',
'fuel_type': 'diesel',
'id': 'd41dba6f-7c76-5341-8ed0-f8799aaf7c4d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN38450',
'listing': 'auction',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 82466,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-18',
'seller_name': None,
'title': 'Citroen Berlingo 1.5 Blue-HDi Club M',
'transmission': 'manual',
'trim': 'Club M',
'year': 2021}
2026-03-28 08:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN38450%27 HTTP/1.1" 200 None
2026-03-28 08:33:15 [auto1.be] INFO: Saving data for GN38450: {'auction_closing_time': 1774716223.0, 'created_time': 1774600280.992175, 'last_price_update_time': 1774686795.311816}
2026-03-28 08:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GN38450') HTTP/1.1" 204 0
2026-03-28 08:33:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ca60800a-cbc0-5456-8454-e5f8f0299db8 with identifier: FA61625
2026-03-28 08:33:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ca60800a-cbc0-5456-8454-e5f8f0299db8 with identifier: FA61625
2026-03-28 08:33:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ca60800a-cbc0-5456-8454-e5f8f0299db8 with identifier: FA61625 to the API
2026-03-28 08:33:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:33:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:33:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:29:37Z',
'fuel_type': 'petrol',
'id': 'ca60800a-cbc0-5456-8454-e5f8f0299db8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA61625',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 87303,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-01',
'seller_name': None,
'title': 'Hyundai Tucson 1.6 T-GDI Advantage 2WD',
'transmission': 'manual',
'trim': 'Advantage 2WD',
'year': 2023}
2026-03-28 08:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA61625%27 HTTP/1.1" 200 None
2026-03-28 08:33:15 [auto1.be] INFO: Saving data for FA61625: {'auction_closing_time': 1774715377.0, 'created_time': 1773909054.800169, 'last_price_update_time': 1774686795.592088}
2026-03-28 08:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FA61625') HTTP/1.1" 204 0
2026-03-28 08:33:15 [auto1.be] INFO: Found listing with ID: YA37935
2026-03-28 08:33:15 [auto1.be] INFO: Found listing with ID: SF89359
2026-03-28 08:33:15 [auto1.be] INFO: Found listing with ID: PL26855
2026-03-28 08:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL26855%27 HTTP/1.1" 200 None
2026-03-28 08:33:15 [auto1.be] INFO: Scrape type for PL26855: 2
2026-03-28 08:33:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5afcfbb0-3fdd-5775-ae8e-e2990ca97ba5 with identifier: PL26855
2026-03-28 08:33:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5afcfbb0-3fdd-5775-ae8e-e2990ca97ba5 with scrape type 2
2026-03-28 08:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5afcfbb0-3fdd-5775-ae8e-e2990ca97ba5 with scrape type 2
2026-03-28 08:33:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5afcfbb0-3fdd-5775-ae8e-e2990ca97ba5, identifier: PL26855
2026-03-28 08:33:15 [auto1.be] INFO: Found listing with ID: XU03064
2026-03-28 08:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU03064%27 HTTP/1.1" 200 None
2026-03-28 08:33:15 [auto1.be] INFO: Scrape type for XU03064: 2
2026-03-28 08:33:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14232f81-1b5a-5dd6-9aed-02252910cad7 with identifier: XU03064
2026-03-28 08:33:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14232f81-1b5a-5dd6-9aed-02252910cad7 with scrape type 2
2026-03-28 08:33:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14232f81-1b5a-5dd6-9aed-02252910cad7 with scrape type 2
2026-03-28 08:33:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 14232f81-1b5a-5dd6-9aed-02252910cad7, identifier: XU03064
2026-03-28 08:33:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5afcfbb0-3fdd-5775-ae8e-e2990ca97ba5 with identifier: PL26855
2026-03-28 08:33:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5afcfbb0-3fdd-5775-ae8e-e2990ca97ba5 with identifier: PL26855
2026-03-28 08:33:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5afcfbb0-3fdd-5775-ae8e-e2990ca97ba5 with identifier: PL26855 to the API
2026-03-28 08:33:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:33:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:33:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 77,
'expiration_date': '2026-03-28T16:36:16Z',
'fuel_type': 'petrol',
'id': '5afcfbb0-3fdd-5775-ae8e-e2990ca97ba5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL26855',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'MiTo',
'odometer': 109094,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-07-30',
'seller_name': None,
'title': 'Alfa Romeo MiTo 1.4 Urban',
'transmission': 'manual',
'trim': 'Urban',
'year': 2018}
2026-03-28 08:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL26855%27 HTTP/1.1" 200 None
2026-03-28 08:33:16 [auto1.be] INFO: Saving data for PL26855: {'auction_closing_time': 1774715776.0, 'created_time': 1774600282.198408, 'last_price_update_time': 1774686796.06204}
2026-03-28 08:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PL26855') HTTP/1.1" 204 0
2026-03-28 08:33:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 14232f81-1b5a-5dd6-9aed-02252910cad7 with identifier: XU03064
2026-03-28 08:33:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 14232f81-1b5a-5dd6-9aed-02252910cad7 with identifier: XU03064
2026-03-28 08:33:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 14232f81-1b5a-5dd6-9aed-02252910cad7 with identifier: XU03064 to the API
2026-03-28 08:33:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:33:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:33:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-28T16:59:37Z',
'fuel_type': 'diesel',
'id': '14232f81-1b5a-5dd6-9aed-02252910cad7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU03064',
'listing': 'auction',
'make': 'Ford',
'model': 'Tourneo Custom',
'odometer': 81592,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-29',
'seller_name': None,
'title': 'Ford Tourneo Custom 2.0 TDCi 320 L2 Titanium',
'transmission': 'automatic',
'trim': '320 L2 Titanium',
'year': 2023}
2026-03-28 08:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU03064%27 HTTP/1.1" 200 None
2026-03-28 08:33:16 [auto1.be] INFO: Saving data for XU03064: {'auction_closing_time': 1774717177.0, 'created_time': 1774600279.863399, 'last_price_update_time': 1774686796.490417}
2026-03-28 08:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XU03064') HTTP/1.1" 204 0
2026-03-28 08:33:16 [auto1.be] INFO: Found listing with ID: MR51068
2026-03-28 08:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR51068%27 HTTP/1.1" 200 None
2026-03-28 08:33:16 [auto1.be] INFO: Scrape type for MR51068: 2
2026-03-28 08:33:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cadc4e62-1ad2-559d-87f7-0b217b93ef9f with identifier: MR51068
2026-03-28 08:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cadc4e62-1ad2-559d-87f7-0b217b93ef9f with scrape type 2
2026-03-28 08:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cadc4e62-1ad2-559d-87f7-0b217b93ef9f with scrape type 2
2026-03-28 08:33:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cadc4e62-1ad2-559d-87f7-0b217b93ef9f, identifier: MR51068
2026-03-28 08:33:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cadc4e62-1ad2-559d-87f7-0b217b93ef9f with identifier: MR51068
2026-03-28 08:33:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cadc4e62-1ad2-559d-87f7-0b217b93ef9f with identifier: MR51068
2026-03-28 08:33:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cadc4e62-1ad2-559d-87f7-0b217b93ef9f with identifier: MR51068 to the API
2026-03-28 08:33:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:33:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:33:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-28T16:00:32Z',
'fuel_type': 'diesel',
'id': 'cadc4e62-1ad2-559d-87f7-0b217b93ef9f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR51068',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 146937,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-23',
'seller_name': None,
'title': 'Hyundai Tucson 1.7 CRDi Comfort 2WD',
'transmission': 'manual',
'trim': 'Comfort 2WD',
'year': 2017}
2026-03-28 08:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR51068%27 HTTP/1.1" 200 None
2026-03-28 08:33:16 [auto1.be] INFO: Saving data for MR51068: {'auction_closing_time': 1774713632.0, 'created_time': 1773301653.095499, 'last_price_update_time': 1774686796.904856}
2026-03-28 08:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MR51068') HTTP/1.1" 204 0
2026-03-28 08:33:16 [auto1.be] INFO: Found listing with ID: BP74088
2026-03-28 08:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP74088%27 HTTP/1.1" 200 None
2026-03-28 08:33:16 [auto1.be] INFO: Scrape type for BP74088: 2
2026-03-28 08:33:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80cd97c3-aa11-5fe8-b2b0-3e4a9c8627ef with identifier: BP74088
2026-03-28 08:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80cd97c3-aa11-5fe8-b2b0-3e4a9c8627ef with scrape type 2
2026-03-28 08:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80cd97c3-aa11-5fe8-b2b0-3e4a9c8627ef with scrape type 2
2026-03-28 08:33:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 80cd97c3-aa11-5fe8-b2b0-3e4a9c8627ef, identifier: BP74088
2026-03-28 08:33:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 80cd97c3-aa11-5fe8-b2b0-3e4a9c8627ef with identifier: BP74088
2026-03-28 08:33:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 80cd97c3-aa11-5fe8-b2b0-3e4a9c8627ef with identifier: BP74088
2026-03-28 08:33:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 80cd97c3-aa11-5fe8-b2b0-3e4a9c8627ef with identifier: BP74088 to the API
2026-03-28 08:33:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:33:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:33:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-28T16:22:24Z',
'fuel_type': 'diesel',
'id': '80cd97c3-aa11-5fe8-b2b0-3e4a9c8627ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP74088',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 126325,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-19',
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2021}
2026-03-28 08:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP74088%27 HTTP/1.1" 200 None
2026-03-28 08:33:17 [auto1.be] INFO: Saving data for BP74088: {'auction_closing_time': 1774714944.0, 'created_time': 1774600281.44092, 'last_price_update_time': 1774686797.26723}
2026-03-28 08:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BP74088') HTTP/1.1" 204 0
2026-03-28 08:33:17 [auto1.be] INFO: Found listing with ID: JJ45584
2026-03-28 08:33:17 [auto1.be] INFO: Found listing with ID: RA11008
2026-03-28 08:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA11008%27 HTTP/1.1" 200 None
2026-03-28 08:33:17 [auto1.be] INFO: Scrape type for RA11008: 2
2026-03-28 08:33:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4419f0c6-fafe-5a86-8bda-b9d9221dc288 with identifier: RA11008
2026-03-28 08:33:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4419f0c6-fafe-5a86-8bda-b9d9221dc288 with scrape type 2
2026-03-28 08:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4419f0c6-fafe-5a86-8bda-b9d9221dc288 with scrape type 2
2026-03-28 08:33:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4419f0c6-fafe-5a86-8bda-b9d9221dc288, identifier: RA11008
2026-03-28 08:33:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4419f0c6-fafe-5a86-8bda-b9d9221dc288 with identifier: RA11008
2026-03-28 08:33:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4419f0c6-fafe-5a86-8bda-b9d9221dc288 with identifier: RA11008
2026-03-28 08:33:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4419f0c6-fafe-5a86-8bda-b9d9221dc288 with identifier: RA11008 to the API
2026-03-28 08:33:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:33:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:33:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-28T16:32:22Z',
'fuel_type': 'diesel',
'id': '4419f0c6-fafe-5a86-8bda-b9d9221dc288',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA11008',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 191118,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-14',
'seller_name': None,
'title': 'Land Rover Evoque 2.2 Td4 Pure',
'transmission': 'automatic',
'trim': 'Pure',
'year': 2013}
2026-03-28 08:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA11008%27 HTTP/1.1" 200 None
2026-03-28 08:33:17 [auto1.be] INFO: Saving data for RA11008: {'auction_closing_time': 1774715542.0, 'created_time': 1773779707.95762, 'last_price_update_time': 1774686797.63548}
2026-03-28 08:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RA11008') HTTP/1.1" 204 0
2026-03-28 08:33:17 [auto1.be] INFO: Found listing with ID: RR43173
2026-03-28 08:33:17 [auto1.be] INFO: Found listing with ID: XT87195
2026-03-28 08:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT87195%27 HTTP/1.1" 200 None
2026-03-28 08:33:17 [auto1.be] INFO: Scrape type for XT87195: 2
2026-03-28 08:33:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8221b10a-9513-5872-a7dc-0ec12cdc3467 with identifier: XT87195
2026-03-28 08:33:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8221b10a-9513-5872-a7dc-0ec12cdc3467 with scrape type 2
2026-03-28 08:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8221b10a-9513-5872-a7dc-0ec12cdc3467 with scrape type 2
2026-03-28 08:33:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8221b10a-9513-5872-a7dc-0ec12cdc3467, identifier: XT87195
2026-03-28 08:33:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8221b10a-9513-5872-a7dc-0ec12cdc3467 with identifier: XT87195
2026-03-28 08:33:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8221b10a-9513-5872-a7dc-0ec12cdc3467 with identifier: XT87195
2026-03-28 08:33:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8221b10a-9513-5872-a7dc-0ec12cdc3467 with identifier: XT87195 to the API
2026-03-28 08:33:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:33:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:33:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-28T16:10:59Z',
'fuel_type': 'petrol',
'id': '8221b10a-9513-5872-a7dc-0ec12cdc3467',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT87195',
'listing': 'auction',
'make': 'Ford',
'model': 'B-Max',
'odometer': 24623,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-12-02',
'seller_name': None,
'title': 'Ford B-Max 1.0 EcoBoost Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2012}
2026-03-28 08:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT87195%27 HTTP/1.1" 200 None
2026-03-28 08:33:18 [auto1.be] INFO: Saving data for XT87195: {'auction_closing_time': 1774714259.0, 'created_time': 1773434044.28735, 'last_price_update_time': 1774686798.01312}
2026-03-28 08:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XT87195') HTTP/1.1" 204 0
2026-03-28 08:33:18 [auto1.be] INFO: Found listing with ID: UT35373
2026-03-28 08:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT35373%27 HTTP/1.1" 200 None
2026-03-28 08:33:18 [auto1.be] INFO: Scrape type for UT35373: 2
2026-03-28 08:33:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41313130-d5aa-5e0f-860b-8946e4f59d87 with identifier: UT35373
2026-03-28 08:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41313130-d5aa-5e0f-860b-8946e4f59d87 with scrape type 2
2026-03-28 08:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41313130-d5aa-5e0f-860b-8946e4f59d87 with scrape type 2
2026-03-28 08:33:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 41313130-d5aa-5e0f-860b-8946e4f59d87, identifier: UT35373
2026-03-28 08:33:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 41313130-d5aa-5e0f-860b-8946e4f59d87 with identifier: UT35373
2026-03-28 08:33:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 41313130-d5aa-5e0f-860b-8946e4f59d87 with identifier: UT35373
2026-03-28 08:33:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 41313130-d5aa-5e0f-860b-8946e4f59d87 with identifier: UT35373 to the API
2026-03-28 08:33:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:33:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:33:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 394,
'expiration_date': '2026-03-28T16:18:20Z',
'fuel_type': 'hybrid',
'id': '41313130-d5aa-5e0f-860b-8946e4f59d87',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT35373',
'listing': 'auction',
'make': 'BMW',
'model': 'X5',
'odometer': 223799,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-20',
'seller_name': None,
'title': 'BMW X5 xDrive 45e M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2020}
2026-03-28 08:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT35373%27 HTTP/1.1" 200 None
2026-03-28 08:33:18 [auto1.be] INFO: Saving data for UT35373: {'auction_closing_time': 1774714700.0, 'created_time': 1773237128.54277, 'last_price_update_time': 1774686798.39611}
2026-03-28 08:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UT35373') HTTP/1.1" 204 0
2026-03-28 08:33:18 [auto1.be] INFO: Found listing with ID: VD09174
2026-03-28 08:33:18 [auto1.be] INFO: Found listing with ID: VA59143
2026-03-28 08:33:18 [auto1.be] INFO: Found listing with ID: MA69424
2026-03-28 08:33:18 [auto1.be] INFO: Found listing with ID: NP75657
2026-03-28 08:33:18 [auto1.be] INFO: Found listing with ID: NB71425
2026-03-28 08:33:18 [auto1.be] INFO: Found listing with ID: NR94896
2026-03-28 08:33:18 [auto1.be] INFO: Found listing with ID: XZ54371
2026-03-28 08:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ54371%27 HTTP/1.1" 200 None
2026-03-28 08:33:18 [auto1.be] INFO: Scrape type for XZ54371: 2
2026-03-28 08:33:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1603053a-812f-5d8f-a76f-4826030020e5 with identifier: XZ54371
2026-03-28 08:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1603053a-812f-5d8f-a76f-4826030020e5 with scrape type 2
2026-03-28 08:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1603053a-812f-5d8f-a76f-4826030020e5 with scrape type 2
2026-03-28 08:33:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1603053a-812f-5d8f-a76f-4826030020e5, identifier: XZ54371
2026-03-28 08:33:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1603053a-812f-5d8f-a76f-4826030020e5 with identifier: XZ54371
2026-03-28 08:33:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1603053a-812f-5d8f-a76f-4826030020e5 with identifier: XZ54371
2026-03-28 08:33:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1603053a-812f-5d8f-a76f-4826030020e5 with identifier: XZ54371 to the API
2026-03-28 08:33:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:33:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:33:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-28T16:58:45Z',
'fuel_type': 'petrol',
'id': '1603053a-812f-5d8f-a76f-4826030020e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ54371',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 67531,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-12-11',
'seller_name': None,
'title': 'Fiat 500 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2018}
2026-03-28 08:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ54371%27 HTTP/1.1" 200 None
2026-03-28 08:33:18 [auto1.be] INFO: Saving data for XZ54371: {'auction_closing_time': 1774717125.0, 'created_time': 1773301759.722365, 'last_price_update_time': 1774686798.768581}
2026-03-28 08:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XZ54371') HTTP/1.1" 204 0
2026-03-28 08:33:18 [auto1.be] INFO: Found listing with ID: AU32211
2026-03-28 08:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU32211%27 HTTP/1.1" 200 None
2026-03-28 08:33:18 [auto1.be] INFO: Scrape type for AU32211: 2
2026-03-28 08:33:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a04fdbc6-010c-5083-9052-2c13ea0e120f with identifier: AU32211
2026-03-28 08:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a04fdbc6-010c-5083-9052-2c13ea0e120f with scrape type 2
2026-03-28 08:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a04fdbc6-010c-5083-9052-2c13ea0e120f with scrape type 2
2026-03-28 08:33:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a04fdbc6-010c-5083-9052-2c13ea0e120f, identifier: AU32211
2026-03-28 08:33:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a04fdbc6-010c-5083-9052-2c13ea0e120f with identifier: AU32211
2026-03-28 08:33:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a04fdbc6-010c-5083-9052-2c13ea0e120f with identifier: AU32211
2026-03-28 08:33:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a04fdbc6-010c-5083-9052-2c13ea0e120f with identifier: AU32211 to the API
2026-03-28 08:33:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:33:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:33:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 212,
'expiration_date': '2026-03-28T16:41:03Z',
'fuel_type': 'diesel',
'id': 'a04fdbc6-010c-5083-9052-2c13ea0e120f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU32211',
'listing': 'auction',
'make': 'Ford',
'model': 'Ranger',
'odometer': 87774,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-15',
'seller_name': None,
'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Raptor',
'transmission': 'automatic',
'trim': 'Doppelkabine 4x4 Raptor',
'year': 2020}
2026-03-28 08:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU32211%27 HTTP/1.1" 200 None
2026-03-28 08:33:19 [auto1.be] INFO: Saving data for AU32211: {'auction_closing_time': 1774716063.0, 'created_time': 1774600290.140546, 'last_price_update_time': 1774686799.273187}
2026-03-28 08:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AU32211') HTTP/1.1" 204 0
2026-03-28 08:33:19 [auto1.be] INFO: Found listing with ID: CK49467
2026-03-28 08:33:19 [auto1.be] INFO: Found listing with ID: JE06286
2026-03-28 08:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JE06286%27 HTTP/1.1" 200 None
2026-03-28 08:33:19 [auto1.be] INFO: Scrape type for JE06286: 2
2026-03-28 08:33:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07164599-4937-5a9f-8c59-b01481e373bb with identifier: JE06286
2026-03-28 08:33:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07164599-4937-5a9f-8c59-b01481e373bb with scrape type 2
2026-03-28 08:33:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07164599-4937-5a9f-8c59-b01481e373bb with scrape type 2
2026-03-28 08:33:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 07164599-4937-5a9f-8c59-b01481e373bb, identifier: JE06286
2026-03-28 08:33:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 07164599-4937-5a9f-8c59-b01481e373bb with identifier: JE06286
2026-03-28 08:33:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 07164599-4937-5a9f-8c59-b01481e373bb with identifier: JE06286
2026-03-28 08:33:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 07164599-4937-5a9f-8c59-b01481e373bb with identifier: JE06286 to the API
2026-03-28 08:33:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 08:33:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 08:33:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 163,
'expiration_date': '2026-03-28T16:20:21Z',
'fuel_type': 'diesel',
'id': '07164599-4937-5a9f-8c59-b01481e373bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE06286',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Sprinter',
'odometer': 414494,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-06-05',
'seller_name': None,
'title': 'Mercedes-Benz Sprinter 316 CDI',
'transmission': 'manual',
'trim': '',
'year': 2010}
2026-03-28 08:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JE06286%27 HTTP/1.1" 200 None
2026-03-28 08:33:19 [auto1.be] INFO: Saving data for JE06286: {'auction_closing_time': 1774714821.0, 'created_time': 1774038710.405376, 'last_price_update_time': 1774686799.671649}
2026-03-28 08:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JE06286') HTTP/1.1" 204 0
2026-03-28 08:33:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 08:33:28 [auto1.be] INFO: Channel: 24h | Page: 44 | totalHits: 1702 | hits on page: 0
2026-03-28 08:33:28 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-28 08:33:28 [auto1.be] INFO: auto1.be Batch config: batch 1/2
2026-03-28 08:33:28 [auto1.be] INFO: auto1.be Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 2, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 1}
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20last_price_update_time%20lt%201774254808 HTTP/1.1" 200 None
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AB64449') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AY19808') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BA24124') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BB63081') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BC84840') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BD29807') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CX33746') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DD67644') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DJ50047') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DJ69749') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DK45388') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DM68362') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DX04274') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DZ45170') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EC16772') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EH30728') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ET67186') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EX66579') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EY75109') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FE86943') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FF72593') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FL05782') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FL71885') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FM14350') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FP25504') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GH31708') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GW19918') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HA15365') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HA19439') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HH57000') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HU31492') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JA08971') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JY99068') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KF90113') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KN86178') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KV61369') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KW52617') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LA88220') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LZ50050') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MA67469') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MK16126') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MX59641') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MY07855') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NU49755') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PA16032') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PE64709') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PV44335') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RJ26699') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RL22884') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RN37869') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SC54334') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SR26939') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SX30605') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TD01846') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TM26407') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TR42258') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TX45109') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TZ47373') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UA30458') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UL07938') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UV81857') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VG03802') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VV61440') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WC26053') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XK23104') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XL08330') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XM15621') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XS20349') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YA35350') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YC15820') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YE87094') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YG03175') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZH74426') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZN21864') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZP83602') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZU57723') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZX17668') HTTP/1.1" 204 0
2026-03-28 08:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZY24236') HTTP/1.1" 204 0
2026-03-28 08:33:29 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (157 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.be/task_25_2026-03-28T08_30_00.jl
2026-03-28 08:33:29 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 251266,
'downloader/request_count': 116,
'downloader/request_method_count/GET': 70,
'downloader/request_method_count/POST': 46,
'downloader/response_bytes': 27869187,
'downloader/response_count': 116,
'downloader/response_status_count/200': 116,
'dupefilter/filtered': 11,
'elapsed_time_seconds': 202.314747,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 28, 8, 33, 28, 968626, tzinfo=datetime.timezone.utc),
'item_scraped_count': 157,
'log_count/DEBUG': 3595,
'log_count/INFO': 4381,
'memusage/max': 184254464,
'memusage/startup': 149827584,
'photo_download_count': 46,
'request_depth_max': 47,
'response_received_count': 70,
'scheduler/dequeued': 116,
'scheduler/dequeued/memory': 116,
'scheduler/enqueued': 116,
'scheduler/enqueued/memory': 116,
'scrape_type/batch_skipped': 849,
'scrape_type/new': 11,
'scrape_type/price_update': 146,
'scrape_type/skipped': 724,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 70,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 3.0323190845948234,
'scrapy-zyte-api/mean_response_seconds': 3.1387630934095285,
'scrapy-zyte-api/processed': 70,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 70,
'scrapy-zyte-api/request_args/experimental.requestCookies': 69,
'scrapy-zyte-api/request_args/experimental.responseCookies': 70,
'scrapy-zyte-api/request_args/httpRequestBody': 46,
'scrapy-zyte-api/request_args/httpRequestMethod': 46,
'scrapy-zyte-api/request_args/httpResponseBody': 70,
'scrapy-zyte-api/request_args/httpResponseHeaders': 70,
'scrapy-zyte-api/request_args/sessionContext': 70,
'scrapy-zyte-api/request_args/url': 70,
'scrapy-zyte-api/status_codes/200': 70,
'scrapy-zyte-api/success': 70,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'source/items_encountered': 1741,
'source/total_available': 1702,
'start_time': datetime.datetime(2026, 3, 28, 8, 30, 6, 653879, tzinfo=datetime.timezone.utc)}
2026-03-28 08:33:29 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-28 08:33:29 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f29c9a2e4d0>
2026-03-28 08:33:29 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f29c9b5bdd0>