2026-03-30 06:30:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 06:30:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 06:30:06 [auto1.be] INFO: Batch mode enabled: batch 1/2
2026-03-30 06:30:06 [auto1.be] INFO: Starting spider auto1.be
2026-03-30 06:30:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 06:30:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 06:30:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 06:30:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 06:30:06 [scrapy.extensions.telnet] INFO: Telnet Password: 6510154b9bcad540
2026-03-30 06:30:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-30 06:30:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.be/task_25_2026-03-30T06_30_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-30 06:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 06:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 06:30:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 06:30:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-30 06:30:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 06:30:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-30 06:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 06:30:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-30 06:30:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 06:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 06:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-30 06:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-30 06:30:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-30 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-30 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-30 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-30 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-30 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-30 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-30 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-30 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-30 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-30 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-30 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-30 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-30 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-30 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-30 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-30 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-30 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-30 06:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-30 06:30:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-30 06:30:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-30 06:30:06 [scrapy.core.engine] INFO: Spider opened
2026-03-30 06:30:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 06:30:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-30 06:30:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 143MiB
2026-03-30 06:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-30 06:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-30 06:30:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:30:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-30 06:30:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:30:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-30 06:30:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:30:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-30 06:30:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:30:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-30 06:30:16 [auto1.be] INFO: Channel: 24h | Page: 0 | totalHits: 1288 | hits on page: 40
2026-03-30 06:30:16 [auto1.be] INFO: Found listing with ID: HM64227
2026-03-30 06:30:16 [auto1.be] INFO: Found listing with ID: YN29778
2026-03-30 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN29778%27 HTTP/1.1" 200 None
2026-03-30 06:30:16 [auto1.be] INFO: Scrape type for YN29778: 1
2026-03-30 06:30:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:30:16 [auto1.be] INFO: Found listing with ID: XN45926
2026-03-30 06:30:16 [auto1.be] INFO: Found listing with ID: VP75874
2026-03-30 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP75874%27 HTTP/1.1" 200 None
2026-03-30 06:30:16 [auto1.be] INFO: Scrape type for VP75874: 2
2026-03-30 06:30:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a839bea-ff22-5c6a-a4b4-c98ed66c4f08 with identifier: VP75874
2026-03-30 06:30:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a839bea-ff22-5c6a-a4b4-c98ed66c4f08 with scrape type 2
2026-03-30 06:30:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a839bea-ff22-5c6a-a4b4-c98ed66c4f08 with scrape type 2
2026-03-30 06:30:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5a839bea-ff22-5c6a-a4b4-c98ed66c4f08, identifier: VP75874
2026-03-30 06:30:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5a839bea-ff22-5c6a-a4b4-c98ed66c4f08 with identifier: VP75874
2026-03-30 06:30:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:30:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-30 06:30:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:30:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:30:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:30:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-30 06:30:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:30:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5a839bea-ff22-5c6a-a4b4-c98ed66c4f08 with identifier: VP75874
2026-03-30 06:30:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5a839bea-ff22-5c6a-a4b4-c98ed66c4f08 with identifier: VP75874 to the API
2026-03-30 06:30:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:40:04Z',
 'fuel_type': 'petrol',
 'id': '5a839bea-ff22-5c6a-a4b4-c98ed66c4f08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP75874',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 125938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-29',
 'seller_name': None,
 'title': 'Fiat Tipo 1.4 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2018}
2026-03-30 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP75874%27 HTTP/1.1" 200 None
2026-03-30 06:30:17 [auto1.be] INFO: Saving data for VP75874: {'auction_closing_time': 1774971604.0, 'created_time': 1773131801.009921, 'last_price_update_time': 1774852217.545026}
2026-03-30 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VP75874') HTTP/1.1" 204 0
2026-03-30 06:30:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:30:17 [auto1.be] INFO: Found listing with ID: MJ73226
2026-03-30 06:30:17 [auto1.be] INFO: Found listing with ID: SU19738
2026-03-30 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU19738%27 HTTP/1.1" 200 None
2026-03-30 06:30:17 [auto1.be] INFO: Scrape type for SU19738: 2
2026-03-30 06:30:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c7508af-0178-5878-8417-86a88c1c1c2d with identifier: SU19738
2026-03-30 06:30:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c7508af-0178-5878-8417-86a88c1c1c2d with scrape type 2
2026-03-30 06:30:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c7508af-0178-5878-8417-86a88c1c1c2d with scrape type 2
2026-03-30 06:30:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7c7508af-0178-5878-8417-86a88c1c1c2d, identifier: SU19738
2026-03-30 06:30:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7c7508af-0178-5878-8417-86a88c1c1c2d with identifier: SU19738
2026-03-30 06:30:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7c7508af-0178-5878-8417-86a88c1c1c2d with identifier: SU19738
2026-03-30 06:30:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7c7508af-0178-5878-8417-86a88c1c1c2d with identifier: SU19738 to the API
2026-03-30 06:30:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:47:44Z',
 'fuel_type': 'petrol',
 'id': '7c7508af-0178-5878-8417-86a88c1c1c2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU19738',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 47225,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-16',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2018}
2026-03-30 06:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU19738%27 HTTP/1.1" 200 None
2026-03-30 06:30:18 [auto1.be] INFO: Saving data for SU19738: {'auction_closing_time': 1774972064.0, 'created_time': 1773133297.294197, 'last_price_update_time': 1774852218.088403}
2026-03-30 06:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SU19738') HTTP/1.1" 204 0
2026-03-30 06:30:18 [auto1.be] INFO: Found listing with ID: KX00210
2026-03-30 06:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX00210%27 HTTP/1.1" 200 None
2026-03-30 06:30:18 [auto1.be] INFO: Scrape type for KX00210: 2
2026-03-30 06:30:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84008d52-5ffd-5f2d-9ee2-fe0d42b01242 with identifier: KX00210
2026-03-30 06:30:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84008d52-5ffd-5f2d-9ee2-fe0d42b01242 with scrape type 2
2026-03-30 06:30:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84008d52-5ffd-5f2d-9ee2-fe0d42b01242 with scrape type 2
2026-03-30 06:30:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 84008d52-5ffd-5f2d-9ee2-fe0d42b01242, identifier: KX00210
2026-03-30 06:30:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 84008d52-5ffd-5f2d-9ee2-fe0d42b01242 with identifier: KX00210
2026-03-30 06:30:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 84008d52-5ffd-5f2d-9ee2-fe0d42b01242 with identifier: KX00210
2026-03-30 06:30:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 84008d52-5ffd-5f2d-9ee2-fe0d42b01242 with identifier: KX00210 to the API
2026-03-30 06:30:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:16:20Z',
 'fuel_type': 'petrol',
 'id': '84008d52-5ffd-5f2d-9ee2-fe0d42b01242',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX00210',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 147109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-25',
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 Club 4x4',
 'transmission': 'manual',
 'trim': 'Club 4x4',
 'year': 2012}
2026-03-30 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX00210%27 HTTP/1.1" 200 None
2026-03-30 06:30:20 [auto1.be] INFO: Saving data for KX00210: {'auction_closing_time': 1774970180.0, 'created_time': 1773133472.309006, 'last_price_update_time': 1774852220.222081}
2026-03-30 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KX00210') HTTP/1.1" 204 0
2026-03-30 06:30:20 [auto1.be] INFO: Found listing with ID: PE06051
2026-03-30 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE06051%27 HTTP/1.1" 200 None
2026-03-30 06:30:20 [auto1.be] INFO: Scrape type for PE06051: 2
2026-03-30 06:30:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52c4748a-0e47-5ed3-a287-86ef18ff7d41 with identifier: PE06051
2026-03-30 06:30:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52c4748a-0e47-5ed3-a287-86ef18ff7d41 with scrape type 2
2026-03-30 06:30:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52c4748a-0e47-5ed3-a287-86ef18ff7d41 with scrape type 2
2026-03-30 06:30:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 52c4748a-0e47-5ed3-a287-86ef18ff7d41, identifier: PE06051
2026-03-30 06:30:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 52c4748a-0e47-5ed3-a287-86ef18ff7d41 with identifier: PE06051
2026-03-30 06:30:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 52c4748a-0e47-5ed3-a287-86ef18ff7d41 with identifier: PE06051
2026-03-30 06:30:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 52c4748a-0e47-5ed3-a287-86ef18ff7d41 with identifier: PE06051 to the API
2026-03-30 06:30:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:24:13Z',
 'fuel_type': 'petrol',
 'id': '52c4748a-0e47-5ed3-a287-86ef18ff7d41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE06051',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 101121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-28',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive passion',
 'year': 2009}
2026-03-30 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE06051%27 HTTP/1.1" 200 None
2026-03-30 06:30:20 [auto1.be] INFO: Saving data for PE06051: {'auction_closing_time': 1774970653.0, 'created_time': 1773133170.652912, 'last_price_update_time': 1774852220.785104}
2026-03-30 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PE06051') HTTP/1.1" 204 0
2026-03-30 06:30:20 [auto1.be] INFO: Found listing with ID: TF58036
2026-03-30 06:30:20 [auto1.be] INFO: Found listing with ID: VR76359
2026-03-30 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VR76359%27 HTTP/1.1" 200 None
2026-03-30 06:30:20 [auto1.be] INFO: Scrape type for VR76359: 1
2026-03-30 06:30:20 [auto1.be] INFO: Found listing with ID: GS35098
2026-03-30 06:30:20 [auto1.be] INFO: Found listing with ID: BS14605
2026-03-30 06:30:20 [auto1.be] INFO: Found listing with ID: ZC01857
2026-03-30 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC01857%27 HTTP/1.1" 200 None
2026-03-30 06:30:20 [auto1.be] INFO: Scrape type for ZC01857: 2
2026-03-30 06:30:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65743daa-34fa-52d9-9aa1-f1827e498b03 with identifier: ZC01857
2026-03-30 06:30:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65743daa-34fa-52d9-9aa1-f1827e498b03 with scrape type 2
2026-03-30 06:30:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65743daa-34fa-52d9-9aa1-f1827e498b03 with scrape type 2
2026-03-30 06:30:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 65743daa-34fa-52d9-9aa1-f1827e498b03, identifier: ZC01857
2026-03-30 06:30:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 65743daa-34fa-52d9-9aa1-f1827e498b03 with identifier: ZC01857
2026-03-30 06:30:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:30:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-30 06:30:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:30:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:30:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-30 06:30:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:30:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 65743daa-34fa-52d9-9aa1-f1827e498b03 with identifier: ZC01857
2026-03-30 06:30:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 65743daa-34fa-52d9-9aa1-f1827e498b03 with identifier: ZC01857 to the API
2026-03-30 06:30:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 374,
 'expiration_date': '2026-03-31T15:09:31Z',
 'fuel_type': 'hybrid',
 'id': '65743daa-34fa-52d9-9aa1-f1827e498b03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC01857',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 265251,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-26',
 'seller_name': None,
 'title': 'Audi Q7 3.0 TDI e-tron quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2017}
2026-03-30 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC01857%27 HTTP/1.1" 200 None
2026-03-30 06:30:22 [auto1.be] INFO: Saving data for ZC01857: {'auction_closing_time': 1774969771.0, 'created_time': 1773137638.245151, 'last_price_update_time': 1774852222.140944}
2026-03-30 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZC01857') HTTP/1.1" 204 0
2026-03-30 06:30:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:30:22 [auto1.be] INFO: Found listing with ID: HT59149
2026-03-30 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT59149%27 HTTP/1.1" 200 None
2026-03-30 06:30:22 [auto1.be] INFO: Scrape type for HT59149: 2
2026-03-30 06:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fda8e606-4305-5a23-8ddb-c02a5820fac8 with identifier: HT59149
2026-03-30 06:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fda8e606-4305-5a23-8ddb-c02a5820fac8 with scrape type 2
2026-03-30 06:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fda8e606-4305-5a23-8ddb-c02a5820fac8 with scrape type 2
2026-03-30 06:30:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fda8e606-4305-5a23-8ddb-c02a5820fac8, identifier: HT59149
2026-03-30 06:30:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fda8e606-4305-5a23-8ddb-c02a5820fac8 with identifier: HT59149
2026-03-30 06:30:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:30:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-30 06:30:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:30:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fda8e606-4305-5a23-8ddb-c02a5820fac8 with identifier: HT59149
2026-03-30 06:30:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fda8e606-4305-5a23-8ddb-c02a5820fac8 with identifier: HT59149 to the API
2026-03-30 06:30:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:53:32Z',
 'fuel_type': 'diesel',
 'id': 'fda8e606-4305-5a23-8ddb-c02a5820fac8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT59149',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 175520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-04',
 'seller_name': None,
 'title': 'BMW X2 sDrive 18d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-30 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT59149%27 HTTP/1.1" 200 None
2026-03-30 06:30:22 [auto1.be] INFO: Saving data for HT59149: {'auction_closing_time': 1774972412.0, 'created_time': 1774125131.130835, 'last_price_update_time': 1774852222.963492}
2026-03-30 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HT59149') HTTP/1.1" 204 0
2026-03-30 06:30:22 [auto1.be] INFO: Found listing with ID: JN20180
2026-03-30 06:30:22 [auto1.be] INFO: Found listing with ID: XG78085
2026-03-30 06:30:22 [auto1.be] INFO: Found listing with ID: VX47829
2026-03-30 06:30:22 [auto1.be] INFO: Found listing with ID: JV43445
2026-03-30 06:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV43445%27 HTTP/1.1" 200 None
2026-03-30 06:30:23 [auto1.be] INFO: Scrape type for JV43445: 1
2026-03-30 06:30:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:30:23 [auto1.be] INFO: Found listing with ID: GK69232
2026-03-30 06:30:23 [auto1.be] INFO: Found listing with ID: FJ11174
2026-03-30 06:30:23 [auto1.be] INFO: Found listing with ID: YP46156
2026-03-30 06:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YP46156%27 HTTP/1.1" 200 None
2026-03-30 06:30:23 [auto1.be] INFO: Scrape type for YP46156: 2
2026-03-30 06:30:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0825d93-d1e7-52db-bff4-9b8b37542ded with identifier: YP46156
2026-03-30 06:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0825d93-d1e7-52db-bff4-9b8b37542ded with scrape type 2
2026-03-30 06:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0825d93-d1e7-52db-bff4-9b8b37542ded with scrape type 2
2026-03-30 06:30:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f0825d93-d1e7-52db-bff4-9b8b37542ded, identifier: YP46156
2026-03-30 06:30:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YN29778/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:30:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:30:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f0825d93-d1e7-52db-bff4-9b8b37542ded with identifier: YP46156
2026-03-30 06:30:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f0825d93-d1e7-52db-bff4-9b8b37542ded with identifier: YP46156
2026-03-30 06:30:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f0825d93-d1e7-52db-bff4-9b8b37542ded with identifier: YP46156 to the API
2026-03-30 06:30:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:14:54Z',
 'fuel_type': 'diesel',
 'id': 'f0825d93-d1e7-52db-bff4-9b8b37542ded',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP46156',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 169890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-13',
 'seller_name': None,
 'title': 'BMW 4er 418d Gran Coupé Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2020}
2026-03-30 06:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YP46156%27 HTTP/1.1" 200 None
2026-03-30 06:30:23 [auto1.be] INFO: Saving data for YP46156: {'auction_closing_time': 1774970094.0, 'created_time': 1773132533.58838, 'last_price_update_time': 1774852223.584183}
2026-03-30 06:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YP46156') HTTP/1.1" 204 0
2026-03-30 06:30:23 [auto1.be] INFO: Found listing with ID: SZ91004
2026-03-30 06:30:23 [auto1.be] INFO: Found listing with ID: SJ04355
2026-03-30 06:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ04355%27 HTTP/1.1" 200 None
2026-03-30 06:30:23 [auto1.be] INFO: Scrape type for SJ04355: 1
2026-03-30 06:30:23 [auto1.be] INFO: Found listing with ID: KD38906
2026-03-30 06:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD38906%27 HTTP/1.1" 200 None
2026-03-30 06:30:23 [auto1.be] INFO: Scrape type for KD38906: 1
2026-03-30 06:30:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:30:23 [auto1.be] INFO: Channel: 24h | Page: 1 | totalHits: 1288 | hits on page: 40
2026-03-30 06:30:23 [auto1.be] INFO: Found listing with ID: DG03200
2026-03-30 06:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DG03200%27 HTTP/1.1" 200 None
2026-03-30 06:30:23 [auto1.be] INFO: Scrape type for DG03200: 2
2026-03-30 06:30:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4819445-f78d-5299-8f24-045beaa7de29 with identifier: DG03200
2026-03-30 06:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4819445-f78d-5299-8f24-045beaa7de29 with scrape type 2
2026-03-30 06:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4819445-f78d-5299-8f24-045beaa7de29 with scrape type 2
2026-03-30 06:30:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b4819445-f78d-5299-8f24-045beaa7de29, identifier: DG03200
2026-03-30 06:30:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b4819445-f78d-5299-8f24-045beaa7de29 with identifier: DG03200
2026-03-30 06:30:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b4819445-f78d-5299-8f24-045beaa7de29 with identifier: DG03200
2026-03-30 06:30:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b4819445-f78d-5299-8f24-045beaa7de29 with identifier: DG03200 to the API
2026-03-30 06:30:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:34:21Z',
 'fuel_type': 'hybrid',
 'id': 'b4819445-f78d-5299-8f24-045beaa7de29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG03200',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 116016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-11',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.5 Hybrid 4x2 Style Selection',
 'transmission': 'automatic',
 'trim': '4x2 Style Selection',
 'year': 2021}
2026-03-30 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DG03200%27 HTTP/1.1" 200 None
2026-03-30 06:30:24 [auto1.be] INFO: Saving data for DG03200: {'auction_closing_time': 1774971261.0, 'created_time': 1774438247.604228, 'last_price_update_time': 1774852224.815485}
2026-03-30 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DG03200') HTTP/1.1" 204 0
2026-03-30 06:30:24 [auto1.be] INFO: Found listing with ID: HM64227
2026-03-30 06:30:24 [auto1.be] INFO: Found listing with ID: YN29778
2026-03-30 06:30:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:30:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:30:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:30:24 [auto1.be] INFO: Found listing with ID: CH88253
2026-03-30 06:30:24 [auto1.be] INFO: Found listing with ID: TY37950
2026-03-30 06:30:24 [auto1.be] INFO: Found listing with ID: KD13812
2026-03-30 06:30:24 [auto1.be] INFO: Found listing with ID: WN92129
2026-03-30 06:30:24 [auto1.be] INFO: Found listing with ID: VW53084
2026-03-30 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW53084%27 HTTP/1.1" 200 None
2026-03-30 06:30:24 [auto1.be] INFO: Scrape type for VW53084: 2
2026-03-30 06:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5faca681-67c1-5210-b307-3c816ebd8574 with identifier: VW53084
2026-03-30 06:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5faca681-67c1-5210-b307-3c816ebd8574 with scrape type 2
2026-03-30 06:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5faca681-67c1-5210-b307-3c816ebd8574 with scrape type 2
2026-03-30 06:30:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5faca681-67c1-5210-b307-3c816ebd8574, identifier: VW53084
2026-03-30 06:30:25 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/YN29778/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-30 06:30:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5faca681-67c1-5210-b307-3c816ebd8574 with identifier: VW53084
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-30 06:30:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:30:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5faca681-67c1-5210-b307-3c816ebd8574 with identifier: VW53084
2026-03-30 06:30:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5faca681-67c1-5210-b307-3c816ebd8574 with identifier: VW53084 to the API
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:27:12Z',
 'fuel_type': 'diesel',
 'id': '5faca681-67c1-5210-b307-3c816ebd8574',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW53084',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 18255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-25',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi EcoBlue ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2024}
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW53084%27 HTTP/1.1" 200 None
2026-03-30 06:30:25 [auto1.be] INFO: Saving data for VW53084: {'auction_closing_time': 1774970832.0, 'created_time': 1773693901.392929, 'last_price_update_time': 1774852225.609409}
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VW53084') HTTP/1.1" 204 0
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: XN45926
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: VP75874
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP75874%27 HTTP/1.1" 200 None
2026-03-30 06:30:25 [auto1.be] INFO: Scrape type for VP75874: 0
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: MJ73226
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: SU19738
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU19738%27 HTTP/1.1" 200 None
2026-03-30 06:30:25 [auto1.be] INFO: Scrape type for SU19738: 0
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: KX00210
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX00210%27 HTTP/1.1" 200 None
2026-03-30 06:30:25 [auto1.be] INFO: Scrape type for KX00210: 0
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: PE06051
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE06051%27 HTTP/1.1" 200 None
2026-03-30 06:30:25 [auto1.be] INFO: Scrape type for PE06051: 0
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: TF58036
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: VR76359
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: HD96937
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: NE40925
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: TU29469
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: ZP62550
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: RK88808
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: LG48907
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: TX40265
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: RJ95996
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ95996%27 HTTP/1.1" 200 None
2026-03-30 06:30:25 [auto1.be] INFO: Scrape type for RJ95996: 0
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: LU32507
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU32507%27 HTTP/1.1" 200 None
2026-03-30 06:30:25 [auto1.be] INFO: Scrape type for LU32507: 0
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: FT44143
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT44143%27 HTTP/1.1" 200 None
2026-03-30 06:30:25 [auto1.be] INFO: Scrape type for FT44143: 0
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: GS35098
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: BS14605
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: ZC01857
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC01857%27 HTTP/1.1" 200 None
2026-03-30 06:30:25 [auto1.be] INFO: Scrape type for ZC01857: 0
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: HT59149
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT59149%27 HTTP/1.1" 200 None
2026-03-30 06:30:25 [auto1.be] INFO: Scrape type for HT59149: 0
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: JN20180
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: XG78085
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: VX47829
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: JV43445
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: GK69232
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: FJ11174
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: YP46156
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YP46156%27 HTTP/1.1" 200 None
2026-03-30 06:30:25 [auto1.be] INFO: Scrape type for YP46156: 0
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: SZ91004
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: SJ04355
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: KD38906
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: DG03200
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DG03200%27 HTTP/1.1" 200 None
2026-03-30 06:30:25 [auto1.be] INFO: Scrape type for DG03200: 0
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: CH88253
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: TY37950
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: KD13812
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: WN92129
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: VW53084
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW53084%27 HTTP/1.1" 200 None
2026-03-30 06:30:25 [auto1.be] INFO: Scrape type for VW53084: 0
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: HD96937
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: NE40925
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: TU29469
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: ZP62550
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: RK88808
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: LG48907
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: TX40265
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: RJ95996
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ95996%27 HTTP/1.1" 200 None
2026-03-30 06:30:25 [auto1.be] INFO: Scrape type for RJ95996: 0
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: LU32507
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU32507%27 HTTP/1.1" 200 None
2026-03-30 06:30:25 [auto1.be] INFO: Scrape type for LU32507: 0
2026-03-30 06:30:25 [auto1.be] INFO: Found listing with ID: FT44143
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT44143%27 HTTP/1.1" 200 None
2026-03-30 06:30:25 [auto1.be] INFO: Scrape type for FT44143: 0
2026-03-30 06:30:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JV43445/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:30:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:30:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SJ04355/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:30:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:30:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:30:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VR76359/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:30:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YN29778> (referer: https://www.auto1.com/v1/car-details-view/YN29778/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:30:26 [auto1.be] INFO: Channel: 24h | Page: 2 | totalHits: 1288 | hits on page: 40
2026-03-30 06:30:26 [auto1.be] INFO: Found listing with ID: DT10357
2026-03-30 06:30:26 [auto1.be] INFO: Found listing with ID: SW43031
2026-03-30 06:30:26 [auto1.be] INFO: Found listing with ID: KH45960
2026-03-30 06:30:26 [auto1.be] INFO: Found listing with ID: VR58028
2026-03-30 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VR58028%27 HTTP/1.1" 200 None
2026-03-30 06:30:26 [auto1.be] INFO: Scrape type for VR58028: 0
2026-03-30 06:30:26 [auto1.be] INFO: Found listing with ID: EX99169
2026-03-30 06:30:26 [auto1.be] INFO: Found listing with ID: ES45973
2026-03-30 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES45973%27 HTTP/1.1" 200 None
2026-03-30 06:30:26 [auto1.be] INFO: Scrape type for ES45973: 0
2026-03-30 06:30:26 [auto1.be] INFO: Found listing with ID: DL06250
2026-03-30 06:30:26 [auto1.be] INFO: Found listing with ID: AM39981
2026-03-30 06:30:26 [auto1.be] INFO: Found listing with ID: NJ87931
2026-03-30 06:30:26 [auto1.be] INFO: Found listing with ID: RS13546
2026-03-30 06:30:26 [auto1.be] INFO: Found listing with ID: MB50362
2026-03-30 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB50362%27 HTTP/1.1" 200 None
2026-03-30 06:30:26 [auto1.be] INFO: Scrape type for MB50362: 0
2026-03-30 06:30:26 [auto1.be] INFO: Found listing with ID: BR08123
2026-03-30 06:30:26 [auto1.be] INFO: Found listing with ID: MR13936
2026-03-30 06:30:26 [auto1.be] INFO: Found listing with ID: VB51630
2026-03-30 06:30:26 [auto1.be] INFO: Found listing with ID: AD75254
2026-03-30 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD75254%27 HTTP/1.1" 200 None
2026-03-30 06:30:26 [auto1.be] INFO: Scrape type for AD75254: 0
2026-03-30 06:30:26 [auto1.be] INFO: Found listing with ID: KM93600
2026-03-30 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM93600%27 HTTP/1.1" 200 None
2026-03-30 06:30:26 [auto1.be] INFO: Scrape type for KM93600: 0
2026-03-30 06:30:26 [auto1.be] INFO: Found listing with ID: JZ74663
2026-03-30 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ74663%27 HTTP/1.1" 200 None
2026-03-30 06:30:26 [auto1.be] INFO: Scrape type for JZ74663: 0
2026-03-30 06:30:26 [auto1.be] INFO: Found listing with ID: JW28444
2026-03-30 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW28444%27 HTTP/1.1" 200 None
2026-03-30 06:30:26 [auto1.be] INFO: Scrape type for JW28444: 0
2026-03-30 06:30:26 [auto1.be] INFO: Found listing with ID: ST41989
2026-03-30 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST41989%27 HTTP/1.1" 200 None
2026-03-30 06:30:26 [auto1.be] INFO: Scrape type for ST41989: 0
2026-03-30 06:30:26 [auto1.be] INFO: Found listing with ID: SB58546
2026-03-30 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB58546%27 HTTP/1.1" 200 None
2026-03-30 06:30:26 [auto1.be] INFO: Scrape type for SB58546: 0
2026-03-30 06:30:26 [auto1.be] INFO: Found listing with ID: ZN33988
2026-03-30 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN33988%27 HTTP/1.1" 200 None
2026-03-30 06:30:26 [auto1.be] INFO: Scrape type for ZN33988: 0
2026-03-30 06:30:26 [auto1.be] INFO: Found listing with ID: WV98137
2026-03-30 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV98137%27 HTTP/1.1" 200 None
2026-03-30 06:30:26 [auto1.be] INFO: Scrape type for WV98137: 0
2026-03-30 06:30:26 [auto1.be] INFO: Found listing with ID: WM98444
2026-03-30 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM98444%27 HTTP/1.1" 200 None
2026-03-30 06:30:26 [auto1.be] INFO: Scrape type for WM98444: 0
2026-03-30 06:30:26 [auto1.be] INFO: Found listing with ID: YL67549
2026-03-30 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL67549%27 HTTP/1.1" 200 None
2026-03-30 06:30:26 [auto1.be] INFO: Scrape type for YL67549: 0
2026-03-30 06:30:26 [auto1.be] INFO: Found listing with ID: RJ01486
2026-03-30 06:30:26 [auto1.be] INFO: Found listing with ID: WP77155
2026-03-30 06:30:26 [auto1.be] INFO: Found listing with ID: CY85383
2026-03-30 06:30:26 [auto1.be] INFO: Found listing with ID: MK20841
2026-03-30 06:30:26 [auto1.be] INFO: Found listing with ID: NE45749
2026-03-30 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE45749%27 HTTP/1.1" 200 None
2026-03-30 06:30:26 [auto1.be] INFO: Scrape type for NE45749: 0
2026-03-30 06:30:26 [auto1.be] INFO: Found listing with ID: VP73114
2026-03-30 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP73114%27 HTTP/1.1" 200 None
2026-03-30 06:30:26 [auto1.be] INFO: Scrape type for VP73114: 0
2026-03-30 06:30:26 [auto1.be] INFO: Found listing with ID: XS85102
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS85102%27 HTTP/1.1" 200 None
2026-03-30 06:30:27 [auto1.be] INFO: Scrape type for XS85102: 0
2026-03-30 06:30:27 [auto1.be] INFO: Found listing with ID: GB22067
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB22067%27 HTTP/1.1" 200 None
2026-03-30 06:30:27 [auto1.be] INFO: Scrape type for GB22067: 0
2026-03-30 06:30:27 [auto1.be] INFO: Found listing with ID: RX06086
2026-03-30 06:30:27 [auto1.be] INFO: Found listing with ID: BJ49980
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ49980%27 HTTP/1.1" 200 None
2026-03-30 06:30:27 [auto1.be] INFO: Scrape type for BJ49980: 0
2026-03-30 06:30:27 [auto1.be] INFO: Found listing with ID: PE70540
2026-03-30 06:30:27 [auto1.be] INFO: Found listing with ID: ZZ18378
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ18378%27 HTTP/1.1" 200 None
2026-03-30 06:30:27 [auto1.be] INFO: Scrape type for ZZ18378: 0
2026-03-30 06:30:27 [auto1.be] INFO: Found listing with ID: GN69495
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN69495%27 HTTP/1.1" 200 None
2026-03-30 06:30:27 [auto1.be] INFO: Scrape type for GN69495: 0
2026-03-30 06:30:27 [auto1.be] INFO: Found listing with ID: XD29708
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD29708%27 HTTP/1.1" 200 None
2026-03-30 06:30:27 [auto1.be] INFO: Scrape type for XD29708: 0
2026-03-30 06:30:27 [auto1.be] INFO: Found listing with ID: SK35491
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK35491%27 HTTP/1.1" 200 None
2026-03-30 06:30:27 [auto1.be] INFO: Scrape type for SK35491: 0
2026-03-30 06:30:27 [auto1.be] INFO: Found listing with ID: KT58942
2026-03-30 06:30:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KD38906/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:30:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f57d6615-93b3-5ade-823b-3cb2ece4dcfe with identifier: YN29778
2026-03-30 06:30:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f57d6615-93b3-5ade-823b-3cb2ece4dcfe with scrape type 1
2026-03-30 06:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f57d6615-93b3-5ade-823b-3cb2ece4dcfe
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F05%252Fbe059a0150296af0d46b01de56d57539%252Fpa%252FYN29778_28f3de5e76a5209425633da91cc05087.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/05/be059a0150296af0d46b01de56d57539/pa/YN29778_28f3de5e76a5209425633da91cc05087.jpg already downloaded
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F05%252Fbe059a0150296af0d46b01de56d57539%252Fpa%252FYN29778_de165a2f8027db66ce88296a76e8b83e.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/05/be059a0150296af0d46b01de56d57539/pa/YN29778_de165a2f8027db66ce88296a76e8b83e.jpg already downloaded
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F05%252Fbe059a0150296af0d46b01de56d57539%252Fpa%252FYN29778_7117eb4c1272f889254d14744b2a7985.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/05/be059a0150296af0d46b01de56d57539/pa/YN29778_7117eb4c1272f889254d14744b2a7985.jpg already downloaded
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F05%252Fbe059a0150296af0d46b01de56d57539%252Fpa%252FYN29778_53cbc42404fc0dfef9030556a2b32962.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/05/be059a0150296af0d46b01de56d57539/pa/YN29778_53cbc42404fc0dfef9030556a2b32962.jpg already downloaded
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F05%252Fbe059a0150296af0d46b01de56d57539%252Fpa%252FYN29778_0d76bd20b31519c56addd7dca28c8426.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/05/be059a0150296af0d46b01de56d57539/pa/YN29778_0d76bd20b31519c56addd7dca28c8426.jpg already downloaded
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F05%252Fbe059a0150296af0d46b01de56d57539%252Fpa%252FYN29778_e2f0500908ce75276c36b35d4c45b50f.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/05/be059a0150296af0d46b01de56d57539/pa/YN29778_e2f0500908ce75276c36b35d4c45b50f.jpg already downloaded
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F05%252Fbe059a0150296af0d46b01de56d57539%252Fpa%252FYN29778_c5630b0e132afd15b7af8f7da25f8227.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/05/be059a0150296af0d46b01de56d57539/pa/YN29778_c5630b0e132afd15b7af8f7da25f8227.jpg already downloaded
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F05%252Fbe059a0150296af0d46b01de56d57539%252Fpa%252FYN29778_c89b9a9957f2a7e4fd9669dc6e6e9e33.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/05/be059a0150296af0d46b01de56d57539/pa/YN29778_c89b9a9957f2a7e4fd9669dc6e6e9e33.jpg already downloaded
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F05%252Fbe059a0150296af0d46b01de56d57539%252Fpa%252FYN29778_68584658c9c8b00d3501293441d97ce9.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/05/be059a0150296af0d46b01de56d57539/pa/YN29778_68584658c9c8b00d3501293441d97ce9.jpg already downloaded
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F05%252Fbe059a0150296af0d46b01de56d57539%252Fpa%252FYN29778_fe87e330ca958e601ce8eba1c5e555d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/05/be059a0150296af0d46b01de56d57539/pa/YN29778_fe87e330ca958e601ce8eba1c5e555d0.jpg already downloaded
2026-03-30 06:30:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f57d6615-93b3-5ade-823b-3cb2ece4dcfe, identifier: YN29778
2026-03-30 06:30:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f57d6615-93b3-5ade-823b-3cb2ece4dcfe with identifier: YN29778
2026-03-30 06:30:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f57d6615-93b3-5ade-823b-3cb2ece4dcfe with identifier: YN29778
2026-03-30 06:30:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f57d6615-93b3-5ade-823b-3cb2ece4dcfe with identifier: YN29778 to the API
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YN29778>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:40:41Z',
 'fuel_type': 'petrol',
 'id': 'f57d6615-93b3-5ade-823b-3cb2ece4dcfe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN29778',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 127111,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgbe/05/be059a0150296af0d46b01de56d57539/pa/YN29778_28f3de5e76a5209425633da91cc05087.jpg',
                'https://img-pa.auto1.com/imgbe/05/be059a0150296af0d46b01de56d57539/pa/YN29778_de165a2f8027db66ce88296a76e8b83e.jpg',
                'https://img-pa.auto1.com/imgbe/05/be059a0150296af0d46b01de56d57539/pa/YN29778_7117eb4c1272f889254d14744b2a7985.jpg',
                'https://img-pa.auto1.com/imgbe/05/be059a0150296af0d46b01de56d57539/pa/YN29778_53cbc42404fc0dfef9030556a2b32962.jpg',
                'https://img-pa.auto1.com/imgbe/05/be059a0150296af0d46b01de56d57539/pa/YN29778_0d76bd20b31519c56addd7dca28c8426.jpg',
                'https://img-pa.auto1.com/imgbe/05/be059a0150296af0d46b01de56d57539/pa/YN29778_e2f0500908ce75276c36b35d4c45b50f.jpg',
                'https://img-pa.auto1.com/imgbe/05/be059a0150296af0d46b01de56d57539/pa/YN29778_c5630b0e132afd15b7af8f7da25f8227.jpg',
                'https://img-pa.auto1.com/imgbe/05/be059a0150296af0d46b01de56d57539/pa/YN29778_c89b9a9957f2a7e4fd9669dc6e6e9e33.jpg',
                'https://img-pa.auto1.com/imgbe/05/be059a0150296af0d46b01de56d57539/pa/YN29778_68584658c9c8b00d3501293441d97ce9.jpg',
                'https://img-pa.auto1.com/imgbe/05/be059a0150296af0d46b01de56d57539/pa/YN29778_fe87e330ca958e601ce8eba1c5e555d0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f57d6615-93b3-5ade-823b-3cb2ece4dcfe/f57d6615-93b3-5ade-823b-3cb2ece4dcfe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/05/be059a0150296af0d46b01de56d57539/pa/YN29778_28f3de5e76a5209425633da91cc05087.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f57d6615-93b3-5ade-823b-3cb2ece4dcfe/f57d6615-93b3-5ade-823b-3cb2ece4dcfe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/05/be059a0150296af0d46b01de56d57539/pa/YN29778_de165a2f8027db66ce88296a76e8b83e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f57d6615-93b3-5ade-823b-3cb2ece4dcfe/f57d6615-93b3-5ade-823b-3cb2ece4dcfe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/05/be059a0150296af0d46b01de56d57539/pa/YN29778_7117eb4c1272f889254d14744b2a7985.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f57d6615-93b3-5ade-823b-3cb2ece4dcfe/f57d6615-93b3-5ade-823b-3cb2ece4dcfe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/05/be059a0150296af0d46b01de56d57539/pa/YN29778_53cbc42404fc0dfef9030556a2b32962.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f57d6615-93b3-5ade-823b-3cb2ece4dcfe/f57d6615-93b3-5ade-823b-3cb2ece4dcfe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/05/be059a0150296af0d46b01de56d57539/pa/YN29778_0d76bd20b31519c56addd7dca28c8426.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f57d6615-93b3-5ade-823b-3cb2ece4dcfe/f57d6615-93b3-5ade-823b-3cb2ece4dcfe_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/05/be059a0150296af0d46b01de56d57539/pa/YN29778_e2f0500908ce75276c36b35d4c45b50f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f57d6615-93b3-5ade-823b-3cb2ece4dcfe/f57d6615-93b3-5ade-823b-3cb2ece4dcfe_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/05/be059a0150296af0d46b01de56d57539/pa/YN29778_c5630b0e132afd15b7af8f7da25f8227.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f57d6615-93b3-5ade-823b-3cb2ece4dcfe/f57d6615-93b3-5ade-823b-3cb2ece4dcfe_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/05/be059a0150296af0d46b01de56d57539/pa/YN29778_c89b9a9957f2a7e4fd9669dc6e6e9e33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f57d6615-93b3-5ade-823b-3cb2ece4dcfe/f57d6615-93b3-5ade-823b-3cb2ece4dcfe_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/05/be059a0150296af0d46b01de56d57539/pa/YN29778_68584658c9c8b00d3501293441d97ce9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f57d6615-93b3-5ade-823b-3cb2ece4dcfe/f57d6615-93b3-5ade-823b-3cb2ece4dcfe_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/05/be059a0150296af0d46b01de56d57539/pa/YN29778_fe87e330ca958e601ce8eba1c5e555d0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN29778%27 HTTP/1.1" 200 None
2026-03-30 06:30:28 [auto1.be] INFO: Saving data for YN29778: {'created_time': 1774852228.033683, 'last_price_update_time': 1774852228.033696, 'auction_closing_time': 1774971641.0}
2026-03-30 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YN29778') HTTP/1.1" 204 0
2026-03-30 06:30:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:30:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JV43445> (referer: https://www.auto1.com/v1/car-details-view/JV43445/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:30:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:30:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31e81bd5-ddd1-5650-8c6b-5c1eae7c328d with identifier: JV43445
2026-03-30 06:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31e81bd5-ddd1-5650-8c6b-5c1eae7c328d with scrape type 1
2026-03-30 06:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 31e81bd5-ddd1-5650-8c6b-5c1eae7c328d
2026-03-30 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fb5%252F66b58a4f01174e94330791aa4ec54cf2%252Fpa%252FJV43445_3a75a4c3b68979337c80ddaed76b913a.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/b5/66b58a4f01174e94330791aa4ec54cf2/pa/JV43445_3a75a4c3b68979337c80ddaed76b913a.jpg already downloaded
2026-03-30 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fb5%252F66b58a4f01174e94330791aa4ec54cf2%252Fpa%252FJV43445_ccaeb699ca11f0f0db8ec430fc9e9ea5.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/b5/66b58a4f01174e94330791aa4ec54cf2/pa/JV43445_ccaeb699ca11f0f0db8ec430fc9e9ea5.jpg already downloaded
2026-03-30 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fb5%252F66b58a4f01174e94330791aa4ec54cf2%252Fpa%252FJV43445_9cf466e22b59d0275dc834711b8e17d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/b5/66b58a4f01174e94330791aa4ec54cf2/pa/JV43445_9cf466e22b59d0275dc834711b8e17d1.jpg already downloaded
2026-03-30 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fb5%252F66b58a4f01174e94330791aa4ec54cf2%252Fpa%252FJV43445_be6ce15cafcc74bba06ad1e75f8abd18.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/b5/66b58a4f01174e94330791aa4ec54cf2/pa/JV43445_be6ce15cafcc74bba06ad1e75f8abd18.jpg already downloaded
2026-03-30 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fb5%252F66b58a4f01174e94330791aa4ec54cf2%252Fpa%252FJV43445_3f2046f54be1209b69c3523db4766171.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/b5/66b58a4f01174e94330791aa4ec54cf2/pa/JV43445_3f2046f54be1209b69c3523db4766171.jpg already downloaded
2026-03-30 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fb5%252F66b58a4f01174e94330791aa4ec54cf2%252Fpa%252FJV43445_281b05f6ec15a25411495f70c57601fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/b5/66b58a4f01174e94330791aa4ec54cf2/pa/JV43445_281b05f6ec15a25411495f70c57601fe.jpg already downloaded
2026-03-30 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fb5%252F66b58a4f01174e94330791aa4ec54cf2%252Fpa%252FJV43445_6215dd08255b72268a2cc35bd335fdca.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/b5/66b58a4f01174e94330791aa4ec54cf2/pa/JV43445_6215dd08255b72268a2cc35bd335fdca.jpg already downloaded
2026-03-30 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fb5%252F66b58a4f01174e94330791aa4ec54cf2%252Fpa%252FJV43445_f66299f43bdaebec410db81e779ea1de.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/b5/66b58a4f01174e94330791aa4ec54cf2/pa/JV43445_f66299f43bdaebec410db81e779ea1de.jpg already downloaded
2026-03-30 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fb5%252F66b58a4f01174e94330791aa4ec54cf2%252Fpa%252FJV43445_40b3813d5852276c2936025d43889dd2.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/b5/66b58a4f01174e94330791aa4ec54cf2/pa/JV43445_40b3813d5852276c2936025d43889dd2.jpg already downloaded
2026-03-30 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Fb5%252F66b58a4f01174e94330791aa4ec54cf2%252Fpa%252FJV43445_fd30cad71592856e7a9a85a1a6b8e326.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/b5/66b58a4f01174e94330791aa4ec54cf2/pa/JV43445_fd30cad71592856e7a9a85a1a6b8e326.jpg already downloaded
2026-03-30 06:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 31e81bd5-ddd1-5650-8c6b-5c1eae7c328d, identifier: JV43445
2026-03-30 06:30:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 31e81bd5-ddd1-5650-8c6b-5c1eae7c328d with identifier: JV43445
2026-03-30 06:30:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 31e81bd5-ddd1-5650-8c6b-5c1eae7c328d with identifier: JV43445
2026-03-30 06:30:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 31e81bd5-ddd1-5650-8c6b-5c1eae7c328d with identifier: JV43445 to the API
2026-03-30 06:30:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JV43445>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:29:43Z',
 'fuel_type': 'diesel',
 'id': '31e81bd5-ddd1-5650-8c6b-5c1eae7c328d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV43445',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 147350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img66/b5/66b58a4f01174e94330791aa4ec54cf2/pa/JV43445_3a75a4c3b68979337c80ddaed76b913a.jpg',
                'https://img-pa.auto1.com/img66/b5/66b58a4f01174e94330791aa4ec54cf2/pa/JV43445_ccaeb699ca11f0f0db8ec430fc9e9ea5.jpg',
                'https://img-pa.auto1.com/img66/b5/66b58a4f01174e94330791aa4ec54cf2/pa/JV43445_9cf466e22b59d0275dc834711b8e17d1.jpg',
                'https://img-pa.auto1.com/img66/b5/66b58a4f01174e94330791aa4ec54cf2/pa/JV43445_be6ce15cafcc74bba06ad1e75f8abd18.jpg',
                'https://img-pa.auto1.com/img66/b5/66b58a4f01174e94330791aa4ec54cf2/pa/JV43445_3f2046f54be1209b69c3523db4766171.jpg',
                'https://img-pa.auto1.com/img66/b5/66b58a4f01174e94330791aa4ec54cf2/pa/JV43445_281b05f6ec15a25411495f70c57601fe.jpg',
                'https://img-pa.auto1.com/img66/b5/66b58a4f01174e94330791aa4ec54cf2/pa/JV43445_6215dd08255b72268a2cc35bd335fdca.jpg',
                'https://img-pa.auto1.com/img66/b5/66b58a4f01174e94330791aa4ec54cf2/pa/JV43445_f66299f43bdaebec410db81e779ea1de.jpg',
                'https://img-pa.auto1.com/img66/b5/66b58a4f01174e94330791aa4ec54cf2/pa/JV43445_40b3813d5852276c2936025d43889dd2.jpg',
                'https://img-pa.auto1.com/img66/b5/66b58a4f01174e94330791aa4ec54cf2/pa/JV43445_fd30cad71592856e7a9a85a1a6b8e326.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31e81bd5-ddd1-5650-8c6b-5c1eae7c328d/31e81bd5-ddd1-5650-8c6b-5c1eae7c328d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/b5/66b58a4f01174e94330791aa4ec54cf2/pa/JV43445_3a75a4c3b68979337c80ddaed76b913a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31e81bd5-ddd1-5650-8c6b-5c1eae7c328d/31e81bd5-ddd1-5650-8c6b-5c1eae7c328d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/b5/66b58a4f01174e94330791aa4ec54cf2/pa/JV43445_ccaeb699ca11f0f0db8ec430fc9e9ea5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31e81bd5-ddd1-5650-8c6b-5c1eae7c328d/31e81bd5-ddd1-5650-8c6b-5c1eae7c328d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/b5/66b58a4f01174e94330791aa4ec54cf2/pa/JV43445_9cf466e22b59d0275dc834711b8e17d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31e81bd5-ddd1-5650-8c6b-5c1eae7c328d/31e81bd5-ddd1-5650-8c6b-5c1eae7c328d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68644,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/b5/66b58a4f01174e94330791aa4ec54cf2/pa/JV43445_be6ce15cafcc74bba06ad1e75f8abd18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31e81bd5-ddd1-5650-8c6b-5c1eae7c328d/31e81bd5-ddd1-5650-8c6b-5c1eae7c328d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59877,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/b5/66b58a4f01174e94330791aa4ec54cf2/pa/JV43445_3f2046f54be1209b69c3523db4766171.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31e81bd5-ddd1-5650-8c6b-5c1eae7c328d/31e81bd5-ddd1-5650-8c6b-5c1eae7c328d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/b5/66b58a4f01174e94330791aa4ec54cf2/pa/JV43445_281b05f6ec15a25411495f70c57601fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31e81bd5-ddd1-5650-8c6b-5c1eae7c328d/31e81bd5-ddd1-5650-8c6b-5c1eae7c328d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/b5/66b58a4f01174e94330791aa4ec54cf2/pa/JV43445_6215dd08255b72268a2cc35bd335fdca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31e81bd5-ddd1-5650-8c6b-5c1eae7c328d/31e81bd5-ddd1-5650-8c6b-5c1eae7c328d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/b5/66b58a4f01174e94330791aa4ec54cf2/pa/JV43445_f66299f43bdaebec410db81e779ea1de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31e81bd5-ddd1-5650-8c6b-5c1eae7c328d/31e81bd5-ddd1-5650-8c6b-5c1eae7c328d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/b5/66b58a4f01174e94330791aa4ec54cf2/pa/JV43445_40b3813d5852276c2936025d43889dd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31e81bd5-ddd1-5650-8c6b-5c1eae7c328d/31e81bd5-ddd1-5650-8c6b-5c1eae7c328d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/b5/66b58a4f01174e94330791aa4ec54cf2/pa/JV43445_fd30cad71592856e7a9a85a1a6b8e326.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 180 d Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2018}
2026-03-30 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV43445%27 HTTP/1.1" 200 None
2026-03-30 06:30:29 [auto1.be] INFO: Saving data for JV43445: {'created_time': 1774852229.451276, 'last_price_update_time': 1774852229.451287, 'auction_closing_time': 1774970983.0}
2026-03-30 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JV43445') HTTP/1.1" 204 0
2026-03-30 06:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SJ04355> (referer: https://www.auto1.com/v1/car-details-view/SJ04355/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:30:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfdbf086-764f-5b34-925a-31433c103110 with identifier: SJ04355
2026-03-30 06:30:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfdbf086-764f-5b34-925a-31433c103110 with scrape type 1
2026-03-30 06:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dfdbf086-764f-5b34-925a-31433c103110
2026-03-30 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F60%252Fc860bdc0d20efb879c653d631b3aa96b%252Fpa%252FSJ04355_6338140619ce66a86efeeb64ae4aa08e.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_6338140619ce66a86efeeb64ae4aa08e.jpg not downloaded yet
2026-03-30 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F60%252Fc860bdc0d20efb879c653d631b3aa96b%252Fpa%252FSJ04355_cd0dca06722fbaa4c11c83fb7585e13f.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_cd0dca06722fbaa4c11c83fb7585e13f.jpg not downloaded yet
2026-03-30 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F60%252Fc860bdc0d20efb879c653d631b3aa96b%252Fpa%252FSJ04355_cad0700faeeb2657fcb2ed5ce0706f36.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_cad0700faeeb2657fcb2ed5ce0706f36.jpg not downloaded yet
2026-03-30 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F60%252Fc860bdc0d20efb879c653d631b3aa96b%252Fpa%252FSJ04355_ac2066a9cfb976a81d874034b14480ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_ac2066a9cfb976a81d874034b14480ef.jpg not downloaded yet
2026-03-30 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F60%252Fc860bdc0d20efb879c653d631b3aa96b%252Fpa%252FSJ04355_bb8978d0b3f795a6a773197465d4f4d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_bb8978d0b3f795a6a773197465d4f4d3.jpg not downloaded yet
2026-03-30 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F60%252Fc860bdc0d20efb879c653d631b3aa96b%252Fpa%252FSJ04355_881573bff818e9e8ee9571cb54f9301f.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_881573bff818e9e8ee9571cb54f9301f.jpg not downloaded yet
2026-03-30 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F60%252Fc860bdc0d20efb879c653d631b3aa96b%252Fpa%252FSJ04355_2ece3a22306b888bae7c211dc5c83b46.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_2ece3a22306b888bae7c211dc5c83b46.jpg not downloaded yet
2026-03-30 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F60%252Fc860bdc0d20efb879c653d631b3aa96b%252Fpa%252FSJ04355_0d6cddfac9d465f51b9029d70f95c46c.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_0d6cddfac9d465f51b9029d70f95c46c.jpg not downloaded yet
2026-03-30 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F60%252Fc860bdc0d20efb879c653d631b3aa96b%252Fpa%252FSJ04355_5db262fdc3730c7a9cac5fa222b63237.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_5db262fdc3730c7a9cac5fa222b63237.jpg not downloaded yet
2026-03-30 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F60%252Fc860bdc0d20efb879c653d631b3aa96b%252Fpa%252FSJ04355_32bbad7d63b971d31b30b6480601bea1.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_32bbad7d63b971d31b30b6480601bea1.jpg not downloaded yet
2026-03-30 06:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_6338140619ce66a86efeeb64ae4aa08e.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_2ece3a22306b888bae7c211dc5c83b46.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_5db262fdc3730c7a9cac5fa222b63237.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_ac2066a9cfb976a81d874034b14480ef.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_0d6cddfac9d465f51b9029d70f95c46c.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:30:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_cd0dca06722fbaa4c11c83fb7585e13f.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:30:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-30 06:30:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-30 06:30:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:30:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6bdd0e50>
2026-03-30 06:30:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:30:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfdbf086-764f-5b34-925a-31433c103110/dfdbf086-764f-5b34-925a-31433c103110_image_0.jpg HTTP/1.1" 201 0
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F60%252Fc860bdc0d20efb879c653d631b3aa96b%252Fpa%252FSJ04355_6338140619ce66a86efeeb64ae4aa08e.jpg') HTTP/1.1" 204 0
2026-03-30 06:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_6338140619ce66a86efeeb64ae4aa08e.jpg saved to cache
2026-03-30 06:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dfdbf086-764f-5b34-925a-31433c103110
2026-03-30 06:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_bb8978d0b3f795a6a773197465d4f4d3.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_32bbad7d63b971d31b30b6480601bea1.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_cad0700faeeb2657fcb2ed5ce0706f36.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_881573bff818e9e8ee9571cb54f9301f.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6bd14f50>
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfdbf086-764f-5b34-925a-31433c103110/dfdbf086-764f-5b34-925a-31433c103110_image_6.jpg HTTP/1.1" 201 0
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F60%252Fc860bdc0d20efb879c653d631b3aa96b%252Fpa%252FSJ04355_2ece3a22306b888bae7c211dc5c83b46.jpg') HTTP/1.1" 204 0
2026-03-30 06:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_2ece3a22306b888bae7c211dc5c83b46.jpg saved to cache
2026-03-30 06:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dfdbf086-764f-5b34-925a-31433c103110
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6b303550>
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfdbf086-764f-5b34-925a-31433c103110/dfdbf086-764f-5b34-925a-31433c103110_image_8.jpg HTTP/1.1" 201 0
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F60%252Fc860bdc0d20efb879c653d631b3aa96b%252Fpa%252FSJ04355_5db262fdc3730c7a9cac5fa222b63237.jpg') HTTP/1.1" 204 0
2026-03-30 06:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_5db262fdc3730c7a9cac5fa222b63237.jpg saved to cache
2026-03-30 06:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dfdbf086-764f-5b34-925a-31433c103110
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6b309e50>
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfdbf086-764f-5b34-925a-31433c103110/dfdbf086-764f-5b34-925a-31433c103110_image_3.jpg HTTP/1.1" 201 0
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F60%252Fc860bdc0d20efb879c653d631b3aa96b%252Fpa%252FSJ04355_ac2066a9cfb976a81d874034b14480ef.jpg') HTTP/1.1" 204 0
2026-03-30 06:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_ac2066a9cfb976a81d874034b14480ef.jpg saved to cache
2026-03-30 06:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dfdbf086-764f-5b34-925a-31433c103110
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6b31e8d0>
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfdbf086-764f-5b34-925a-31433c103110/dfdbf086-764f-5b34-925a-31433c103110_image_7.jpg HTTP/1.1" 201 0
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F60%252Fc860bdc0d20efb879c653d631b3aa96b%252Fpa%252FSJ04355_0d6cddfac9d465f51b9029d70f95c46c.jpg') HTTP/1.1" 204 0
2026-03-30 06:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_0d6cddfac9d465f51b9029d70f95c46c.jpg saved to cache
2026-03-30 06:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dfdbf086-764f-5b34-925a-31433c103110
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6b30b490>
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfdbf086-764f-5b34-925a-31433c103110/dfdbf086-764f-5b34-925a-31433c103110_image_1.jpg HTTP/1.1" 201 0
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F60%252Fc860bdc0d20efb879c653d631b3aa96b%252Fpa%252FSJ04355_cd0dca06722fbaa4c11c83fb7585e13f.jpg') HTTP/1.1" 204 0
2026-03-30 06:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_cd0dca06722fbaa4c11c83fb7585e13f.jpg saved to cache
2026-03-30 06:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dfdbf086-764f-5b34-925a-31433c103110
2026-03-30 06:30:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6b324cd0>
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfdbf086-764f-5b34-925a-31433c103110/dfdbf086-764f-5b34-925a-31433c103110_image_4.jpg HTTP/1.1" 201 0
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F60%252Fc860bdc0d20efb879c653d631b3aa96b%252Fpa%252FSJ04355_bb8978d0b3f795a6a773197465d4f4d3.jpg') HTTP/1.1" 204 0
2026-03-30 06:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_bb8978d0b3f795a6a773197465d4f4d3.jpg saved to cache
2026-03-30 06:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dfdbf086-764f-5b34-925a-31433c103110
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6bd76410>
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfdbf086-764f-5b34-925a-31433c103110/dfdbf086-764f-5b34-925a-31433c103110_image_9.jpg HTTP/1.1" 201 0
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F60%252Fc860bdc0d20efb879c653d631b3aa96b%252Fpa%252FSJ04355_32bbad7d63b971d31b30b6480601bea1.jpg') HTTP/1.1" 204 0
2026-03-30 06:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_32bbad7d63b971d31b30b6480601bea1.jpg saved to cache
2026-03-30 06:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dfdbf086-764f-5b34-925a-31433c103110
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6be4f150>
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfdbf086-764f-5b34-925a-31433c103110/dfdbf086-764f-5b34-925a-31433c103110_image_2.jpg HTTP/1.1" 201 0
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F60%252Fc860bdc0d20efb879c653d631b3aa96b%252Fpa%252FSJ04355_cad0700faeeb2657fcb2ed5ce0706f36.jpg') HTTP/1.1" 204 0
2026-03-30 06:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_cad0700faeeb2657fcb2ed5ce0706f36.jpg saved to cache
2026-03-30 06:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dfdbf086-764f-5b34-925a-31433c103110
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6bd66510>
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:30:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfdbf086-764f-5b34-925a-31433c103110/dfdbf086-764f-5b34-925a-31433c103110_image_5.jpg HTTP/1.1" 201 0
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F60%252Fc860bdc0d20efb879c653d631b3aa96b%252Fpa%252FSJ04355_881573bff818e9e8ee9571cb54f9301f.jpg') HTTP/1.1" 204 0
2026-03-30 06:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_881573bff818e9e8ee9571cb54f9301f.jpg saved to cache
2026-03-30 06:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dfdbf086-764f-5b34-925a-31433c103110
2026-03-30 06:30:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dfdbf086-764f-5b34-925a-31433c103110, skipping ID generation
2026-03-30 06:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfdbf086-764f-5b34-925a-31433c103110 with scrape type 1
2026-03-30 06:30:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dfdbf086-764f-5b34-925a-31433c103110 sending to next pipeline
2026-03-30 06:30:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dfdbf086-764f-5b34-925a-31433c103110, identifier: SJ04355
2026-03-30 06:30:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dfdbf086-764f-5b34-925a-31433c103110 with identifier: SJ04355
2026-03-30 06:30:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dfdbf086-764f-5b34-925a-31433c103110 with identifier: SJ04355
2026-03-30 06:30:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dfdbf086-764f-5b34-925a-31433c103110 with identifier: SJ04355 to the API
2026-03-30 06:30:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_881573bff818e9e8ee9571cb54f9301f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:42:58Z',
 'fuel_type': 'petrol',
 'id': 'dfdbf086-764f-5b34-925a-31433c103110',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ04355',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 33272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfdbf086-764f-5b34-925a-31433c103110/dfdbf086-764f-5b34-925a-31433c103110_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_6338140619ce66a86efeeb64ae4aa08e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfdbf086-764f-5b34-925a-31433c103110/dfdbf086-764f-5b34-925a-31433c103110_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_cd0dca06722fbaa4c11c83fb7585e13f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfdbf086-764f-5b34-925a-31433c103110/dfdbf086-764f-5b34-925a-31433c103110_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_cad0700faeeb2657fcb2ed5ce0706f36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfdbf086-764f-5b34-925a-31433c103110/dfdbf086-764f-5b34-925a-31433c103110_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_ac2066a9cfb976a81d874034b14480ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfdbf086-764f-5b34-925a-31433c103110/dfdbf086-764f-5b34-925a-31433c103110_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_bb8978d0b3f795a6a773197465d4f4d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfdbf086-764f-5b34-925a-31433c103110/dfdbf086-764f-5b34-925a-31433c103110_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_881573bff818e9e8ee9571cb54f9301f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfdbf086-764f-5b34-925a-31433c103110/dfdbf086-764f-5b34-925a-31433c103110_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_2ece3a22306b888bae7c211dc5c83b46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfdbf086-764f-5b34-925a-31433c103110/dfdbf086-764f-5b34-925a-31433c103110_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_0d6cddfac9d465f51b9029d70f95c46c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfdbf086-764f-5b34-925a-31433c103110/dfdbf086-764f-5b34-925a-31433c103110_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_5db262fdc3730c7a9cac5fa222b63237.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfdbf086-764f-5b34-925a-31433c103110/dfdbf086-764f-5b34-925a-31433c103110_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/60/c860bdc0d20efb879c653d631b3aa96b/pa/SJ04355_32bbad7d63b971d31b30b6480601bea1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-07-17',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi A5 35 TFSI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2024}
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ04355%27 HTTP/1.1" 200 None
2026-03-30 06:30:31 [auto1.be] INFO: Saving data for SJ04355: {'created_time': 1774852231.519525, 'last_price_update_time': 1774852231.519536, 'auction_closing_time': 1774971778.0}
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SJ04355') HTTP/1.1" 204 0
2026-03-30 06:30:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VR76359> (referer: https://www.auto1.com/v1/car-details-view/VR76359/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:30:31 [auto1.be] INFO: Channel: 24h | Page: 3 | totalHits: 1288 | hits on page: 40
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: UY87343
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: MH83966
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: DE26055
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE26055%27 HTTP/1.1" 200 None
2026-03-30 06:30:31 [auto1.be] INFO: Scrape type for DE26055: 0
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: AD76625
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: ET26989
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET26989%27 HTTP/1.1" 200 None
2026-03-30 06:30:31 [auto1.be] INFO: Scrape type for ET26989: 0
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: PF75414
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF75414%27 HTTP/1.1" 200 None
2026-03-30 06:30:31 [auto1.be] INFO: Scrape type for PF75414: 0
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: WZ74297
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WZ74297%27 HTTP/1.1" 200 None
2026-03-30 06:30:31 [auto1.be] INFO: Scrape type for WZ74297: 0
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: KR32592
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KR32592%27 HTTP/1.1" 200 None
2026-03-30 06:30:31 [auto1.be] INFO: Scrape type for KR32592: 0
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: WU68692
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU68692%27 HTTP/1.1" 200 None
2026-03-30 06:30:31 [auto1.be] INFO: Scrape type for WU68692: 0
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: HX23250
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: DH89229
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: UZ99297
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: DZ79289
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: DX83468
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DX83468%27 HTTP/1.1" 200 None
2026-03-30 06:30:31 [auto1.be] INFO: Scrape type for DX83468: 0
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: ZY04103
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: EP64027
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: UR96395
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: SD20873
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD20873%27 HTTP/1.1" 200 None
2026-03-30 06:30:31 [auto1.be] INFO: Scrape type for SD20873: 0
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: EN78807
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN78807%27 HTTP/1.1" 200 None
2026-03-30 06:30:31 [auto1.be] INFO: Scrape type for EN78807: 0
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: SD10160
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: PZ32696
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: YA34487
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: RC41327
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: BL31735
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: PJ34917
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: TM16461
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: PC06950
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC06950%27 HTTP/1.1" 200 None
2026-03-30 06:30:31 [auto1.be] INFO: Scrape type for PC06950: 0
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: JN34238
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JN34238%27 HTTP/1.1" 200 None
2026-03-30 06:30:31 [auto1.be] INFO: Scrape type for JN34238: 0
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: KD33371
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: ZM02853
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: ZC87174
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC87174%27 HTTP/1.1" 200 None
2026-03-30 06:30:31 [auto1.be] INFO: Scrape type for ZC87174: 0
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: ZP04877
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: BY53413
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: GZ17047
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GZ17047%27 HTTP/1.1" 200 None
2026-03-30 06:30:31 [auto1.be] INFO: Scrape type for GZ17047: 0
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: TN87621
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TN87621%27 HTTP/1.1" 200 None
2026-03-30 06:30:31 [auto1.be] INFO: Scrape type for TN87621: 0
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: LY35485
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: DP17314
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP17314%27 HTTP/1.1" 200 None
2026-03-30 06:30:31 [auto1.be] INFO: Scrape type for DP17314: 0
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: KU68109
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: WT61211
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT61211%27 HTTP/1.1" 200 None
2026-03-30 06:30:31 [auto1.be] INFO: Scrape type for WT61211: 0
2026-03-30 06:30:31 [auto1.be] INFO: Found listing with ID: RG41014
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RG41014%27 HTTP/1.1" 200 None
2026-03-30 06:30:31 [auto1.be] INFO: Scrape type for RG41014: 0
2026-03-30 06:30:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:30:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01e12037-ca94-58bb-bb80-754232f59b7d with identifier: VR76359
2026-03-30 06:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01e12037-ca94-58bb-bb80-754232f59b7d with scrape type 1
2026-03-30 06:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 01e12037-ca94-58bb-bb80-754232f59b7d
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Ffd%252F4bfdb0f60b59479dc686ef8bc37c45c8%252Fpa%252FVR76359_750f3ba5e51f3f1baa6a70400b950c42.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/fd/4bfdb0f60b59479dc686ef8bc37c45c8/pa/VR76359_750f3ba5e51f3f1baa6a70400b950c42.jpg already downloaded
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Ffd%252F4bfdb0f60b59479dc686ef8bc37c45c8%252Fpa%252FVR76359_55f09e86607c508fe11531ae3812bb28.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/fd/4bfdb0f60b59479dc686ef8bc37c45c8/pa/VR76359_55f09e86607c508fe11531ae3812bb28.jpg already downloaded
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Ffd%252F4bfdb0f60b59479dc686ef8bc37c45c8%252Fpa%252FVR76359_9b746bda04c66c3c0e58545fda6a4dbf.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/fd/4bfdb0f60b59479dc686ef8bc37c45c8/pa/VR76359_9b746bda04c66c3c0e58545fda6a4dbf.jpg already downloaded
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Ffd%252F4bfdb0f60b59479dc686ef8bc37c45c8%252Fpa%252FVR76359_17232d3be03c01b2d954aafa24d9fe90.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/fd/4bfdb0f60b59479dc686ef8bc37c45c8/pa/VR76359_17232d3be03c01b2d954aafa24d9fe90.jpg already downloaded
2026-03-30 06:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Ffd%252F4bfdb0f60b59479dc686ef8bc37c45c8%252Fpa%252FVR76359_cd3878b174c03231ee053ee584b80a26.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/fd/4bfdb0f60b59479dc686ef8bc37c45c8/pa/VR76359_cd3878b174c03231ee053ee584b80a26.jpg already downloaded
2026-03-30 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Ffd%252F4bfdb0f60b59479dc686ef8bc37c45c8%252Fpa%252FVR76359_9bca5c6398f88ff025f53b032d1e8bb0.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/fd/4bfdb0f60b59479dc686ef8bc37c45c8/pa/VR76359_9bca5c6398f88ff025f53b032d1e8bb0.jpg already downloaded
2026-03-30 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Ffd%252F4bfdb0f60b59479dc686ef8bc37c45c8%252Fpa%252FVR76359_55705bedabd84d2055a3c8f92e9dd897.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/fd/4bfdb0f60b59479dc686ef8bc37c45c8/pa/VR76359_55705bedabd84d2055a3c8f92e9dd897.jpg already downloaded
2026-03-30 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Ffd%252F4bfdb0f60b59479dc686ef8bc37c45c8%252Fpa%252FVR76359_4669d933499a9cee54ee20a7b46ebb29.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/fd/4bfdb0f60b59479dc686ef8bc37c45c8/pa/VR76359_4669d933499a9cee54ee20a7b46ebb29.jpg already downloaded
2026-03-30 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Ffd%252F4bfdb0f60b59479dc686ef8bc37c45c8%252Fpa%252FVR76359_fa9c11cfcad9ac6a90ba9ec355e58a95.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/fd/4bfdb0f60b59479dc686ef8bc37c45c8/pa/VR76359_fa9c11cfcad9ac6a90ba9ec355e58a95.jpg already downloaded
2026-03-30 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252Ffd%252F4bfdb0f60b59479dc686ef8bc37c45c8%252Fpa%252FVR76359_19d7ffff85c2bf141cef71f4699d5c0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/fd/4bfdb0f60b59479dc686ef8bc37c45c8/pa/VR76359_19d7ffff85c2bf141cef71f4699d5c0b.jpg already downloaded
2026-03-30 06:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 01e12037-ca94-58bb-bb80-754232f59b7d, identifier: VR76359
2026-03-30 06:30:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 01e12037-ca94-58bb-bb80-754232f59b7d with identifier: VR76359
2026-03-30 06:30:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 01e12037-ca94-58bb-bb80-754232f59b7d with identifier: VR76359
2026-03-30 06:30:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 01e12037-ca94-58bb-bb80-754232f59b7d with identifier: VR76359 to the API
2026-03-30 06:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VR76359>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6D-TEMP',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:27:28Z',
 'fuel_type': 'diesel',
 'id': '01e12037-ca94-58bb-bb80-754232f59b7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR76359',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 110343,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img4b/fd/4bfdb0f60b59479dc686ef8bc37c45c8/pa/VR76359_750f3ba5e51f3f1baa6a70400b950c42.jpg',
                'https://img-pa.auto1.com/img4b/fd/4bfdb0f60b59479dc686ef8bc37c45c8/pa/VR76359_55f09e86607c508fe11531ae3812bb28.jpg',
                'https://img-pa.auto1.com/img4b/fd/4bfdb0f60b59479dc686ef8bc37c45c8/pa/VR76359_9b746bda04c66c3c0e58545fda6a4dbf.jpg',
                'https://img-pa.auto1.com/img4b/fd/4bfdb0f60b59479dc686ef8bc37c45c8/pa/VR76359_17232d3be03c01b2d954aafa24d9fe90.jpg',
                'https://img-pa.auto1.com/img4b/fd/4bfdb0f60b59479dc686ef8bc37c45c8/pa/VR76359_cd3878b174c03231ee053ee584b80a26.jpg',
                'https://img-pa.auto1.com/img4b/fd/4bfdb0f60b59479dc686ef8bc37c45c8/pa/VR76359_9bca5c6398f88ff025f53b032d1e8bb0.jpg',
                'https://img-pa.auto1.com/img4b/fd/4bfdb0f60b59479dc686ef8bc37c45c8/pa/VR76359_55705bedabd84d2055a3c8f92e9dd897.jpg',
                'https://img-pa.auto1.com/img4b/fd/4bfdb0f60b59479dc686ef8bc37c45c8/pa/VR76359_4669d933499a9cee54ee20a7b46ebb29.jpg',
                'https://img-pa.auto1.com/img4b/fd/4bfdb0f60b59479dc686ef8bc37c45c8/pa/VR76359_fa9c11cfcad9ac6a90ba9ec355e58a95.jpg',
                'https://img-pa.auto1.com/img4b/fd/4bfdb0f60b59479dc686ef8bc37c45c8/pa/VR76359_19d7ffff85c2bf141cef71f4699d5c0b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e12037-ca94-58bb-bb80-754232f59b7d/01e12037-ca94-58bb-bb80-754232f59b7d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79999,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/fd/4bfdb0f60b59479dc686ef8bc37c45c8/pa/VR76359_750f3ba5e51f3f1baa6a70400b950c42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e12037-ca94-58bb-bb80-754232f59b7d/01e12037-ca94-58bb-bb80-754232f59b7d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2684955,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/fd/4bfdb0f60b59479dc686ef8bc37c45c8/pa/VR76359_55f09e86607c508fe11531ae3812bb28.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e12037-ca94-58bb-bb80-754232f59b7d/01e12037-ca94-58bb-bb80-754232f59b7d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2400667,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/fd/4bfdb0f60b59479dc686ef8bc37c45c8/pa/VR76359_9b746bda04c66c3c0e58545fda6a4dbf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e12037-ca94-58bb-bb80-754232f59b7d/01e12037-ca94-58bb-bb80-754232f59b7d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2320830,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/fd/4bfdb0f60b59479dc686ef8bc37c45c8/pa/VR76359_17232d3be03c01b2d954aafa24d9fe90.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e12037-ca94-58bb-bb80-754232f59b7d/01e12037-ca94-58bb-bb80-754232f59b7d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2438479,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/fd/4bfdb0f60b59479dc686ef8bc37c45c8/pa/VR76359_cd3878b174c03231ee053ee584b80a26.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e12037-ca94-58bb-bb80-754232f59b7d/01e12037-ca94-58bb-bb80-754232f59b7d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2427787,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/fd/4bfdb0f60b59479dc686ef8bc37c45c8/pa/VR76359_9bca5c6398f88ff025f53b032d1e8bb0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e12037-ca94-58bb-bb80-754232f59b7d/01e12037-ca94-58bb-bb80-754232f59b7d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2545661,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/fd/4bfdb0f60b59479dc686ef8bc37c45c8/pa/VR76359_55705bedabd84d2055a3c8f92e9dd897.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e12037-ca94-58bb-bb80-754232f59b7d/01e12037-ca94-58bb-bb80-754232f59b7d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2619057,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/fd/4bfdb0f60b59479dc686ef8bc37c45c8/pa/VR76359_4669d933499a9cee54ee20a7b46ebb29.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e12037-ca94-58bb-bb80-754232f59b7d/01e12037-ca94-58bb-bb80-754232f59b7d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73999,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/fd/4bfdb0f60b59479dc686ef8bc37c45c8/pa/VR76359_fa9c11cfcad9ac6a90ba9ec355e58a95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01e12037-ca94-58bb-bb80-754232f59b7d/01e12037-ca94-58bb-bb80-754232f59b7d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/fd/4bfdb0f60b59479dc686ef8bc37c45c8/pa/VR76359_19d7ffff85c2bf141cef71f4699d5c0b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar XF 20d R-Sport',
 'transmission': 'automatic',
 'trim': 'R-Sport',
 'year': 2019}
2026-03-30 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VR76359%27 HTTP/1.1" 200 None
2026-03-30 06:30:32 [auto1.be] INFO: Saving data for VR76359: {'created_time': 1774852232.522364, 'last_price_update_time': 1774852232.52238, 'auction_closing_time': 1774970848.0}
2026-03-30 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VR76359') HTTP/1.1" 204 0
2026-03-30 06:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:30:33 [auto1.be] INFO: Channel: 24h | Page: 4 | totalHits: 1288 | hits on page: 40
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: VL25326
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: PH78267
2026-03-30 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH78267%27 HTTP/1.1" 200 None
2026-03-30 06:30:33 [auto1.be] INFO: Scrape type for PH78267: 0
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: GA47341
2026-03-30 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GA47341%27 HTTP/1.1" 200 None
2026-03-30 06:30:33 [auto1.be] INFO: Scrape type for GA47341: 0
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: NL54460
2026-03-30 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NL54460%27 HTTP/1.1" 200 None
2026-03-30 06:30:33 [auto1.be] INFO: Scrape type for NL54460: 0
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: RE30310
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: MM05603
2026-03-30 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MM05603%27 HTTP/1.1" 200 None
2026-03-30 06:30:33 [auto1.be] INFO: Scrape type for MM05603: 0
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: MT15926
2026-03-30 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MT15926%27 HTTP/1.1" 200 None
2026-03-30 06:30:33 [auto1.be] INFO: Scrape type for MT15926: 0
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: RR05667
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: RA52713
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: XY08671
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: GB86339
2026-03-30 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GB86339%27 HTTP/1.1" 200 None
2026-03-30 06:30:33 [auto1.be] INFO: Scrape type for GB86339: 0
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: PW41553
2026-03-30 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PW41553%27 HTTP/1.1" 200 None
2026-03-30 06:30:33 [auto1.be] INFO: Scrape type for PW41553: 0
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: FF69776
2026-03-30 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF69776%27 HTTP/1.1" 200 None
2026-03-30 06:30:33 [auto1.be] INFO: Scrape type for FF69776: 0
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: BY20726
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: YH64614
2026-03-30 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH64614%27 HTTP/1.1" 200 None
2026-03-30 06:30:33 [auto1.be] INFO: Scrape type for YH64614: 0
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: KF56069
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: BT87712
2026-03-30 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT87712%27 HTTP/1.1" 200 None
2026-03-30 06:30:33 [auto1.be] INFO: Scrape type for BT87712: 0
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: BV02466
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: SY52065
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: NC51382
2026-03-30 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC51382%27 HTTP/1.1" 200 None
2026-03-30 06:30:33 [auto1.be] INFO: Scrape type for NC51382: 0
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: NG60197
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: XU40393
2026-03-30 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU40393%27 HTTP/1.1" 200 None
2026-03-30 06:30:33 [auto1.be] INFO: Scrape type for XU40393: 0
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: JU27695
2026-03-30 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU27695%27 HTTP/1.1" 200 None
2026-03-30 06:30:33 [auto1.be] INFO: Scrape type for JU27695: 0
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: YR77899
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: FH50113
2026-03-30 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH50113%27 HTTP/1.1" 200 None
2026-03-30 06:30:33 [auto1.be] INFO: Scrape type for FH50113: 0
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: YU69949
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: VM31149
2026-03-30 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM31149%27 HTTP/1.1" 200 None
2026-03-30 06:30:33 [auto1.be] INFO: Scrape type for VM31149: 0
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: JC67757
2026-03-30 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC67757%27 HTTP/1.1" 200 None
2026-03-30 06:30:33 [auto1.be] INFO: Scrape type for JC67757: 0
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: UA36767
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: VE25219
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: WA86347
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: PS31946
2026-03-30 06:30:33 [auto1.be] INFO: Found listing with ID: DY35896
2026-03-30 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY35896%27 HTTP/1.1" 200 None
2026-03-30 06:30:34 [auto1.be] INFO: Scrape type for DY35896: 0
2026-03-30 06:30:34 [auto1.be] INFO: Found listing with ID: KZ95632
2026-03-30 06:30:34 [auto1.be] INFO: Found listing with ID: VM01272
2026-03-30 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM01272%27 HTTP/1.1" 200 None
2026-03-30 06:30:34 [auto1.be] INFO: Scrape type for VM01272: 0
2026-03-30 06:30:34 [auto1.be] INFO: Found listing with ID: KL42374
2026-03-30 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KL42374%27 HTTP/1.1" 200 None
2026-03-30 06:30:34 [auto1.be] INFO: Scrape type for KL42374: 0
2026-03-30 06:30:34 [auto1.be] INFO: Found listing with ID: UF75491
2026-03-30 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF75491%27 HTTP/1.1" 200 None
2026-03-30 06:30:34 [auto1.be] INFO: Scrape type for UF75491: 0
2026-03-30 06:30:34 [auto1.be] INFO: Found listing with ID: ZP25114
2026-03-30 06:30:34 [auto1.be] INFO: Found listing with ID: FP22064
2026-03-30 06:30:34 [auto1.be] INFO: Found listing with ID: EL71552
2026-03-30 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL71552%27 HTTP/1.1" 200 None
2026-03-30 06:30:34 [auto1.be] INFO: Scrape type for EL71552: 0
2026-03-30 06:30:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:30:35 [auto1.be] INFO: Channel: 24h | Page: 5 | totalHits: 1288 | hits on page: 40
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: SK78967
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK78967%27 HTTP/1.1" 200 None
2026-03-30 06:30:35 [auto1.be] INFO: Scrape type for SK78967: 0
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: TG30379
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TG30379%27 HTTP/1.1" 200 None
2026-03-30 06:30:35 [auto1.be] INFO: Scrape type for TG30379: 0
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: MX26890
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: DB21184
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB21184%27 HTTP/1.1" 200 None
2026-03-30 06:30:35 [auto1.be] INFO: Scrape type for DB21184: 0
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: ZX91910
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: LU53556
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: TT03576
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: BD95571
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: TC19196
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: EA40127
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA40127%27 HTTP/1.1" 200 None
2026-03-30 06:30:35 [auto1.be] INFO: Scrape type for EA40127: 0
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: DF78239
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF78239%27 HTTP/1.1" 200 None
2026-03-30 06:30:35 [auto1.be] INFO: Scrape type for DF78239: 0
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: CM14446
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: VE29498
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: BE62996
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BE62996%27 HTTP/1.1" 200 None
2026-03-30 06:30:35 [auto1.be] INFO: Scrape type for BE62996: 0
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: AM49333
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: EL91929
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL91929%27 HTTP/1.1" 200 None
2026-03-30 06:30:35 [auto1.be] INFO: Scrape type for EL91929: 0
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: FC05247
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: NC38410
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: LE91648
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE91648%27 HTTP/1.1" 200 None
2026-03-30 06:30:35 [auto1.be] INFO: Scrape type for LE91648: 0
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: ZZ00486
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ00486%27 HTTP/1.1" 200 None
2026-03-30 06:30:35 [auto1.be] INFO: Scrape type for ZZ00486: 0
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: TX69988
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: HK94342
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: YK14398
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK14398%27 HTTP/1.1" 200 None
2026-03-30 06:30:35 [auto1.be] INFO: Scrape type for YK14398: 0
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: FC68971
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC68971%27 HTTP/1.1" 200 None
2026-03-30 06:30:35 [auto1.be] INFO: Scrape type for FC68971: 0
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: SL05027
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: TE49371
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE49371%27 HTTP/1.1" 200 None
2026-03-30 06:30:35 [auto1.be] INFO: Scrape type for TE49371: 0
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: EK47235
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: SJ26894
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: VP06293
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: CC34063
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC34063%27 HTTP/1.1" 200 None
2026-03-30 06:30:35 [auto1.be] INFO: Scrape type for CC34063: 0
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: LD32822
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: DH17925
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: UX89863
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX89863%27 HTTP/1.1" 200 None
2026-03-30 06:30:35 [auto1.be] INFO: Scrape type for UX89863: 0
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: UX80051
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: MG99487
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: AJ87899
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AJ87899%27 HTTP/1.1" 200 None
2026-03-30 06:30:35 [auto1.be] INFO: Scrape type for AJ87899: 0
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: RL01911
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL01911%27 HTTP/1.1" 200 None
2026-03-30 06:30:35 [auto1.be] INFO: Scrape type for RL01911: 0
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: FG10633
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: KE27400
2026-03-30 06:30:35 [auto1.be] INFO: Found listing with ID: JV95971
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV95971%27 HTTP/1.1" 200 None
2026-03-30 06:30:35 [auto1.be] INFO: Scrape type for JV95971: 0
2026-03-30 06:30:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:30:36 [auto1.be] INFO: Channel: 24h | Page: 6 | totalHits: 1288 | hits on page: 40
2026-03-30 06:30:36 [auto1.be] INFO: Found listing with ID: LK25886
2026-03-30 06:30:36 [auto1.be] INFO: Found listing with ID: SB67636
2026-03-30 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB67636%27 HTTP/1.1" 200 None
2026-03-30 06:30:36 [auto1.be] INFO: Scrape type for SB67636: 0
2026-03-30 06:30:36 [auto1.be] INFO: Found listing with ID: ZU13483
2026-03-30 06:30:36 [auto1.be] INFO: Found listing with ID: CE14127
2026-03-30 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE14127%27 HTTP/1.1" 200 None
2026-03-30 06:30:36 [auto1.be] INFO: Scrape type for CE14127: 2
2026-03-30 06:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de37f07b-ab10-57cd-93e8-2b87d9aeec98 with identifier: CE14127
2026-03-30 06:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de37f07b-ab10-57cd-93e8-2b87d9aeec98 with scrape type 2
2026-03-30 06:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de37f07b-ab10-57cd-93e8-2b87d9aeec98 with scrape type 2
2026-03-30 06:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: de37f07b-ab10-57cd-93e8-2b87d9aeec98, identifier: CE14127
2026-03-30 06:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: de37f07b-ab10-57cd-93e8-2b87d9aeec98 with identifier: CE14127
2026-03-30 06:30:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: de37f07b-ab10-57cd-93e8-2b87d9aeec98 with identifier: CE14127
2026-03-30 06:30:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: de37f07b-ab10-57cd-93e8-2b87d9aeec98 with identifier: CE14127 to the API
2026-03-30 06:30:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:40:10Z',
 'fuel_type': 'diesel',
 'id': 'de37f07b-ab10-57cd-93e8-2b87d9aeec98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE14127',
 'listing': 'auction',
 'make': 'Infiniti',
 'model': 'Q30',
 'odometer': 176169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-28',
 'seller_name': None,
 'title': 'Infiniti Q30 1.5 Diesel Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2018}
2026-03-30 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE14127%27 HTTP/1.1" 200 None
2026-03-30 06:30:37 [auto1.be] INFO: Saving data for CE14127: {'auction_closing_time': 1774885210.0, 'created_time': 1774729861.020848, 'last_price_update_time': 1774852237.157413}
2026-03-30 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CE14127') HTTP/1.1" 204 0
2026-03-30 06:30:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:30:37 [auto1.be] INFO: Found listing with ID: KA88762
2026-03-30 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KA88762%27 HTTP/1.1" 200 None
2026-03-30 06:30:37 [auto1.be] INFO: Scrape type for KA88762: 0
2026-03-30 06:30:37 [auto1.be] INFO: Found listing with ID: ML65590
2026-03-30 06:30:37 [auto1.be] INFO: Found listing with ID: GG74067
2026-03-30 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG74067%27 HTTP/1.1" 200 None
2026-03-30 06:30:37 [auto1.be] INFO: Scrape type for GG74067: 2
2026-03-30 06:30:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d81d6d19-1ec9-53be-813e-e43f33ce72f3 with identifier: GG74067
2026-03-30 06:30:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d81d6d19-1ec9-53be-813e-e43f33ce72f3 with scrape type 2
2026-03-30 06:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d81d6d19-1ec9-53be-813e-e43f33ce72f3 with scrape type 2
2026-03-30 06:30:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d81d6d19-1ec9-53be-813e-e43f33ce72f3, identifier: GG74067
2026-03-30 06:30:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d81d6d19-1ec9-53be-813e-e43f33ce72f3 with identifier: GG74067
2026-03-30 06:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:30:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-30 06:30:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:30:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d81d6d19-1ec9-53be-813e-e43f33ce72f3 with identifier: GG74067
2026-03-30 06:30:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d81d6d19-1ec9-53be-813e-e43f33ce72f3 with identifier: GG74067 to the API
2026-03-30 06:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:51:36Z',
 'fuel_type': 'petrol',
 'id': 'd81d6d19-1ec9-53be-813e-e43f33ce72f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG74067',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf IV',
 'odometer': 258823,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-08-21',
 'seller_name': None,
 'title': 'Volkswagen Golf IV 1.6 Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2002}
2026-03-30 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG74067%27 HTTP/1.1" 200 None
2026-03-30 06:30:37 [auto1.be] INFO: Saving data for GG74067: {'auction_closing_time': 1774885896.0, 'created_time': 1774524730.657489, 'last_price_update_time': 1774852237.780107}
2026-03-30 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GG74067') HTTP/1.1" 204 0
2026-03-30 06:30:37 [auto1.be] INFO: Found listing with ID: HN37913
2026-03-30 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HN37913%27 HTTP/1.1" 200 None
2026-03-30 06:30:37 [auto1.be] INFO: Scrape type for HN37913: 2
2026-03-30 06:30:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9324ecf-0440-5388-a2dd-8bad776e6d54 with identifier: HN37913
2026-03-30 06:30:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9324ecf-0440-5388-a2dd-8bad776e6d54 with scrape type 2
2026-03-30 06:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9324ecf-0440-5388-a2dd-8bad776e6d54 with scrape type 2
2026-03-30 06:30:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e9324ecf-0440-5388-a2dd-8bad776e6d54, identifier: HN37913
2026-03-30 06:30:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e9324ecf-0440-5388-a2dd-8bad776e6d54 with identifier: HN37913
2026-03-30 06:30:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e9324ecf-0440-5388-a2dd-8bad776e6d54 with identifier: HN37913
2026-03-30 06:30:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e9324ecf-0440-5388-a2dd-8bad776e6d54 with identifier: HN37913 to the API
2026-03-30 06:30:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:44:22Z',
 'fuel_type': 'diesel',
 'id': 'e9324ecf-0440-5388-a2dd-8bad776e6d54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN37913',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 185513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-27',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 06:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HN37913%27 HTTP/1.1" 200 None
2026-03-30 06:30:38 [auto1.be] INFO: Saving data for HN37913: {'auction_closing_time': 1774885462.0, 'created_time': 1774729854.402623, 'last_price_update_time': 1774852238.175598}
2026-03-30 06:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HN37913') HTTP/1.1" 204 0
2026-03-30 06:30:38 [auto1.be] INFO: Found listing with ID: YU22338
2026-03-30 06:30:38 [auto1.be] INFO: Found listing with ID: SW98803
2026-03-30 06:30:38 [auto1.be] INFO: Found listing with ID: LP50838
2026-03-30 06:30:38 [auto1.be] INFO: Found listing with ID: NH43704
2026-03-30 06:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH43704%27 HTTP/1.1" 200 None
2026-03-30 06:30:38 [auto1.be] INFO: Scrape type for NH43704: 2
2026-03-30 06:30:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c164491e-6902-526a-b9d8-8e2ade1f7772 with identifier: NH43704
2026-03-30 06:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c164491e-6902-526a-b9d8-8e2ade1f7772 with scrape type 2
2026-03-30 06:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c164491e-6902-526a-b9d8-8e2ade1f7772 with scrape type 2
2026-03-30 06:30:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c164491e-6902-526a-b9d8-8e2ade1f7772, identifier: NH43704
2026-03-30 06:30:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c164491e-6902-526a-b9d8-8e2ade1f7772 with identifier: NH43704
2026-03-30 06:30:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:30:38 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-30 06:30:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:30:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c164491e-6902-526a-b9d8-8e2ade1f7772 with identifier: NH43704
2026-03-30 06:30:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c164491e-6902-526a-b9d8-8e2ade1f7772 with identifier: NH43704 to the API
2026-03-30 06:30:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:04:23Z',
 'fuel_type': 'diesel',
 'id': 'c164491e-6902-526a-b9d8-8e2ade1f7772',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH43704',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XE',
 'odometer': 135789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-12',
 'seller_name': None,
 'title': 'Jaguar XE 20d R-Sport',
 'transmission': 'automatic',
 'trim': 'R-Sport',
 'year': 2019}
2026-03-30 06:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH43704%27 HTTP/1.1" 200 None
2026-03-30 06:30:38 [auto1.be] INFO: Saving data for NH43704: {'auction_closing_time': 1774883063.0, 'created_time': 1774729859.606087, 'last_price_update_time': 1774852238.788766}
2026-03-30 06:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NH43704') HTTP/1.1" 204 0
2026-03-30 06:30:38 [auto1.be] INFO: Found listing with ID: MW29844
2026-03-30 06:30:38 [auto1.be] INFO: Found listing with ID: FH45476
2026-03-30 06:30:38 [auto1.be] INFO: Found listing with ID: NP55006
2026-03-30 06:30:38 [auto1.be] INFO: Found listing with ID: XM15621
2026-03-30 06:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM15621%27 HTTP/1.1" 200 None
2026-03-30 06:30:38 [auto1.be] INFO: Scrape type for XM15621: 2
2026-03-30 06:30:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3ff3281-a45f-5620-b4dc-65349ca69ad5 with identifier: XM15621
2026-03-30 06:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3ff3281-a45f-5620-b4dc-65349ca69ad5 with scrape type 2
2026-03-30 06:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3ff3281-a45f-5620-b4dc-65349ca69ad5 with scrape type 2
2026-03-30 06:30:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c3ff3281-a45f-5620-b4dc-65349ca69ad5, identifier: XM15621
2026-03-30 06:30:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c3ff3281-a45f-5620-b4dc-65349ca69ad5 with identifier: XM15621
2026-03-30 06:30:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c3ff3281-a45f-5620-b4dc-65349ca69ad5 with identifier: XM15621
2026-03-30 06:30:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c3ff3281-a45f-5620-b4dc-65349ca69ad5 with identifier: XM15621 to the API
2026-03-30 06:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:51:50Z',
 'fuel_type': 'petrol',
 'id': 'c3ff3281-a45f-5620-b4dc-65349ca69ad5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM15621',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 159447,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-11',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2016}
2026-03-30 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM15621%27 HTTP/1.1" 200 None
2026-03-30 06:30:39 [auto1.be] INFO: Saving data for XM15621: {'auction_closing_time': 1774885910.0, 'created_time': 1774729860.36308, 'last_price_update_time': 1774852239.206986}
2026-03-30 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XM15621') HTTP/1.1" 204 0
2026-03-30 06:30:39 [auto1.be] INFO: Found listing with ID: DP40243
2026-03-30 06:30:39 [auto1.be] INFO: Found listing with ID: BR63185
2026-03-30 06:30:39 [auto1.be] INFO: Found listing with ID: FM14350
2026-03-30 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM14350%27 HTTP/1.1" 200 None
2026-03-30 06:30:39 [auto1.be] INFO: Scrape type for FM14350: 2
2026-03-30 06:30:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f40c52f4-51c8-5099-8944-beef9d168590 with identifier: FM14350
2026-03-30 06:30:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f40c52f4-51c8-5099-8944-beef9d168590 with scrape type 2
2026-03-30 06:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f40c52f4-51c8-5099-8944-beef9d168590 with scrape type 2
2026-03-30 06:30:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f40c52f4-51c8-5099-8944-beef9d168590, identifier: FM14350
2026-03-30 06:30:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f40c52f4-51c8-5099-8944-beef9d168590 with identifier: FM14350
2026-03-30 06:30:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f40c52f4-51c8-5099-8944-beef9d168590 with identifier: FM14350
2026-03-30 06:30:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f40c52f4-51c8-5099-8944-beef9d168590 with identifier: FM14350 to the API
2026-03-30 06:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:06:46Z',
 'fuel_type': 'petrol',
 'id': 'f40c52f4-51c8-5099-8944-beef9d168590',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM14350',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 99721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-30',
 'seller_name': None,
 'title': 'Renault Scenic 1.3 TCe Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2021}
2026-03-30 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM14350%27 HTTP/1.1" 200 None
2026-03-30 06:30:39 [auto1.be] INFO: Saving data for FM14350: {'auction_closing_time': 1774883206.0, 'created_time': 1774729860.001915, 'last_price_update_time': 1774852239.692787}
2026-03-30 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FM14350') HTTP/1.1" 204 0
2026-03-30 06:30:39 [auto1.be] INFO: Found listing with ID: WL66260
2026-03-30 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL66260%27 HTTP/1.1" 200 None
2026-03-30 06:30:39 [auto1.be] INFO: Scrape type for WL66260: 2
2026-03-30 06:30:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a393945-1faf-5eaf-8ffe-42dbeb9e37fc with identifier: WL66260
2026-03-30 06:30:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a393945-1faf-5eaf-8ffe-42dbeb9e37fc with scrape type 2
2026-03-30 06:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a393945-1faf-5eaf-8ffe-42dbeb9e37fc with scrape type 2
2026-03-30 06:30:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8a393945-1faf-5eaf-8ffe-42dbeb9e37fc, identifier: WL66260
2026-03-30 06:30:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8a393945-1faf-5eaf-8ffe-42dbeb9e37fc with identifier: WL66260
2026-03-30 06:30:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8a393945-1faf-5eaf-8ffe-42dbeb9e37fc with identifier: WL66260
2026-03-30 06:30:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8a393945-1faf-5eaf-8ffe-42dbeb9e37fc with identifier: WL66260 to the API
2026-03-30 06:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:59:05Z',
 'fuel_type': 'petrol',
 'id': '8a393945-1faf-5eaf-8ffe-42dbeb9e37fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL66260',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 89953,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-06',
 'seller_name': None,
 'title': 'Dacia Duster 1.6 SCe Essential',
 'transmission': 'manual',
 'trim': 'Essential',
 'year': 2019}
2026-03-30 06:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL66260%27 HTTP/1.1" 200 None
2026-03-30 06:30:40 [auto1.be] INFO: Saving data for WL66260: {'auction_closing_time': 1774886345.0, 'created_time': 1774038883.617994, 'last_price_update_time': 1774852240.072637}
2026-03-30 06:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WL66260') HTTP/1.1" 204 0
2026-03-30 06:30:40 [auto1.be] INFO: Found listing with ID: FY63763
2026-03-30 06:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY63763%27 HTTP/1.1" 200 None
2026-03-30 06:30:40 [auto1.be] INFO: Scrape type for FY63763: 2
2026-03-30 06:30:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f0f3674-2922-5e79-8394-cf919c44c6fa with identifier: FY63763
2026-03-30 06:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f0f3674-2922-5e79-8394-cf919c44c6fa with scrape type 2
2026-03-30 06:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f0f3674-2922-5e79-8394-cf919c44c6fa with scrape type 2
2026-03-30 06:30:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0f0f3674-2922-5e79-8394-cf919c44c6fa, identifier: FY63763
2026-03-30 06:30:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0f0f3674-2922-5e79-8394-cf919c44c6fa with identifier: FY63763
2026-03-30 06:30:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0f0f3674-2922-5e79-8394-cf919c44c6fa with identifier: FY63763
2026-03-30 06:30:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0f0f3674-2922-5e79-8394-cf919c44c6fa with identifier: FY63763 to the API
2026-03-30 06:30:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:54:43Z',
 'fuel_type': 'diesel',
 'id': '0f0f3674-2922-5e79-8394-cf919c44c6fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY63763',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 61964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-05',
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi EcoBlue 320 L2 Limited',
 'transmission': 'automatic',
 'trim': '320 L2 Limited',
 'year': 2024}
2026-03-30 06:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY63763%27 HTTP/1.1" 200 None
2026-03-30 06:30:40 [auto1.be] INFO: Saving data for FY63763: {'auction_closing_time': 1774886083.0, 'created_time': 1774729860.688051, 'last_price_update_time': 1774852240.466422}
2026-03-30 06:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FY63763') HTTP/1.1" 204 0
2026-03-30 06:30:40 [auto1.be] INFO: Found listing with ID: CD50133
2026-03-30 06:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD50133%27 HTTP/1.1" 200 None
2026-03-30 06:30:40 [auto1.be] INFO: Scrape type for CD50133: 2
2026-03-30 06:30:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d21bff88-00bb-56a4-8c83-1c3504b09287 with identifier: CD50133
2026-03-30 06:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d21bff88-00bb-56a4-8c83-1c3504b09287 with scrape type 2
2026-03-30 06:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d21bff88-00bb-56a4-8c83-1c3504b09287 with scrape type 2
2026-03-30 06:30:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d21bff88-00bb-56a4-8c83-1c3504b09287, identifier: CD50133
2026-03-30 06:30:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d21bff88-00bb-56a4-8c83-1c3504b09287 with identifier: CD50133
2026-03-30 06:30:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d21bff88-00bb-56a4-8c83-1c3504b09287 with identifier: CD50133
2026-03-30 06:30:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d21bff88-00bb-56a4-8c83-1c3504b09287 with identifier: CD50133 to the API
2026-03-30 06:30:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:43:32Z',
 'fuel_type': 'diesel',
 'id': 'd21bff88-00bb-56a4-8c83-1c3504b09287',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD50133',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 205000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-09',
 'seller_name': None,
 'title': 'Audi A3 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2010}
2026-03-30 06:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD50133%27 HTTP/1.1" 200 None
2026-03-30 06:30:40 [auto1.be] INFO: Saving data for CD50133: {'auction_closing_time': 1774885412.0, 'created_time': 1774002047.819883, 'last_price_update_time': 1774852240.868477}
2026-03-30 06:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CD50133') HTTP/1.1" 204 0
2026-03-30 06:30:40 [auto1.be] INFO: Found listing with ID: SZ16034
2026-03-30 06:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ16034%27 HTTP/1.1" 200 None
2026-03-30 06:30:40 [auto1.be] INFO: Scrape type for SZ16034: 2
2026-03-30 06:30:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f09987ab-24b8-5363-864a-9fd243afa5e9 with identifier: SZ16034
2026-03-30 06:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f09987ab-24b8-5363-864a-9fd243afa5e9 with scrape type 2
2026-03-30 06:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f09987ab-24b8-5363-864a-9fd243afa5e9 with scrape type 2
2026-03-30 06:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f09987ab-24b8-5363-864a-9fd243afa5e9, identifier: SZ16034
2026-03-30 06:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:30:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KD38906> (referer: https://www.auto1.com/v1/car-details-view/KD38906/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:30:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f09987ab-24b8-5363-864a-9fd243afa5e9 with identifier: SZ16034
2026-03-30 06:30:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f09987ab-24b8-5363-864a-9fd243afa5e9 with identifier: SZ16034
2026-03-30 06:30:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f09987ab-24b8-5363-864a-9fd243afa5e9 with identifier: SZ16034 to the API
2026-03-30 06:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:21:08Z',
 'fuel_type': 'diesel',
 'id': 'f09987ab-24b8-5363-864a-9fd243afa5e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ16034',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 218325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-09',
 'seller_name': None,
 'title': 'Audi A5 Sportback 3.0 V6 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-30 06:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ16034%27 HTTP/1.1" 200 None
2026-03-30 06:30:41 [auto1.be] INFO: Saving data for SZ16034: {'auction_closing_time': 1774884068.0, 'created_time': 1774729863.315397, 'last_price_update_time': 1774852241.316633}
2026-03-30 06:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SZ16034') HTTP/1.1" 204 0
2026-03-30 06:30:41 [auto1.be] INFO: Found listing with ID: FP25504
2026-03-30 06:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP25504%27 HTTP/1.1" 200 None
2026-03-30 06:30:41 [auto1.be] INFO: Scrape type for FP25504: 2
2026-03-30 06:30:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7 with identifier: FP25504
2026-03-30 06:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7 with scrape type 2
2026-03-30 06:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7 with scrape type 2
2026-03-30 06:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7, identifier: FP25504
2026-03-30 06:30:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7 with identifier: FP25504
2026-03-30 06:30:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7 with identifier: FP25504
2026-03-30 06:30:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7 with identifier: FP25504 to the API
2026-03-30 06:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-30T15:50:50Z',
 'fuel_type': 'petrol',
 'id': '24085bd3-4bff-5ca7-9c5e-82dc2a18a3b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP25504',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 148752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-28',
 'seller_name': None,
 'title': 'BMW 4er 430i Gran Coupé xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2018}
2026-03-30 06:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP25504%27 HTTP/1.1" 200 None
2026-03-30 06:30:41 [auto1.be] INFO: Saving data for FP25504: {'auction_closing_time': 1774885850.0, 'created_time': 1774729885.879155, 'last_price_update_time': 1774852241.694679}
2026-03-30 06:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FP25504') HTTP/1.1" 204 0
2026-03-30 06:30:41 [auto1.be] INFO: Found listing with ID: BX88810
2026-03-30 06:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX88810%27 HTTP/1.1" 200 None
2026-03-30 06:30:41 [auto1.be] INFO: Scrape type for BX88810: 2
2026-03-30 06:30:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe with identifier: BX88810
2026-03-30 06:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe with scrape type 2
2026-03-30 06:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe with scrape type 2
2026-03-30 06:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe, identifier: BX88810
2026-03-30 06:30:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe with identifier: BX88810
2026-03-30 06:30:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe with identifier: BX88810
2026-03-30 06:30:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe with identifier: BX88810 to the API
2026-03-30 06:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:43:40Z',
 'fuel_type': 'diesel',
 'id': 'a026c8e0-cc25-54ba-a9d8-5c00c8d40dfe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX88810',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 170628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-02',
 'seller_name': None,
 'title': 'Renault Scenic 1.5 dCi Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2016}
2026-03-30 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX88810%27 HTTP/1.1" 200 None
2026-03-30 06:30:42 [auto1.be] INFO: Saving data for BX88810: {'auction_closing_time': 1774885420.0, 'created_time': 1774729865.811073, 'last_price_update_time': 1774852242.104162}
2026-03-30 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BX88810') HTTP/1.1" 204 0
2026-03-30 06:30:42 [auto1.be] INFO: Channel: 24h | Page: 7 | totalHits: 1288 | hits on page: 40
2026-03-30 06:30:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 078a7e87-9a9b-521d-9d32-7327beb33078 with identifier: KD38906
2026-03-30 06:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 078a7e87-9a9b-521d-9d32-7327beb33078 with scrape type 1
2026-03-30 06:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 078a7e87-9a9b-521d-9d32-7327beb33078
2026-03-30 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb6%252F63b6754edbf17a20dac9efdd33d45543%252Fpa%252FKD38906_9714e4f86fb3e1600a7cd2af63cb06c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_9714e4f86fb3e1600a7cd2af63cb06c1.jpg not downloaded yet
2026-03-30 06:30:42 [auto1.be] INFO: Found listing with ID: EJ45470
2026-03-30 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ45470%27 HTTP/1.1" 200 None
2026-03-30 06:30:42 [auto1.be] INFO: Scrape type for EJ45470: 0
2026-03-30 06:30:42 [auto1.be] INFO: Found listing with ID: AK19302
2026-03-30 06:30:42 [auto1.be] INFO: Found listing with ID: EZ00027
2026-03-30 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ00027%27 HTTP/1.1" 200 None
2026-03-30 06:30:42 [auto1.be] INFO: Scrape type for EZ00027: 2
2026-03-30 06:30:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c56a1ff-25c9-5901-90d0-0b81ecd53dd0 with identifier: EZ00027
2026-03-30 06:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c56a1ff-25c9-5901-90d0-0b81ecd53dd0 with scrape type 2
2026-03-30 06:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c56a1ff-25c9-5901-90d0-0b81ecd53dd0 with scrape type 2
2026-03-30 06:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2c56a1ff-25c9-5901-90d0-0b81ecd53dd0, identifier: EZ00027
2026-03-30 06:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2c56a1ff-25c9-5901-90d0-0b81ecd53dd0 with identifier: EZ00027
2026-03-30 06:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2c56a1ff-25c9-5901-90d0-0b81ecd53dd0 with identifier: EZ00027
2026-03-30 06:30:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2c56a1ff-25c9-5901-90d0-0b81ecd53dd0 with identifier: EZ00027 to the API
2026-03-30 06:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:09:03Z',
 'fuel_type': 'diesel',
 'id': '2c56a1ff-25c9-5901-90d0-0b81ecd53dd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ00027',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 207990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-25',
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ00027%27 HTTP/1.1" 200 None
2026-03-30 06:30:42 [auto1.be] INFO: Saving data for EZ00027: {'auction_closing_time': 1774883343.0, 'created_time': 1774038883.957366, 'last_price_update_time': 1774852242.750121}
2026-03-30 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EZ00027') HTTP/1.1" 204 0
2026-03-30 06:30:42 [auto1.be] INFO: Found listing with ID: JS18374
2026-03-30 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS18374%27 HTTP/1.1" 200 None
2026-03-30 06:30:42 [auto1.be] INFO: Scrape type for JS18374: 0
2026-03-30 06:30:42 [auto1.be] INFO: Found listing with ID: YW00445
2026-03-30 06:30:42 [auto1.be] INFO: Found listing with ID: TX45109
2026-03-30 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX45109%27 HTTP/1.1" 200 None
2026-03-30 06:30:42 [auto1.be] INFO: Scrape type for TX45109: 2
2026-03-30 06:30:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f880e35c-93a2-5ccb-9448-eea535ac0528 with identifier: TX45109
2026-03-30 06:30:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f880e35c-93a2-5ccb-9448-eea535ac0528 with scrape type 2
2026-03-30 06:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f880e35c-93a2-5ccb-9448-eea535ac0528 with scrape type 2
2026-03-30 06:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f880e35c-93a2-5ccb-9448-eea535ac0528, identifier: TX45109
2026-03-30 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb6%252F63b6754edbf17a20dac9efdd33d45543%252Fpa%252FKD38906_854cd041386d218ce98b29298ceaaa97.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_854cd041386d218ce98b29298ceaaa97.jpg not downloaded yet
2026-03-30 06:30:42 [auto1.be] INFO: Found listing with ID: PD85961
2026-03-30 06:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD85961%27 HTTP/1.1" 200 None
2026-03-30 06:30:43 [auto1.be] INFO: Scrape type for PD85961: 2
2026-03-30 06:30:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fca1d837-7e58-5fe3-ad3b-bf418902878e with identifier: PD85961
2026-03-30 06:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fca1d837-7e58-5fe3-ad3b-bf418902878e with scrape type 2
2026-03-30 06:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fca1d837-7e58-5fe3-ad3b-bf418902878e with scrape type 2
2026-03-30 06:30:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fca1d837-7e58-5fe3-ad3b-bf418902878e, identifier: PD85961
2026-03-30 06:30:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f880e35c-93a2-5ccb-9448-eea535ac0528 with identifier: TX45109
2026-03-30 06:30:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f880e35c-93a2-5ccb-9448-eea535ac0528 with identifier: TX45109
2026-03-30 06:30:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f880e35c-93a2-5ccb-9448-eea535ac0528 with identifier: TX45109 to the API
2026-03-30 06:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:42:03Z',
 'fuel_type': 'diesel',
 'id': 'f880e35c-93a2-5ccb-9448-eea535ac0528',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX45109',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 278573,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-22',
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 e-HDi Business-Line',
 'transmission': 'automatic',
 'trim': 'Business-Line',
 'year': 2013}
2026-03-30 06:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX45109%27 HTTP/1.1" 200 None
2026-03-30 06:30:43 [auto1.be] INFO: Saving data for TX45109: {'auction_closing_time': 1774885323.0, 'created_time': 1774729868.051442, 'last_price_update_time': 1774852243.465308}
2026-03-30 06:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TX45109') HTTP/1.1" 204 0
2026-03-30 06:30:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:30:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fca1d837-7e58-5fe3-ad3b-bf418902878e with identifier: PD85961
2026-03-30 06:30:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fca1d837-7e58-5fe3-ad3b-bf418902878e with identifier: PD85961
2026-03-30 06:30:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fca1d837-7e58-5fe3-ad3b-bf418902878e with identifier: PD85961 to the API
2026-03-30 06:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:56:58Z',
 'fuel_type': 'diesel',
 'id': 'fca1d837-7e58-5fe3-ad3b-bf418902878e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD85961',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 168820,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-10',
 'seller_name': None,
 'title': 'Kia Sportage 1.7 CRDi Edition 7 2WD',
 'transmission': 'manual',
 'trim': 'Edition 7 2WD',
 'year': 2017}
2026-03-30 06:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD85961%27 HTTP/1.1" 200 None
2026-03-30 06:30:43 [auto1.be] INFO: Saving data for PD85961: {'auction_closing_time': 1774886218.0, 'created_time': 1774729861.729906, 'last_price_update_time': 1774852243.835839}
2026-03-30 06:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PD85961') HTTP/1.1" 204 0
2026-03-30 06:30:43 [auto1.be] INFO: Found listing with ID: JD01885
2026-03-30 06:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JD01885%27 HTTP/1.1" 200 None
2026-03-30 06:30:43 [auto1.be] INFO: Scrape type for JD01885: 2
2026-03-30 06:30:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7aadd58-ffec-5042-90af-62accda44cb4 with identifier: JD01885
2026-03-30 06:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7aadd58-ffec-5042-90af-62accda44cb4 with scrape type 2
2026-03-30 06:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7aadd58-ffec-5042-90af-62accda44cb4 with scrape type 2
2026-03-30 06:30:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b7aadd58-ffec-5042-90af-62accda44cb4, identifier: JD01885
2026-03-30 06:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb6%252F63b6754edbf17a20dac9efdd33d45543%252Fpa%252FKD38906_d1c3844feab7a06a1d717665b6d21f8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_d1c3844feab7a06a1d717665b6d21f8b.jpg not downloaded yet
2026-03-30 06:30:43 [auto1.be] INFO: Found listing with ID: NR82041
2026-03-30 06:30:43 [auto1.be] INFO: Found listing with ID: HU84368
2026-03-30 06:30:43 [auto1.be] INFO: Found listing with ID: CC85070
2026-03-30 06:30:43 [auto1.be] INFO: Found listing with ID: EA25293
2026-03-30 06:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA25293%27 HTTP/1.1" 200 None
2026-03-30 06:30:43 [auto1.be] INFO: Scrape type for EA25293: 2
2026-03-30 06:30:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48cb7c2b-fc61-55e8-8315-8bc240ab5aae with identifier: EA25293
2026-03-30 06:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48cb7c2b-fc61-55e8-8315-8bc240ab5aae with scrape type 2
2026-03-30 06:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48cb7c2b-fc61-55e8-8315-8bc240ab5aae with scrape type 2
2026-03-30 06:30:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 48cb7c2b-fc61-55e8-8315-8bc240ab5aae, identifier: EA25293
2026-03-30 06:30:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b7aadd58-ffec-5042-90af-62accda44cb4 with identifier: JD01885
2026-03-30 06:30:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b7aadd58-ffec-5042-90af-62accda44cb4 with identifier: JD01885
2026-03-30 06:30:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b7aadd58-ffec-5042-90af-62accda44cb4 with identifier: JD01885 to the API
2026-03-30 06:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:47:25Z',
 'fuel_type': 'diesel',
 'id': 'b7aadd58-ffec-5042-90af-62accda44cb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD01885',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-05',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Business-Line',
 'transmission': 'manual',
 'trim': 'Business-Line',
 'year': 2016}
2026-03-30 06:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JD01885%27 HTTP/1.1" 200 None
2026-03-30 06:30:44 [auto1.be] INFO: Saving data for JD01885: {'auction_closing_time': 1774885645.0, 'created_time': 1774643437.267415, 'last_price_update_time': 1774852244.340007}
2026-03-30 06:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JD01885') HTTP/1.1" 204 0
2026-03-30 06:30:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 48cb7c2b-fc61-55e8-8315-8bc240ab5aae with identifier: EA25293
2026-03-30 06:30:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 48cb7c2b-fc61-55e8-8315-8bc240ab5aae with identifier: EA25293
2026-03-30 06:30:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 48cb7c2b-fc61-55e8-8315-8bc240ab5aae with identifier: EA25293 to the API
2026-03-30 06:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:14:52Z',
 'fuel_type': 'petrol',
 'id': '48cb7c2b-fc61-55e8-8315-8bc240ab5aae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA25293',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 123744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-03',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2026-03-30 06:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EA25293%27 HTTP/1.1" 200 None
2026-03-30 06:30:44 [auto1.be] INFO: Saving data for EA25293: {'auction_closing_time': 1774883692.0, 'created_time': 1774643618.56467, 'last_price_update_time': 1774852244.619438}
2026-03-30 06:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EA25293') HTTP/1.1" 204 0
2026-03-30 06:30:44 [auto1.be] INFO: Found listing with ID: GK88228
2026-03-30 06:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GK88228%27 HTTP/1.1" 200 None
2026-03-30 06:30:44 [auto1.be] INFO: Scrape type for GK88228: 2
2026-03-30 06:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bc2d3e3-70d3-5d5b-8bf5-5399b0c47c53 with identifier: GK88228
2026-03-30 06:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bc2d3e3-70d3-5d5b-8bf5-5399b0c47c53 with scrape type 2
2026-03-30 06:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bc2d3e3-70d3-5d5b-8bf5-5399b0c47c53 with scrape type 2
2026-03-30 06:30:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2bc2d3e3-70d3-5d5b-8bf5-5399b0c47c53, identifier: GK88228
2026-03-30 06:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb6%252F63b6754edbf17a20dac9efdd33d45543%252Fpa%252FKD38906_67acbd5ec179eaf193cb6e2a83c3566b.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_67acbd5ec179eaf193cb6e2a83c3566b.jpg not downloaded yet
2026-03-30 06:30:44 [auto1.be] INFO: Found listing with ID: KE26750
2026-03-30 06:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE26750%27 HTTP/1.1" 200 None
2026-03-30 06:30:44 [auto1.be] INFO: Scrape type for KE26750: 0
2026-03-30 06:30:44 [auto1.be] INFO: Found listing with ID: SP00889
2026-03-30 06:30:44 [auto1.be] INFO: Found listing with ID: XU03064
2026-03-30 06:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU03064%27 HTTP/1.1" 200 None
2026-03-30 06:30:44 [auto1.be] INFO: Scrape type for XU03064: 0
2026-03-30 06:30:44 [auto1.be] INFO: Found listing with ID: SR49598
2026-03-30 06:30:44 [auto1.be] INFO: Found listing with ID: NN99297
2026-03-30 06:30:44 [auto1.be] INFO: Found listing with ID: UX94260
2026-03-30 06:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX94260%27 HTTP/1.1" 200 None
2026-03-30 06:30:44 [auto1.be] INFO: Scrape type for UX94260: 0
2026-03-30 06:30:44 [auto1.be] INFO: Found listing with ID: YW61664
2026-03-30 06:30:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2bc2d3e3-70d3-5d5b-8bf5-5399b0c47c53 with identifier: GK88228
2026-03-30 06:30:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2bc2d3e3-70d3-5d5b-8bf5-5399b0c47c53 with identifier: GK88228
2026-03-30 06:30:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2bc2d3e3-70d3-5d5b-8bf5-5399b0c47c53 with identifier: GK88228 to the API
2026-03-30 06:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:28:14Z',
 'fuel_type': 'petrol',
 'id': '2bc2d3e3-70d3-5d5b-8bf5-5399b0c47c53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK88228',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 161920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-10',
 'seller_name': None,
 'title': 'BMW 4er 420i Gran Coupé M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-30 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GK88228%27 HTTP/1.1" 200 None
2026-03-30 06:30:45 [auto1.be] INFO: Saving data for GK88228: {'auction_closing_time': 1774884494.0, 'created_time': 1773390869.438716, 'last_price_update_time': 1774852245.107075}
2026-03-30 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GK88228') HTTP/1.1" 204 0
2026-03-30 06:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_9714e4f86fb3e1600a7cd2af63cb06c1.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:30:45 [auto1.be] INFO: Found listing with ID: XZ48466
2026-03-30 06:30:45 [auto1.be] INFO: Found listing with ID: RP30975
2026-03-30 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RP30975%27 HTTP/1.1" 200 None
2026-03-30 06:30:45 [auto1.be] INFO: Scrape type for RP30975: 0
2026-03-30 06:30:45 [auto1.be] INFO: Found listing with ID: DW61635
2026-03-30 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW61635%27 HTTP/1.1" 200 None
2026-03-30 06:30:45 [auto1.be] INFO: Scrape type for DW61635: 0
2026-03-30 06:30:45 [auto1.be] INFO: Found listing with ID: TV92859
2026-03-30 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV92859%27 HTTP/1.1" 200 None
2026-03-30 06:30:45 [auto1.be] INFO: Scrape type for TV92859: 0
2026-03-30 06:30:45 [auto1.be] INFO: Found listing with ID: XZ54371
2026-03-30 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ54371%27 HTTP/1.1" 200 None
2026-03-30 06:30:45 [auto1.be] INFO: Scrape type for XZ54371: 0
2026-03-30 06:30:45 [auto1.be] INFO: Found listing with ID: BT09121
2026-03-30 06:30:45 [auto1.be] INFO: Found listing with ID: GT11330
2026-03-30 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GT11330%27 HTTP/1.1" 200 None
2026-03-30 06:30:45 [auto1.be] INFO: Scrape type for GT11330: 2
2026-03-30 06:30:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bad3d40-207e-5f55-b53a-295eede7508c with identifier: GT11330
2026-03-30 06:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bad3d40-207e-5f55-b53a-295eede7508c with scrape type 2
2026-03-30 06:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bad3d40-207e-5f55-b53a-295eede7508c with scrape type 2
2026-03-30 06:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0bad3d40-207e-5f55-b53a-295eede7508c, identifier: GT11330
2026-03-30 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb6%252F63b6754edbf17a20dac9efdd33d45543%252Fpa%252FKD38906_80624ec7d0845e026d9254af6a759f42.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_80624ec7d0845e026d9254af6a759f42.jpg not downloaded yet
2026-03-30 06:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_854cd041386d218ce98b29298ceaaa97.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0bad3d40-207e-5f55-b53a-295eede7508c with identifier: GT11330
2026-03-30 06:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:30:45 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-30 06:30:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0bad3d40-207e-5f55-b53a-295eede7508c with identifier: GT11330
2026-03-30 06:30:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0bad3d40-207e-5f55-b53a-295eede7508c with identifier: GT11330 to the API
2026-03-30 06:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:18:04Z',
 'fuel_type': 'petrol',
 'id': '0bad3d40-207e-5f55-b53a-295eede7508c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT11330',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'forfour',
 'odometer': 128631,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-10-03',
 'seller_name': None,
 'title': 'Smart forfour 1.5 Basis passion',
 'transmission': 'manual',
 'trim': 'Basis passion',
 'year': 2004}
2026-03-30 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GT11330%27 HTTP/1.1" 200 None
2026-03-30 06:30:45 [auto1.be] INFO: Saving data for GT11330: {'auction_closing_time': 1774883884.0, 'created_time': 1773226265.57557, 'last_price_update_time': 1774852245.920546}
2026-03-30 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GT11330') HTTP/1.1" 204 0
2026-03-30 06:30:45 [auto1.be] INFO: Found listing with ID: CX99155
2026-03-30 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX99155%27 HTTP/1.1" 200 None
2026-03-30 06:30:45 [auto1.be] INFO: Scrape type for CX99155: 2
2026-03-30 06:30:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07109768-a8fd-50b0-91e3-aeb2061c4d22 with identifier: CX99155
2026-03-30 06:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07109768-a8fd-50b0-91e3-aeb2061c4d22 with scrape type 2
2026-03-30 06:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07109768-a8fd-50b0-91e3-aeb2061c4d22 with scrape type 2
2026-03-30 06:30:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 07109768-a8fd-50b0-91e3-aeb2061c4d22, identifier: CX99155
2026-03-30 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb6%252F63b6754edbf17a20dac9efdd33d45543%252Fpa%252FKD38906_1bff09479bf0a3309c3a3151f16bd944.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_1bff09479bf0a3309c3a3151f16bd944.jpg not downloaded yet
2026-03-30 06:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_d1c3844feab7a06a1d717665b6d21f8b.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 07109768-a8fd-50b0-91e3-aeb2061c4d22 with identifier: CX99155
2026-03-30 06:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:30:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-30 06:30:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 07109768-a8fd-50b0-91e3-aeb2061c4d22 with identifier: CX99155
2026-03-30 06:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 07109768-a8fd-50b0-91e3-aeb2061c4d22 with identifier: CX99155 to the API
2026-03-30 06:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:07:49Z',
 'fuel_type': 'diesel',
 'id': '07109768-a8fd-50b0-91e3-aeb2061c4d22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX99155',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 230408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-04',
 'seller_name': None,
 'title': 'Dacia Sandero 1.5 dCi Laureate',
 'transmission': 'manual',
 'trim': 'Laureate',
 'year': 2013}
2026-03-30 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX99155%27 HTTP/1.1" 200 None
2026-03-30 06:30:46 [auto1.be] INFO: Saving data for CX99155: {'auction_closing_time': 1774883269.0, 'created_time': 1774643610.708655, 'last_price_update_time': 1774852246.4455}
2026-03-30 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CX99155') HTTP/1.1" 204 0
2026-03-30 06:30:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:30:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6b301290>
2026-03-30 06:30:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:30:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:30:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_078a7e87-9a9b-521d-9d32-7327beb33078/078a7e87-9a9b-521d-9d32-7327beb33078_image_0.jpg HTTP/1.1" 201 0
2026-03-30 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb6%252F63b6754edbf17a20dac9efdd33d45543%252Fpa%252FKD38906_9714e4f86fb3e1600a7cd2af63cb06c1.jpg') HTTP/1.1" 204 0
2026-03-30 06:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_9714e4f86fb3e1600a7cd2af63cb06c1.jpg saved to cache
2026-03-30 06:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 078a7e87-9a9b-521d-9d32-7327beb33078
2026-03-30 06:30:46 [auto1.be] INFO: Found listing with ID: CX21788
2026-03-30 06:30:46 [auto1.be] INFO: Found listing with ID: WE70666
2026-03-30 06:30:46 [auto1.be] INFO: Found listing with ID: KX60472
2026-03-30 06:30:46 [auto1.be] INFO: Found listing with ID: LZ48262
2026-03-30 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LZ48262%27 HTTP/1.1" 200 None
2026-03-30 06:30:46 [auto1.be] INFO: Scrape type for LZ48262: 2
2026-03-30 06:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a640e348-1bde-5834-9365-38be7c082299 with identifier: LZ48262
2026-03-30 06:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a640e348-1bde-5834-9365-38be7c082299 with scrape type 2
2026-03-30 06:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a640e348-1bde-5834-9365-38be7c082299 with scrape type 2
2026-03-30 06:30:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a640e348-1bde-5834-9365-38be7c082299, identifier: LZ48262
2026-03-30 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb6%252F63b6754edbf17a20dac9efdd33d45543%252Fpa%252FKD38906_882005b00ac31d9fd72a115a05a3614d.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_882005b00ac31d9fd72a115a05a3614d.jpg not downloaded yet
2026-03-30 06:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_67acbd5ec179eaf193cb6e2a83c3566b.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a640e348-1bde-5834-9365-38be7c082299 with identifier: LZ48262
2026-03-30 06:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a640e348-1bde-5834-9365-38be7c082299 with identifier: LZ48262
2026-03-30 06:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a640e348-1bde-5834-9365-38be7c082299 with identifier: LZ48262 to the API
2026-03-30 06:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:24:01Z',
 'fuel_type': 'petrol',
 'id': 'a640e348-1bde-5834-9365-38be7c082299',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ48262',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 41785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-14',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech YOU',
 'transmission': 'manual',
 'trim': 'YOU',
 'year': 2024}
2026-03-30 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LZ48262%27 HTTP/1.1" 200 None
2026-03-30 06:30:46 [auto1.be] INFO: Saving data for LZ48262: {'auction_closing_time': 1774884241.0, 'created_time': 1773301711.523556, 'last_price_update_time': 1774852246.914106}
2026-03-30 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LZ48262') HTTP/1.1" 204 0
2026-03-30 06:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6bcb89d0>
2026-03-30 06:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_078a7e87-9a9b-521d-9d32-7327beb33078/078a7e87-9a9b-521d-9d32-7327beb33078_image_1.jpg HTTP/1.1" 201 0
2026-03-30 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb6%252F63b6754edbf17a20dac9efdd33d45543%252Fpa%252FKD38906_854cd041386d218ce98b29298ceaaa97.jpg') HTTP/1.1" 204 0
2026-03-30 06:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_854cd041386d218ce98b29298ceaaa97.jpg saved to cache
2026-03-30 06:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 078a7e87-9a9b-521d-9d32-7327beb33078
2026-03-30 06:30:47 [auto1.be] INFO: Found listing with ID: HS59761
2026-03-30 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS59761%27 HTTP/1.1" 200 None
2026-03-30 06:30:47 [auto1.be] INFO: Scrape type for HS59761: 2
2026-03-30 06:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fd75480-87a9-57c0-b2a5-e785c4c31e4f with identifier: HS59761
2026-03-30 06:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fd75480-87a9-57c0-b2a5-e785c4c31e4f with scrape type 2
2026-03-30 06:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fd75480-87a9-57c0-b2a5-e785c4c31e4f with scrape type 2
2026-03-30 06:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3fd75480-87a9-57c0-b2a5-e785c4c31e4f, identifier: HS59761
2026-03-30 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb6%252F63b6754edbf17a20dac9efdd33d45543%252Fpa%252FKD38906_2acd68cc9b2276477519cf736c727e9a.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_2acd68cc9b2276477519cf736c727e9a.jpg not downloaded yet
2026-03-30 06:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_80624ec7d0845e026d9254af6a759f42.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:30:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3fd75480-87a9-57c0-b2a5-e785c4c31e4f with identifier: HS59761
2026-03-30 06:30:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3fd75480-87a9-57c0-b2a5-e785c4c31e4f with identifier: HS59761
2026-03-30 06:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3fd75480-87a9-57c0-b2a5-e785c4c31e4f with identifier: HS59761 to the API
2026-03-30 06:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:32:51Z',
 'fuel_type': 'diesel',
 'id': '3fd75480-87a9-57c0-b2a5-e785c4c31e4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS59761',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 72994,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-12',
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Active Pack',
 'transmission': 'automatic',
 'trim': 'Active Pack',
 'year': 2023}
2026-03-30 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS59761%27 HTTP/1.1" 200 None
2026-03-30 06:30:47 [auto1.be] INFO: Saving data for HS59761: {'auction_closing_time': 1774884771.0, 'created_time': 1774643497.148986, 'last_price_update_time': 1774852247.464633}
2026-03-30 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HS59761') HTTP/1.1" 204 0
2026-03-30 06:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6be4e590>
2026-03-30 06:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_078a7e87-9a9b-521d-9d32-7327beb33078/078a7e87-9a9b-521d-9d32-7327beb33078_image_2.jpg HTTP/1.1" 201 0
2026-03-30 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb6%252F63b6754edbf17a20dac9efdd33d45543%252Fpa%252FKD38906_d1c3844feab7a06a1d717665b6d21f8b.jpg') HTTP/1.1" 204 0
2026-03-30 06:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_d1c3844feab7a06a1d717665b6d21f8b.jpg saved to cache
2026-03-30 06:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 078a7e87-9a9b-521d-9d32-7327beb33078
2026-03-30 06:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_1bff09479bf0a3309c3a3151f16bd944.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:30:47 [auto1.be] INFO: Found listing with ID: ML85388
2026-03-30 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML85388%27 HTTP/1.1" 200 None
2026-03-30 06:30:47 [auto1.be] INFO: Scrape type for ML85388: 0
2026-03-30 06:30:47 [auto1.be] INFO: Found listing with ID: RM46702
2026-03-30 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM46702%27 HTTP/1.1" 200 None
2026-03-30 06:30:47 [auto1.be] INFO: Scrape type for RM46702: 2
2026-03-30 06:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc0e1375-1c24-52fe-bef3-32e29d915a60 with identifier: RM46702
2026-03-30 06:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc0e1375-1c24-52fe-bef3-32e29d915a60 with scrape type 2
2026-03-30 06:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc0e1375-1c24-52fe-bef3-32e29d915a60 with scrape type 2
2026-03-30 06:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dc0e1375-1c24-52fe-bef3-32e29d915a60, identifier: RM46702
2026-03-30 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb6%252F63b6754edbf17a20dac9efdd33d45543%252Fpa%252FKD38906_8024300b702d0ed78fe6c634de84c73d.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_8024300b702d0ed78fe6c634de84c73d.jpg not downloaded yet
2026-03-30 06:30:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dc0e1375-1c24-52fe-bef3-32e29d915a60 with identifier: RM46702
2026-03-30 06:30:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dc0e1375-1c24-52fe-bef3-32e29d915a60 with identifier: RM46702
2026-03-30 06:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dc0e1375-1c24-52fe-bef3-32e29d915a60 with identifier: RM46702 to the API
2026-03-30 06:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:09:26Z',
 'fuel_type': 'petrol',
 'id': 'dc0e1375-1c24-52fe-bef3-32e29d915a60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM46702',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 87002,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-10',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2019}
2026-03-30 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM46702%27 HTTP/1.1" 200 None
2026-03-30 06:30:47 [auto1.be] INFO: Saving data for RM46702: {'auction_closing_time': 1774883366.0, 'created_time': 1774557088.897698, 'last_price_update_time': 1774852247.964367}
2026-03-30 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RM46702') HTTP/1.1" 204 0
2026-03-30 06:30:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:30:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6b31e810>
2026-03-30 06:30:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:30:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:30:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_078a7e87-9a9b-521d-9d32-7327beb33078/078a7e87-9a9b-521d-9d32-7327beb33078_image_3.jpg HTTP/1.1" 201 0
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb6%252F63b6754edbf17a20dac9efdd33d45543%252Fpa%252FKD38906_67acbd5ec179eaf193cb6e2a83c3566b.jpg') HTTP/1.1" 204 0
2026-03-30 06:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_67acbd5ec179eaf193cb6e2a83c3566b.jpg saved to cache
2026-03-30 06:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 078a7e87-9a9b-521d-9d32-7327beb33078
2026-03-30 06:30:48 [auto1.be] INFO: Found listing with ID: AJ68637
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AJ68637%27 HTTP/1.1" 200 None
2026-03-30 06:30:48 [auto1.be] INFO: Scrape type for AJ68637: 0
2026-03-30 06:30:48 [auto1.be] INFO: Found listing with ID: CT30439
2026-03-30 06:30:48 [auto1.be] INFO: Found listing with ID: HY77866
2026-03-30 06:30:48 [auto1.be] INFO: Found listing with ID: HW95173
2026-03-30 06:30:48 [auto1.be] INFO: Found listing with ID: SW90596
2026-03-30 06:30:48 [auto1.be] INFO: Found listing with ID: BD10300
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD10300%27 HTTP/1.1" 200 None
2026-03-30 06:30:48 [auto1.be] INFO: Scrape type for BD10300: 0
2026-03-30 06:30:48 [auto1.be] INFO: Found listing with ID: JW86952
2026-03-30 06:30:48 [auto1.be] INFO: Found listing with ID: RK79502
2026-03-30 06:30:48 [auto1.be] INFO: Found listing with ID: RK12486
2026-03-30 06:30:48 [auto1.be] INFO: Found listing with ID: ZS70359
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZS70359%27 HTTP/1.1" 200 None
2026-03-30 06:30:48 [auto1.be] INFO: Scrape type for ZS70359: 2
2026-03-30 06:30:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b7af419-f1a7-5722-b52a-c9af478eeab2 with identifier: ZS70359
2026-03-30 06:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b7af419-f1a7-5722-b52a-c9af478eeab2 with scrape type 2
2026-03-30 06:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b7af419-f1a7-5722-b52a-c9af478eeab2 with scrape type 2
2026-03-30 06:30:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1b7af419-f1a7-5722-b52a-c9af478eeab2, identifier: ZS70359
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb6%252F63b6754edbf17a20dac9efdd33d45543%252Fpa%252FKD38906_2fa0c559fba6509b3a452412adce4270.jpg%27 HTTP/1.1" 200 None
2026-03-30 06:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_2fa0c559fba6509b3a452412adce4270.jpg not downloaded yet
2026-03-30 06:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6bea3390>
2026-03-30 06:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_078a7e87-9a9b-521d-9d32-7327beb33078/078a7e87-9a9b-521d-9d32-7327beb33078_image_4.jpg HTTP/1.1" 201 0
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb6%252F63b6754edbf17a20dac9efdd33d45543%252Fpa%252FKD38906_80624ec7d0845e026d9254af6a759f42.jpg') HTTP/1.1" 204 0
2026-03-30 06:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_80624ec7d0845e026d9254af6a759f42.jpg saved to cache
2026-03-30 06:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 078a7e87-9a9b-521d-9d32-7327beb33078
2026-03-30 06:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_882005b00ac31d9fd72a115a05a3614d.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1b7af419-f1a7-5722-b52a-c9af478eeab2 with identifier: ZS70359
2026-03-30 06:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1b7af419-f1a7-5722-b52a-c9af478eeab2 with identifier: ZS70359
2026-03-30 06:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1b7af419-f1a7-5722-b52a-c9af478eeab2 with identifier: ZS70359 to the API
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:33:16Z',
 'fuel_type': 'diesel',
 'id': '1b7af419-f1a7-5722-b52a-c9af478eeab2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS70359',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 94593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-29',
 'seller_name': None,
 'title': 'Hyundai ix35 2.0 CRDi Premium AWD',
 'transmission': 'automatic',
 'trim': 'Premium AWD',
 'year': 2016}
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZS70359%27 HTTP/1.1" 200 None
2026-03-30 06:30:48 [auto1.be] INFO: Saving data for ZS70359: {'auction_closing_time': 1774884796.0, 'created_time': 1773779669.073823, 'last_price_update_time': 1774852248.507297}
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZS70359') HTTP/1.1" 204 0
2026-03-30 06:30:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:30:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6b31ef50>
2026-03-30 06:30:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:30:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_078a7e87-9a9b-521d-9d32-7327beb33078/078a7e87-9a9b-521d-9d32-7327beb33078_image_5.jpg HTTP/1.1" 201 0
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb6%252F63b6754edbf17a20dac9efdd33d45543%252Fpa%252FKD38906_1bff09479bf0a3309c3a3151f16bd944.jpg') HTTP/1.1" 204 0
2026-03-30 06:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_1bff09479bf0a3309c3a3151f16bd944.jpg saved to cache
2026-03-30 06:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 078a7e87-9a9b-521d-9d32-7327beb33078
2026-03-30 06:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_2acd68cc9b2276477519cf736c727e9a.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:30:48 [auto1.be] INFO: Found listing with ID: SE23508
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE23508%27 HTTP/1.1" 200 None
2026-03-30 06:30:48 [auto1.be] INFO: Scrape type for SE23508: 0
2026-03-30 06:30:48 [auto1.be] INFO: Found listing with ID: SN78128
2026-03-30 06:30:48 [auto1.be] INFO: Found listing with ID: WW99205
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WW99205%27 HTTP/1.1" 200 None
2026-03-30 06:30:48 [auto1.be] INFO: Scrape type for WW99205: 0
2026-03-30 06:30:48 [auto1.be] INFO: Found listing with ID: VM12927
2026-03-30 06:30:48 [auto1.be] INFO: Found listing with ID: LH25651
2026-03-30 06:30:48 [auto1.be] INFO: Found listing with ID: SD77902
2026-03-30 06:30:48 [auto1.be] INFO: Found listing with ID: EK72945
2026-03-30 06:30:48 [auto1.be] INFO: Found listing with ID: LK16000
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK16000%27 HTTP/1.1" 200 None
2026-03-30 06:30:48 [auto1.be] INFO: Scrape type for LK16000: 2
2026-03-30 06:30:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6489067b-a958-52c0-b402-3218f78f1747 with identifier: LK16000
2026-03-30 06:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6489067b-a958-52c0-b402-3218f78f1747 with scrape type 2
2026-03-30 06:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6489067b-a958-52c0-b402-3218f78f1747 with scrape type 2
2026-03-30 06:30:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6489067b-a958-52c0-b402-3218f78f1747, identifier: LK16000
2026-03-30 06:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6489067b-a958-52c0-b402-3218f78f1747 with identifier: LK16000
2026-03-30 06:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6489067b-a958-52c0-b402-3218f78f1747 with identifier: LK16000
2026-03-30 06:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6489067b-a958-52c0-b402-3218f78f1747 with identifier: LK16000 to the API
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-30T15:12:42Z',
 'fuel_type': 'petrol',
 'id': '6489067b-a958-52c0-b402-3218f78f1747',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK16000',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 94834,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-07',
 'seller_name': None,
 'title': 'Renault Megane 1.2 TCe Energy Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2013}
2026-03-30 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK16000%27 HTTP/1.1" 200 None
2026-03-30 06:30:49 [auto1.be] INFO: Saving data for LK16000: {'auction_closing_time': 1774883562.0, 'created_time': 1774524696.871293, 'last_price_update_time': 1774852249.101857}
2026-03-30 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LK16000') HTTP/1.1" 204 0
2026-03-30 06:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_8024300b702d0ed78fe6c634de84c73d.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:30:49 [auto1.be] INFO: Found listing with ID: WA10715
2026-03-30 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA10715%27 HTTP/1.1" 200 None
2026-03-30 06:30:49 [auto1.be] INFO: Scrape type for WA10715: 0
2026-03-30 06:30:49 [auto1.be] INFO: Found listing with ID: EB09170
2026-03-30 06:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6bd8b390>
2026-03-30 06:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_078a7e87-9a9b-521d-9d32-7327beb33078/078a7e87-9a9b-521d-9d32-7327beb33078_image_6.jpg HTTP/1.1" 201 0
2026-03-30 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb6%252F63b6754edbf17a20dac9efdd33d45543%252Fpa%252FKD38906_882005b00ac31d9fd72a115a05a3614d.jpg') HTTP/1.1" 204 0
2026-03-30 06:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_882005b00ac31d9fd72a115a05a3614d.jpg saved to cache
2026-03-30 06:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 078a7e87-9a9b-521d-9d32-7327beb33078
2026-03-30 06:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6bd8f650>
2026-03-30 06:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_078a7e87-9a9b-521d-9d32-7327beb33078/078a7e87-9a9b-521d-9d32-7327beb33078_image_7.jpg HTTP/1.1" 201 0
2026-03-30 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb6%252F63b6754edbf17a20dac9efdd33d45543%252Fpa%252FKD38906_2acd68cc9b2276477519cf736c727e9a.jpg') HTTP/1.1" 204 0
2026-03-30 06:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_2acd68cc9b2276477519cf736c727e9a.jpg saved to cache
2026-03-30 06:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 078a7e87-9a9b-521d-9d32-7327beb33078
2026-03-30 06:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6bdc5010>
2026-03-30 06:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_078a7e87-9a9b-521d-9d32-7327beb33078/078a7e87-9a9b-521d-9d32-7327beb33078_image_8.jpg HTTP/1.1" 201 0
2026-03-30 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb6%252F63b6754edbf17a20dac9efdd33d45543%252Fpa%252FKD38906_8024300b702d0ed78fe6c634de84c73d.jpg') HTTP/1.1" 204 0
2026-03-30 06:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_8024300b702d0ed78fe6c634de84c73d.jpg saved to cache
2026-03-30 06:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 078a7e87-9a9b-521d-9d32-7327beb33078
2026-03-30 06:30:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_2fa0c559fba6509b3a452412adce4270.jpg> (referer: https://www.auto1.com/)
2026-03-30 06:30:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 06:30:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f2e6bc0a810>
2026-03-30 06:30:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 06:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 06:30:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 06:30:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_078a7e87-9a9b-521d-9d32-7327beb33078/078a7e87-9a9b-521d-9d32-7327beb33078_image_9.jpg HTTP/1.1" 201 0
2026-03-30 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252Fb6%252F63b6754edbf17a20dac9efdd33d45543%252Fpa%252FKD38906_2fa0c559fba6509b3a452412adce4270.jpg') HTTP/1.1" 204 0
2026-03-30 06:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_2fa0c559fba6509b3a452412adce4270.jpg saved to cache
2026-03-30 06:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 078a7e87-9a9b-521d-9d32-7327beb33078
2026-03-30 06:30:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 078a7e87-9a9b-521d-9d32-7327beb33078, skipping ID generation
2026-03-30 06:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 078a7e87-9a9b-521d-9d32-7327beb33078 with scrape type 1
2026-03-30 06:30:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 078a7e87-9a9b-521d-9d32-7327beb33078 sending to next pipeline
2026-03-30 06:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 078a7e87-9a9b-521d-9d32-7327beb33078, identifier: KD38906
2026-03-30 06:30:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 078a7e87-9a9b-521d-9d32-7327beb33078 with identifier: KD38906
2026-03-30 06:30:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 078a7e87-9a9b-521d-9d32-7327beb33078 with identifier: KD38906
2026-03-30 06:30:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 078a7e87-9a9b-521d-9d32-7327beb33078 with identifier: KD38906 to the API
2026-03-30 06:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_2fa0c559fba6509b3a452412adce4270.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 292,
 'expiration_date': '2026-03-31T15:04:55Z',
 'fuel_type': 'hybrid',
 'id': '078a7e87-9a9b-521d-9d32-7327beb33078',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD38906',
 'listing': 'auction',
 'location': 'BE, Ghislenghien',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 132599,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_078a7e87-9a9b-521d-9d32-7327beb33078/078a7e87-9a9b-521d-9d32-7327beb33078_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_9714e4f86fb3e1600a7cd2af63cb06c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_078a7e87-9a9b-521d-9d32-7327beb33078/078a7e87-9a9b-521d-9d32-7327beb33078_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_854cd041386d218ce98b29298ceaaa97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_078a7e87-9a9b-521d-9d32-7327beb33078/078a7e87-9a9b-521d-9d32-7327beb33078_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_d1c3844feab7a06a1d717665b6d21f8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_078a7e87-9a9b-521d-9d32-7327beb33078/078a7e87-9a9b-521d-9d32-7327beb33078_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_67acbd5ec179eaf193cb6e2a83c3566b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_078a7e87-9a9b-521d-9d32-7327beb33078/078a7e87-9a9b-521d-9d32-7327beb33078_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_80624ec7d0845e026d9254af6a759f42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_078a7e87-9a9b-521d-9d32-7327beb33078/078a7e87-9a9b-521d-9d32-7327beb33078_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_1bff09479bf0a3309c3a3151f16bd944.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_078a7e87-9a9b-521d-9d32-7327beb33078/078a7e87-9a9b-521d-9d32-7327beb33078_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_882005b00ac31d9fd72a115a05a3614d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_078a7e87-9a9b-521d-9d32-7327beb33078/078a7e87-9a9b-521d-9d32-7327beb33078_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56868,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_2acd68cc9b2276477519cf736c727e9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_078a7e87-9a9b-521d-9d32-7327beb33078/078a7e87-9a9b-521d-9d32-7327beb33078_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_8024300b702d0ed78fe6c634de84c73d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_078a7e87-9a9b-521d-9d32-7327beb33078/078a7e87-9a9b-521d-9d32-7327beb33078_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59184,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/b6/63b6754edbf17a20dac9efdd33d45543/pa/KD38906_2fa0c559fba6509b3a452412adce4270.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 30e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2026-03-30 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD38906%27 HTTP/1.1" 200 None
2026-03-30 06:30:49 [auto1.be] INFO: Saving data for KD38906: {'created_time': 1774852249.939133, 'last_price_update_time': 1774852249.939143, 'auction_closing_time': 1774969495.0}
2026-03-30 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KD38906') HTTP/1.1" 204 0
2026-03-30 06:30:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:30:53 [auto1.be] INFO: Channel: 24h | Page: 8 | totalHits: 1288 | hits on page: 40
2026-03-30 06:30:53 [auto1.be] INFO: Found listing with ID: XN92471
2026-03-30 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN92471%27 HTTP/1.1" 200 None
2026-03-30 06:30:53 [auto1.be] INFO: Scrape type for XN92471: 2
2026-03-30 06:30:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84ac1513-66b8-5a90-a85c-273bcb8746f0 with identifier: XN92471
2026-03-30 06:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84ac1513-66b8-5a90-a85c-273bcb8746f0 with scrape type 2
2026-03-30 06:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84ac1513-66b8-5a90-a85c-273bcb8746f0 with scrape type 2
2026-03-30 06:30:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 84ac1513-66b8-5a90-a85c-273bcb8746f0, identifier: XN92471
2026-03-30 06:30:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 84ac1513-66b8-5a90-a85c-273bcb8746f0 with identifier: XN92471
2026-03-30 06:30:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 84ac1513-66b8-5a90-a85c-273bcb8746f0 with identifier: XN92471
2026-03-30 06:30:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 84ac1513-66b8-5a90-a85c-273bcb8746f0 with identifier: XN92471 to the API
2026-03-30 06:30:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:02:31Z',
 'fuel_type': 'petrol',
 'id': '84ac1513-66b8-5a90-a85c-273bcb8746f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN92471',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 77780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-23',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2013}
2026-03-30 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN92471%27 HTTP/1.1" 200 None
2026-03-30 06:30:53 [auto1.be] INFO: Saving data for XN92471: {'auction_closing_time': 1774882951.0, 'created_time': 1774643617.196526, 'last_price_update_time': 1774852253.437694}
2026-03-30 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XN92471') HTTP/1.1" 204 0
2026-03-30 06:30:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:30:53 [auto1.be] INFO: Found listing with ID: NB03494
2026-03-30 06:30:53 [auto1.be] INFO: Found listing with ID: WJ85942
2026-03-30 06:30:53 [auto1.be] INFO: Found listing with ID: CK14854
2026-03-30 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK14854%27 HTTP/1.1" 200 None
2026-03-30 06:30:53 [auto1.be] INFO: Scrape type for CK14854: 2
2026-03-30 06:30:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17b3182c-01b0-545d-a767-c318b1ff4838 with identifier: CK14854
2026-03-30 06:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17b3182c-01b0-545d-a767-c318b1ff4838 with scrape type 2
2026-03-30 06:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17b3182c-01b0-545d-a767-c318b1ff4838 with scrape type 2
2026-03-30 06:30:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 17b3182c-01b0-545d-a767-c318b1ff4838, identifier: CK14854
2026-03-30 06:30:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 17b3182c-01b0-545d-a767-c318b1ff4838 with identifier: CK14854
2026-03-30 06:30:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 17b3182c-01b0-545d-a767-c318b1ff4838 with identifier: CK14854
2026-03-30 06:30:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 17b3182c-01b0-545d-a767-c318b1ff4838 with identifier: CK14854 to the API
2026-03-30 06:30:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:40:49Z',
 'fuel_type': 'petrol',
 'id': '17b3182c-01b0-545d-a767-c318b1ff4838',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK14854',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 171817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-27',
 'seller_name': None,
 'title': 'Lancia Ypsilon 0.9 TwinAir Gold',
 'transmission': 'automatic',
 'trim': 'Gold',
 'year': 2014}
2026-03-30 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK14854%27 HTTP/1.1" 200 None
2026-03-30 06:30:53 [auto1.be] INFO: Saving data for CK14854: {'auction_closing_time': 1774885249.0, 'created_time': 1773822664.508962, 'last_price_update_time': 1774852253.922957}
2026-03-30 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CK14854') HTTP/1.1" 204 0
2026-03-30 06:30:53 [auto1.be] INFO: Found listing with ID: ZL62218
2026-03-30 06:30:53 [auto1.be] INFO: Found listing with ID: KG55279
2026-03-30 06:30:53 [auto1.be] INFO: Found listing with ID: JS91211
2026-03-30 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS91211%27 HTTP/1.1" 200 None
2026-03-30 06:30:53 [auto1.be] INFO: Scrape type for JS91211: 0
2026-03-30 06:30:53 [auto1.be] INFO: Found listing with ID: EX56301
2026-03-30 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX56301%27 HTTP/1.1" 200 None
2026-03-30 06:30:53 [auto1.be] INFO: Scrape type for EX56301: 2
2026-03-30 06:30:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 055508f5-57f2-543a-a3ef-afee25bf24ad with identifier: EX56301
2026-03-30 06:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 055508f5-57f2-543a-a3ef-afee25bf24ad with scrape type 2
2026-03-30 06:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 055508f5-57f2-543a-a3ef-afee25bf24ad with scrape type 2
2026-03-30 06:30:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 055508f5-57f2-543a-a3ef-afee25bf24ad, identifier: EX56301
2026-03-30 06:30:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 055508f5-57f2-543a-a3ef-afee25bf24ad with identifier: EX56301
2026-03-30 06:30:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 055508f5-57f2-543a-a3ef-afee25bf24ad with identifier: EX56301
2026-03-30 06:30:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 055508f5-57f2-543a-a3ef-afee25bf24ad with identifier: EX56301 to the API
2026-03-30 06:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:36:20Z',
 'fuel_type': 'diesel',
 'id': '055508f5-57f2-543a-a3ef-afee25bf24ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX56301',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S60',
 'odometer': 134900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-12',
 'seller_name': None,
 'title': 'Volvo S60 2.0 D4 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2017}
2026-03-30 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX56301%27 HTTP/1.1" 200 None
2026-03-30 06:30:54 [auto1.be] INFO: Saving data for EX56301: {'auction_closing_time': 1774884980.0, 'created_time': 1774643657.861915, 'last_price_update_time': 1774852254.337961}
2026-03-30 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EX56301') HTTP/1.1" 204 0
2026-03-30 06:30:54 [auto1.be] INFO: Found listing with ID: DL13581
2026-03-30 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL13581%27 HTTP/1.1" 200 None
2026-03-30 06:30:54 [auto1.be] INFO: Scrape type for DL13581: 0
2026-03-30 06:30:54 [auto1.be] INFO: Found listing with ID: EL84394
2026-03-30 06:30:54 [auto1.be] INFO: Found listing with ID: WG23357
2026-03-30 06:30:54 [auto1.be] INFO: Found listing with ID: HP15544
2026-03-30 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP15544%27 HTTP/1.1" 200 None
2026-03-30 06:30:54 [auto1.be] INFO: Scrape type for HP15544: 0
2026-03-30 06:30:54 [auto1.be] INFO: Found listing with ID: PB67516
2026-03-30 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB67516%27 HTTP/1.1" 200 None
2026-03-30 06:30:54 [auto1.be] INFO: Scrape type for PB67516: 2
2026-03-30 06:30:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f34dfec1-d751-59e7-972b-8aecf26a3c83 with identifier: PB67516
2026-03-30 06:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f34dfec1-d751-59e7-972b-8aecf26a3c83 with scrape type 2
2026-03-30 06:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f34dfec1-d751-59e7-972b-8aecf26a3c83 with scrape type 2
2026-03-30 06:30:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f34dfec1-d751-59e7-972b-8aecf26a3c83, identifier: PB67516
2026-03-30 06:30:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f34dfec1-d751-59e7-972b-8aecf26a3c83 with identifier: PB67516
2026-03-30 06:30:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f34dfec1-d751-59e7-972b-8aecf26a3c83 with identifier: PB67516
2026-03-30 06:30:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f34dfec1-d751-59e7-972b-8aecf26a3c83 with identifier: PB67516 to the API
2026-03-30 06:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:34:16Z',
 'fuel_type': 'diesel',
 'id': 'f34dfec1-d751-59e7-972b-8aecf26a3c83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB67516',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 312233,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-01',
 'seller_name': None,
 'title': 'Opel Vivaro 1.6 Biturbo CDTI Combi L2H1 2,9t',
 'transmission': 'manual',
 'trim': 'Combi L2H1 2,9t',
 'year': 2017}
2026-03-30 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB67516%27 HTTP/1.1" 200 None
2026-03-30 06:30:54 [auto1.be] INFO: Saving data for PB67516: {'auction_closing_time': 1774884856.0, 'created_time': 1773779950.412741, 'last_price_update_time': 1774852254.821189}
2026-03-30 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PB67516') HTTP/1.1" 204 0
2026-03-30 06:30:54 [auto1.be] INFO: Found listing with ID: XB95573
2026-03-30 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB95573%27 HTTP/1.1" 200 None
2026-03-30 06:30:54 [auto1.be] INFO: Scrape type for XB95573: 2
2026-03-30 06:30:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 470800c9-f629-52c1-80ba-c4a90acbc99f with identifier: XB95573
2026-03-30 06:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 470800c9-f629-52c1-80ba-c4a90acbc99f with scrape type 2
2026-03-30 06:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 470800c9-f629-52c1-80ba-c4a90acbc99f with scrape type 2
2026-03-30 06:30:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 470800c9-f629-52c1-80ba-c4a90acbc99f, identifier: XB95573
2026-03-30 06:30:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 470800c9-f629-52c1-80ba-c4a90acbc99f with identifier: XB95573
2026-03-30 06:30:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 470800c9-f629-52c1-80ba-c4a90acbc99f with identifier: XB95573
2026-03-30 06:30:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 470800c9-f629-52c1-80ba-c4a90acbc99f with identifier: XB95573 to the API
2026-03-30 06:30:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:04:11Z',
 'fuel_type': 'petrol',
 'id': '470800c9-f629-52c1-80ba-c4a90acbc99f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB95573',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 201001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-29',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-30 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB95573%27 HTTP/1.1" 200 None
2026-03-30 06:30:55 [auto1.be] INFO: Saving data for XB95573: {'auction_closing_time': 1774883051.0, 'created_time': 1773401489.45726, 'last_price_update_time': 1774852255.318024}
2026-03-30 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XB95573') HTTP/1.1" 204 0
2026-03-30 06:30:55 [auto1.be] INFO: Found listing with ID: ND89972
2026-03-30 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND89972%27 HTTP/1.1" 200 None
2026-03-30 06:30:55 [auto1.be] INFO: Scrape type for ND89972: 0
2026-03-30 06:30:55 [auto1.be] INFO: Found listing with ID: LG37246
2026-03-30 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG37246%27 HTTP/1.1" 200 None
2026-03-30 06:30:55 [auto1.be] INFO: Scrape type for LG37246: 0
2026-03-30 06:30:55 [auto1.be] INFO: Found listing with ID: JB70681
2026-03-30 06:30:55 [auto1.be] INFO: Found listing with ID: JS91755
2026-03-30 06:30:55 [auto1.be] INFO: Found listing with ID: EV46077
2026-03-30 06:30:55 [auto1.be] INFO: Found listing with ID: FB34577
2026-03-30 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FB34577%27 HTTP/1.1" 200 None
2026-03-30 06:30:55 [auto1.be] INFO: Scrape type for FB34577: 2
2026-03-30 06:30:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd7ce98c-f5eb-5145-9733-5bb396206c83 with identifier: FB34577
2026-03-30 06:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd7ce98c-f5eb-5145-9733-5bb396206c83 with scrape type 2
2026-03-30 06:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd7ce98c-f5eb-5145-9733-5bb396206c83 with scrape type 2
2026-03-30 06:30:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dd7ce98c-f5eb-5145-9733-5bb396206c83, identifier: FB34577
2026-03-30 06:30:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dd7ce98c-f5eb-5145-9733-5bb396206c83 with identifier: FB34577
2026-03-30 06:30:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dd7ce98c-f5eb-5145-9733-5bb396206c83 with identifier: FB34577
2026-03-30 06:30:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dd7ce98c-f5eb-5145-9733-5bb396206c83 with identifier: FB34577 to the API
2026-03-30 06:30:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:55:25Z',
 'fuel_type': 'diesel',
 'id': 'dd7ce98c-f5eb-5145-9733-5bb396206c83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB34577',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 348563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-30',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-30 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FB34577%27 HTTP/1.1" 200 None
2026-03-30 06:30:55 [auto1.be] INFO: Saving data for FB34577: {'auction_closing_time': 1774886125.0, 'created_time': 1774729873.20163, 'last_price_update_time': 1774852255.79515}
2026-03-30 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FB34577') HTTP/1.1" 204 0
2026-03-30 06:30:55 [auto1.be] INFO: Found listing with ID: JV80966
2026-03-30 06:30:55 [auto1.be] INFO: Found listing with ID: GR79063
2026-03-30 06:30:55 [auto1.be] INFO: Found listing with ID: PR27183
2026-03-30 06:30:55 [auto1.be] INFO: Found listing with ID: KP74596
2026-03-30 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP74596%27 HTTP/1.1" 200 None
2026-03-30 06:30:55 [auto1.be] INFO: Scrape type for KP74596: 2
2026-03-30 06:30:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81029d9f-3bc6-57b9-aff2-c5b6c81c5648 with identifier: KP74596
2026-03-30 06:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81029d9f-3bc6-57b9-aff2-c5b6c81c5648 with scrape type 2
2026-03-30 06:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81029d9f-3bc6-57b9-aff2-c5b6c81c5648 with scrape type 2
2026-03-30 06:30:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 81029d9f-3bc6-57b9-aff2-c5b6c81c5648, identifier: KP74596
2026-03-30 06:30:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 81029d9f-3bc6-57b9-aff2-c5b6c81c5648 with identifier: KP74596
2026-03-30 06:30:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:30:55 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-30 06:30:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:30:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 81029d9f-3bc6-57b9-aff2-c5b6c81c5648 with identifier: KP74596
2026-03-30 06:30:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 81029d9f-3bc6-57b9-aff2-c5b6c81c5648 with identifier: KP74596 to the API
2026-03-30 06:30:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:11:50Z',
 'fuel_type': 'petrol',
 'id': '81029d9f-3bc6-57b9-aff2-c5b6c81c5648',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP74596',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 143314,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-24',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 VTi Feel Edition',
 'transmission': 'manual',
 'trim': 'Feel Edition',
 'year': 2014}
2026-03-30 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP74596%27 HTTP/1.1" 200 None
2026-03-30 06:30:56 [auto1.be] INFO: Saving data for KP74596: {'auction_closing_time': 1774883510.0, 'created_time': 1773747412.202757, 'last_price_update_time': 1774852256.305596}
2026-03-30 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KP74596') HTTP/1.1" 204 0
2026-03-30 06:30:56 [auto1.be] INFO: Found listing with ID: TL70885
2026-03-30 06:30:56 [auto1.be] INFO: Found listing with ID: JW06840
2026-03-30 06:30:56 [auto1.be] INFO: Found listing with ID: RR43173
2026-03-30 06:30:56 [auto1.be] INFO: Found listing with ID: BN63741
2026-03-30 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BN63741%27 HTTP/1.1" 200 None
2026-03-30 06:30:56 [auto1.be] INFO: Scrape type for BN63741: 2
2026-03-30 06:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e36d345a-bd0c-58ee-b38f-cae5980cf0a6 with identifier: BN63741
2026-03-30 06:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e36d345a-bd0c-58ee-b38f-cae5980cf0a6 with scrape type 2
2026-03-30 06:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e36d345a-bd0c-58ee-b38f-cae5980cf0a6 with scrape type 2
2026-03-30 06:30:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e36d345a-bd0c-58ee-b38f-cae5980cf0a6, identifier: BN63741
2026-03-30 06:30:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e36d345a-bd0c-58ee-b38f-cae5980cf0a6 with identifier: BN63741
2026-03-30 06:30:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e36d345a-bd0c-58ee-b38f-cae5980cf0a6 with identifier: BN63741
2026-03-30 06:30:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e36d345a-bd0c-58ee-b38f-cae5980cf0a6 with identifier: BN63741 to the API
2026-03-30 06:30:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 91,
 'expiration_date': '2026-03-30T15:17:53Z',
 'fuel_type': 'petrol',
 'id': 'e36d345a-bd0c-58ee-b38f-cae5980cf0a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN63741',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 13380,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-10-07',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe Essential',
 'transmission': 'manual',
 'trim': 'Essential',
 'year': 2024}
2026-03-30 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BN63741%27 HTTP/1.1" 200 None
2026-03-30 06:30:56 [auto1.be] INFO: Saving data for BN63741: {'auction_closing_time': 1774883873.0, 'created_time': 1774557027.861188, 'last_price_update_time': 1774852256.797472}
2026-03-30 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BN63741') HTTP/1.1" 204 0
2026-03-30 06:30:56 [auto1.be] INFO: Found listing with ID: NV81106
2026-03-30 06:30:56 [auto1.be] INFO: Found listing with ID: GL29646
2026-03-30 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GL29646%27 HTTP/1.1" 200 None
2026-03-30 06:30:56 [auto1.be] INFO: Scrape type for GL29646: 0
2026-03-30 06:30:56 [auto1.be] INFO: Found listing with ID: ZG73435
2026-03-30 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG73435%27 HTTP/1.1" 200 None
2026-03-30 06:30:56 [auto1.be] INFO: Scrape type for ZG73435: 0
2026-03-30 06:30:56 [auto1.be] INFO: Found listing with ID: HS23763
2026-03-30 06:30:56 [auto1.be] INFO: Found listing with ID: RA46458
2026-03-30 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA46458%27 HTTP/1.1" 200 None
2026-03-30 06:30:56 [auto1.be] INFO: Scrape type for RA46458: 2
2026-03-30 06:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7f290f3-de57-56c0-9027-f8b5471ec80e with identifier: RA46458
2026-03-30 06:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7f290f3-de57-56c0-9027-f8b5471ec80e with scrape type 2
2026-03-30 06:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7f290f3-de57-56c0-9027-f8b5471ec80e with scrape type 2
2026-03-30 06:30:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b7f290f3-de57-56c0-9027-f8b5471ec80e, identifier: RA46458
2026-03-30 06:30:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b7f290f3-de57-56c0-9027-f8b5471ec80e with identifier: RA46458
2026-03-30 06:30:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b7f290f3-de57-56c0-9027-f8b5471ec80e with identifier: RA46458
2026-03-30 06:30:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b7f290f3-de57-56c0-9027-f8b5471ec80e with identifier: RA46458 to the API
2026-03-30 06:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:14:45Z',
 'fuel_type': 'petrol',
 'id': 'b7f290f3-de57-56c0-9027-f8b5471ec80e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA46458',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 85225,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-11-27',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2000}
2026-03-30 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA46458%27 HTTP/1.1" 200 None
2026-03-30 06:30:57 [auto1.be] INFO: Saving data for RA46458: {'auction_closing_time': 1774883685.0, 'created_time': 1774643646.887681, 'last_price_update_time': 1774852257.890913}
2026-03-30 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RA46458') HTTP/1.1" 204 0
2026-03-30 06:30:57 [auto1.be] INFO: Found listing with ID: VE53331
2026-03-30 06:30:57 [auto1.be] INFO: Found listing with ID: HD23270
2026-03-30 06:30:57 [auto1.be] INFO: Found listing with ID: HP14917
2026-03-30 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP14917%27 HTTP/1.1" 200 None
2026-03-30 06:30:57 [auto1.be] INFO: Scrape type for HP14917: 2
2026-03-30 06:30:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 808abb3b-0ea3-5f95-8e22-e7eaed99a6de with identifier: HP14917
2026-03-30 06:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 808abb3b-0ea3-5f95-8e22-e7eaed99a6de with scrape type 2
2026-03-30 06:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 808abb3b-0ea3-5f95-8e22-e7eaed99a6de with scrape type 2
2026-03-30 06:30:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 808abb3b-0ea3-5f95-8e22-e7eaed99a6de, identifier: HP14917
2026-03-30 06:30:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 808abb3b-0ea3-5f95-8e22-e7eaed99a6de with identifier: HP14917
2026-03-30 06:30:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 808abb3b-0ea3-5f95-8e22-e7eaed99a6de with identifier: HP14917
2026-03-30 06:30:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 808abb3b-0ea3-5f95-8e22-e7eaed99a6de with identifier: HP14917 to the API
2026-03-30 06:30:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:02:14Z',
 'fuel_type': 'diesel',
 'id': '808abb3b-0ea3-5f95-8e22-e7eaed99a6de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP14917',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 170964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-11',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 220 d Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2013}
2026-03-30 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP14917%27 HTTP/1.1" 200 None
2026-03-30 06:30:58 [auto1.be] INFO: Saving data for HP14917: {'auction_closing_time': 1774882934.0, 'created_time': 1773747710.539213, 'last_price_update_time': 1774852258.445343}
2026-03-30 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HP14917') HTTP/1.1" 204 0
2026-03-30 06:30:58 [auto1.be] INFO: Found listing with ID: WK92284
2026-03-30 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK92284%27 HTTP/1.1" 200 None
2026-03-30 06:30:58 [auto1.be] INFO: Scrape type for WK92284: 0
2026-03-30 06:30:58 [auto1.be] INFO: Found listing with ID: GX61337
2026-03-30 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX61337%27 HTTP/1.1" 200 None
2026-03-30 06:30:58 [auto1.be] INFO: Scrape type for GX61337: 2
2026-03-30 06:30:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3c606a4-debf-5aa0-bac1-8352f14136fc with identifier: GX61337
2026-03-30 06:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3c606a4-debf-5aa0-bac1-8352f14136fc with scrape type 2
2026-03-30 06:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3c606a4-debf-5aa0-bac1-8352f14136fc with scrape type 2
2026-03-30 06:30:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b3c606a4-debf-5aa0-bac1-8352f14136fc, identifier: GX61337
2026-03-30 06:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:30:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b3c606a4-debf-5aa0-bac1-8352f14136fc with identifier: GX61337
2026-03-30 06:30:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b3c606a4-debf-5aa0-bac1-8352f14136fc with identifier: GX61337
2026-03-30 06:30:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b3c606a4-debf-5aa0-bac1-8352f14136fc with identifier: GX61337 to the API
2026-03-30 06:30:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:01:43Z',
 'fuel_type': 'petrol',
 'id': 'b3c606a4-debf-5aa0-bac1-8352f14136fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX61337',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 56740,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-25',
 'seller_name': None,
 'title': 'Kia XCeed 1.0 TGDI Concept',
 'transmission': 'manual',
 'trim': 'Concept',
 'year': 2020}
2026-03-30 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GX61337%27 HTTP/1.1" 200 None
2026-03-30 06:30:58 [auto1.be] INFO: Saving data for GX61337: {'auction_closing_time': 1774882903.0, 'created_time': 1774524670.979238, 'last_price_update_time': 1774852258.954143}
2026-03-30 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GX61337') HTTP/1.1" 204 0
2026-03-30 06:30:58 [auto1.be] INFO: Found listing with ID: UL34611
2026-03-30 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL34611%27 HTTP/1.1" 200 None
2026-03-30 06:30:58 [auto1.be] INFO: Scrape type for UL34611: 2
2026-03-30 06:30:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5e3db12-67b8-50d3-92db-458c0c76c2d8 with identifier: UL34611
2026-03-30 06:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5e3db12-67b8-50d3-92db-458c0c76c2d8 with scrape type 2
2026-03-30 06:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5e3db12-67b8-50d3-92db-458c0c76c2d8 with scrape type 2
2026-03-30 06:30:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c5e3db12-67b8-50d3-92db-458c0c76c2d8, identifier: UL34611
2026-03-30 06:30:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c5e3db12-67b8-50d3-92db-458c0c76c2d8 with identifier: UL34611
2026-03-30 06:30:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c5e3db12-67b8-50d3-92db-458c0c76c2d8 with identifier: UL34611
2026-03-30 06:30:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c5e3db12-67b8-50d3-92db-458c0c76c2d8 with identifier: UL34611 to the API
2026-03-30 06:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 211,
 'expiration_date': '2026-03-30T15:42:13Z',
 'fuel_type': 'hybrid',
 'id': 'c5e3db12-67b8-50d3-92db-458c0c76c2d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL34611',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 175078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-15',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T5 Recharge Plug-in Hybrid Inscription Expression '
          '2WD',
 'transmission': 'automatic',
 'trim': 'Inscription Expression 2WD',
 'year': 2022}
2026-03-30 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL34611%27 HTTP/1.1" 200 None
2026-03-30 06:30:59 [auto1.be] INFO: Saving data for UL34611: {'auction_closing_time': 1774885333.0, 'created_time': 1773301757.745511, 'last_price_update_time': 1774852259.3283}
2026-03-30 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UL34611') HTTP/1.1" 204 0
2026-03-30 06:30:59 [auto1.be] INFO: Found listing with ID: MW76341
2026-03-30 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW76341%27 HTTP/1.1" 200 None
2026-03-30 06:30:59 [auto1.be] INFO: Scrape type for MW76341: 0
2026-03-30 06:30:59 [auto1.be] INFO: Channel: 24h | Page: 9 | totalHits: 1288 | hits on page: 40
2026-03-30 06:30:59 [auto1.be] INFO: Found listing with ID: AA49507
2026-03-30 06:30:59 [auto1.be] INFO: Found listing with ID: EZ55101
2026-03-30 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ55101%27 HTTP/1.1" 200 None
2026-03-30 06:30:59 [auto1.be] INFO: Scrape type for EZ55101: 2
2026-03-30 06:30:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 514e9273-813b-58fb-9c98-e900f39e458d with identifier: EZ55101
2026-03-30 06:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 514e9273-813b-58fb-9c98-e900f39e458d with scrape type 2
2026-03-30 06:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 514e9273-813b-58fb-9c98-e900f39e458d with scrape type 2
2026-03-30 06:30:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 514e9273-813b-58fb-9c98-e900f39e458d, identifier: EZ55101
2026-03-30 06:30:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:30:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 514e9273-813b-58fb-9c98-e900f39e458d with identifier: EZ55101
2026-03-30 06:30:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 514e9273-813b-58fb-9c98-e900f39e458d with identifier: EZ55101
2026-03-30 06:30:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 514e9273-813b-58fb-9c98-e900f39e458d with identifier: EZ55101 to the API
2026-03-30 06:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:30:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:30:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:11:04Z',
 'fuel_type': 'petrol',
 'id': '514e9273-813b-58fb-9c98-e900f39e458d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ55101',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 149041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-30',
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'manual',
 'trim': 'M Sport',
 'year': 2021}
2026-03-30 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EZ55101%27 HTTP/1.1" 200 None
2026-03-30 06:30:59 [auto1.be] INFO: Saving data for EZ55101: {'auction_closing_time': 1774883464.0, 'created_time': 1773779936.379094, 'last_price_update_time': 1774852259.745702}
2026-03-30 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EZ55101') HTTP/1.1" 204 0
2026-03-30 06:30:59 [auto1.be] INFO: Found listing with ID: TH53375
2026-03-30 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH53375%27 HTTP/1.1" 200 None
2026-03-30 06:30:59 [auto1.be] INFO: Scrape type for TH53375: 0
2026-03-30 06:30:59 [auto1.be] INFO: Found listing with ID: LE66186
2026-03-30 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE66186%27 HTTP/1.1" 200 None
2026-03-30 06:30:59 [auto1.be] INFO: Scrape type for LE66186: 2
2026-03-30 06:30:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23aa2eef-18fc-549f-9d8d-d4675e7addbc with identifier: LE66186
2026-03-30 06:30:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23aa2eef-18fc-549f-9d8d-d4675e7addbc with scrape type 2
2026-03-30 06:30:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23aa2eef-18fc-549f-9d8d-d4675e7addbc with scrape type 2
2026-03-30 06:30:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 23aa2eef-18fc-549f-9d8d-d4675e7addbc, identifier: LE66186
2026-03-30 06:30:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 23aa2eef-18fc-549f-9d8d-d4675e7addbc with identifier: LE66186
2026-03-30 06:30:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 23aa2eef-18fc-549f-9d8d-d4675e7addbc with identifier: LE66186
2026-03-30 06:30:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 23aa2eef-18fc-549f-9d8d-d4675e7addbc with identifier: LE66186 to the API
2026-03-30 06:30:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:29:25Z',
 'fuel_type': 'diesel',
 'id': '23aa2eef-18fc-549f-9d8d-d4675e7addbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE66186',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 250246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-30',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE66186%27 HTTP/1.1" 200 None
2026-03-30 06:31:00 [auto1.be] INFO: Saving data for LE66186: {'auction_closing_time': 1774884565.0, 'created_time': 1774643650.447888, 'last_price_update_time': 1774852260.189774}
2026-03-30 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LE66186') HTTP/1.1" 204 0
2026-03-30 06:31:00 [auto1.be] INFO: Found listing with ID: RH88749
2026-03-30 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH88749%27 HTTP/1.1" 200 None
2026-03-30 06:31:00 [auto1.be] INFO: Scrape type for RH88749: 2
2026-03-30 06:31:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c8d90b4-4d1c-5e19-b032-06761a4fd7fd with identifier: RH88749
2026-03-30 06:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c8d90b4-4d1c-5e19-b032-06761a4fd7fd with scrape type 2
2026-03-30 06:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c8d90b4-4d1c-5e19-b032-06761a4fd7fd with scrape type 2
2026-03-30 06:31:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1c8d90b4-4d1c-5e19-b032-06761a4fd7fd, identifier: RH88749
2026-03-30 06:31:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1c8d90b4-4d1c-5e19-b032-06761a4fd7fd with identifier: RH88749
2026-03-30 06:31:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1c8d90b4-4d1c-5e19-b032-06761a4fd7fd with identifier: RH88749
2026-03-30 06:31:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1c8d90b4-4d1c-5e19-b032-06761a4fd7fd with identifier: RH88749 to the API
2026-03-30 06:31:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 55,
 'expiration_date': '2026-03-30T15:07:39Z',
 'fuel_type': 'diesel',
 'id': '1c8d90b4-4d1c-5e19-b032-06761a4fd7fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH88749',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 273273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-29',
 'seller_name': None,
 'title': 'Citroen C1 1.4 HDi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2006}
2026-03-30 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH88749%27 HTTP/1.1" 200 None
2026-03-30 06:31:00 [auto1.be] INFO: Saving data for RH88749: {'auction_closing_time': 1774883259.0, 'created_time': 1774557093.65814, 'last_price_update_time': 1774852260.592888}
2026-03-30 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RH88749') HTTP/1.1" 204 0
2026-03-30 06:31:00 [auto1.be] INFO: Found listing with ID: RK42644
2026-03-30 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK42644%27 HTTP/1.1" 200 None
2026-03-30 06:31:00 [auto1.be] INFO: Scrape type for RK42644: 2
2026-03-30 06:31:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ccf5a2e-b5a8-5937-8bc2-d593eb497435 with identifier: RK42644
2026-03-30 06:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ccf5a2e-b5a8-5937-8bc2-d593eb497435 with scrape type 2
2026-03-30 06:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ccf5a2e-b5a8-5937-8bc2-d593eb497435 with scrape type 2
2026-03-30 06:31:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3ccf5a2e-b5a8-5937-8bc2-d593eb497435, identifier: RK42644
2026-03-30 06:31:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3ccf5a2e-b5a8-5937-8bc2-d593eb497435 with identifier: RK42644
2026-03-30 06:31:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3ccf5a2e-b5a8-5937-8bc2-d593eb497435 with identifier: RK42644
2026-03-30 06:31:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3ccf5a2e-b5a8-5937-8bc2-d593eb497435 with identifier: RK42644 to the API
2026-03-30 06:31:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:47:01Z',
 'fuel_type': 'diesel',
 'id': '3ccf5a2e-b5a8-5937-8bc2-d593eb497435',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK42644',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 168399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-30',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2011}
2026-03-30 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK42644%27 HTTP/1.1" 200 None
2026-03-30 06:31:00 [auto1.be] INFO: Saving data for RK42644: {'auction_closing_time': 1774885621.0, 'created_time': 1774643488.360626, 'last_price_update_time': 1774852260.989736}
2026-03-30 06:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RK42644') HTTP/1.1" 204 0
2026-03-30 06:31:01 [auto1.be] INFO: Found listing with ID: AP73624
2026-03-30 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AP73624%27 HTTP/1.1" 200 None
2026-03-30 06:31:01 [auto1.be] INFO: Scrape type for AP73624: 2
2026-03-30 06:31:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c55397c6-6523-538d-8401-e93bcfbe5d68 with identifier: AP73624
2026-03-30 06:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c55397c6-6523-538d-8401-e93bcfbe5d68 with scrape type 2
2026-03-30 06:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c55397c6-6523-538d-8401-e93bcfbe5d68 with scrape type 2
2026-03-30 06:31:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c55397c6-6523-538d-8401-e93bcfbe5d68, identifier: AP73624
2026-03-30 06:31:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c55397c6-6523-538d-8401-e93bcfbe5d68 with identifier: AP73624
2026-03-30 06:31:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c55397c6-6523-538d-8401-e93bcfbe5d68 with identifier: AP73624
2026-03-30 06:31:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c55397c6-6523-538d-8401-e93bcfbe5d68 with identifier: AP73624 to the API
2026-03-30 06:31:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 159,
 'expiration_date': '2026-03-30T15:26:52Z',
 'fuel_type': 'petrol',
 'id': 'c55397c6-6523-538d-8401-e93bcfbe5d68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP73624',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 139592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-07',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T N-Connecta',
 'transmission': 'automatic',
 'trim': 'N-Connecta',
 'year': 2019}
2026-03-30 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AP73624%27 HTTP/1.1" 200 None
2026-03-30 06:31:01 [auto1.be] INFO: Saving data for AP73624: {'auction_closing_time': 1774884412.0, 'created_time': 1774557096.785178, 'last_price_update_time': 1774852261.407525}
2026-03-30 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AP73624') HTTP/1.1" 204 0
2026-03-30 06:31:01 [auto1.be] INFO: Found listing with ID: JV18684
2026-03-30 06:31:01 [auto1.be] INFO: Found listing with ID: DF44974
2026-03-30 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF44974%27 HTTP/1.1" 200 None
2026-03-30 06:31:01 [auto1.be] INFO: Scrape type for DF44974: 0
2026-03-30 06:31:01 [auto1.be] INFO: Found listing with ID: DW87206
2026-03-30 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW87206%27 HTTP/1.1" 200 None
2026-03-30 06:31:01 [auto1.be] INFO: Scrape type for DW87206: 2
2026-03-30 06:31:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 219a16b6-d815-5fa2-9c5a-28a2605538df with identifier: DW87206
2026-03-30 06:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 219a16b6-d815-5fa2-9c5a-28a2605538df with scrape type 2
2026-03-30 06:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 219a16b6-d815-5fa2-9c5a-28a2605538df with scrape type 2
2026-03-30 06:31:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 219a16b6-d815-5fa2-9c5a-28a2605538df, identifier: DW87206
2026-03-30 06:31:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 219a16b6-d815-5fa2-9c5a-28a2605538df with identifier: DW87206
2026-03-30 06:31:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 219a16b6-d815-5fa2-9c5a-28a2605538df with identifier: DW87206
2026-03-30 06:31:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 219a16b6-d815-5fa2-9c5a-28a2605538df with identifier: DW87206 to the API
2026-03-30 06:31:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:57:41Z',
 'fuel_type': 'diesel',
 'id': '219a16b6-d815-5fa2-9c5a-28a2605538df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW87206',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 169340,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-05',
 'seller_name': None,
 'title': 'BMW 2er 218d M Sport',
 'transmission': 'manual',
 'trim': 'M Sport',
 'year': 2017}
2026-03-30 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW87206%27 HTTP/1.1" 200 None
2026-03-30 06:31:01 [auto1.be] INFO: Saving data for DW87206: {'auction_closing_time': 1774886261.0, 'created_time': 1774643652.173748, 'last_price_update_time': 1774852261.924022}
2026-03-30 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DW87206') HTTP/1.1" 204 0
2026-03-30 06:31:01 [auto1.be] INFO: Found listing with ID: NY99560
2026-03-30 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY99560%27 HTTP/1.1" 200 None
2026-03-30 06:31:01 [auto1.be] INFO: Scrape type for NY99560: 2
2026-03-30 06:31:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f75c4c57-ac4b-5311-a0db-e58a108023d4 with identifier: NY99560
2026-03-30 06:31:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f75c4c57-ac4b-5311-a0db-e58a108023d4 with scrape type 2
2026-03-30 06:31:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f75c4c57-ac4b-5311-a0db-e58a108023d4 with scrape type 2
2026-03-30 06:31:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f75c4c57-ac4b-5311-a0db-e58a108023d4, identifier: NY99560
2026-03-30 06:31:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f75c4c57-ac4b-5311-a0db-e58a108023d4 with identifier: NY99560
2026-03-30 06:31:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f75c4c57-ac4b-5311-a0db-e58a108023d4 with identifier: NY99560
2026-03-30 06:31:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f75c4c57-ac4b-5311-a0db-e58a108023d4 with identifier: NY99560 to the API
2026-03-30 06:31:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:28:23Z',
 'fuel_type': 'hybrid',
 'id': 'f75c4c57-ac4b-5311-a0db-e58a108023d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY99560',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 76052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-19',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2022}
2026-03-30 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NY99560%27 HTTP/1.1" 200 None
2026-03-30 06:31:03 [auto1.be] INFO: Saving data for NY99560: {'auction_closing_time': 1774884503.0, 'created_time': 1774643654.321706, 'last_price_update_time': 1774852263.333503}
2026-03-30 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NY99560') HTTP/1.1" 204 0
2026-03-30 06:31:03 [auto1.be] INFO: Found listing with ID: NC25574
2026-03-30 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC25574%27 HTTP/1.1" 200 None
2026-03-30 06:31:03 [auto1.be] INFO: Scrape type for NC25574: 0
2026-03-30 06:31:03 [auto1.be] INFO: Found listing with ID: ZM46816
2026-03-30 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM46816%27 HTTP/1.1" 200 None
2026-03-30 06:31:03 [auto1.be] INFO: Scrape type for ZM46816: 0
2026-03-30 06:31:03 [auto1.be] INFO: Found listing with ID: RY85405
2026-03-30 06:31:03 [auto1.be] INFO: Found listing with ID: BA52354
2026-03-30 06:31:03 [auto1.be] INFO: Found listing with ID: NG50909
2026-03-30 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG50909%27 HTTP/1.1" 200 None
2026-03-30 06:31:03 [auto1.be] INFO: Scrape type for NG50909: 2
2026-03-30 06:31:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 218f08b8-69a8-597a-92d9-597c477a7aa8 with identifier: NG50909
2026-03-30 06:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 218f08b8-69a8-597a-92d9-597c477a7aa8 with scrape type 2
2026-03-30 06:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 218f08b8-69a8-597a-92d9-597c477a7aa8 with scrape type 2
2026-03-30 06:31:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 218f08b8-69a8-597a-92d9-597c477a7aa8, identifier: NG50909
2026-03-30 06:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:31:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 218f08b8-69a8-597a-92d9-597c477a7aa8 with identifier: NG50909
2026-03-30 06:31:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 218f08b8-69a8-597a-92d9-597c477a7aa8 with identifier: NG50909
2026-03-30 06:31:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 218f08b8-69a8-597a-92d9-597c477a7aa8 with identifier: NG50909 to the API
2026-03-30 06:31:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-30T15:24:14Z',
 'fuel_type': 'petrol',
 'id': '218f08b8-69a8-597a-92d9-597c477a7aa8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG50909',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 146103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-20',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2013}
2026-03-30 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG50909%27 HTTP/1.1" 200 None
2026-03-30 06:31:03 [auto1.be] INFO: Saving data for NG50909: {'auction_closing_time': 1774884254.0, 'created_time': 1773137745.388471, 'last_price_update_time': 1774852263.763097}
2026-03-30 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NG50909') HTTP/1.1" 204 0
2026-03-30 06:31:03 [auto1.be] INFO: Found listing with ID: TU47744
2026-03-30 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU47744%27 HTTP/1.1" 200 None
2026-03-30 06:31:03 [auto1.be] INFO: Scrape type for TU47744: 2
2026-03-30 06:31:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7837f19-9d6b-58ca-ab26-796f67095cf9 with identifier: TU47744
2026-03-30 06:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7837f19-9d6b-58ca-ab26-796f67095cf9 with scrape type 2
2026-03-30 06:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7837f19-9d6b-58ca-ab26-796f67095cf9 with scrape type 2
2026-03-30 06:31:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b7837f19-9d6b-58ca-ab26-796f67095cf9, identifier: TU47744
2026-03-30 06:31:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b7837f19-9d6b-58ca-ab26-796f67095cf9 with identifier: TU47744
2026-03-30 06:31:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b7837f19-9d6b-58ca-ab26-796f67095cf9 with identifier: TU47744
2026-03-30 06:31:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b7837f19-9d6b-58ca-ab26-796f67095cf9 with identifier: TU47744 to the API
2026-03-30 06:31:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:45:07Z',
 'fuel_type': 'diesel',
 'id': 'b7837f19-9d6b-58ca-ab26-796f67095cf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU47744',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 228161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-05',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.0 D-4D Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2013}
2026-03-30 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU47744%27 HTTP/1.1" 200 None
2026-03-30 06:31:04 [auto1.be] INFO: Saving data for TU47744: {'auction_closing_time': 1774885507.0, 'created_time': 1774524684.965676, 'last_price_update_time': 1774852264.169031}
2026-03-30 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TU47744') HTTP/1.1" 204 0
2026-03-30 06:31:04 [auto1.be] INFO: Found listing with ID: GD11285
2026-03-30 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GD11285%27 HTTP/1.1" 200 None
2026-03-30 06:31:04 [auto1.be] INFO: Scrape type for GD11285: 0
2026-03-30 06:31:04 [auto1.be] INFO: Found listing with ID: UC23117
2026-03-30 06:31:04 [auto1.be] INFO: Found listing with ID: RS46918
2026-03-30 06:31:04 [auto1.be] INFO: Found listing with ID: GF24104
2026-03-30 06:31:04 [auto1.be] INFO: Found listing with ID: NG90127
2026-03-30 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG90127%27 HTTP/1.1" 200 None
2026-03-30 06:31:04 [auto1.be] INFO: Scrape type for NG90127: 2
2026-03-30 06:31:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 689d1450-c91a-59c5-8e6f-f4e9dbc68a31 with identifier: NG90127
2026-03-30 06:31:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 689d1450-c91a-59c5-8e6f-f4e9dbc68a31 with scrape type 2
2026-03-30 06:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 689d1450-c91a-59c5-8e6f-f4e9dbc68a31 with scrape type 2
2026-03-30 06:31:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 689d1450-c91a-59c5-8e6f-f4e9dbc68a31, identifier: NG90127
2026-03-30 06:31:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 689d1450-c91a-59c5-8e6f-f4e9dbc68a31 with identifier: NG90127
2026-03-30 06:31:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 689d1450-c91a-59c5-8e6f-f4e9dbc68a31 with identifier: NG90127
2026-03-30 06:31:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 689d1450-c91a-59c5-8e6f-f4e9dbc68a31 with identifier: NG90127 to the API
2026-03-30 06:31:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:58:56Z',
 'fuel_type': 'petrol',
 'id': '689d1450-c91a-59c5-8e6f-f4e9dbc68a31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG90127',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 134234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-07',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2019}
2026-03-30 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG90127%27 HTTP/1.1" 200 None
2026-03-30 06:31:04 [auto1.be] INFO: Saving data for NG90127: {'auction_closing_time': 1774886336.0, 'created_time': 1774524669.649977, 'last_price_update_time': 1774852264.588888}
2026-03-30 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NG90127') HTTP/1.1" 204 0
2026-03-30 06:31:04 [auto1.be] INFO: Channel: 24h | Page: 10 | totalHits: 1288 | hits on page: 40
2026-03-30 06:31:04 [auto1.be] INFO: Found listing with ID: PJ82537
2026-03-30 06:31:04 [auto1.be] INFO: Found listing with ID: BT94428
2026-03-30 06:31:04 [auto1.be] INFO: Found listing with ID: WC55286
2026-03-30 06:31:04 [auto1.be] INFO: Found listing with ID: CC17071
2026-03-30 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC17071%27 HTTP/1.1" 200 None
2026-03-30 06:31:04 [auto1.be] INFO: Scrape type for CC17071: 0
2026-03-30 06:31:04 [auto1.be] INFO: Found listing with ID: KH63709
2026-03-30 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH63709%27 HTTP/1.1" 200 None
2026-03-30 06:31:04 [auto1.be] INFO: Scrape type for KH63709: 0
2026-03-30 06:31:04 [auto1.be] INFO: Found listing with ID: YN02015
2026-03-30 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN02015%27 HTTP/1.1" 200 None
2026-03-30 06:31:04 [auto1.be] INFO: Scrape type for YN02015: 2
2026-03-30 06:31:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7715cd53-ea1d-5c62-8a22-dd974965764b with identifier: YN02015
2026-03-30 06:31:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7715cd53-ea1d-5c62-8a22-dd974965764b with scrape type 2
2026-03-30 06:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7715cd53-ea1d-5c62-8a22-dd974965764b with scrape type 2
2026-03-30 06:31:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7715cd53-ea1d-5c62-8a22-dd974965764b, identifier: YN02015
2026-03-30 06:31:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7715cd53-ea1d-5c62-8a22-dd974965764b with identifier: YN02015
2026-03-30 06:31:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7715cd53-ea1d-5c62-8a22-dd974965764b with identifier: YN02015
2026-03-30 06:31:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7715cd53-ea1d-5c62-8a22-dd974965764b with identifier: YN02015 to the API
2026-03-30 06:31:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-30T15:45:07Z',
 'fuel_type': 'hybrid',
 'id': '7715cd53-ea1d-5c62-8a22-dd974965764b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN02015',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 149154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-18',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 350e 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2017}
2026-03-30 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN02015%27 HTTP/1.1" 200 None
2026-03-30 06:31:05 [auto1.be] INFO: Saving data for YN02015: {'auction_closing_time': 1774885507.0, 'created_time': 1774643431.644295, 'last_price_update_time': 1774852265.120853}
2026-03-30 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YN02015') HTTP/1.1" 204 0
2026-03-30 06:31:05 [auto1.be] INFO: Found listing with ID: RZ47312
2026-03-30 06:31:05 [auto1.be] INFO: Found listing with ID: BP14655
2026-03-30 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP14655%27 HTTP/1.1" 200 None
2026-03-30 06:31:05 [auto1.be] INFO: Scrape type for BP14655: 0
2026-03-30 06:31:05 [auto1.be] INFO: Found listing with ID: ND78338
2026-03-30 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND78338%27 HTTP/1.1" 200 None
2026-03-30 06:31:05 [auto1.be] INFO: Scrape type for ND78338: 2
2026-03-30 06:31:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcfde79d-7732-504a-936f-78c7d505981f with identifier: ND78338
2026-03-30 06:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcfde79d-7732-504a-936f-78c7d505981f with scrape type 2
2026-03-30 06:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bcfde79d-7732-504a-936f-78c7d505981f with scrape type 2
2026-03-30 06:31:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bcfde79d-7732-504a-936f-78c7d505981f, identifier: ND78338
2026-03-30 06:31:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:31:05 [auto1.be] INFO: Found listing with ID: MG81689
2026-03-30 06:31:05 [auto1.be] INFO: Found listing with ID: VW32861
2026-03-30 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW32861%27 HTTP/1.1" 200 None
2026-03-30 06:31:05 [auto1.be] INFO: Scrape type for VW32861: 2
2026-03-30 06:31:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a816a3a2-a052-5345-8f53-a1206ac57403 with identifier: VW32861
2026-03-30 06:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a816a3a2-a052-5345-8f53-a1206ac57403 with scrape type 2
2026-03-30 06:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a816a3a2-a052-5345-8f53-a1206ac57403 with scrape type 2
2026-03-30 06:31:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a816a3a2-a052-5345-8f53-a1206ac57403, identifier: VW32861
2026-03-30 06:31:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bcfde79d-7732-504a-936f-78c7d505981f with identifier: ND78338
2026-03-30 06:31:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bcfde79d-7732-504a-936f-78c7d505981f with identifier: ND78338
2026-03-30 06:31:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bcfde79d-7732-504a-936f-78c7d505981f with identifier: ND78338 to the API
2026-03-30 06:31:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:38:26Z',
 'fuel_type': 'hybrid',
 'id': 'bcfde79d-7732-504a-936f-78c7d505981f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND78338',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 173793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-12',
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2017}
2026-03-30 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ND78338%27 HTTP/1.1" 200 None
2026-03-30 06:31:05 [auto1.be] INFO: Saving data for ND78338: {'auction_closing_time': 1774885106.0, 'created_time': 1773693902.331347, 'last_price_update_time': 1774852265.656034}
2026-03-30 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ND78338') HTTP/1.1" 204 0
2026-03-30 06:31:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a816a3a2-a052-5345-8f53-a1206ac57403 with identifier: VW32861
2026-03-30 06:31:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a816a3a2-a052-5345-8f53-a1206ac57403 with identifier: VW32861
2026-03-30 06:31:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a816a3a2-a052-5345-8f53-a1206ac57403 with identifier: VW32861 to the API
2026-03-30 06:31:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:04:25Z',
 'fuel_type': 'hybrid',
 'id': 'a816a3a2-a052-5345-8f53-a1206ac57403',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW32861',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 50169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-01',
 'seller_name': None,
 'title': 'MINI Countryman Cooper S E Hybrid ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2017}
2026-03-30 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW32861%27 HTTP/1.1" 200 None
2026-03-30 06:31:06 [auto1.be] INFO: Saving data for VW32861: {'auction_closing_time': 1774883065.0, 'created_time': 1774643481.780312, 'last_price_update_time': 1774852266.059533}
2026-03-30 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VW32861') HTTP/1.1" 204 0
2026-03-30 06:31:06 [auto1.be] INFO: Found listing with ID: LK55982
2026-03-30 06:31:06 [auto1.be] INFO: Found listing with ID: DW77345
2026-03-30 06:31:06 [auto1.be] INFO: Found listing with ID: NN42853
2026-03-30 06:31:06 [auto1.be] INFO: Found listing with ID: CS90165
2026-03-30 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS90165%27 HTTP/1.1" 200 None
2026-03-30 06:31:06 [auto1.be] INFO: Scrape type for CS90165: 2
2026-03-30 06:31:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf424dce-9bd0-590b-8744-14f51e284260 with identifier: CS90165
2026-03-30 06:31:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf424dce-9bd0-590b-8744-14f51e284260 with scrape type 2
2026-03-30 06:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf424dce-9bd0-590b-8744-14f51e284260 with scrape type 2
2026-03-30 06:31:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cf424dce-9bd0-590b-8744-14f51e284260, identifier: CS90165
2026-03-30 06:31:06 [auto1.be] INFO: Found listing with ID: PE83293
2026-03-30 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE83293%27 HTTP/1.1" 200 None
2026-03-30 06:31:06 [auto1.be] INFO: Scrape type for PE83293: 0
2026-03-30 06:31:06 [auto1.be] INFO: Found listing with ID: WA92632
2026-03-30 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA92632%27 HTTP/1.1" 200 None
2026-03-30 06:31:06 [auto1.be] INFO: Scrape type for WA92632: 0
2026-03-30 06:31:06 [auto1.be] INFO: Found listing with ID: ZL15279
2026-03-30 06:31:06 [auto1.be] INFO: Found listing with ID: RW14221
2026-03-30 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW14221%27 HTTP/1.1" 200 None
2026-03-30 06:31:06 [auto1.be] INFO: Scrape type for RW14221: 0
2026-03-30 06:31:06 [auto1.be] INFO: Found listing with ID: WV47829
2026-03-30 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV47829%27 HTTP/1.1" 200 None
2026-03-30 06:31:06 [auto1.be] INFO: Scrape type for WV47829: 2
2026-03-30 06:31:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eadca8bf-3085-55c5-bef2-d61f7a749a42 with identifier: WV47829
2026-03-30 06:31:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eadca8bf-3085-55c5-bef2-d61f7a749a42 with scrape type 2
2026-03-30 06:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eadca8bf-3085-55c5-bef2-d61f7a749a42 with scrape type 2
2026-03-30 06:31:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: eadca8bf-3085-55c5-bef2-d61f7a749a42, identifier: WV47829
2026-03-30 06:31:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cf424dce-9bd0-590b-8744-14f51e284260 with identifier: CS90165
2026-03-30 06:31:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cf424dce-9bd0-590b-8744-14f51e284260 with identifier: CS90165
2026-03-30 06:31:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cf424dce-9bd0-590b-8744-14f51e284260 with identifier: CS90165 to the API
2026-03-30 06:31:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:42:00Z',
 'fuel_type': 'diesel',
 'id': 'cf424dce-9bd0-590b-8744-14f51e284260',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS90165',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 241657,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-07',
 'seller_name': None,
 'title': 'Audi A5 2.0 TDI clean diesel',
 'transmission': 'manual',
 'trim': 'clean diesel',
 'year': 2015}
2026-03-30 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS90165%27 HTTP/1.1" 200 None
2026-03-30 06:31:06 [auto1.be] INFO: Saving data for CS90165: {'auction_closing_time': 1774885320.0, 'created_time': 1774524700.407624, 'last_price_update_time': 1774852266.61111}
2026-03-30 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CS90165') HTTP/1.1" 204 0
2026-03-30 06:31:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: eadca8bf-3085-55c5-bef2-d61f7a749a42 with identifier: WV47829
2026-03-30 06:31:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: eadca8bf-3085-55c5-bef2-d61f7a749a42 with identifier: WV47829
2026-03-30 06:31:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: eadca8bf-3085-55c5-bef2-d61f7a749a42 with identifier: WV47829 to the API
2026-03-30 06:31:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:19:55Z',
 'fuel_type': 'diesel',
 'id': 'eadca8bf-3085-55c5-bef2-d61f7a749a42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV47829',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand Tourneo Connect',
 'odometer': 111467,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-04',
 'seller_name': None,
 'title': 'Ford Grand Tourneo Connect 1.5 EcoBlue TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2021}
2026-03-30 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV47829%27 HTTP/1.1" 200 None
2026-03-30 06:31:06 [auto1.be] INFO: Saving data for WV47829: {'auction_closing_time': 1774883995.0, 'created_time': 1773909053.334438, 'last_price_update_time': 1774852266.891683}
2026-03-30 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WV47829') HTTP/1.1" 204 0
2026-03-30 06:31:06 [auto1.be] INFO: Found listing with ID: LA76788
2026-03-30 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA76788%27 HTTP/1.1" 200 None
2026-03-30 06:31:06 [auto1.be] INFO: Scrape type for LA76788: 2
2026-03-30 06:31:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2c6f3ad-4ef5-5685-9ce0-cbea6dadb640 with identifier: LA76788
2026-03-30 06:31:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2c6f3ad-4ef5-5685-9ce0-cbea6dadb640 with scrape type 2
2026-03-30 06:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2c6f3ad-4ef5-5685-9ce0-cbea6dadb640 with scrape type 2
2026-03-30 06:31:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b2c6f3ad-4ef5-5685-9ce0-cbea6dadb640, identifier: LA76788
2026-03-30 06:31:07 [auto1.be] INFO: Found listing with ID: AK54797
2026-03-30 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK54797%27 HTTP/1.1" 200 None
2026-03-30 06:31:07 [auto1.be] INFO: Scrape type for AK54797: 2
2026-03-30 06:31:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4862eee9-488b-5df7-afbe-2532b1169169 with identifier: AK54797
2026-03-30 06:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4862eee9-488b-5df7-afbe-2532b1169169 with scrape type 2
2026-03-30 06:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4862eee9-488b-5df7-afbe-2532b1169169 with scrape type 2
2026-03-30 06:31:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4862eee9-488b-5df7-afbe-2532b1169169, identifier: AK54797
2026-03-30 06:31:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b2c6f3ad-4ef5-5685-9ce0-cbea6dadb640 with identifier: LA76788
2026-03-30 06:31:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b2c6f3ad-4ef5-5685-9ce0-cbea6dadb640 with identifier: LA76788
2026-03-30 06:31:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b2c6f3ad-4ef5-5685-9ce0-cbea6dadb640 with identifier: LA76788 to the API
2026-03-30 06:31:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:46:58Z',
 'fuel_type': 'diesel',
 'id': 'b2c6f3ad-4ef5-5685-9ce0-cbea6dadb640',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA76788',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 129227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-04',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 SE AWD',
 'transmission': 'automatic',
 'trim': 'SE AWD',
 'year': 2016}
2026-03-30 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA76788%27 HTTP/1.1" 200 None
2026-03-30 06:31:07 [auto1.be] INFO: Saving data for LA76788: {'auction_closing_time': 1774885618.0, 'created_time': 1773866557.317288, 'last_price_update_time': 1774852267.411686}
2026-03-30 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LA76788') HTTP/1.1" 204 0
2026-03-30 06:31:07 [scrapy.extensions.logstats] INFO: Crawled 24 pages (at 24 pages/min), scraped 67 items (at 67 items/min)
2026-03-30 06:31:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 165MiB
2026-03-30 06:31:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4862eee9-488b-5df7-afbe-2532b1169169 with identifier: AK54797
2026-03-30 06:31:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4862eee9-488b-5df7-afbe-2532b1169169 with identifier: AK54797
2026-03-30 06:31:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4862eee9-488b-5df7-afbe-2532b1169169 with identifier: AK54797 to the API
2026-03-30 06:31:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:24:15Z',
 'fuel_type': 'diesel',
 'id': '4862eee9-488b-5df7-afbe-2532b1169169',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK54797',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 113656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-15',
 'seller_name': None,
 'title': 'Land Rover Evoque D165 Mild-Hybrid R-Dynamic S',
 'transmission': 'automatic',
 'trim': 'R-Dynamic S',
 'year': 2021}
2026-03-30 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK54797%27 HTTP/1.1" 200 None
2026-03-30 06:31:07 [auto1.be] INFO: Saving data for AK54797: {'auction_closing_time': 1774884255.0, 'created_time': 1774557066.316145, 'last_price_update_time': 1774852267.800528}
2026-03-30 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AK54797') HTTP/1.1" 204 0
2026-03-30 06:31:07 [auto1.be] INFO: Found listing with ID: HB19534
2026-03-30 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB19534%27 HTTP/1.1" 200 None
2026-03-30 06:31:07 [auto1.be] INFO: Scrape type for HB19534: 0
2026-03-30 06:31:07 [auto1.be] INFO: Found listing with ID: AY47657
2026-03-30 06:31:07 [auto1.be] INFO: Found listing with ID: BU27000
2026-03-30 06:31:07 [auto1.be] INFO: Found listing with ID: PL61351
2026-03-30 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL61351%27 HTTP/1.1" 200 None
2026-03-30 06:31:07 [auto1.be] INFO: Scrape type for PL61351: 2
2026-03-30 06:31:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9ddad94-b6c8-5f03-8a21-5df36bca4e3a with identifier: PL61351
2026-03-30 06:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9ddad94-b6c8-5f03-8a21-5df36bca4e3a with scrape type 2
2026-03-30 06:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9ddad94-b6c8-5f03-8a21-5df36bca4e3a with scrape type 2
2026-03-30 06:31:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f9ddad94-b6c8-5f03-8a21-5df36bca4e3a, identifier: PL61351
2026-03-30 06:31:07 [auto1.be] INFO: Found listing with ID: LK29098
2026-03-30 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK29098%27 HTTP/1.1" 200 None
2026-03-30 06:31:07 [auto1.be] INFO: Scrape type for LK29098: 0
2026-03-30 06:31:07 [auto1.be] INFO: Found listing with ID: YP74524
2026-03-30 06:31:07 [auto1.be] INFO: Found listing with ID: DY69036
2026-03-30 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY69036%27 HTTP/1.1" 200 None
2026-03-30 06:31:07 [auto1.be] INFO: Scrape type for DY69036: 2
2026-03-30 06:31:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e19a411a-5376-51bb-adec-fa5662b5b79f with identifier: DY69036
2026-03-30 06:31:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e19a411a-5376-51bb-adec-fa5662b5b79f with scrape type 2
2026-03-30 06:31:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e19a411a-5376-51bb-adec-fa5662b5b79f with scrape type 2
2026-03-30 06:31:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e19a411a-5376-51bb-adec-fa5662b5b79f, identifier: DY69036
2026-03-30 06:31:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f9ddad94-b6c8-5f03-8a21-5df36bca4e3a with identifier: PL61351
2026-03-30 06:31:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f9ddad94-b6c8-5f03-8a21-5df36bca4e3a with identifier: PL61351
2026-03-30 06:31:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f9ddad94-b6c8-5f03-8a21-5df36bca4e3a with identifier: PL61351 to the API
2026-03-30 06:31:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:06:55Z',
 'fuel_type': 'diesel',
 'id': 'f9ddad94-b6c8-5f03-8a21-5df36bca4e3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL61351',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 209058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-27',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Join',
 'transmission': 'automatic',
 'trim': 'Join',
 'year': 2019}
2026-03-30 06:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL61351%27 HTTP/1.1" 200 None
2026-03-30 06:31:08 [auto1.be] INFO: Saving data for PL61351: {'auction_closing_time': 1774883215.0, 'created_time': 1774557242.383892, 'last_price_update_time': 1774852268.340122}
2026-03-30 06:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PL61351') HTTP/1.1" 204 0
2026-03-30 06:31:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e19a411a-5376-51bb-adec-fa5662b5b79f with identifier: DY69036
2026-03-30 06:31:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:31:08 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-30 06:31:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:31:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e19a411a-5376-51bb-adec-fa5662b5b79f with identifier: DY69036
2026-03-30 06:31:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e19a411a-5376-51bb-adec-fa5662b5b79f with identifier: DY69036 to the API
2026-03-30 06:31:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:36:25Z',
 'fuel_type': 'diesel',
 'id': 'e19a411a-5376-51bb-adec-fa5662b5b79f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY69036',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 188759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-16',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2009}
2026-03-30 06:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY69036%27 HTTP/1.1" 200 None
2026-03-30 06:31:08 [auto1.be] INFO: Saving data for DY69036: {'auction_closing_time': 1774884985.0, 'created_time': 1774643649.750288, 'last_price_update_time': 1774852268.749838}
2026-03-30 06:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DY69036') HTTP/1.1" 204 0
2026-03-30 06:31:08 [auto1.be] INFO: Found listing with ID: AE13452
2026-03-30 06:31:08 [auto1.be] INFO: Found listing with ID: FG26500
2026-03-30 06:31:08 [auto1.be] INFO: Found listing with ID: WP32655
2026-03-30 06:31:08 [auto1.be] INFO: Found listing with ID: MC44479
2026-03-30 06:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC44479%27 HTTP/1.1" 200 None
2026-03-30 06:31:08 [auto1.be] INFO: Scrape type for MC44479: 0
2026-03-30 06:31:08 [auto1.be] INFO: Found listing with ID: SC04496
2026-03-30 06:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC04496%27 HTTP/1.1" 200 None
2026-03-30 06:31:08 [auto1.be] INFO: Scrape type for SC04496: 0
2026-03-30 06:31:08 [auto1.be] INFO: Found listing with ID: CC56747
2026-03-30 06:31:08 [auto1.be] INFO: Found listing with ID: XJ47711
2026-03-30 06:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ47711%27 HTTP/1.1" 200 None
2026-03-30 06:31:08 [auto1.be] INFO: Scrape type for XJ47711: 0
2026-03-30 06:31:08 [auto1.be] INFO: Found listing with ID: CK49467
2026-03-30 06:31:08 [auto1.be] INFO: Found listing with ID: JA34397
2026-03-30 06:31:08 [auto1.be] INFO: Found listing with ID: XC31503
2026-03-30 06:31:08 [auto1.be] INFO: Found listing with ID: LE58292
2026-03-30 06:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE58292%27 HTTP/1.1" 200 None
2026-03-30 06:31:08 [auto1.be] INFO: Scrape type for LE58292: 2
2026-03-30 06:31:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e88dec51-e319-5ca0-abb3-23e230e11298 with identifier: LE58292
2026-03-30 06:31:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e88dec51-e319-5ca0-abb3-23e230e11298 with scrape type 2
2026-03-30 06:31:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e88dec51-e319-5ca0-abb3-23e230e11298 with scrape type 2
2026-03-30 06:31:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e88dec51-e319-5ca0-abb3-23e230e11298, identifier: LE58292
2026-03-30 06:31:08 [auto1.be] INFO: Found listing with ID: YG22909
2026-03-30 06:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG22909%27 HTTP/1.1" 200 None
2026-03-30 06:31:08 [auto1.be] INFO: Scrape type for YG22909: 0
2026-03-30 06:31:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e88dec51-e319-5ca0-abb3-23e230e11298 with identifier: LE58292
2026-03-30 06:31:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e88dec51-e319-5ca0-abb3-23e230e11298 with identifier: LE58292
2026-03-30 06:31:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e88dec51-e319-5ca0-abb3-23e230e11298 with identifier: LE58292 to the API
2026-03-30 06:31:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:32:18Z',
 'fuel_type': 'diesel',
 'id': 'e88dec51-e319-5ca0-abb3-23e230e11298',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE58292',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 113628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-26',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D2 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2016}
2026-03-30 06:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE58292%27 HTTP/1.1" 200 None
2026-03-30 06:31:09 [auto1.be] INFO: Saving data for LE58292: {'auction_closing_time': 1774884738.0, 'created_time': 1774524704.281292, 'last_price_update_time': 1774852269.229059}
2026-03-30 06:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LE58292') HTTP/1.1" 204 0
2026-03-30 06:31:09 [auto1.be] INFO: Found listing with ID: DL17322
2026-03-30 06:31:09 [auto1.be] INFO: Found listing with ID: SE12861
2026-03-30 06:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE12861%27 HTTP/1.1" 200 None
2026-03-30 06:31:09 [auto1.be] INFO: Scrape type for SE12861: 2
2026-03-30 06:31:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3958b6f2-330e-537a-b8a3-483a87ed7f71 with identifier: SE12861
2026-03-30 06:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3958b6f2-330e-537a-b8a3-483a87ed7f71 with scrape type 2
2026-03-30 06:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3958b6f2-330e-537a-b8a3-483a87ed7f71 with scrape type 2
2026-03-30 06:31:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3958b6f2-330e-537a-b8a3-483a87ed7f71, identifier: SE12861
2026-03-30 06:31:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3958b6f2-330e-537a-b8a3-483a87ed7f71 with identifier: SE12861
2026-03-30 06:31:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3958b6f2-330e-537a-b8a3-483a87ed7f71 with identifier: SE12861
2026-03-30 06:31:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3958b6f2-330e-537a-b8a3-483a87ed7f71 with identifier: SE12861 to the API
2026-03-30 06:31:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:05:33Z',
 'fuel_type': 'diesel',
 'id': '3958b6f2-330e-537a-b8a3-483a87ed7f71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE12861',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 206586,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-06',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-30 06:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SE12861%27 HTTP/1.1" 200 None
2026-03-30 06:31:09 [auto1.be] INFO: Saving data for SE12861: {'auction_closing_time': 1774883133.0, 'created_time': 1774643610.224222, 'last_price_update_time': 1774852269.700791}
2026-03-30 06:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SE12861') HTTP/1.1" 204 0
2026-03-30 06:31:09 [auto1.be] INFO: Found listing with ID: BJ27729
2026-03-30 06:31:09 [auto1.be] INFO: Found listing with ID: YM63500
2026-03-30 06:31:09 [auto1.be] INFO: Found listing with ID: DP96573
2026-03-30 06:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP96573%27 HTTP/1.1" 200 None
2026-03-30 06:31:09 [auto1.be] INFO: Scrape type for DP96573: 0
2026-03-30 06:31:09 [auto1.be] INFO: Found listing with ID: EN18719
2026-03-30 06:31:09 [auto1.be] INFO: Found listing with ID: WH07577
2026-03-30 06:31:09 [auto1.be] INFO: Found listing with ID: LJ91533
2026-03-30 06:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LJ91533%27 HTTP/1.1" 200 None
2026-03-30 06:31:09 [auto1.be] INFO: Scrape type for LJ91533: 2
2026-03-30 06:31:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7845b786-ced6-52e0-b98e-ad07e24228e2 with identifier: LJ91533
2026-03-30 06:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7845b786-ced6-52e0-b98e-ad07e24228e2 with scrape type 2
2026-03-30 06:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7845b786-ced6-52e0-b98e-ad07e24228e2 with scrape type 2
2026-03-30 06:31:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7845b786-ced6-52e0-b98e-ad07e24228e2, identifier: LJ91533
2026-03-30 06:31:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7845b786-ced6-52e0-b98e-ad07e24228e2 with identifier: LJ91533
2026-03-30 06:31:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7845b786-ced6-52e0-b98e-ad07e24228e2 with identifier: LJ91533
2026-03-30 06:31:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7845b786-ced6-52e0-b98e-ad07e24228e2 with identifier: LJ91533 to the API
2026-03-30 06:31:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:02:43Z',
 'fuel_type': 'diesel',
 'id': '7845b786-ced6-52e0-b98e-ad07e24228e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ91533',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 249231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-10',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2010}
2026-03-30 06:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LJ91533%27 HTTP/1.1" 200 None
2026-03-30 06:31:10 [auto1.be] INFO: Saving data for LJ91533: {'auction_closing_time': 1774882963.0, 'created_time': 1774643660.82226, 'last_price_update_time': 1774852270.115051}
2026-03-30 06:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LJ91533') HTTP/1.1" 204 0
2026-03-30 06:31:10 [auto1.be] INFO: Found listing with ID: TY52799
2026-03-30 06:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY52799%27 HTTP/1.1" 200 None
2026-03-30 06:31:10 [auto1.be] INFO: Scrape type for TY52799: 2
2026-03-30 06:31:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 381d8655-56fb-5dab-ac63-b55d8beb6d0e with identifier: TY52799
2026-03-30 06:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 381d8655-56fb-5dab-ac63-b55d8beb6d0e with scrape type 2
2026-03-30 06:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 381d8655-56fb-5dab-ac63-b55d8beb6d0e with scrape type 2
2026-03-30 06:31:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 381d8655-56fb-5dab-ac63-b55d8beb6d0e, identifier: TY52799
2026-03-30 06:31:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 381d8655-56fb-5dab-ac63-b55d8beb6d0e with identifier: TY52799
2026-03-30 06:31:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 381d8655-56fb-5dab-ac63-b55d8beb6d0e with identifier: TY52799
2026-03-30 06:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 381d8655-56fb-5dab-ac63-b55d8beb6d0e with identifier: TY52799 to the API
2026-03-30 06:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:29:58Z',
 'fuel_type': 'diesel',
 'id': '381d8655-56fb-5dab-ac63-b55d8beb6d0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY52799',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 133263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-23',
 'seller_name': None,
 'title': 'BMW 1er 116d',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-30 06:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY52799%27 HTTP/1.1" 200 None
2026-03-30 06:31:10 [auto1.be] INFO: Saving data for TY52799: {'auction_closing_time': 1774884598.0, 'created_time': 1773866650.163275, 'last_price_update_time': 1774852270.523901}
2026-03-30 06:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TY52799') HTTP/1.1" 204 0
2026-03-30 06:31:10 [auto1.be] INFO: Found listing with ID: EM18277
2026-03-30 06:31:10 [auto1.be] INFO: Found listing with ID: XJ49438
2026-03-30 06:31:10 [auto1.be] INFO: Found listing with ID: ZB59407
2026-03-30 06:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZB59407%27 HTTP/1.1" 200 None
2026-03-30 06:31:10 [auto1.be] INFO: Scrape type for ZB59407: 2
2026-03-30 06:31:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82a3ea25-3305-5fd5-9dfa-25983e9f96f3 with identifier: ZB59407
2026-03-30 06:31:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82a3ea25-3305-5fd5-9dfa-25983e9f96f3 with scrape type 2
2026-03-30 06:31:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82a3ea25-3305-5fd5-9dfa-25983e9f96f3 with scrape type 2
2026-03-30 06:31:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 82a3ea25-3305-5fd5-9dfa-25983e9f96f3, identifier: ZB59407
2026-03-30 06:31:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 82a3ea25-3305-5fd5-9dfa-25983e9f96f3 with identifier: ZB59407
2026-03-30 06:31:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 82a3ea25-3305-5fd5-9dfa-25983e9f96f3 with identifier: ZB59407
2026-03-30 06:31:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 82a3ea25-3305-5fd5-9dfa-25983e9f96f3 with identifier: ZB59407 to the API
2026-03-30 06:31:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:21:40Z',
 'fuel_type': 'petrol',
 'id': '82a3ea25-3305-5fd5-9dfa-25983e9f96f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB59407',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 102886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-11',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.2 e-THP Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2019}
2026-03-30 06:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZB59407%27 HTTP/1.1" 200 None
2026-03-30 06:31:10 [auto1.be] INFO: Saving data for ZB59407: {'auction_closing_time': 1774884100.0, 'created_time': 1773747683.859757, 'last_price_update_time': 1774852270.920082}
2026-03-30 06:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZB59407') HTTP/1.1" 204 0
2026-03-30 06:31:11 [auto1.be] INFO: Found listing with ID: YW29468
2026-03-30 06:31:11 [auto1.be] INFO: Found listing with ID: NU46591
2026-03-30 06:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU46591%27 HTTP/1.1" 200 None
2026-03-30 06:31:11 [auto1.be] INFO: Scrape type for NU46591: 2
2026-03-30 06:31:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 985a2368-356f-5991-b43b-36c54861b5b5 with identifier: NU46591
2026-03-30 06:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 985a2368-356f-5991-b43b-36c54861b5b5 with scrape type 2
2026-03-30 06:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 985a2368-356f-5991-b43b-36c54861b5b5 with scrape type 2
2026-03-30 06:31:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 985a2368-356f-5991-b43b-36c54861b5b5, identifier: NU46591
2026-03-30 06:31:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 985a2368-356f-5991-b43b-36c54861b5b5 with identifier: NU46591
2026-03-30 06:31:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 985a2368-356f-5991-b43b-36c54861b5b5 with identifier: NU46591
2026-03-30 06:31:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 985a2368-356f-5991-b43b-36c54861b5b5 with identifier: NU46591 to the API
2026-03-30 06:31:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 530,
 'expiration_date': '2026-03-30T15:12:21Z',
 'fuel_type': 'petrol',
 'id': '985a2368-356f-5991-b43b-36c54861b5b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU46591',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X7',
 'odometer': 82957,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-15',
 'seller_name': None,
 'title': 'BMW X7 M50i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-30 06:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU46591%27 HTTP/1.1" 200 None
2026-03-30 06:31:11 [auto1.be] INFO: Saving data for NU46591: {'auction_closing_time': 1774883541.0, 'created_time': 1774643647.550374, 'last_price_update_time': 1774852271.378389}
2026-03-30 06:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NU46591') HTTP/1.1" 204 0
2026-03-30 06:31:11 [auto1.be] INFO: Found listing with ID: AS01915
2026-03-30 06:31:11 [auto1.be] INFO: Found listing with ID: AB44644
2026-03-30 06:31:11 [auto1.be] INFO: Found listing with ID: XM93272
2026-03-30 06:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM93272%27 HTTP/1.1" 200 None
2026-03-30 06:31:11 [auto1.be] INFO: Scrape type for XM93272: 0
2026-03-30 06:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:31:11 [auto1.be] INFO: Channel: 24h | Page: 11 | totalHits: 1288 | hits on page: 40
2026-03-30 06:31:11 [auto1.be] INFO: Found listing with ID: TL07516
2026-03-30 06:31:11 [auto1.be] INFO: Found listing with ID: CS76215
2026-03-30 06:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS76215%27 HTTP/1.1" 200 None
2026-03-30 06:31:11 [auto1.be] INFO: Scrape type for CS76215: 2
2026-03-30 06:31:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41cb4f8b-3f47-5e1f-93ef-6b7506c322af with identifier: CS76215
2026-03-30 06:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41cb4f8b-3f47-5e1f-93ef-6b7506c322af with scrape type 2
2026-03-30 06:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41cb4f8b-3f47-5e1f-93ef-6b7506c322af with scrape type 2
2026-03-30 06:31:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 41cb4f8b-3f47-5e1f-93ef-6b7506c322af, identifier: CS76215
2026-03-30 06:31:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 41cb4f8b-3f47-5e1f-93ef-6b7506c322af with identifier: CS76215
2026-03-30 06:31:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:31:11 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-30 06:31:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:31:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 41cb4f8b-3f47-5e1f-93ef-6b7506c322af with identifier: CS76215
2026-03-30 06:31:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 41cb4f8b-3f47-5e1f-93ef-6b7506c322af with identifier: CS76215 to the API
2026-03-30 06:31:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:01:31Z',
 'fuel_type': 'petrol',
 'id': '41cb4f8b-3f47-5e1f-93ef-6b7506c322af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS76215',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 115278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-06',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Signature',
 'transmission': 'manual',
 'trim': 'Signature',
 'year': 2020}
2026-03-30 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS76215%27 HTTP/1.1" 200 None
2026-03-30 06:31:12 [auto1.be] INFO: Saving data for CS76215: {'auction_closing_time': 1774882891.0, 'created_time': 1774557107.100583, 'last_price_update_time': 1774852272.01338}
2026-03-30 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CS76215') HTTP/1.1" 204 0
2026-03-30 06:31:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:31:12 [auto1.be] INFO: Found listing with ID: JK00802
2026-03-30 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JK00802%27 HTTP/1.1" 200 None
2026-03-30 06:31:12 [auto1.be] INFO: Scrape type for JK00802: 2
2026-03-30 06:31:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a115b03-bae1-5659-b73c-a9b56f44c662 with identifier: JK00802
2026-03-30 06:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a115b03-bae1-5659-b73c-a9b56f44c662 with scrape type 2
2026-03-30 06:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a115b03-bae1-5659-b73c-a9b56f44c662 with scrape type 2
2026-03-30 06:31:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3a115b03-bae1-5659-b73c-a9b56f44c662, identifier: JK00802
2026-03-30 06:31:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3a115b03-bae1-5659-b73c-a9b56f44c662 with identifier: JK00802
2026-03-30 06:31:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3a115b03-bae1-5659-b73c-a9b56f44c662 with identifier: JK00802
2026-03-30 06:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3a115b03-bae1-5659-b73c-a9b56f44c662 with identifier: JK00802 to the API
2026-03-30 06:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:58:28Z',
 'fuel_type': 'diesel',
 'id': '3a115b03-bae1-5659-b73c-a9b56f44c662',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK00802',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 182688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-02-27',
 'seller_name': None,
 'title': 'Skoda Octavia 1.9 TDI Tour',
 'transmission': 'manual',
 'trim': 'Tour',
 'year': 2006}
2026-03-30 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JK00802%27 HTTP/1.1" 200 None
2026-03-30 06:31:12 [auto1.be] INFO: Saving data for JK00802: {'auction_closing_time': 1774886308.0, 'created_time': 1774643433.28042, 'last_price_update_time': 1774852272.40901}
2026-03-30 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JK00802') HTTP/1.1" 204 0
2026-03-30 06:31:12 [auto1.be] INFO: Found listing with ID: WD81319
2026-03-30 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD81319%27 HTTP/1.1" 200 None
2026-03-30 06:31:12 [auto1.be] INFO: Scrape type for WD81319: 2
2026-03-30 06:31:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09ee685d-6fce-52ec-9f94-6ed2aaf8c349 with identifier: WD81319
2026-03-30 06:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09ee685d-6fce-52ec-9f94-6ed2aaf8c349 with scrape type 2
2026-03-30 06:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09ee685d-6fce-52ec-9f94-6ed2aaf8c349 with scrape type 2
2026-03-30 06:31:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 09ee685d-6fce-52ec-9f94-6ed2aaf8c349, identifier: WD81319
2026-03-30 06:31:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 09ee685d-6fce-52ec-9f94-6ed2aaf8c349 with identifier: WD81319
2026-03-30 06:31:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 09ee685d-6fce-52ec-9f94-6ed2aaf8c349 with identifier: WD81319
2026-03-30 06:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 09ee685d-6fce-52ec-9f94-6ed2aaf8c349 with identifier: WD81319 to the API
2026-03-30 06:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:45:37Z',
 'fuel_type': 'petrol',
 'id': '09ee685d-6fce-52ec-9f94-6ed2aaf8c349',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD81319',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 61727,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-18',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-30 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD81319%27 HTTP/1.1" 200 None
2026-03-30 06:31:12 [auto1.be] INFO: Saving data for WD81319: {'auction_closing_time': 1774885537.0, 'created_time': 1774643664.285306, 'last_price_update_time': 1774852272.765322}
2026-03-30 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WD81319') HTTP/1.1" 204 0
2026-03-30 06:31:12 [auto1.be] INFO: Found listing with ID: WA82695
2026-03-30 06:31:12 [auto1.be] INFO: Found listing with ID: ZM54310
2026-03-30 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM54310%27 HTTP/1.1" 200 None
2026-03-30 06:31:12 [auto1.be] INFO: Scrape type for ZM54310: 0
2026-03-30 06:31:12 [auto1.be] INFO: Found listing with ID: AF68960
2026-03-30 06:31:12 [auto1.be] INFO: Found listing with ID: RW94228
2026-03-30 06:31:12 [auto1.be] INFO: Found listing with ID: FE52220
2026-03-30 06:31:12 [auto1.be] INFO: Found listing with ID: MZ83142
2026-03-30 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ83142%27 HTTP/1.1" 200 None
2026-03-30 06:31:12 [auto1.be] INFO: Scrape type for MZ83142: 2
2026-03-30 06:31:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa8dc67b-4464-57eb-8fee-49e21b2fe627 with identifier: MZ83142
2026-03-30 06:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa8dc67b-4464-57eb-8fee-49e21b2fe627 with scrape type 2
2026-03-30 06:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa8dc67b-4464-57eb-8fee-49e21b2fe627 with scrape type 2
2026-03-30 06:31:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fa8dc67b-4464-57eb-8fee-49e21b2fe627, identifier: MZ83142
2026-03-30 06:31:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fa8dc67b-4464-57eb-8fee-49e21b2fe627 with identifier: MZ83142
2026-03-30 06:31:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fa8dc67b-4464-57eb-8fee-49e21b2fe627 with identifier: MZ83142
2026-03-30 06:31:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fa8dc67b-4464-57eb-8fee-49e21b2fe627 with identifier: MZ83142 to the API
2026-03-30 06:31:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:52:43Z',
 'fuel_type': 'diesel',
 'id': 'fa8dc67b-4464-57eb-8fee-49e21b2fe627',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ83142',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 187766,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-17',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2016}
2026-03-30 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ83142%27 HTTP/1.1" 200 None
2026-03-30 06:31:13 [auto1.be] INFO: Saving data for MZ83142: {'auction_closing_time': 1774885963.0, 'created_time': 1773866096.224422, 'last_price_update_time': 1774852273.198234}
2026-03-30 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MZ83142') HTTP/1.1" 204 0
2026-03-30 06:31:13 [auto1.be] INFO: Found listing with ID: YG62523
2026-03-30 06:31:13 [auto1.be] INFO: Found listing with ID: CA72484
2026-03-30 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA72484%27 HTTP/1.1" 200 None
2026-03-30 06:31:13 [auto1.be] INFO: Scrape type for CA72484: 2
2026-03-30 06:31:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d0e83ae-50c5-5e36-a54e-a86862682694 with identifier: CA72484
2026-03-30 06:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d0e83ae-50c5-5e36-a54e-a86862682694 with scrape type 2
2026-03-30 06:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d0e83ae-50c5-5e36-a54e-a86862682694 with scrape type 2
2026-03-30 06:31:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4d0e83ae-50c5-5e36-a54e-a86862682694, identifier: CA72484
2026-03-30 06:31:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4d0e83ae-50c5-5e36-a54e-a86862682694 with identifier: CA72484
2026-03-30 06:31:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4d0e83ae-50c5-5e36-a54e-a86862682694 with identifier: CA72484
2026-03-30 06:31:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4d0e83ae-50c5-5e36-a54e-a86862682694 with identifier: CA72484 to the API
2026-03-30 06:31:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:07:02Z',
 'fuel_type': 'diesel',
 'id': '4d0e83ae-50c5-5e36-a54e-a86862682694',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA72484',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 54019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-24',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Live M',
 'transmission': 'manual',
 'trim': 'Live M',
 'year': 2021}
2026-03-30 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA72484%27 HTTP/1.1" 200 None
2026-03-30 06:31:13 [auto1.be] INFO: Saving data for CA72484: {'auction_closing_time': 1774883222.0, 'created_time': 1774254701.393151, 'last_price_update_time': 1774852273.666208}
2026-03-30 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CA72484') HTTP/1.1" 204 0
2026-03-30 06:31:13 [auto1.be] INFO: Found listing with ID: XK61886
2026-03-30 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK61886%27 HTTP/1.1" 200 None
2026-03-30 06:31:13 [auto1.be] INFO: Scrape type for XK61886: 0
2026-03-30 06:31:13 [auto1.be] INFO: Found listing with ID: VU61418
2026-03-30 06:31:13 [auto1.be] INFO: Found listing with ID: XC82229
2026-03-30 06:31:13 [auto1.be] INFO: Found listing with ID: ZF47475
2026-03-30 06:31:13 [auto1.be] INFO: Found listing with ID: SD60477
2026-03-30 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD60477%27 HTTP/1.1" 200 None
2026-03-30 06:31:13 [auto1.be] INFO: Scrape type for SD60477: 0
2026-03-30 06:31:13 [auto1.be] INFO: Found listing with ID: PP48497
2026-03-30 06:31:13 [auto1.be] INFO: Found listing with ID: YB47559
2026-03-30 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB47559%27 HTTP/1.1" 200 None
2026-03-30 06:31:13 [auto1.be] INFO: Scrape type for YB47559: 2
2026-03-30 06:31:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c434bced-6124-571a-ab44-4176838b7555 with identifier: YB47559
2026-03-30 06:31:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c434bced-6124-571a-ab44-4176838b7555 with scrape type 2
2026-03-30 06:31:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c434bced-6124-571a-ab44-4176838b7555 with scrape type 2
2026-03-30 06:31:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c434bced-6124-571a-ab44-4176838b7555, identifier: YB47559
2026-03-30 06:31:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c434bced-6124-571a-ab44-4176838b7555 with identifier: YB47559
2026-03-30 06:31:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c434bced-6124-571a-ab44-4176838b7555 with identifier: YB47559
2026-03-30 06:31:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c434bced-6124-571a-ab44-4176838b7555 with identifier: YB47559 to the API
2026-03-30 06:31:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:56:10Z',
 'fuel_type': 'diesel',
 'id': 'c434bced-6124-571a-ab44-4176838b7555',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB47559',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 184273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-11',
 'seller_name': None,
 'title': 'Nissan X-Trail 1.6 dCi Tekna',
 'transmission': 'automatic',
 'trim': 'Tekna',
 'year': 2015}
2026-03-30 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB47559%27 HTTP/1.1" 200 None
2026-03-30 06:31:14 [auto1.be] INFO: Saving data for YB47559: {'auction_closing_time': 1774886170.0, 'created_time': 1773434299.099478, 'last_price_update_time': 1774852274.108351}
2026-03-30 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YB47559') HTTP/1.1" 204 0
2026-03-30 06:31:14 [auto1.be] INFO: Found listing with ID: PT26763
2026-03-30 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PT26763%27 HTTP/1.1" 200 None
2026-03-30 06:31:14 [auto1.be] INFO: Scrape type for PT26763: 2
2026-03-30 06:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 587ea13f-532d-5194-a614-83d6c952f2dc with identifier: PT26763
2026-03-30 06:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 587ea13f-532d-5194-a614-83d6c952f2dc with scrape type 2
2026-03-30 06:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 587ea13f-532d-5194-a614-83d6c952f2dc with scrape type 2
2026-03-30 06:31:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 587ea13f-532d-5194-a614-83d6c952f2dc, identifier: PT26763
2026-03-30 06:31:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 587ea13f-532d-5194-a614-83d6c952f2dc with identifier: PT26763
2026-03-30 06:31:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 587ea13f-532d-5194-a614-83d6c952f2dc with identifier: PT26763
2026-03-30 06:31:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 587ea13f-532d-5194-a614-83d6c952f2dc with identifier: PT26763 to the API
2026-03-30 06:31:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:33:17Z',
 'fuel_type': 'diesel',
 'id': '587ea13f-532d-5194-a614-83d6c952f2dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT26763',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 175344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-20',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 d BlueTEC Avantgarde',
 'transmission': 'manual',
 'trim': 'BlueTEC Avantgarde',
 'year': 2015}
2026-03-30 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PT26763%27 HTTP/1.1" 200 None
2026-03-30 06:31:14 [auto1.be] INFO: Saving data for PT26763: {'auction_closing_time': 1774884797.0, 'created_time': 1774643626.180468, 'last_price_update_time': 1774852274.476859}
2026-03-30 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PT26763') HTTP/1.1" 204 0
2026-03-30 06:31:14 [auto1.be] INFO: Found listing with ID: PN18532
2026-03-30 06:31:14 [auto1.be] INFO: Found listing with ID: DH81993
2026-03-30 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH81993%27 HTTP/1.1" 200 None
2026-03-30 06:31:14 [auto1.be] INFO: Scrape type for DH81993: 2
2026-03-30 06:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37c842aa-bc4f-5da9-a78d-74a263351f67 with identifier: DH81993
2026-03-30 06:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37c842aa-bc4f-5da9-a78d-74a263351f67 with scrape type 2
2026-03-30 06:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37c842aa-bc4f-5da9-a78d-74a263351f67 with scrape type 2
2026-03-30 06:31:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 37c842aa-bc4f-5da9-a78d-74a263351f67, identifier: DH81993
2026-03-30 06:31:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 37c842aa-bc4f-5da9-a78d-74a263351f67 with identifier: DH81993
2026-03-30 06:31:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 37c842aa-bc4f-5da9-a78d-74a263351f67 with identifier: DH81993
2026-03-30 06:31:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 37c842aa-bc4f-5da9-a78d-74a263351f67 with identifier: DH81993 to the API
2026-03-30 06:31:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:57:38Z',
 'fuel_type': 'diesel',
 'id': '37c842aa-bc4f-5da9-a78d-74a263351f67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH81993',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 164928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-10',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI quattro Ambition',
 'transmission': 'manual',
 'trim': 'quattro Ambition',
 'year': 2014}
2026-03-30 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH81993%27 HTTP/1.1" 200 None
2026-03-30 06:31:14 [auto1.be] INFO: Saving data for DH81993: {'auction_closing_time': 1774886258.0, 'created_time': 1774557032.149476, 'last_price_update_time': 1774852274.867287}
2026-03-30 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DH81993') HTTP/1.1" 204 0
2026-03-30 06:31:14 [auto1.be] INFO: Found listing with ID: VD09174
2026-03-30 06:31:14 [auto1.be] INFO: Found listing with ID: FY33898
2026-03-30 06:31:14 [auto1.be] INFO: Found listing with ID: ST89131
2026-03-30 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST89131%27 HTTP/1.1" 200 None
2026-03-30 06:31:14 [auto1.be] INFO: Scrape type for ST89131: 0
2026-03-30 06:31:14 [auto1.be] INFO: Found listing with ID: TU68669
2026-03-30 06:31:14 [auto1.be] INFO: Found listing with ID: PC96861
2026-03-30 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC96861%27 HTTP/1.1" 200 None
2026-03-30 06:31:15 [auto1.be] INFO: Scrape type for PC96861: 2
2026-03-30 06:31:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1db3aabd-187e-5b20-b476-734ae3ac1f01 with identifier: PC96861
2026-03-30 06:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1db3aabd-187e-5b20-b476-734ae3ac1f01 with scrape type 2
2026-03-30 06:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1db3aabd-187e-5b20-b476-734ae3ac1f01 with scrape type 2
2026-03-30 06:31:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1db3aabd-187e-5b20-b476-734ae3ac1f01, identifier: PC96861
2026-03-30 06:31:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1db3aabd-187e-5b20-b476-734ae3ac1f01 with identifier: PC96861
2026-03-30 06:31:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1db3aabd-187e-5b20-b476-734ae3ac1f01 with identifier: PC96861
2026-03-30 06:31:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1db3aabd-187e-5b20-b476-734ae3ac1f01 with identifier: PC96861 to the API
2026-03-30 06:31:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:24:05Z',
 'fuel_type': 'diesel',
 'id': '1db3aabd-187e-5b20-b476-734ae3ac1f01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC96861',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 205828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-04',
 'seller_name': None,
 'title': 'BMW X1 sDrive 20d Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2017}
2026-03-30 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC96861%27 HTTP/1.1" 200 None
2026-03-30 06:31:15 [auto1.be] INFO: Saving data for PC96861: {'auction_closing_time': 1774884245.0, 'created_time': 1773301753.190102, 'last_price_update_time': 1774852275.3757}
2026-03-30 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PC96861') HTTP/1.1" 204 0
2026-03-30 06:31:15 [auto1.be] INFO: Found listing with ID: PH64665
2026-03-30 06:31:15 [auto1.be] INFO: Found listing with ID: RH07818
2026-03-30 06:31:15 [auto1.be] INFO: Found listing with ID: LT97220
2026-03-30 06:31:15 [auto1.be] INFO: Found listing with ID: ML35155
2026-03-30 06:31:15 [auto1.be] INFO: Found listing with ID: UB84637
2026-03-30 06:31:15 [auto1.be] INFO: Found listing with ID: YV36261
2026-03-30 06:31:15 [auto1.be] INFO: Found listing with ID: XJ82974
2026-03-30 06:31:15 [auto1.be] INFO: Found listing with ID: MB19665
2026-03-30 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB19665%27 HTTP/1.1" 200 None
2026-03-30 06:31:15 [auto1.be] INFO: Scrape type for MB19665: 0
2026-03-30 06:31:15 [auto1.be] INFO: Found listing with ID: SJ78748
2026-03-30 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ78748%27 HTTP/1.1" 200 None
2026-03-30 06:31:15 [auto1.be] INFO: Scrape type for SJ78748: 0
2026-03-30 06:31:15 [auto1.be] INFO: Found listing with ID: UM90025
2026-03-30 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM90025%27 HTTP/1.1" 200 None
2026-03-30 06:31:15 [auto1.be] INFO: Scrape type for UM90025: 0
2026-03-30 06:31:15 [auto1.be] INFO: Found listing with ID: NC04706
2026-03-30 06:31:15 [auto1.be] INFO: Found listing with ID: CD06973
2026-03-30 06:31:15 [auto1.be] INFO: Found listing with ID: LW74134
2026-03-30 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW74134%27 HTTP/1.1" 200 None
2026-03-30 06:31:15 [auto1.be] INFO: Scrape type for LW74134: 0
2026-03-30 06:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:31:15 [auto1.be] INFO: Channel: 24h | Page: 12 | totalHits: 1288 | hits on page: 40
2026-03-30 06:31:15 [auto1.be] INFO: Found listing with ID: WE68493
2026-03-30 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE68493%27 HTTP/1.1" 200 None
2026-03-30 06:31:15 [auto1.be] INFO: Scrape type for WE68493: 2
2026-03-30 06:31:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d931e28-ca20-5db0-8f32-ebe4c7b3ade3 with identifier: WE68493
2026-03-30 06:31:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d931e28-ca20-5db0-8f32-ebe4c7b3ade3 with scrape type 2
2026-03-30 06:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d931e28-ca20-5db0-8f32-ebe4c7b3ade3 with scrape type 2
2026-03-30 06:31:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2d931e28-ca20-5db0-8f32-ebe4c7b3ade3, identifier: WE68493
2026-03-30 06:31:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2d931e28-ca20-5db0-8f32-ebe4c7b3ade3 with identifier: WE68493
2026-03-30 06:31:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2d931e28-ca20-5db0-8f32-ebe4c7b3ade3 with identifier: WE68493
2026-03-30 06:31:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2d931e28-ca20-5db0-8f32-ebe4c7b3ade3 with identifier: WE68493 to the API
2026-03-30 06:31:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:47:40Z',
 'fuel_type': 'petrol',
 'id': '2d931e28-ca20-5db0-8f32-ebe4c7b3ade3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE68493',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 139607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-07',
 'seller_name': None,
 'title': 'Volkswagen Beetle 1.2 TSI Design',
 'transmission': 'manual',
 'trim': 'Design',
 'year': 2014}
2026-03-30 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE68493%27 HTTP/1.1" 200 None
2026-03-30 06:31:15 [auto1.be] INFO: Saving data for WE68493: {'auction_closing_time': 1774885660.0, 'created_time': 1774524698.240862, 'last_price_update_time': 1774852275.946675}
2026-03-30 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WE68493') HTTP/1.1" 204 0
2026-03-30 06:31:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:31:16 [auto1.be] INFO: Found listing with ID: AM54260
2026-03-30 06:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM54260%27 HTTP/1.1" 200 None
2026-03-30 06:31:16 [auto1.be] INFO: Scrape type for AM54260: 2
2026-03-30 06:31:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d77d4183-7921-57e4-9dc2-3fb3d4766ee8 with identifier: AM54260
2026-03-30 06:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d77d4183-7921-57e4-9dc2-3fb3d4766ee8 with scrape type 2
2026-03-30 06:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d77d4183-7921-57e4-9dc2-3fb3d4766ee8 with scrape type 2
2026-03-30 06:31:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d77d4183-7921-57e4-9dc2-3fb3d4766ee8, identifier: AM54260
2026-03-30 06:31:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d77d4183-7921-57e4-9dc2-3fb3d4766ee8 with identifier: AM54260
2026-03-30 06:31:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d77d4183-7921-57e4-9dc2-3fb3d4766ee8 with identifier: AM54260
2026-03-30 06:31:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d77d4183-7921-57e4-9dc2-3fb3d4766ee8 with identifier: AM54260 to the API
2026-03-30 06:31:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:25:29Z',
 'fuel_type': 'diesel',
 'id': 'd77d4183-7921-57e4-9dc2-3fb3d4766ee8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM54260',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 203078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-17',
 'seller_name': None,
 'title': 'Peugeot 5008 2.0 HDi Platinum',
 'transmission': 'automatic',
 'trim': 'Platinum',
 'year': 2011}
2026-03-30 06:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM54260%27 HTTP/1.1" 200 None
2026-03-30 06:31:16 [auto1.be] INFO: Saving data for AM54260: {'auction_closing_time': 1774884329.0, 'created_time': 1773909030.335938, 'last_price_update_time': 1774852276.420207}
2026-03-30 06:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AM54260') HTTP/1.1" 204 0
2026-03-30 06:31:16 [auto1.be] INFO: Found listing with ID: WP77061
2026-03-30 06:31:16 [auto1.be] INFO: Found listing with ID: TK93480
2026-03-30 06:31:16 [auto1.be] INFO: Found listing with ID: ZJ47299
2026-03-30 06:31:16 [auto1.be] INFO: Found listing with ID: JJ10339
2026-03-30 06:31:16 [auto1.be] INFO: Found listing with ID: KD31542
2026-03-30 06:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD31542%27 HTTP/1.1" 200 None
2026-03-30 06:31:16 [auto1.be] INFO: Scrape type for KD31542: 0
2026-03-30 06:31:16 [auto1.be] INFO: Found listing with ID: RW29034
2026-03-30 06:31:16 [auto1.be] INFO: Found listing with ID: FV97066
2026-03-30 06:31:16 [auto1.be] INFO: Found listing with ID: DW89258
2026-03-30 06:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW89258%27 HTTP/1.1" 200 None
2026-03-30 06:31:16 [auto1.be] INFO: Scrape type for DW89258: 2
2026-03-30 06:31:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52248d4a-e6ea-5101-8ddf-fea58ffe956a with identifier: DW89258
2026-03-30 06:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52248d4a-e6ea-5101-8ddf-fea58ffe956a with scrape type 2
2026-03-30 06:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52248d4a-e6ea-5101-8ddf-fea58ffe956a with scrape type 2
2026-03-30 06:31:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 52248d4a-e6ea-5101-8ddf-fea58ffe956a, identifier: DW89258
2026-03-30 06:31:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 52248d4a-e6ea-5101-8ddf-fea58ffe956a with identifier: DW89258
2026-03-30 06:31:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 52248d4a-e6ea-5101-8ddf-fea58ffe956a with identifier: DW89258
2026-03-30 06:31:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 52248d4a-e6ea-5101-8ddf-fea58ffe956a with identifier: DW89258 to the API
2026-03-30 06:31:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:29:27Z',
 'fuel_type': 'petrol',
 'id': '52248d4a-e6ea-5101-8ddf-fea58ffe956a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW89258',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 118026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-29',
 'seller_name': None,
 'title': 'Fiat Tipo 1.4 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2018}
2026-03-30 06:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW89258%27 HTTP/1.1" 200 None
2026-03-30 06:31:16 [auto1.be] INFO: Saving data for DW89258: {'auction_closing_time': 1774884567.0, 'created_time': 1774557026.899328, 'last_price_update_time': 1774852276.852786}
2026-03-30 06:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DW89258') HTTP/1.1" 204 0
2026-03-30 06:31:16 [auto1.be] INFO: Found listing with ID: RA68631
2026-03-30 06:31:16 [auto1.be] INFO: Found listing with ID: AU32211
2026-03-30 06:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU32211%27 HTTP/1.1" 200 None
2026-03-30 06:31:16 [auto1.be] INFO: Scrape type for AU32211: 0
2026-03-30 06:31:16 [auto1.be] INFO: Found listing with ID: HA88594
2026-03-30 06:31:16 [auto1.be] INFO: Found listing with ID: DB63111
2026-03-30 06:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB63111%27 HTTP/1.1" 200 None
2026-03-30 06:31:16 [auto1.be] INFO: Scrape type for DB63111: 0
2026-03-30 06:31:16 [auto1.be] INFO: Found listing with ID: JZ16543
2026-03-30 06:31:16 [auto1.be] INFO: Found listing with ID: SX32022
2026-03-30 06:31:16 [auto1.be] INFO: Found listing with ID: NP17382
2026-03-30 06:31:16 [auto1.be] INFO: Found listing with ID: TF03002
2026-03-30 06:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF03002%27 HTTP/1.1" 200 None
2026-03-30 06:31:16 [auto1.be] INFO: Scrape type for TF03002: 0
2026-03-30 06:31:16 [auto1.be] INFO: Found listing with ID: KK24955
2026-03-30 06:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KK24955%27 HTTP/1.1" 200 None
2026-03-30 06:31:16 [auto1.be] INFO: Scrape type for KK24955: 0
2026-03-30 06:31:16 [auto1.be] INFO: Found listing with ID: BA13225
2026-03-30 06:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA13225%27 HTTP/1.1" 200 None
2026-03-30 06:31:16 [auto1.be] INFO: Scrape type for BA13225: 2
2026-03-30 06:31:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 187da6b3-d1f2-5477-86c4-8669ced36174 with identifier: BA13225
2026-03-30 06:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 187da6b3-d1f2-5477-86c4-8669ced36174 with scrape type 2
2026-03-30 06:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 187da6b3-d1f2-5477-86c4-8669ced36174 with scrape type 2
2026-03-30 06:31:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 187da6b3-d1f2-5477-86c4-8669ced36174, identifier: BA13225
2026-03-30 06:31:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 187da6b3-d1f2-5477-86c4-8669ced36174 with identifier: BA13225
2026-03-30 06:31:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 187da6b3-d1f2-5477-86c4-8669ced36174 with identifier: BA13225
2026-03-30 06:31:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 187da6b3-d1f2-5477-86c4-8669ced36174 with identifier: BA13225 to the API
2026-03-30 06:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:27:04Z',
 'fuel_type': 'petrol',
 'id': '187da6b3-d1f2-5477-86c4-8669ced36174',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA13225',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 56773,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-07',
 'seller_name': None,
 'title': 'Citroen C3 1.2 VTi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2013}
2026-03-30 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA13225%27 HTTP/1.1" 200 None
2026-03-30 06:31:17 [auto1.be] INFO: Saving data for BA13225: {'auction_closing_time': 1774884424.0, 'created_time': 1774557221.174339, 'last_price_update_time': 1774852277.316286}
2026-03-30 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BA13225') HTTP/1.1" 204 0
2026-03-30 06:31:17 [auto1.be] INFO: Found listing with ID: TE72836
2026-03-30 06:31:17 [auto1.be] INFO: Found listing with ID: HY58683
2026-03-30 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY58683%27 HTTP/1.1" 200 None
2026-03-30 06:31:17 [auto1.be] INFO: Scrape type for HY58683: 2
2026-03-30 06:31:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc with identifier: HY58683
2026-03-30 06:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc with scrape type 2
2026-03-30 06:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc with scrape type 2
2026-03-30 06:31:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc, identifier: HY58683
2026-03-30 06:31:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc with identifier: HY58683
2026-03-30 06:31:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc with identifier: HY58683
2026-03-30 06:31:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc with identifier: HY58683 to the API
2026-03-30 06:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:55:35Z',
 'fuel_type': 'diesel',
 'id': 'c2c2ef4d-3c67-5859-b5d3-d46d692ec5cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY58683',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 272404,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-07',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2012}
2026-03-30 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY58683%27 HTTP/1.1" 200 None
2026-03-30 06:31:17 [auto1.be] INFO: Saving data for HY58683: {'auction_closing_time': 1774886135.0, 'created_time': 1774643673.265195, 'last_price_update_time': 1774852277.817486}
2026-03-30 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HY58683') HTTP/1.1" 204 0
2026-03-30 06:31:17 [auto1.be] INFO: Found listing with ID: ZJ76170
2026-03-30 06:31:17 [auto1.be] INFO: Found listing with ID: XK75143
2026-03-30 06:31:17 [auto1.be] INFO: Found listing with ID: SS18683
2026-03-30 06:31:17 [auto1.be] INFO: Found listing with ID: XC12599
2026-03-30 06:31:17 [auto1.be] INFO: Found listing with ID: NP23299
2026-03-30 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP23299%27 HTTP/1.1" 200 None
2026-03-30 06:31:17 [auto1.be] INFO: Scrape type for NP23299: 2
2026-03-30 06:31:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c97d0b5-b7c0-55cc-b081-a6bb755f8a72 with identifier: NP23299
2026-03-30 06:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c97d0b5-b7c0-55cc-b081-a6bb755f8a72 with scrape type 2
2026-03-30 06:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c97d0b5-b7c0-55cc-b081-a6bb755f8a72 with scrape type 2
2026-03-30 06:31:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7c97d0b5-b7c0-55cc-b081-a6bb755f8a72, identifier: NP23299
2026-03-30 06:31:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7c97d0b5-b7c0-55cc-b081-a6bb755f8a72 with identifier: NP23299
2026-03-30 06:31:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7c97d0b5-b7c0-55cc-b081-a6bb755f8a72 with identifier: NP23299
2026-03-30 06:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7c97d0b5-b7c0-55cc-b081-a6bb755f8a72 with identifier: NP23299 to the API
2026-03-30 06:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:03:33Z',
 'fuel_type': 'petrol',
 'id': '7c97d0b5-b7c0-55cc-b081-a6bb755f8a72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP23299',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 58429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-10',
 'seller_name': None,
 'title': 'Audi Q2 35 TFSI advanced',
 'transmission': 'automatic',
 'trim': 'advanced',
 'year': 2022}
2026-03-30 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP23299%27 HTTP/1.1" 200 None
2026-03-30 06:31:18 [auto1.be] INFO: Saving data for NP23299: {'auction_closing_time': 1774883013.0, 'created_time': 1773224571.095282, 'last_price_update_time': 1774852278.245997}
2026-03-30 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NP23299') HTTP/1.1" 204 0
2026-03-30 06:31:18 [auto1.be] INFO: Found listing with ID: UA98228
2026-03-30 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA98228%27 HTTP/1.1" 200 None
2026-03-30 06:31:18 [auto1.be] INFO: Scrape type for UA98228: 0
2026-03-30 06:31:18 [auto1.be] INFO: Found listing with ID: VT00410
2026-03-30 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VT00410%27 HTTP/1.1" 200 None
2026-03-30 06:31:18 [auto1.be] INFO: Scrape type for VT00410: 0
2026-03-30 06:31:18 [auto1.be] INFO: Found listing with ID: ZH69808
2026-03-30 06:31:18 [auto1.be] INFO: Found listing with ID: WJ68976
2026-03-30 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ68976%27 HTTP/1.1" 200 None
2026-03-30 06:31:18 [auto1.be] INFO: Scrape type for WJ68976: 2
2026-03-30 06:31:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd0fcadb-0820-5f2b-be46-a8cd384f0249 with identifier: WJ68976
2026-03-30 06:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd0fcadb-0820-5f2b-be46-a8cd384f0249 with scrape type 2
2026-03-30 06:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd0fcadb-0820-5f2b-be46-a8cd384f0249 with scrape type 2
2026-03-30 06:31:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cd0fcadb-0820-5f2b-be46-a8cd384f0249, identifier: WJ68976
2026-03-30 06:31:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cd0fcadb-0820-5f2b-be46-a8cd384f0249 with identifier: WJ68976
2026-03-30 06:31:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cd0fcadb-0820-5f2b-be46-a8cd384f0249 with identifier: WJ68976
2026-03-30 06:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cd0fcadb-0820-5f2b-be46-a8cd384f0249 with identifier: WJ68976 to the API
2026-03-30 06:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:50:13Z',
 'fuel_type': 'petrol',
 'id': 'cd0fcadb-0820-5f2b-be46-a8cd384f0249',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ68976',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Coupe',
 'odometer': 50580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-04',
 'seller_name': None,
 'title': 'MINI Coupe Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ68976%27 HTTP/1.1" 200 None
2026-03-30 06:31:18 [auto1.be] INFO: Saving data for WJ68976: {'auction_closing_time': 1774885813.0, 'created_time': 1774643589.861876, 'last_price_update_time': 1774852278.660005}
2026-03-30 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WJ68976') HTTP/1.1" 204 0
2026-03-30 06:31:18 [auto1.be] INFO: Found listing with ID: TH19224
2026-03-30 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH19224%27 HTTP/1.1" 200 None
2026-03-30 06:31:18 [auto1.be] INFO: Scrape type for TH19224: 0
2026-03-30 06:31:18 [auto1.be] INFO: Found listing with ID: CS08088
2026-03-30 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS08088%27 HTTP/1.1" 200 None
2026-03-30 06:31:18 [auto1.be] INFO: Scrape type for CS08088: 2
2026-03-30 06:31:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adfe1580-0708-5d4e-a83f-c5de661cf19d with identifier: CS08088
2026-03-30 06:31:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adfe1580-0708-5d4e-a83f-c5de661cf19d with scrape type 2
2026-03-30 06:31:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adfe1580-0708-5d4e-a83f-c5de661cf19d with scrape type 2
2026-03-30 06:31:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: adfe1580-0708-5d4e-a83f-c5de661cf19d, identifier: CS08088
2026-03-30 06:31:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: adfe1580-0708-5d4e-a83f-c5de661cf19d with identifier: CS08088
2026-03-30 06:31:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: adfe1580-0708-5d4e-a83f-c5de661cf19d with identifier: CS08088
2026-03-30 06:31:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: adfe1580-0708-5d4e-a83f-c5de661cf19d with identifier: CS08088 to the API
2026-03-30 06:31:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:05:02Z',
 'fuel_type': 'petrol',
 'id': 'adfe1580-0708-5d4e-a83f-c5de661cf19d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS08088',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 73097,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-25',
 'seller_name': None,
 'title': 'Jeep Renegade 1.4 M-Air Longitude FWD',
 'transmission': 'manual',
 'trim': 'Longitude FWD',
 'year': 2018}
2026-03-30 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS08088%27 HTTP/1.1" 200 None
2026-03-30 06:31:19 [auto1.be] INFO: Saving data for CS08088: {'auction_closing_time': 1774883102.0, 'created_time': 1774557073.305658, 'last_price_update_time': 1774852279.166082}
2026-03-30 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CS08088') HTTP/1.1" 204 0
2026-03-30 06:31:19 [auto1.be] INFO: Found listing with ID: XE73160
2026-03-30 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE73160%27 HTTP/1.1" 200 None
2026-03-30 06:31:19 [auto1.be] INFO: Scrape type for XE73160: 0
2026-03-30 06:31:19 [auto1.be] INFO: Found listing with ID: VH38978
2026-03-30 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VH38978%27 HTTP/1.1" 200 None
2026-03-30 06:31:19 [auto1.be] INFO: Scrape type for VH38978: 2
2026-03-30 06:31:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bce93e7-3742-5e77-aea9-ff747806c471 with identifier: VH38978
2026-03-30 06:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bce93e7-3742-5e77-aea9-ff747806c471 with scrape type 2
2026-03-30 06:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bce93e7-3742-5e77-aea9-ff747806c471 with scrape type 2
2026-03-30 06:31:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1bce93e7-3742-5e77-aea9-ff747806c471, identifier: VH38978
2026-03-30 06:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:31:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1bce93e7-3742-5e77-aea9-ff747806c471 with identifier: VH38978
2026-03-30 06:31:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1bce93e7-3742-5e77-aea9-ff747806c471 with identifier: VH38978
2026-03-30 06:31:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1bce93e7-3742-5e77-aea9-ff747806c471 with identifier: VH38978 to the API
2026-03-30 06:31:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:13:31Z',
 'fuel_type': 'diesel',
 'id': '1bce93e7-3742-5e77-aea9-ff747806c471',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH38978',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 123493,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-02',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Laureate 4x2',
 'transmission': 'manual',
 'trim': 'Laureate 4x2',
 'year': 2014}
2026-03-30 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VH38978%27 HTTP/1.1" 200 None
2026-03-30 06:31:19 [auto1.be] INFO: Saving data for VH38978: {'auction_closing_time': 1774883611.0, 'created_time': 1774557070.813886, 'last_price_update_time': 1774852279.663338}
2026-03-30 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VH38978') HTTP/1.1" 204 0
2026-03-30 06:31:19 [auto1.be] INFO: Found listing with ID: DY96127
2026-03-30 06:31:19 [auto1.be] INFO: Found listing with ID: HT10085
2026-03-30 06:31:19 [auto1.be] INFO: Found listing with ID: BB40778
2026-03-30 06:31:19 [auto1.be] INFO: Found listing with ID: DP96261
2026-03-30 06:31:19 [auto1.be] INFO: Found listing with ID: DK43204
2026-03-30 06:31:19 [auto1.be] INFO: Channel: 24h | Page: 13 | totalHits: 1288 | hits on page: 40
2026-03-30 06:31:19 [auto1.be] INFO: Found listing with ID: WH41445
2026-03-30 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH41445%27 HTTP/1.1" 200 None
2026-03-30 06:31:19 [auto1.be] INFO: Scrape type for WH41445: 0
2026-03-30 06:31:19 [auto1.be] INFO: Found listing with ID: MD04738
2026-03-30 06:31:19 [auto1.be] INFO: Found listing with ID: WG62431
2026-03-30 06:31:19 [auto1.be] INFO: Found listing with ID: CB86664
2026-03-30 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB86664%27 HTTP/1.1" 200 None
2026-03-30 06:31:19 [auto1.be] INFO: Scrape type for CB86664: 0
2026-03-30 06:31:19 [auto1.be] INFO: Found listing with ID: NW54949
2026-03-30 06:31:19 [auto1.be] INFO: Found listing with ID: ZK51965
2026-03-30 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK51965%27 HTTP/1.1" 200 None
2026-03-30 06:31:19 [auto1.be] INFO: Scrape type for ZK51965: 0
2026-03-30 06:31:19 [auto1.be] INFO: Found listing with ID: TT75307
2026-03-30 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT75307%27 HTTP/1.1" 200 None
2026-03-30 06:31:19 [auto1.be] INFO: Scrape type for TT75307: 2
2026-03-30 06:31:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7be96da6-1122-530d-ac76-d4cae71b5afe with identifier: TT75307
2026-03-30 06:31:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7be96da6-1122-530d-ac76-d4cae71b5afe with scrape type 2
2026-03-30 06:31:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7be96da6-1122-530d-ac76-d4cae71b5afe with scrape type 2
2026-03-30 06:31:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7be96da6-1122-530d-ac76-d4cae71b5afe, identifier: TT75307
2026-03-30 06:31:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7be96da6-1122-530d-ac76-d4cae71b5afe with identifier: TT75307
2026-03-30 06:31:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7be96da6-1122-530d-ac76-d4cae71b5afe with identifier: TT75307
2026-03-30 06:31:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7be96da6-1122-530d-ac76-d4cae71b5afe with identifier: TT75307 to the API
2026-03-30 06:31:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:18:17Z',
 'fuel_type': 'diesel',
 'id': '7be96da6-1122-530d-ac76-d4cae71b5afe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT75307',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 65422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-05',
 'seller_name': None,
 'title': 'MINI Countryman Cooper D Classic Trim',
 'transmission': 'automatic',
 'trim': 'Classic Trim',
 'year': 2021}
2026-03-30 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT75307%27 HTTP/1.1" 200 None
2026-03-30 06:31:20 [auto1.be] INFO: Saving data for TT75307: {'auction_closing_time': 1774883897.0, 'created_time': 1774557235.793881, 'last_price_update_time': 1774852280.127113}
2026-03-30 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TT75307') HTTP/1.1" 204 0
2026-03-30 06:31:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:31:20 [auto1.be] INFO: Found listing with ID: EP09858
2026-03-30 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP09858%27 HTTP/1.1" 200 None
2026-03-30 06:31:20 [auto1.be] INFO: Scrape type for EP09858: 0
2026-03-30 06:31:20 [auto1.be] INFO: Found listing with ID: CW40114
2026-03-30 06:31:20 [auto1.be] INFO: Found listing with ID: DH21315
2026-03-30 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH21315%27 HTTP/1.1" 200 None
2026-03-30 06:31:20 [auto1.be] INFO: Scrape type for DH21315: 2
2026-03-30 06:31:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2eeef821-e9b6-5408-9795-db3f0b0a6098 with identifier: DH21315
2026-03-30 06:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eeef821-e9b6-5408-9795-db3f0b0a6098 with scrape type 2
2026-03-30 06:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2eeef821-e9b6-5408-9795-db3f0b0a6098 with scrape type 2
2026-03-30 06:31:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2eeef821-e9b6-5408-9795-db3f0b0a6098, identifier: DH21315
2026-03-30 06:31:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2eeef821-e9b6-5408-9795-db3f0b0a6098 with identifier: DH21315
2026-03-30 06:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2eeef821-e9b6-5408-9795-db3f0b0a6098 with identifier: DH21315
2026-03-30 06:31:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2eeef821-e9b6-5408-9795-db3f0b0a6098 with identifier: DH21315 to the API
2026-03-30 06:31:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:48:18Z',
 'fuel_type': 'hybrid',
 'id': '2eeef821-e9b6-5408-9795-db3f0b0a6098',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH21315',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 70634,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-13',
 'seller_name': None,
 'title': 'Jeep Compass 1.3 T4 4xe Plug-in Hybrid Longitude',
 'transmission': 'automatic',
 'trim': 'Longitude',
 'year': 2022}
2026-03-30 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH21315%27 HTTP/1.1" 200 None
2026-03-30 06:31:20 [auto1.be] INFO: Saving data for DH21315: {'auction_closing_time': 1774885698.0, 'created_time': 1774557104.067219, 'last_price_update_time': 1774852280.641269}
2026-03-30 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DH21315') HTTP/1.1" 204 0
2026-03-30 06:31:20 [auto1.be] INFO: Found listing with ID: EW63431
2026-03-30 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EW63431%27 HTTP/1.1" 200 None
2026-03-30 06:31:20 [auto1.be] INFO: Scrape type for EW63431: 0
2026-03-30 06:31:20 [auto1.be] INFO: Found listing with ID: GH94077
2026-03-30 06:31:20 [auto1.be] INFO: Found listing with ID: RG44645
2026-03-30 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RG44645%27 HTTP/1.1" 200 None
2026-03-30 06:31:20 [auto1.be] INFO: Scrape type for RG44645: 2
2026-03-30 06:31:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7a01386-52ec-53c5-9081-20e192543e2a with identifier: RG44645
2026-03-30 06:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7a01386-52ec-53c5-9081-20e192543e2a with scrape type 2
2026-03-30 06:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7a01386-52ec-53c5-9081-20e192543e2a with scrape type 2
2026-03-30 06:31:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b7a01386-52ec-53c5-9081-20e192543e2a, identifier: RG44645
2026-03-30 06:31:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b7a01386-52ec-53c5-9081-20e192543e2a with identifier: RG44645
2026-03-30 06:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b7a01386-52ec-53c5-9081-20e192543e2a with identifier: RG44645
2026-03-30 06:31:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b7a01386-52ec-53c5-9081-20e192543e2a with identifier: RG44645 to the API
2026-03-30 06:31:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:30:09Z',
 'fuel_type': 'diesel',
 'id': 'b7a01386-52ec-53c5-9081-20e192543e2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG44645',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 231514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-08',
 'seller_name': None,
 'title': 'BMW 2er 218d Active Tourer Basis',
 'transmission': 'automatic',
 'trim': 'Basis',
 'year': 2015}
2026-03-30 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RG44645%27 HTTP/1.1" 200 None
2026-03-30 06:31:21 [auto1.be] INFO: Saving data for RG44645: {'auction_closing_time': 1774884609.0, 'created_time': 1774643611.764016, 'last_price_update_time': 1774852281.081574}
2026-03-30 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RG44645') HTTP/1.1" 204 0
2026-03-30 06:31:21 [auto1.be] INFO: Found listing with ID: DS23322
2026-03-30 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DS23322%27 HTTP/1.1" 200 None
2026-03-30 06:31:21 [auto1.be] INFO: Scrape type for DS23322: 0
2026-03-30 06:31:21 [auto1.be] INFO: Found listing with ID: LU38585
2026-03-30 06:31:21 [auto1.be] INFO: Found listing with ID: GW63299
2026-03-30 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW63299%27 HTTP/1.1" 200 None
2026-03-30 06:31:21 [auto1.be] INFO: Scrape type for GW63299: 0
2026-03-30 06:31:21 [auto1.be] INFO: Found listing with ID: JF41683
2026-03-30 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JF41683%27 HTTP/1.1" 200 None
2026-03-30 06:31:21 [auto1.be] INFO: Scrape type for JF41683: 0
2026-03-30 06:31:21 [auto1.be] INFO: Found listing with ID: GJ23391
2026-03-30 06:31:21 [auto1.be] INFO: Found listing with ID: VM57702
2026-03-30 06:31:21 [auto1.be] INFO: Found listing with ID: FT96499
2026-03-30 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT96499%27 HTTP/1.1" 200 None
2026-03-30 06:31:21 [auto1.be] INFO: Scrape type for FT96499: 2
2026-03-30 06:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ecd41b0-500f-5767-8029-5f9550729423 with identifier: FT96499
2026-03-30 06:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ecd41b0-500f-5767-8029-5f9550729423 with scrape type 2
2026-03-30 06:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ecd41b0-500f-5767-8029-5f9550729423 with scrape type 2
2026-03-30 06:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2ecd41b0-500f-5767-8029-5f9550729423, identifier: FT96499
2026-03-30 06:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2ecd41b0-500f-5767-8029-5f9550729423 with identifier: FT96499
2026-03-30 06:31:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2ecd41b0-500f-5767-8029-5f9550729423 with identifier: FT96499
2026-03-30 06:31:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2ecd41b0-500f-5767-8029-5f9550729423 with identifier: FT96499 to the API
2026-03-30 06:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:58:37Z',
 'fuel_type': 'petrol',
 'id': '2ecd41b0-500f-5767-8029-5f9550729423',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT96499',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 25850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-24',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 e-THP Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2020}
2026-03-30 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT96499%27 HTTP/1.1" 200 None
2026-03-30 06:31:21 [auto1.be] INFO: Saving data for FT96499: {'auction_closing_time': 1774886317.0, 'created_time': 1774557069.442864, 'last_price_update_time': 1774852281.698547}
2026-03-30 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FT96499') HTTP/1.1" 204 0
2026-03-30 06:31:21 [auto1.be] INFO: Found listing with ID: XR84470
2026-03-30 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR84470%27 HTTP/1.1" 200 None
2026-03-30 06:31:21 [auto1.be] INFO: Scrape type for XR84470: 2
2026-03-30 06:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc1f669b-7f9f-534e-bfb1-c7e2f0c42b5b with identifier: XR84470
2026-03-30 06:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc1f669b-7f9f-534e-bfb1-c7e2f0c42b5b with scrape type 2
2026-03-30 06:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc1f669b-7f9f-534e-bfb1-c7e2f0c42b5b with scrape type 2
2026-03-30 06:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dc1f669b-7f9f-534e-bfb1-c7e2f0c42b5b, identifier: XR84470
2026-03-30 06:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dc1f669b-7f9f-534e-bfb1-c7e2f0c42b5b with identifier: XR84470
2026-03-30 06:31:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dc1f669b-7f9f-534e-bfb1-c7e2f0c42b5b with identifier: XR84470
2026-03-30 06:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dc1f669b-7f9f-534e-bfb1-c7e2f0c42b5b with identifier: XR84470 to the API
2026-03-30 06:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:51:06Z',
 'fuel_type': 'petrol',
 'id': 'dc1f669b-7f9f-534e-bfb1-c7e2f0c42b5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR84470',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Alto',
 'odometer': 162715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-12',
 'seller_name': None,
 'title': 'Suzuki Alto 1.0 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2009}
2026-03-30 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR84470%27 HTTP/1.1" 200 None
2026-03-30 06:31:22 [auto1.be] INFO: Saving data for XR84470: {'auction_closing_time': 1774885866.0, 'created_time': 1774524703.352459, 'last_price_update_time': 1774852282.199053}
2026-03-30 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XR84470') HTTP/1.1" 204 0
2026-03-30 06:31:22 [auto1.be] INFO: Found listing with ID: FL46625
2026-03-30 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL46625%27 HTTP/1.1" 200 None
2026-03-30 06:31:22 [auto1.be] INFO: Scrape type for FL46625: 2
2026-03-30 06:31:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4bd949b-b83e-529a-9f2a-bacf018aaace with identifier: FL46625
2026-03-30 06:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4bd949b-b83e-529a-9f2a-bacf018aaace with scrape type 2
2026-03-30 06:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4bd949b-b83e-529a-9f2a-bacf018aaace with scrape type 2
2026-03-30 06:31:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e4bd949b-b83e-529a-9f2a-bacf018aaace, identifier: FL46625
2026-03-30 06:31:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e4bd949b-b83e-529a-9f2a-bacf018aaace with identifier: FL46625
2026-03-30 06:31:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e4bd949b-b83e-529a-9f2a-bacf018aaace with identifier: FL46625
2026-03-30 06:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e4bd949b-b83e-529a-9f2a-bacf018aaace with identifier: FL46625 to the API
2026-03-30 06:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:08:28Z',
 'fuel_type': 'diesel',
 'id': 'e4bd949b-b83e-529a-9f2a-bacf018aaace',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL46625',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 176922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-16',
 'seller_name': None,
 'title': 'Toyota Auris 1.4 Turbodiesel Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2008}
2026-03-30 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL46625%27 HTTP/1.1" 200 None
2026-03-30 06:31:22 [auto1.be] INFO: Saving data for FL46625: {'auction_closing_time': 1774883308.0, 'created_time': 1773909417.812952, 'last_price_update_time': 1774852282.602873}
2026-03-30 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FL46625') HTTP/1.1" 204 0
2026-03-30 06:31:22 [auto1.be] INFO: Found listing with ID: AX12673
2026-03-30 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX12673%27 HTTP/1.1" 200 None
2026-03-30 06:31:22 [auto1.be] INFO: Scrape type for AX12673: 2
2026-03-30 06:31:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fba3529-108b-5d2a-b9e6-62c793f85b36 with identifier: AX12673
2026-03-30 06:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fba3529-108b-5d2a-b9e6-62c793f85b36 with scrape type 2
2026-03-30 06:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fba3529-108b-5d2a-b9e6-62c793f85b36 with scrape type 2
2026-03-30 06:31:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6fba3529-108b-5d2a-b9e6-62c793f85b36, identifier: AX12673
2026-03-30 06:31:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6fba3529-108b-5d2a-b9e6-62c793f85b36 with identifier: AX12673
2026-03-30 06:31:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6fba3529-108b-5d2a-b9e6-62c793f85b36 with identifier: AX12673
2026-03-30 06:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6fba3529-108b-5d2a-b9e6-62c793f85b36 with identifier: AX12673 to the API
2026-03-30 06:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:25:13Z',
 'fuel_type': 'diesel',
 'id': '6fba3529-108b-5d2a-b9e6-62c793f85b36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX12673',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 187259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-27',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D2 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2015}
2026-03-30 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX12673%27 HTTP/1.1" 200 None
2026-03-30 06:31:22 [auto1.be] INFO: Saving data for AX12673: {'auction_closing_time': 1774884313.0, 'created_time': 1774643685.270479, 'last_price_update_time': 1774852282.998958}
2026-03-30 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AX12673') HTTP/1.1" 204 0
2026-03-30 06:31:23 [auto1.be] INFO: Found listing with ID: JH02802
2026-03-30 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JH02802%27 HTTP/1.1" 200 None
2026-03-30 06:31:23 [auto1.be] INFO: Scrape type for JH02802: 0
2026-03-30 06:31:23 [auto1.be] INFO: Found listing with ID: GF63829
2026-03-30 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF63829%27 HTTP/1.1" 200 None
2026-03-30 06:31:23 [auto1.be] INFO: Scrape type for GF63829: 0
2026-03-30 06:31:23 [auto1.be] INFO: Found listing with ID: KG19380
2026-03-30 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG19380%27 HTTP/1.1" 200 None
2026-03-30 06:31:23 [auto1.be] INFO: Scrape type for KG19380: 2
2026-03-30 06:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc6a1cac-752f-55b3-a2e9-a12e622df169 with identifier: KG19380
2026-03-30 06:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc6a1cac-752f-55b3-a2e9-a12e622df169 with scrape type 2
2026-03-30 06:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc6a1cac-752f-55b3-a2e9-a12e622df169 with scrape type 2
2026-03-30 06:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bc6a1cac-752f-55b3-a2e9-a12e622df169, identifier: KG19380
2026-03-30 06:31:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bc6a1cac-752f-55b3-a2e9-a12e622df169 with identifier: KG19380
2026-03-30 06:31:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bc6a1cac-752f-55b3-a2e9-a12e622df169 with identifier: KG19380
2026-03-30 06:31:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bc6a1cac-752f-55b3-a2e9-a12e622df169 with identifier: KG19380 to the API
2026-03-30 06:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-30T15:09:30Z',
 'fuel_type': 'diesel',
 'id': 'bc6a1cac-752f-55b3-a2e9-a12e622df169',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG19380',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 33710,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-26',
 'seller_name': None,
 'title': 'Dacia Sandero 1.5 dCi Stepway II',
 'transmission': 'manual',
 'trim': 'Stepway II',
 'year': 2012}
2026-03-30 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG19380%27 HTTP/1.1" 200 None
2026-03-30 06:31:23 [auto1.be] INFO: Saving data for KG19380: {'auction_closing_time': 1774883370.0, 'created_time': 1774557068.228256, 'last_price_update_time': 1774852283.434416}
2026-03-30 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KG19380') HTTP/1.1" 204 0
2026-03-30 06:31:23 [auto1.be] INFO: Found listing with ID: HH24769
2026-03-30 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH24769%27 HTTP/1.1" 200 None
2026-03-30 06:31:23 [auto1.be] INFO: Scrape type for HH24769: 2
2026-03-30 06:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63bf927a-c95c-5e4d-a667-a96f479ae7b8 with identifier: HH24769
2026-03-30 06:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63bf927a-c95c-5e4d-a667-a96f479ae7b8 with scrape type 2
2026-03-30 06:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63bf927a-c95c-5e4d-a667-a96f479ae7b8 with scrape type 2
2026-03-30 06:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 63bf927a-c95c-5e4d-a667-a96f479ae7b8, identifier: HH24769
2026-03-30 06:31:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 63bf927a-c95c-5e4d-a667-a96f479ae7b8 with identifier: HH24769
2026-03-30 06:31:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 63bf927a-c95c-5e4d-a667-a96f479ae7b8 with identifier: HH24769
2026-03-30 06:31:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 63bf927a-c95c-5e4d-a667-a96f479ae7b8 with identifier: HH24769 to the API
2026-03-30 06:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:16:25Z',
 'fuel_type': 'diesel',
 'id': '63bf927a-c95c-5e4d-a667-a96f479ae7b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH24769',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 138785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-24',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-03-30 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH24769%27 HTTP/1.1" 200 None
2026-03-30 06:31:23 [auto1.be] INFO: Saving data for HH24769: {'auction_closing_time': 1774883785.0, 'created_time': 1774643627.944707, 'last_price_update_time': 1774852283.810746}
2026-03-30 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HH24769') HTTP/1.1" 204 0
2026-03-30 06:31:23 [auto1.be] INFO: Found listing with ID: CA55783
2026-03-30 06:31:23 [auto1.be] INFO: Found listing with ID: EP14144
2026-03-30 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP14144%27 HTTP/1.1" 200 None
2026-03-30 06:31:23 [auto1.be] INFO: Scrape type for EP14144: 0
2026-03-30 06:31:23 [auto1.be] INFO: Found listing with ID: HP74170
2026-03-30 06:31:23 [auto1.be] INFO: Found listing with ID: EG14798
2026-03-30 06:31:23 [auto1.be] INFO: Found listing with ID: YN26679
2026-03-30 06:31:23 [auto1.be] INFO: Found listing with ID: HX42019
2026-03-30 06:31:23 [auto1.be] INFO: Found listing with ID: JW58136
2026-03-30 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW58136%27 HTTP/1.1" 200 None
2026-03-30 06:31:23 [auto1.be] INFO: Scrape type for JW58136: 0
2026-03-30 06:31:23 [auto1.be] INFO: Found listing with ID: RM51088
2026-03-30 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM51088%27 HTTP/1.1" 200 None
2026-03-30 06:31:23 [auto1.be] INFO: Scrape type for RM51088: 2
2026-03-30 06:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78c4b978-7553-5b88-b410-5d869264a521 with identifier: RM51088
2026-03-30 06:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78c4b978-7553-5b88-b410-5d869264a521 with scrape type 2
2026-03-30 06:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78c4b978-7553-5b88-b410-5d869264a521 with scrape type 2
2026-03-30 06:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 78c4b978-7553-5b88-b410-5d869264a521, identifier: RM51088
2026-03-30 06:31:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 78c4b978-7553-5b88-b410-5d869264a521 with identifier: RM51088
2026-03-30 06:31:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 78c4b978-7553-5b88-b410-5d869264a521 with identifier: RM51088
2026-03-30 06:31:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 78c4b978-7553-5b88-b410-5d869264a521 with identifier: RM51088 to the API
2026-03-30 06:31:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:15:02Z',
 'fuel_type': 'diesel',
 'id': '78c4b978-7553-5b88-b410-5d869264a521',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM51088',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'DS3',
 'odometer': 74889,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-24',
 'seller_name': None,
 'title': 'Citroen DS3 1.6 e-HDi Red Edition',
 'transmission': 'manual',
 'trim': 'Red Edition',
 'year': 2015}
2026-03-30 06:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM51088%27 HTTP/1.1" 200 None
2026-03-30 06:31:24 [auto1.be] INFO: Saving data for RM51088: {'auction_closing_time': 1774883702.0, 'created_time': 1774643669.746717, 'last_price_update_time': 1774852284.241653}
2026-03-30 06:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RM51088') HTTP/1.1" 204 0
2026-03-30 06:31:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:31:24 [auto1.be] INFO: Found listing with ID: KW38150
2026-03-30 06:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW38150%27 HTTP/1.1" 200 None
2026-03-30 06:31:24 [auto1.be] INFO: Scrape type for KW38150: 0
2026-03-30 06:31:24 [auto1.be] INFO: Found listing with ID: JC96921
2026-03-30 06:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC96921%27 HTTP/1.1" 200 None
2026-03-30 06:31:24 [auto1.be] INFO: Scrape type for JC96921: 2
2026-03-30 06:31:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2051630-c42a-5d6f-be76-1902a8b67a62 with identifier: JC96921
2026-03-30 06:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2051630-c42a-5d6f-be76-1902a8b67a62 with scrape type 2
2026-03-30 06:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2051630-c42a-5d6f-be76-1902a8b67a62 with scrape type 2
2026-03-30 06:31:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d2051630-c42a-5d6f-be76-1902a8b67a62, identifier: JC96921
2026-03-30 06:31:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d2051630-c42a-5d6f-be76-1902a8b67a62 with identifier: JC96921
2026-03-30 06:31:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d2051630-c42a-5d6f-be76-1902a8b67a62 with identifier: JC96921
2026-03-30 06:31:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d2051630-c42a-5d6f-be76-1902a8b67a62 with identifier: JC96921 to the API
2026-03-30 06:31:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:25:51Z',
 'fuel_type': 'diesel',
 'id': 'd2051630-c42a-5d6f-be76-1902a8b67a62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC96921',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 95234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-06',
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2015}
2026-03-30 06:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC96921%27 HTTP/1.1" 200 None
2026-03-30 06:31:24 [auto1.be] INFO: Saving data for JC96921: {'auction_closing_time': 1774884351.0, 'created_time': 1774643607.231004, 'last_price_update_time': 1774852284.732865}
2026-03-30 06:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JC96921') HTTP/1.1" 204 0
2026-03-30 06:31:24 [auto1.be] INFO: Found listing with ID: SV05686
2026-03-30 06:31:24 [auto1.be] INFO: Found listing with ID: CS46874
2026-03-30 06:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS46874%27 HTTP/1.1" 200 None
2026-03-30 06:31:24 [auto1.be] INFO: Scrape type for CS46874: 2
2026-03-30 06:31:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8a005ab-8638-5fcf-a703-140bcf3ce8af with identifier: CS46874
2026-03-30 06:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8a005ab-8638-5fcf-a703-140bcf3ce8af with scrape type 2
2026-03-30 06:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8a005ab-8638-5fcf-a703-140bcf3ce8af with scrape type 2
2026-03-30 06:31:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d8a005ab-8638-5fcf-a703-140bcf3ce8af, identifier: CS46874
2026-03-30 06:31:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d8a005ab-8638-5fcf-a703-140bcf3ce8af with identifier: CS46874
2026-03-30 06:31:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d8a005ab-8638-5fcf-a703-140bcf3ce8af with identifier: CS46874
2026-03-30 06:31:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d8a005ab-8638-5fcf-a703-140bcf3ce8af with identifier: CS46874 to the API
2026-03-30 06:31:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:44:04Z',
 'fuel_type': 'petrol',
 'id': 'd8a005ab-8638-5fcf-a703-140bcf3ce8af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS46874',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 160033,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-28',
 'seller_name': None,
 'title': 'Honda Jazz 1.4 Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2011}
2026-03-30 06:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS46874%27 HTTP/1.1" 200 None
2026-03-30 06:31:25 [auto1.be] INFO: Saving data for CS46874: {'auction_closing_time': 1774885444.0, 'created_time': 1774557093.995115, 'last_price_update_time': 1774852285.118813}
2026-03-30 06:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CS46874') HTTP/1.1" 204 0
2026-03-30 06:31:25 [auto1.be] INFO: Channel: 24h | Page: 14 | totalHits: 1288 | hits on page: 40
2026-03-30 06:31:25 [auto1.be] INFO: Found listing with ID: GG55355
2026-03-30 06:31:25 [auto1.be] INFO: Found listing with ID: TK63545
2026-03-30 06:31:25 [auto1.be] INFO: Found listing with ID: MP28046
2026-03-30 06:31:25 [auto1.be] INFO: Found listing with ID: HG61894
2026-03-30 06:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HG61894%27 HTTP/1.1" 200 None
2026-03-30 06:31:25 [auto1.be] INFO: Scrape type for HG61894: 2
2026-03-30 06:31:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1 with identifier: HG61894
2026-03-30 06:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1 with scrape type 2
2026-03-30 06:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1 with scrape type 2
2026-03-30 06:31:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1, identifier: HG61894
2026-03-30 06:31:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:31:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1 with identifier: HG61894
2026-03-30 06:31:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1 with identifier: HG61894
2026-03-30 06:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 92ed346f-bea4-53ac-8a8e-ac9f15ca07c1 with identifier: HG61894 to the API
2026-03-30 06:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:48:19Z',
 'fuel_type': 'diesel',
 'id': '92ed346f-bea4-53ac-8a8e-ac9f15ca07c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG61894',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 128355,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-01',
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi GT Line",
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2020}
2026-03-30 06:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HG61894%27 HTTP/1.1" 200 None
2026-03-30 06:31:25 [auto1.be] INFO: Saving data for HG61894: {'auction_closing_time': 1774885699.0, 'created_time': 1774643651.486528, 'last_price_update_time': 1774852285.641764}
2026-03-30 06:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HG61894') HTTP/1.1" 204 0
2026-03-30 06:31:25 [auto1.be] INFO: Found listing with ID: RB98158
2026-03-30 06:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB98158%27 HTTP/1.1" 200 None
2026-03-30 06:31:25 [auto1.be] INFO: Scrape type for RB98158: 2
2026-03-30 06:31:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b with identifier: RB98158
2026-03-30 06:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b with scrape type 2
2026-03-30 06:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b with scrape type 2
2026-03-30 06:31:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b, identifier: RB98158
2026-03-30 06:31:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b with identifier: RB98158
2026-03-30 06:31:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b with identifier: RB98158
2026-03-30 06:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b with identifier: RB98158 to the API
2026-03-30 06:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:26:31Z',
 'fuel_type': 'diesel',
 'id': '1cbe85d5-cdea-52ac-bd9c-7927aeb18d9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB98158',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 213660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-08',
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.2 DI-D Instyle 4WD',
 'transmission': 'automatic',
 'trim': 'Instyle 4WD',
 'year': 2014}
2026-03-30 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB98158%27 HTTP/1.1" 200 None
2026-03-30 06:31:26 [auto1.be] INFO: Saving data for RB98158: {'auction_closing_time': 1774884391.0, 'created_time': 1774643670.43135, 'last_price_update_time': 1774852286.056662}
2026-03-30 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RB98158') HTTP/1.1" 204 0
2026-03-30 06:31:26 [auto1.be] INFO: Found listing with ID: WA78577
2026-03-30 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA78577%27 HTTP/1.1" 200 None
2026-03-30 06:31:26 [auto1.be] INFO: Scrape type for WA78577: 2
2026-03-30 06:31:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a603700c-8eed-5a9f-9b5e-2a3a80c36eb6 with identifier: WA78577
2026-03-30 06:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a603700c-8eed-5a9f-9b5e-2a3a80c36eb6 with scrape type 2
2026-03-30 06:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a603700c-8eed-5a9f-9b5e-2a3a80c36eb6 with scrape type 2
2026-03-30 06:31:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a603700c-8eed-5a9f-9b5e-2a3a80c36eb6, identifier: WA78577
2026-03-30 06:31:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a603700c-8eed-5a9f-9b5e-2a3a80c36eb6 with identifier: WA78577
2026-03-30 06:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a603700c-8eed-5a9f-9b5e-2a3a80c36eb6 with identifier: WA78577
2026-03-30 06:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a603700c-8eed-5a9f-9b5e-2a3a80c36eb6 with identifier: WA78577 to the API
2026-03-30 06:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:14:39Z',
 'fuel_type': 'diesel',
 'id': 'a603700c-8eed-5a9f-9b5e-2a3a80c36eb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA78577',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 126790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-06',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 1.6 CDTI DPF Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2019}
2026-03-30 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA78577%27 HTTP/1.1" 200 None
2026-03-30 06:31:26 [auto1.be] INFO: Saving data for WA78577: {'auction_closing_time': 1774883679.0, 'created_time': 1774557074.542997, 'last_price_update_time': 1774852286.452901}
2026-03-30 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WA78577') HTTP/1.1" 204 0
2026-03-30 06:31:26 [auto1.be] INFO: Found listing with ID: NP75657
2026-03-30 06:31:26 [auto1.be] INFO: Found listing with ID: BC49055
2026-03-30 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC49055%27 HTTP/1.1" 200 None
2026-03-30 06:31:26 [auto1.be] INFO: Scrape type for BC49055: 0
2026-03-30 06:31:26 [auto1.be] INFO: Found listing with ID: JJ27182
2026-03-30 06:31:26 [auto1.be] INFO: Found listing with ID: EG19315
2026-03-30 06:31:26 [auto1.be] INFO: Found listing with ID: KN88676
2026-03-30 06:31:26 [auto1.be] INFO: Found listing with ID: CD53749
2026-03-30 06:31:26 [auto1.be] INFO: Found listing with ID: RX75304
2026-03-30 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX75304%27 HTTP/1.1" 200 None
2026-03-30 06:31:26 [auto1.be] INFO: Scrape type for RX75304: 0
2026-03-30 06:31:26 [auto1.be] INFO: Found listing with ID: DG02903
2026-03-30 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DG02903%27 HTTP/1.1" 200 None
2026-03-30 06:31:26 [auto1.be] INFO: Scrape type for DG02903: 0
2026-03-30 06:31:26 [auto1.be] INFO: Found listing with ID: WU67286
2026-03-30 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU67286%27 HTTP/1.1" 200 None
2026-03-30 06:31:26 [auto1.be] INFO: Scrape type for WU67286: 2
2026-03-30 06:31:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c5d6d2f-0524-5caf-8730-1b67876e390b with identifier: WU67286
2026-03-30 06:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c5d6d2f-0524-5caf-8730-1b67876e390b with scrape type 2
2026-03-30 06:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c5d6d2f-0524-5caf-8730-1b67876e390b with scrape type 2
2026-03-30 06:31:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2c5d6d2f-0524-5caf-8730-1b67876e390b, identifier: WU67286
2026-03-30 06:31:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2c5d6d2f-0524-5caf-8730-1b67876e390b with identifier: WU67286
2026-03-30 06:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2c5d6d2f-0524-5caf-8730-1b67876e390b with identifier: WU67286
2026-03-30 06:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2c5d6d2f-0524-5caf-8730-1b67876e390b with identifier: WU67286 to the API
2026-03-30 06:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:33:21Z',
 'fuel_type': 'diesel',
 'id': '2c5d6d2f-0524-5caf-8730-1b67876e390b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU67286',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 256770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-28',
 'seller_name': None,
 'title': 'Opel Vivaro 2.0 CDTI Kasten L2H1 2,9t Doppelkabine',
 'transmission': 'manual',
 'trim': 'Kasten L2H1 2,9t Doppelkabine',
 'year': 2013}
2026-03-30 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU67286%27 HTTP/1.1" 200 None
2026-03-30 06:31:26 [auto1.be] INFO: Saving data for WU67286: {'auction_closing_time': 1774884801.0, 'created_time': 1774557071.226326, 'last_price_update_time': 1774852286.920849}
2026-03-30 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WU67286') HTTP/1.1" 204 0
2026-03-30 06:31:27 [auto1.be] INFO: Found listing with ID: LL08256
2026-03-30 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LL08256%27 HTTP/1.1" 200 None
2026-03-30 06:31:27 [auto1.be] INFO: Scrape type for LL08256: 2
2026-03-30 06:31:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 605abb47-5ccc-5d98-954c-37d2779ff39e with identifier: LL08256
2026-03-30 06:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 605abb47-5ccc-5d98-954c-37d2779ff39e with scrape type 2
2026-03-30 06:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 605abb47-5ccc-5d98-954c-37d2779ff39e with scrape type 2
2026-03-30 06:31:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 605abb47-5ccc-5d98-954c-37d2779ff39e, identifier: LL08256
2026-03-30 06:31:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 605abb47-5ccc-5d98-954c-37d2779ff39e with identifier: LL08256
2026-03-30 06:31:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 605abb47-5ccc-5d98-954c-37d2779ff39e with identifier: LL08256
2026-03-30 06:31:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 605abb47-5ccc-5d98-954c-37d2779ff39e with identifier: LL08256 to the API
2026-03-30 06:31:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:56:25Z',
 'fuel_type': 'petrol',
 'id': '605abb47-5ccc-5d98-954c-37d2779ff39e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL08256',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 105113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-02',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Allstar BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2017}
2026-03-30 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LL08256%27 HTTP/1.1" 200 None
2026-03-30 06:31:27 [auto1.be] INFO: Saving data for LL08256: {'auction_closing_time': 1774886185.0, 'created_time': 1773236772.964812, 'last_price_update_time': 1774852287.409747}
2026-03-30 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LL08256') HTTP/1.1" 204 0
2026-03-30 06:31:27 [auto1.be] INFO: Found listing with ID: AV28567
2026-03-30 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV28567%27 HTTP/1.1" 200 None
2026-03-30 06:31:27 [auto1.be] INFO: Scrape type for AV28567: 0
2026-03-30 06:31:27 [auto1.be] INFO: Found listing with ID: CG84069
2026-03-30 06:31:27 [auto1.be] INFO: Found listing with ID: WB95668
2026-03-30 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB95668%27 HTTP/1.1" 200 None
2026-03-30 06:31:27 [auto1.be] INFO: Scrape type for WB95668: 0
2026-03-30 06:31:27 [auto1.be] INFO: Found listing with ID: FS62191
2026-03-30 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS62191%27 HTTP/1.1" 200 None
2026-03-30 06:31:27 [auto1.be] INFO: Scrape type for FS62191: 2
2026-03-30 06:31:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c773424-bccf-594a-b9f2-3927cc0e113c with identifier: FS62191
2026-03-30 06:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c773424-bccf-594a-b9f2-3927cc0e113c with scrape type 2
2026-03-30 06:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c773424-bccf-594a-b9f2-3927cc0e113c with scrape type 2
2026-03-30 06:31:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5c773424-bccf-594a-b9f2-3927cc0e113c, identifier: FS62191
2026-03-30 06:31:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5c773424-bccf-594a-b9f2-3927cc0e113c with identifier: FS62191
2026-03-30 06:31:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5c773424-bccf-594a-b9f2-3927cc0e113c with identifier: FS62191
2026-03-30 06:31:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5c773424-bccf-594a-b9f2-3927cc0e113c with identifier: FS62191 to the API
2026-03-30 06:31:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:08:04Z',
 'fuel_type': 'petrol',
 'id': '5c773424-bccf-594a-b9f2-3927cc0e113c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS62191',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 93400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-10',
 'seller_name': None,
 'title': 'BMW X4 xDrive 20i Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-30 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS62191%27 HTTP/1.1" 200 None
2026-03-30 06:31:27 [auto1.be] INFO: Saving data for FS62191: {'auction_closing_time': 1774883284.0, 'created_time': 1773866601.069438, 'last_price_update_time': 1774852287.840837}
2026-03-30 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FS62191') HTTP/1.1" 204 0
2026-03-30 06:31:27 [auto1.be] INFO: Found listing with ID: WU43595
2026-03-30 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU43595%27 HTTP/1.1" 200 None
2026-03-30 06:31:27 [auto1.be] INFO: Scrape type for WU43595: 2
2026-03-30 06:31:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca14168e-cc49-55ea-8119-9684b8ea4f0a with identifier: WU43595
2026-03-30 06:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca14168e-cc49-55ea-8119-9684b8ea4f0a with scrape type 2
2026-03-30 06:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca14168e-cc49-55ea-8119-9684b8ea4f0a with scrape type 2
2026-03-30 06:31:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ca14168e-cc49-55ea-8119-9684b8ea4f0a, identifier: WU43595
2026-03-30 06:31:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ca14168e-cc49-55ea-8119-9684b8ea4f0a with identifier: WU43595
2026-03-30 06:31:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ca14168e-cc49-55ea-8119-9684b8ea4f0a with identifier: WU43595
2026-03-30 06:31:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ca14168e-cc49-55ea-8119-9684b8ea4f0a with identifier: WU43595 to the API
2026-03-30 06:31:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 212,
 'expiration_date': '2026-03-30T15:49:35Z',
 'fuel_type': 'diesel',
 'id': 'ca14168e-cc49-55ea-8119-9684b8ea4f0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU43595',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 35619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-07',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Raptor',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Raptor',
 'year': 2021}
2026-03-30 06:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU43595%27 HTTP/1.1" 200 None
2026-03-30 06:31:28 [auto1.be] INFO: Saving data for WU43595: {'auction_closing_time': 1774885775.0, 'created_time': 1773520257.455045, 'last_price_update_time': 1774852288.227654}
2026-03-30 06:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WU43595') HTTP/1.1" 204 0
2026-03-30 06:31:28 [auto1.be] INFO: Found listing with ID: HK81119
2026-03-30 06:31:28 [auto1.be] INFO: Found listing with ID: ZJ33794
2026-03-30 06:31:28 [auto1.be] INFO: Found listing with ID: VF88831
2026-03-30 06:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VF88831%27 HTTP/1.1" 200 None
2026-03-30 06:31:28 [auto1.be] INFO: Scrape type for VF88831: 0
2026-03-30 06:31:28 [auto1.be] INFO: Found listing with ID: VK66376
2026-03-30 06:31:28 [auto1.be] INFO: Found listing with ID: RA11008
2026-03-30 06:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA11008%27 HTTP/1.1" 200 None
2026-03-30 06:31:28 [auto1.be] INFO: Scrape type for RA11008: 0
2026-03-30 06:31:28 [auto1.be] INFO: Found listing with ID: KV01738
2026-03-30 06:31:28 [auto1.be] INFO: Found listing with ID: EE45657
2026-03-30 06:31:28 [auto1.be] INFO: Found listing with ID: PS61885
2026-03-30 06:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS61885%27 HTTP/1.1" 200 None
2026-03-30 06:31:28 [auto1.be] INFO: Scrape type for PS61885: 0
2026-03-30 06:31:28 [auto1.be] INFO: Found listing with ID: UW52037
2026-03-30 06:31:28 [auto1.be] INFO: Found listing with ID: YW15851
2026-03-30 06:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW15851%27 HTTP/1.1" 200 None
2026-03-30 06:31:28 [auto1.be] INFO: Scrape type for YW15851: 2
2026-03-30 06:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ce650e6-ecb3-5f99-81b6-48e4ae10d7ac with identifier: YW15851
2026-03-30 06:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ce650e6-ecb3-5f99-81b6-48e4ae10d7ac with scrape type 2
2026-03-30 06:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ce650e6-ecb3-5f99-81b6-48e4ae10d7ac with scrape type 2
2026-03-30 06:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3ce650e6-ecb3-5f99-81b6-48e4ae10d7ac, identifier: YW15851
2026-03-30 06:31:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3ce650e6-ecb3-5f99-81b6-48e4ae10d7ac with identifier: YW15851
2026-03-30 06:31:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3ce650e6-ecb3-5f99-81b6-48e4ae10d7ac with identifier: YW15851
2026-03-30 06:31:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3ce650e6-ecb3-5f99-81b6-48e4ae10d7ac with identifier: YW15851 to the API
2026-03-30 06:31:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:25:28Z',
 'fuel_type': 'diesel',
 'id': '3ce650e6-ecb3-5f99-81b6-48e4ae10d7ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW15851',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Boxer',
 'odometer': 97288,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-14',
 'seller_name': None,
 'title': 'Peugeot Boxer 2.0 Blue-HDi 335 L3 BlueHDi 130 Cargo Edition mit '
          'Ladebordwand',
 'transmission': 'manual',
 'trim': '335 L3 BlueHDi 130 Cargo Edition mit Ladebordwand',
 'year': 2017}
2026-03-30 06:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW15851%27 HTTP/1.1" 200 None
2026-03-30 06:31:28 [auto1.be] INFO: Saving data for YW15851: {'auction_closing_time': 1774884328.0, 'created_time': 1774557039.454165, 'last_price_update_time': 1774852288.701697}
2026-03-30 06:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YW15851') HTTP/1.1" 204 0
2026-03-30 06:31:28 [auto1.be] INFO: Found listing with ID: NS97708
2026-03-30 06:31:28 [auto1.be] INFO: Found listing with ID: MB15455
2026-03-30 06:31:28 [auto1.be] INFO: Found listing with ID: RY14212
2026-03-30 06:31:28 [auto1.be] INFO: Found listing with ID: PB96026
2026-03-30 06:31:28 [auto1.be] INFO: Found listing with ID: EL33380
2026-03-30 06:31:28 [auto1.be] INFO: Found listing with ID: UH14890
2026-03-30 06:31:28 [auto1.be] INFO: Found listing with ID: YK73361
2026-03-30 06:31:28 [auto1.be] INFO: Found listing with ID: FF99790
2026-03-30 06:31:28 [auto1.be] INFO: Found listing with ID: DP88518
2026-03-30 06:31:28 [auto1.be] INFO: Found listing with ID: XL26167
2026-03-30 06:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL26167%27 HTTP/1.1" 200 None
2026-03-30 06:31:28 [auto1.be] INFO: Scrape type for XL26167: 2
2026-03-30 06:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc1f7f23-016e-5c83-89be-1ae807e0a8d4 with identifier: XL26167
2026-03-30 06:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc1f7f23-016e-5c83-89be-1ae807e0a8d4 with scrape type 2
2026-03-30 06:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc1f7f23-016e-5c83-89be-1ae807e0a8d4 with scrape type 2
2026-03-30 06:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bc1f7f23-016e-5c83-89be-1ae807e0a8d4, identifier: XL26167
2026-03-30 06:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:31:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bc1f7f23-016e-5c83-89be-1ae807e0a8d4 with identifier: XL26167
2026-03-30 06:31:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bc1f7f23-016e-5c83-89be-1ae807e0a8d4 with identifier: XL26167
2026-03-30 06:31:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bc1f7f23-016e-5c83-89be-1ae807e0a8d4 with identifier: XL26167 to the API
2026-03-30 06:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:16:59Z',
 'fuel_type': 'petrol',
 'id': 'bc1f7f23-016e-5c83-89be-1ae807e0a8d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL26167',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 87470,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-21',
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-30 06:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL26167%27 HTTP/1.1" 200 None
2026-03-30 06:31:29 [auto1.be] INFO: Saving data for XL26167: {'auction_closing_time': 1774883819.0, 'created_time': 1773348734.831051, 'last_price_update_time': 1774852289.192121}
2026-03-30 06:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XL26167') HTTP/1.1" 204 0
2026-03-30 06:31:29 [auto1.be] INFO: Channel: 24h | Page: 15 | totalHits: 1288 | hits on page: 40
2026-03-30 06:31:29 [auto1.be] INFO: Found listing with ID: YJ00240
2026-03-30 06:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ00240%27 HTTP/1.1" 200 None
2026-03-30 06:31:29 [auto1.be] INFO: Scrape type for YJ00240: 2
2026-03-30 06:31:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c148a875-8b3a-5c20-b7bf-4f7bda84682a with identifier: YJ00240
2026-03-30 06:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c148a875-8b3a-5c20-b7bf-4f7bda84682a with scrape type 2
2026-03-30 06:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c148a875-8b3a-5c20-b7bf-4f7bda84682a with scrape type 2
2026-03-30 06:31:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c148a875-8b3a-5c20-b7bf-4f7bda84682a, identifier: YJ00240
2026-03-30 06:31:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c148a875-8b3a-5c20-b7bf-4f7bda84682a with identifier: YJ00240
2026-03-30 06:31:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c148a875-8b3a-5c20-b7bf-4f7bda84682a with identifier: YJ00240
2026-03-30 06:31:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c148a875-8b3a-5c20-b7bf-4f7bda84682a with identifier: YJ00240 to the API
2026-03-30 06:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:30:09Z',
 'fuel_type': 'diesel',
 'id': 'c148a875-8b3a-5c20-b7bf-4f7bda84682a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ00240',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 259930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-22',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2015}
2026-03-30 06:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ00240%27 HTTP/1.1" 200 None
2026-03-30 06:31:30 [auto1.be] INFO: Saving data for YJ00240: {'auction_closing_time': 1774884609.0, 'created_time': 1774643675.202451, 'last_price_update_time': 1774852290.257924}
2026-03-30 06:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YJ00240') HTTP/1.1" 204 0
2026-03-30 06:31:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:31:30 [auto1.be] INFO: Found listing with ID: NB09051
2026-03-30 06:31:30 [auto1.be] INFO: Found listing with ID: GF65026
2026-03-30 06:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF65026%27 HTTP/1.1" 200 None
2026-03-30 06:31:30 [auto1.be] INFO: Scrape type for GF65026: 2
2026-03-30 06:31:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40b69ed5-a932-5905-a3d4-cdf0da70402e with identifier: GF65026
2026-03-30 06:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40b69ed5-a932-5905-a3d4-cdf0da70402e with scrape type 2
2026-03-30 06:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40b69ed5-a932-5905-a3d4-cdf0da70402e with scrape type 2
2026-03-30 06:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 40b69ed5-a932-5905-a3d4-cdf0da70402e, identifier: GF65026
2026-03-30 06:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 40b69ed5-a932-5905-a3d4-cdf0da70402e with identifier: GF65026
2026-03-30 06:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 40b69ed5-a932-5905-a3d4-cdf0da70402e with identifier: GF65026
2026-03-30 06:31:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 40b69ed5-a932-5905-a3d4-cdf0da70402e with identifier: GF65026 to the API
2026-03-30 06:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:53:05Z',
 'fuel_type': 'petrol',
 'id': '40b69ed5-a932-5905-a3d4-cdf0da70402e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF65026',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 126051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-31',
 'seller_name': None,
 'title': 'Skoda Octavia 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2019}
2026-03-30 06:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF65026%27 HTTP/1.1" 200 None
2026-03-30 06:31:30 [auto1.be] INFO: Saving data for GF65026: {'auction_closing_time': 1774885985.0, 'created_time': 1773779689.446213, 'last_price_update_time': 1774852290.74295}
2026-03-30 06:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GF65026') HTTP/1.1" 204 0
2026-03-30 06:31:30 [auto1.be] INFO: Found listing with ID: HS49836
2026-03-30 06:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS49836%27 HTTP/1.1" 200 None
2026-03-30 06:31:30 [auto1.be] INFO: Scrape type for HS49836: 2
2026-03-30 06:31:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f37a60ee-f930-574d-82be-1a702a31b7e5 with identifier: HS49836
2026-03-30 06:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f37a60ee-f930-574d-82be-1a702a31b7e5 with scrape type 2
2026-03-30 06:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f37a60ee-f930-574d-82be-1a702a31b7e5 with scrape type 2
2026-03-30 06:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f37a60ee-f930-574d-82be-1a702a31b7e5, identifier: HS49836
2026-03-30 06:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f37a60ee-f930-574d-82be-1a702a31b7e5 with identifier: HS49836
2026-03-30 06:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f37a60ee-f930-574d-82be-1a702a31b7e5 with identifier: HS49836
2026-03-30 06:31:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f37a60ee-f930-574d-82be-1a702a31b7e5 with identifier: HS49836 to the API
2026-03-30 06:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:19:04Z',
 'fuel_type': 'petrol',
 'id': 'f37a60ee-f930-574d-82be-1a702a31b7e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS49836',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 92340,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-22',
 'seller_name': None,
 'title': 'Seat Leon 1.5 TSI ACT FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2020}
2026-03-30 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS49836%27 HTTP/1.1" 200 None
2026-03-30 06:31:31 [auto1.be] INFO: Saving data for HS49836: {'auction_closing_time': 1774883944.0, 'created_time': 1774643646.037091, 'last_price_update_time': 1774852291.522087}
2026-03-30 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HS49836') HTTP/1.1" 204 0
2026-03-30 06:31:31 [auto1.be] INFO: Found listing with ID: CU87114
2026-03-30 06:31:31 [auto1.be] INFO: Found listing with ID: UX15937
2026-03-30 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX15937%27 HTTP/1.1" 200 None
2026-03-30 06:31:31 [auto1.be] INFO: Scrape type for UX15937: 0
2026-03-30 06:31:31 [auto1.be] INFO: Found listing with ID: RU19747
2026-03-30 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU19747%27 HTTP/1.1" 200 None
2026-03-30 06:31:31 [auto1.be] INFO: Scrape type for RU19747: 0
2026-03-30 06:31:31 [auto1.be] INFO: Found listing with ID: BV41613
2026-03-30 06:31:31 [auto1.be] INFO: Found listing with ID: ZS27075
2026-03-30 06:31:31 [auto1.be] INFO: Found listing with ID: UA67521
2026-03-30 06:31:31 [auto1.be] INFO: Found listing with ID: CS20047
2026-03-30 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS20047%27 HTTP/1.1" 200 None
2026-03-30 06:31:31 [auto1.be] INFO: Scrape type for CS20047: 2
2026-03-30 06:31:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9315727-438e-577e-93ee-c9466ccaf151 with identifier: CS20047
2026-03-30 06:31:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9315727-438e-577e-93ee-c9466ccaf151 with scrape type 2
2026-03-30 06:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9315727-438e-577e-93ee-c9466ccaf151 with scrape type 2
2026-03-30 06:31:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b9315727-438e-577e-93ee-c9466ccaf151, identifier: CS20047
2026-03-30 06:31:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b9315727-438e-577e-93ee-c9466ccaf151 with identifier: CS20047
2026-03-30 06:31:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b9315727-438e-577e-93ee-c9466ccaf151 with identifier: CS20047
2026-03-30 06:31:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b9315727-438e-577e-93ee-c9466ccaf151 with identifier: CS20047 to the API
2026-03-30 06:31:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:39:07Z',
 'fuel_type': 'diesel',
 'id': 'b9315727-438e-577e-93ee-c9466ccaf151',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS20047',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 196118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-15',
 'seller_name': None,
 'title': 'Toyota Yaris 1.4 D-4D',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-30 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS20047%27 HTTP/1.1" 200 None
2026-03-30 06:31:31 [auto1.be] INFO: Saving data for CS20047: {'auction_closing_time': 1774885147.0, 'created_time': 1774643651.067447, 'last_price_update_time': 1774852291.956861}
2026-03-30 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CS20047') HTTP/1.1" 204 0
2026-03-30 06:31:31 [auto1.be] INFO: Found listing with ID: MK30308
2026-03-30 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK30308%27 HTTP/1.1" 200 None
2026-03-30 06:31:31 [auto1.be] INFO: Scrape type for MK30308: 2
2026-03-30 06:31:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65a64476-33bd-5625-b0bf-97078fff89b2 with identifier: MK30308
2026-03-30 06:31:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65a64476-33bd-5625-b0bf-97078fff89b2 with scrape type 2
2026-03-30 06:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65a64476-33bd-5625-b0bf-97078fff89b2 with scrape type 2
2026-03-30 06:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 65a64476-33bd-5625-b0bf-97078fff89b2, identifier: MK30308
2026-03-30 06:31:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 65a64476-33bd-5625-b0bf-97078fff89b2 with identifier: MK30308
2026-03-30 06:31:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 65a64476-33bd-5625-b0bf-97078fff89b2 with identifier: MK30308
2026-03-30 06:31:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 65a64476-33bd-5625-b0bf-97078fff89b2 with identifier: MK30308 to the API
2026-03-30 06:31:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:51:23Z',
 'fuel_type': 'petrol',
 'id': '65a64476-33bd-5625-b0bf-97078fff89b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK30308',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 37304,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-23',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2020}
2026-03-30 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK30308%27 HTTP/1.1" 200 None
2026-03-30 06:31:32 [auto1.be] INFO: Saving data for MK30308: {'auction_closing_time': 1774885883.0, 'created_time': 1774643451.803545, 'last_price_update_time': 1774852292.366403}
2026-03-30 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MK30308') HTTP/1.1" 204 0
2026-03-30 06:31:32 [auto1.be] INFO: Found listing with ID: YA85838
2026-03-30 06:31:32 [auto1.be] INFO: Found listing with ID: FA61625
2026-03-30 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA61625%27 HTTP/1.1" 200 None
2026-03-30 06:31:32 [auto1.be] INFO: Scrape type for FA61625: 0
2026-03-30 06:31:32 [auto1.be] INFO: Found listing with ID: RL24593
2026-03-30 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL24593%27 HTTP/1.1" 200 None
2026-03-30 06:31:32 [auto1.be] INFO: Scrape type for RL24593: 2
2026-03-30 06:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9ef8c0e-2cfa-5d16-b352-8a129b53477b with identifier: RL24593
2026-03-30 06:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9ef8c0e-2cfa-5d16-b352-8a129b53477b with scrape type 2
2026-03-30 06:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9ef8c0e-2cfa-5d16-b352-8a129b53477b with scrape type 2
2026-03-30 06:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d9ef8c0e-2cfa-5d16-b352-8a129b53477b, identifier: RL24593
2026-03-30 06:31:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d9ef8c0e-2cfa-5d16-b352-8a129b53477b with identifier: RL24593
2026-03-30 06:31:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d9ef8c0e-2cfa-5d16-b352-8a129b53477b with identifier: RL24593
2026-03-30 06:31:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d9ef8c0e-2cfa-5d16-b352-8a129b53477b with identifier: RL24593 to the API
2026-03-30 06:31:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:44:53Z',
 'fuel_type': 'petrol',
 'id': 'd9ef8c0e-2cfa-5d16-b352-8a129b53477b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL24593',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C2',
 'odometer': 95375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-31',
 'seller_name': None,
 'title': 'Citroen C2 1.1 Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2009}
2026-03-30 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL24593%27 HTTP/1.1" 200 None
2026-03-30 06:31:32 [auto1.be] INFO: Saving data for RL24593: {'auction_closing_time': 1774885493.0, 'created_time': 1774557186.204094, 'last_price_update_time': 1774852292.873144}
2026-03-30 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RL24593') HTTP/1.1" 204 0
2026-03-30 06:31:32 [auto1.be] INFO: Found listing with ID: PJ20685
2026-03-30 06:31:32 [auto1.be] INFO: Found listing with ID: XV14848
2026-03-30 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XV14848%27 HTTP/1.1" 200 None
2026-03-30 06:31:32 [auto1.be] INFO: Scrape type for XV14848: 2
2026-03-30 06:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73768219-642a-599a-b543-150284d0217e with identifier: XV14848
2026-03-30 06:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73768219-642a-599a-b543-150284d0217e with scrape type 2
2026-03-30 06:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73768219-642a-599a-b543-150284d0217e with scrape type 2
2026-03-30 06:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 73768219-642a-599a-b543-150284d0217e, identifier: XV14848
2026-03-30 06:31:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 73768219-642a-599a-b543-150284d0217e with identifier: XV14848
2026-03-30 06:31:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 73768219-642a-599a-b543-150284d0217e with identifier: XV14848
2026-03-30 06:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 73768219-642a-599a-b543-150284d0217e with identifier: XV14848 to the API
2026-03-30 06:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:30:02Z',
 'fuel_type': 'petrol',
 'id': '73768219-642a-599a-b543-150284d0217e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV14848',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 122829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-11',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.6 SIDI Turbo Edition Start/Stop',
 'transmission': 'manual',
 'trim': 'Edition Start/Stop',
 'year': 2018}
2026-03-30 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XV14848%27 HTTP/1.1" 200 None
2026-03-30 06:31:33 [auto1.be] INFO: Saving data for XV14848: {'auction_closing_time': 1774884602.0, 'created_time': 1774557091.708332, 'last_price_update_time': 1774852293.26263}
2026-03-30 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XV14848') HTTP/1.1" 204 0
2026-03-30 06:31:33 [auto1.be] INFO: Found listing with ID: DY20434
2026-03-30 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY20434%27 HTTP/1.1" 200 None
2026-03-30 06:31:33 [auto1.be] INFO: Scrape type for DY20434: 0
2026-03-30 06:31:33 [auto1.be] INFO: Found listing with ID: CH15764
2026-03-30 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH15764%27 HTTP/1.1" 200 None
2026-03-30 06:31:33 [auto1.be] INFO: Scrape type for CH15764: 2
2026-03-30 06:31:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f2c7d48-8aea-5fa2-8ce2-5c57a28a7fd3 with identifier: CH15764
2026-03-30 06:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f2c7d48-8aea-5fa2-8ce2-5c57a28a7fd3 with scrape type 2
2026-03-30 06:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f2c7d48-8aea-5fa2-8ce2-5c57a28a7fd3 with scrape type 2
2026-03-30 06:31:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2f2c7d48-8aea-5fa2-8ce2-5c57a28a7fd3, identifier: CH15764
2026-03-30 06:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2f2c7d48-8aea-5fa2-8ce2-5c57a28a7fd3 with identifier: CH15764
2026-03-30 06:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2f2c7d48-8aea-5fa2-8ce2-5c57a28a7fd3 with identifier: CH15764
2026-03-30 06:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2f2c7d48-8aea-5fa2-8ce2-5c57a28a7fd3 with identifier: CH15764 to the API
2026-03-30 06:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:12:50Z',
 'fuel_type': 'petrol',
 'id': '2f2c7d48-8aea-5fa2-8ce2-5c57a28a7fd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH15764',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 115167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-16',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-30 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH15764%27 HTTP/1.1" 200 None
2026-03-30 06:31:33 [auto1.be] INFO: Saving data for CH15764: {'auction_closing_time': 1774883570.0, 'created_time': 1773693293.869452, 'last_price_update_time': 1774852293.657406}
2026-03-30 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CH15764') HTTP/1.1" 204 0
2026-03-30 06:31:33 [auto1.be] INFO: Found listing with ID: HY35953
2026-03-30 06:31:33 [auto1.be] INFO: Found listing with ID: AX58227
2026-03-30 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX58227%27 HTTP/1.1" 200 None
2026-03-30 06:31:33 [auto1.be] INFO: Scrape type for AX58227: 2
2026-03-30 06:31:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78a19676-1b6e-5222-a431-c70f0c69f0da with identifier: AX58227
2026-03-30 06:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78a19676-1b6e-5222-a431-c70f0c69f0da with scrape type 2
2026-03-30 06:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78a19676-1b6e-5222-a431-c70f0c69f0da with scrape type 2
2026-03-30 06:31:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 78a19676-1b6e-5222-a431-c70f0c69f0da, identifier: AX58227
2026-03-30 06:31:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 78a19676-1b6e-5222-a431-c70f0c69f0da with identifier: AX58227
2026-03-30 06:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 78a19676-1b6e-5222-a431-c70f0c69f0da with identifier: AX58227
2026-03-30 06:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 78a19676-1b6e-5222-a431-c70f0c69f0da with identifier: AX58227 to the API
2026-03-30 06:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:30:17Z',
 'fuel_type': 'petrol',
 'id': '78a19676-1b6e-5222-a431-c70f0c69f0da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX58227',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 177531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-03',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX58227%27 HTTP/1.1" 200 None
2026-03-30 06:31:34 [auto1.be] INFO: Saving data for AX58227: {'auction_closing_time': 1774884617.0, 'created_time': 1774557178.874044, 'last_price_update_time': 1774852294.069868}
2026-03-30 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AX58227') HTTP/1.1" 204 0
2026-03-30 06:31:34 [auto1.be] INFO: Found listing with ID: HM69306
2026-03-30 06:31:34 [auto1.be] INFO: Found listing with ID: GG92230
2026-03-30 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG92230%27 HTTP/1.1" 200 None
2026-03-30 06:31:34 [auto1.be] INFO: Scrape type for GG92230: 2
2026-03-30 06:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d05296d-0859-511e-9c11-3277a7c46677 with identifier: GG92230
2026-03-30 06:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d05296d-0859-511e-9c11-3277a7c46677 with scrape type 2
2026-03-30 06:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d05296d-0859-511e-9c11-3277a7c46677 with scrape type 2
2026-03-30 06:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7d05296d-0859-511e-9c11-3277a7c46677, identifier: GG92230
2026-03-30 06:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7d05296d-0859-511e-9c11-3277a7c46677 with identifier: GG92230
2026-03-30 06:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7d05296d-0859-511e-9c11-3277a7c46677 with identifier: GG92230
2026-03-30 06:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7d05296d-0859-511e-9c11-3277a7c46677 with identifier: GG92230 to the API
2026-03-30 06:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:20:08Z',
 'fuel_type': 'diesel',
 'id': '7d05296d-0859-511e-9c11-3277a7c46677',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG92230',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 98622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-29',
 'seller_name': None,
 'title': 'BMW X2 sDrive 18d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2018}
2026-03-30 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG92230%27 HTTP/1.1" 200 None
2026-03-30 06:31:34 [auto1.be] INFO: Saving data for GG92230: {'auction_closing_time': 1774884008.0, 'created_time': 1773953006.288354, 'last_price_update_time': 1774852294.463262}
2026-03-30 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GG92230') HTTP/1.1" 204 0
2026-03-30 06:31:34 [auto1.be] INFO: Found listing with ID: XC97675
2026-03-30 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC97675%27 HTTP/1.1" 200 None
2026-03-30 06:31:34 [auto1.be] INFO: Scrape type for XC97675: 0
2026-03-30 06:31:34 [auto1.be] INFO: Found listing with ID: LE04651
2026-03-30 06:31:34 [auto1.be] INFO: Found listing with ID: XZ27909
2026-03-30 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ27909%27 HTTP/1.1" 200 None
2026-03-30 06:31:34 [auto1.be] INFO: Scrape type for XZ27909: 2
2026-03-30 06:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ecffe6c-970f-5d77-8ddf-5349f842fdd7 with identifier: XZ27909
2026-03-30 06:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ecffe6c-970f-5d77-8ddf-5349f842fdd7 with scrape type 2
2026-03-30 06:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ecffe6c-970f-5d77-8ddf-5349f842fdd7 with scrape type 2
2026-03-30 06:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6ecffe6c-970f-5d77-8ddf-5349f842fdd7, identifier: XZ27909
2026-03-30 06:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6ecffe6c-970f-5d77-8ddf-5349f842fdd7 with identifier: XZ27909
2026-03-30 06:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6ecffe6c-970f-5d77-8ddf-5349f842fdd7 with identifier: XZ27909
2026-03-30 06:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6ecffe6c-970f-5d77-8ddf-5349f842fdd7 with identifier: XZ27909 to the API
2026-03-30 06:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:08:00Z',
 'fuel_type': 'diesel',
 'id': '6ecffe6c-970f-5d77-8ddf-5349f842fdd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ27909',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 213426,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-01',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-30 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ27909%27 HTTP/1.1" 200 None
2026-03-30 06:31:34 [auto1.be] INFO: Saving data for XZ27909: {'auction_closing_time': 1774883280.0, 'created_time': 1774524673.441385, 'last_price_update_time': 1774852294.95775}
2026-03-30 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XZ27909') HTTP/1.1" 204 0
2026-03-30 06:31:34 [auto1.be] INFO: Channel: 24h | Page: 16 | totalHits: 1288 | hits on page: 40
2026-03-30 06:31:34 [auto1.be] INFO: Found listing with ID: CV26650
2026-03-30 06:31:34 [auto1.be] INFO: Found listing with ID: XH41981
2026-03-30 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH41981%27 HTTP/1.1" 200 None
2026-03-30 06:31:34 [auto1.be] INFO: Scrape type for XH41981: 2
2026-03-30 06:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c5137b9-71e4-5e3a-b0c0-2bb80e4614aa with identifier: XH41981
2026-03-30 06:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c5137b9-71e4-5e3a-b0c0-2bb80e4614aa with scrape type 2
2026-03-30 06:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c5137b9-71e4-5e3a-b0c0-2bb80e4614aa with scrape type 2
2026-03-30 06:31:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7c5137b9-71e4-5e3a-b0c0-2bb80e4614aa, identifier: XH41981
2026-03-30 06:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7c5137b9-71e4-5e3a-b0c0-2bb80e4614aa with identifier: XH41981
2026-03-30 06:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7c5137b9-71e4-5e3a-b0c0-2bb80e4614aa with identifier: XH41981
2026-03-30 06:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7c5137b9-71e4-5e3a-b0c0-2bb80e4614aa with identifier: XH41981 to the API
2026-03-30 06:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:25:39Z',
 'fuel_type': 'diesel',
 'id': '7c5137b9-71e4-5e3a-b0c0-2bb80e4614aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH41981',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 91890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-23',
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 316 CDI RWD L2',
 'transmission': 'manual',
 'trim': 'RWD L2',
 'year': 2019}
2026-03-30 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH41981%27 HTTP/1.1" 200 None
2026-03-30 06:31:35 [auto1.be] INFO: Saving data for XH41981: {'auction_closing_time': 1774884339.0, 'created_time': 1774557203.357526, 'last_price_update_time': 1774852295.349107}
2026-03-30 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XH41981') HTTP/1.1" 204 0
2026-03-30 06:31:35 [auto1.be] INFO: Found listing with ID: TH79553
2026-03-30 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH79553%27 HTTP/1.1" 200 None
2026-03-30 06:31:35 [auto1.be] INFO: Scrape type for TH79553: 2
2026-03-30 06:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1631e56e-713b-5129-a480-c2f713cdb8f5 with identifier: TH79553
2026-03-30 06:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1631e56e-713b-5129-a480-c2f713cdb8f5 with scrape type 2
2026-03-30 06:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1631e56e-713b-5129-a480-c2f713cdb8f5 with scrape type 2
2026-03-30 06:31:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1631e56e-713b-5129-a480-c2f713cdb8f5, identifier: TH79553
2026-03-30 06:31:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:31:35 [auto1.be] INFO: Found listing with ID: SV23823
2026-03-30 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV23823%27 HTTP/1.1" 200 None
2026-03-30 06:31:35 [auto1.be] INFO: Scrape type for SV23823: 2
2026-03-30 06:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11bb0ce2-f631-5cbe-8d25-185616472de3 with identifier: SV23823
2026-03-30 06:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11bb0ce2-f631-5cbe-8d25-185616472de3 with scrape type 2
2026-03-30 06:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11bb0ce2-f631-5cbe-8d25-185616472de3 with scrape type 2
2026-03-30 06:31:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 11bb0ce2-f631-5cbe-8d25-185616472de3, identifier: SV23823
2026-03-30 06:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1631e56e-713b-5129-a480-c2f713cdb8f5 with identifier: TH79553
2026-03-30 06:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1631e56e-713b-5129-a480-c2f713cdb8f5 with identifier: TH79553
2026-03-30 06:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1631e56e-713b-5129-a480-c2f713cdb8f5 with identifier: TH79553 to the API
2026-03-30 06:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:50:43Z',
 'fuel_type': 'petrol',
 'id': '1631e56e-713b-5129-a480-c2f713cdb8f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH79553',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 93406,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-09-28',
 'seller_name': None,
 'title': 'Suzuki Swift 1.3 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2005}
2026-03-30 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TH79553%27 HTTP/1.1" 200 None
2026-03-30 06:31:35 [auto1.be] INFO: Saving data for TH79553: {'auction_closing_time': 1774885843.0, 'created_time': 1774557107.436338, 'last_price_update_time': 1774852295.850352}
2026-03-30 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TH79553') HTTP/1.1" 204 0
2026-03-30 06:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 11bb0ce2-f631-5cbe-8d25-185616472de3 with identifier: SV23823
2026-03-30 06:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 11bb0ce2-f631-5cbe-8d25-185616472de3 with identifier: SV23823
2026-03-30 06:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 11bb0ce2-f631-5cbe-8d25-185616472de3 with identifier: SV23823 to the API
2026-03-30 06:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:08:42Z',
 'fuel_type': 'diesel',
 'id': '11bb0ce2-f631-5cbe-8d25-185616472de3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV23823',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 72737,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-26',
 'seller_name': None,
 'title': 'Ford Ranger 3.2 TDCi Doppelkabine 4x4 Wildtrak',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Wildtrak',
 'year': 2017}
2026-03-30 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV23823%27 HTTP/1.1" 200 None
2026-03-30 06:31:36 [auto1.be] INFO: Saving data for SV23823: {'auction_closing_time': 1774883322.0, 'created_time': 1774643659.931199, 'last_price_update_time': 1774852296.146128}
2026-03-30 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SV23823') HTTP/1.1" 204 0
2026-03-30 06:31:36 [auto1.be] INFO: Found listing with ID: BV36868
2026-03-30 06:31:36 [auto1.be] INFO: Found listing with ID: EK41744
2026-03-30 06:31:36 [auto1.be] INFO: Found listing with ID: JB98140
2026-03-30 06:31:36 [auto1.be] INFO: Found listing with ID: ED70069
2026-03-30 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED70069%27 HTTP/1.1" 200 None
2026-03-30 06:31:36 [auto1.be] INFO: Scrape type for ED70069: 0
2026-03-30 06:31:36 [auto1.be] INFO: Found listing with ID: RM32931
2026-03-30 06:31:36 [auto1.be] INFO: Found listing with ID: SK81997
2026-03-30 06:31:36 [auto1.be] INFO: Found listing with ID: XE15288
2026-03-30 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE15288%27 HTTP/1.1" 200 None
2026-03-30 06:31:36 [auto1.be] INFO: Scrape type for XE15288: 0
2026-03-30 06:31:36 [auto1.be] INFO: Found listing with ID: PJ31589
2026-03-30 06:31:36 [auto1.be] INFO: Found listing with ID: MN41841
2026-03-30 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MN41841%27 HTTP/1.1" 200 None
2026-03-30 06:31:36 [auto1.be] INFO: Scrape type for MN41841: 0
2026-03-30 06:31:36 [auto1.be] INFO: Found listing with ID: TV22564
2026-03-30 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV22564%27 HTTP/1.1" 200 None
2026-03-30 06:31:36 [auto1.be] INFO: Scrape type for TV22564: 2
2026-03-30 06:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b075b720-14d8-560d-9ac6-feeca91fea2b with identifier: TV22564
2026-03-30 06:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b075b720-14d8-560d-9ac6-feeca91fea2b with scrape type 2
2026-03-30 06:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b075b720-14d8-560d-9ac6-feeca91fea2b with scrape type 2
2026-03-30 06:31:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b075b720-14d8-560d-9ac6-feeca91fea2b, identifier: TV22564
2026-03-30 06:31:36 [auto1.be] INFO: Found listing with ID: HW65369
2026-03-30 06:31:36 [auto1.be] INFO: Found listing with ID: YC48670
2026-03-30 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC48670%27 HTTP/1.1" 200 None
2026-03-30 06:31:36 [auto1.be] INFO: Scrape type for YC48670: 2
2026-03-30 06:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5107bb6-1b68-5b7a-8fcf-b08dfbc1e9e7 with identifier: YC48670
2026-03-30 06:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5107bb6-1b68-5b7a-8fcf-b08dfbc1e9e7 with scrape type 2
2026-03-30 06:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5107bb6-1b68-5b7a-8fcf-b08dfbc1e9e7 with scrape type 2
2026-03-30 06:31:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f5107bb6-1b68-5b7a-8fcf-b08dfbc1e9e7, identifier: YC48670
2026-03-30 06:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b075b720-14d8-560d-9ac6-feeca91fea2b with identifier: TV22564
2026-03-30 06:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b075b720-14d8-560d-9ac6-feeca91fea2b with identifier: TV22564
2026-03-30 06:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b075b720-14d8-560d-9ac6-feeca91fea2b with identifier: TV22564 to the API
2026-03-30 06:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:09:40Z',
 'fuel_type': 'diesel',
 'id': 'b075b720-14d8-560d-9ac6-feeca91fea2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV22564',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 189507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-24',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2011}
2026-03-30 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV22564%27 HTTP/1.1" 200 None
2026-03-30 06:31:36 [auto1.be] INFO: Saving data for TV22564: {'auction_closing_time': 1774883380.0, 'created_time': 1773237825.833481, 'last_price_update_time': 1774852296.723227}
2026-03-30 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TV22564') HTTP/1.1" 204 0
2026-03-30 06:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f5107bb6-1b68-5b7a-8fcf-b08dfbc1e9e7 with identifier: YC48670
2026-03-30 06:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f5107bb6-1b68-5b7a-8fcf-b08dfbc1e9e7 with identifier: YC48670
2026-03-30 06:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f5107bb6-1b68-5b7a-8fcf-b08dfbc1e9e7 with identifier: YC48670 to the API
2026-03-30 06:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:09Z',
 'fuel_type': 'diesel',
 'id': 'f5107bb6-1b68-5b7a-8fcf-b08dfbc1e9e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC48670',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60 Cross Country',
 'odometer': 134686,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-04',
 'seller_name': None,
 'title': 'Volvo V60 Cross Country 2.0 D3 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2015}
2026-03-30 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YC48670%27 HTTP/1.1" 200 None
2026-03-30 06:31:37 [auto1.be] INFO: Saving data for YC48670: {'auction_closing_time': 1774885689.0, 'created_time': 1773909043.888902, 'last_price_update_time': 1774852297.851143}
2026-03-30 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YC48670') HTTP/1.1" 204 0
2026-03-30 06:31:37 [auto1.be] INFO: Found listing with ID: UF59925
2026-03-30 06:31:37 [auto1.be] INFO: Found listing with ID: UA82763
2026-03-30 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA82763%27 HTTP/1.1" 200 None
2026-03-30 06:31:37 [auto1.be] INFO: Scrape type for UA82763: 0
2026-03-30 06:31:37 [auto1.be] INFO: Found listing with ID: YX48939
2026-03-30 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX48939%27 HTTP/1.1" 200 None
2026-03-30 06:31:37 [auto1.be] INFO: Scrape type for YX48939: 0
2026-03-30 06:31:37 [auto1.be] INFO: Found listing with ID: RA81540
2026-03-30 06:31:37 [auto1.be] INFO: Found listing with ID: LW38679
2026-03-30 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW38679%27 HTTP/1.1" 200 None
2026-03-30 06:31:37 [auto1.be] INFO: Scrape type for LW38679: 0
2026-03-30 06:31:37 [auto1.be] INFO: Found listing with ID: RW15578
2026-03-30 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW15578%27 HTTP/1.1" 200 None
2026-03-30 06:31:37 [auto1.be] INFO: Scrape type for RW15578: 0
2026-03-30 06:31:37 [auto1.be] INFO: Found listing with ID: WG20951
2026-03-30 06:31:37 [auto1.be] INFO: Found listing with ID: UW21644
2026-03-30 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW21644%27 HTTP/1.1" 200 None
2026-03-30 06:31:37 [auto1.be] INFO: Scrape type for UW21644: 0
2026-03-30 06:31:37 [auto1.be] INFO: Found listing with ID: AG87445
2026-03-30 06:31:37 [auto1.be] INFO: Found listing with ID: LX45606
2026-03-30 06:31:37 [auto1.be] INFO: Found listing with ID: DE21401
2026-03-30 06:31:37 [auto1.be] INFO: Found listing with ID: MJ77172
2026-03-30 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ77172%27 HTTP/1.1" 200 None
2026-03-30 06:31:37 [auto1.be] INFO: Scrape type for MJ77172: 2
2026-03-30 06:31:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a94e00e-567c-5886-92a5-ac1f83efb459 with identifier: MJ77172
2026-03-30 06:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a94e00e-567c-5886-92a5-ac1f83efb459 with scrape type 2
2026-03-30 06:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a94e00e-567c-5886-92a5-ac1f83efb459 with scrape type 2
2026-03-30 06:31:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7a94e00e-567c-5886-92a5-ac1f83efb459, identifier: MJ77172
2026-03-30 06:31:38 [auto1.be] INFO: Found listing with ID: MK11042
2026-03-30 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK11042%27 HTTP/1.1" 200 None
2026-03-30 06:31:38 [auto1.be] INFO: Scrape type for MK11042: 0
2026-03-30 06:31:38 [auto1.be] INFO: Found listing with ID: SZ23077
2026-03-30 06:31:38 [auto1.be] INFO: Found listing with ID: TS47815
2026-03-30 06:31:38 [auto1.be] INFO: Found listing with ID: RU10603
2026-03-30 06:31:38 [auto1.be] INFO: Found listing with ID: AX51995
2026-03-30 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AX51995%27 HTTP/1.1" 200 None
2026-03-30 06:31:38 [auto1.be] INFO: Scrape type for AX51995: 0
2026-03-30 06:31:38 [auto1.be] INFO: Found listing with ID: SX30605
2026-03-30 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX30605%27 HTTP/1.1" 200 None
2026-03-30 06:31:38 [auto1.be] INFO: Scrape type for SX30605: 2
2026-03-30 06:31:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16f240d7-1719-5c01-b6f3-18d6515f2b96 with identifier: SX30605
2026-03-30 06:31:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16f240d7-1719-5c01-b6f3-18d6515f2b96 with scrape type 2
2026-03-30 06:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16f240d7-1719-5c01-b6f3-18d6515f2b96 with scrape type 2
2026-03-30 06:31:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 16f240d7-1719-5c01-b6f3-18d6515f2b96, identifier: SX30605
2026-03-30 06:31:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7a94e00e-567c-5886-92a5-ac1f83efb459 with identifier: MJ77172
2026-03-30 06:31:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7a94e00e-567c-5886-92a5-ac1f83efb459 with identifier: MJ77172
2026-03-30 06:31:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7a94e00e-567c-5886-92a5-ac1f83efb459 with identifier: MJ77172 to the API
2026-03-30 06:31:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:40:42Z',
 'fuel_type': 'diesel',
 'id': '7a94e00e-567c-5886-92a5-ac1f83efb459',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ77172',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 114574,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-10',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ77172%27 HTTP/1.1" 200 None
2026-03-30 06:31:38 [auto1.be] INFO: Saving data for MJ77172: {'auction_closing_time': 1774885242.0, 'created_time': 1773909063.792135, 'last_price_update_time': 1774852298.520751}
2026-03-30 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MJ77172') HTTP/1.1" 204 0
2026-03-30 06:31:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 16f240d7-1719-5c01-b6f3-18d6515f2b96 with identifier: SX30605
2026-03-30 06:31:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 16f240d7-1719-5c01-b6f3-18d6515f2b96 with identifier: SX30605
2026-03-30 06:31:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 16f240d7-1719-5c01-b6f3-18d6515f2b96 with identifier: SX30605 to the API
2026-03-30 06:31:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:42:53Z',
 'fuel_type': 'diesel',
 'id': '16f240d7-1719-5c01-b6f3-18d6515f2b96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX30605',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 160421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-07',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 CRDi Premium 2WD',
 'transmission': 'automatic',
 'trim': 'Premium 2WD',
 'year': 2019}
2026-03-30 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX30605%27 HTTP/1.1" 200 None
2026-03-30 06:31:38 [auto1.be] INFO: Saving data for SX30605: {'auction_closing_time': 1774885373.0, 'created_time': 1774729891.603916, 'last_price_update_time': 1774852298.958695}
2026-03-30 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SX30605') HTTP/1.1" 204 0
2026-03-30 06:31:39 [auto1.be] INFO: Found listing with ID: RK68346
2026-03-30 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK68346%27 HTTP/1.1" 200 None
2026-03-30 06:31:39 [auto1.be] INFO: Scrape type for RK68346: 2
2026-03-30 06:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5b6344d-cf9f-576b-876a-86d555ceef5c with identifier: RK68346
2026-03-30 06:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5b6344d-cf9f-576b-876a-86d555ceef5c with scrape type 2
2026-03-30 06:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5b6344d-cf9f-576b-876a-86d555ceef5c with scrape type 2
2026-03-30 06:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c5b6344d-cf9f-576b-876a-86d555ceef5c, identifier: RK68346
2026-03-30 06:31:39 [auto1.be] INFO: Found listing with ID: KW80684
2026-03-30 06:31:39 [auto1.be] INFO: Found listing with ID: LF90651
2026-03-30 06:31:39 [auto1.be] INFO: Found listing with ID: ZJ26609
2026-03-30 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ26609%27 HTTP/1.1" 200 None
2026-03-30 06:31:39 [auto1.be] INFO: Scrape type for ZJ26609: 2
2026-03-30 06:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4af47f6a-5867-55f6-be17-46f1d0252695 with identifier: ZJ26609
2026-03-30 06:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4af47f6a-5867-55f6-be17-46f1d0252695 with scrape type 2
2026-03-30 06:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4af47f6a-5867-55f6-be17-46f1d0252695 with scrape type 2
2026-03-30 06:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4af47f6a-5867-55f6-be17-46f1d0252695, identifier: ZJ26609
2026-03-30 06:31:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c5b6344d-cf9f-576b-876a-86d555ceef5c with identifier: RK68346
2026-03-30 06:31:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c5b6344d-cf9f-576b-876a-86d555ceef5c with identifier: RK68346
2026-03-30 06:31:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c5b6344d-cf9f-576b-876a-86d555ceef5c with identifier: RK68346 to the API
2026-03-30 06:31:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:34:34Z',
 'fuel_type': 'diesel',
 'id': 'c5b6344d-cf9f-576b-876a-86d555ceef5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK68346',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 330990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-31',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2019}
2026-03-30 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK68346%27 HTTP/1.1" 200 None
2026-03-30 06:31:39 [auto1.be] INFO: Saving data for RK68346: {'auction_closing_time': 1774884874.0, 'created_time': 1774643653.653374, 'last_price_update_time': 1774852299.505598}
2026-03-30 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RK68346') HTTP/1.1" 204 0
2026-03-30 06:31:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4af47f6a-5867-55f6-be17-46f1d0252695 with identifier: ZJ26609
2026-03-30 06:31:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:31:39 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-30 06:31:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:31:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4af47f6a-5867-55f6-be17-46f1d0252695 with identifier: ZJ26609
2026-03-30 06:31:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4af47f6a-5867-55f6-be17-46f1d0252695 with identifier: ZJ26609 to the API
2026-03-30 06:31:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:57:50Z',
 'fuel_type': 'petrol',
 'id': '4af47f6a-5867-55f6-be17-46f1d0252695',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ26609',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 96165,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-03',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Signature',
 'transmission': 'manual',
 'trim': 'Signature',
 'year': 2019}
2026-03-30 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ26609%27 HTTP/1.1" 200 None
2026-03-30 06:31:39 [auto1.be] INFO: Saving data for ZJ26609: {'auction_closing_time': 1774886270.0, 'created_time': 1774557187.648745, 'last_price_update_time': 1774852299.938566}
2026-03-30 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZJ26609') HTTP/1.1" 204 0
2026-03-30 06:31:39 [auto1.be] INFO: Found listing with ID: VE52917
2026-03-30 06:31:39 [auto1.be] INFO: Found listing with ID: GC03502
2026-03-30 06:31:39 [auto1.be] INFO: Found listing with ID: JX04101
2026-03-30 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX04101%27 HTTP/1.1" 200 None
2026-03-30 06:31:39 [auto1.be] INFO: Scrape type for JX04101: 2
2026-03-30 06:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d92782b-9b84-5c05-ae4a-9825cdb5422e with identifier: JX04101
2026-03-30 06:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d92782b-9b84-5c05-ae4a-9825cdb5422e with scrape type 2
2026-03-30 06:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d92782b-9b84-5c05-ae4a-9825cdb5422e with scrape type 2
2026-03-30 06:31:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0d92782b-9b84-5c05-ae4a-9825cdb5422e, identifier: JX04101
2026-03-30 06:31:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0d92782b-9b84-5c05-ae4a-9825cdb5422e with identifier: JX04101
2026-03-30 06:31:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0d92782b-9b84-5c05-ae4a-9825cdb5422e with identifier: JX04101
2026-03-30 06:31:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0d92782b-9b84-5c05-ae4a-9825cdb5422e with identifier: JX04101 to the API
2026-03-30 06:31:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:08:41Z',
 'fuel_type': 'diesel',
 'id': '0d92782b-9b84-5c05-ae4a-9825cdb5422e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX04101',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 214547,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-26',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 CRDi Select 2WD',
 'transmission': 'manual',
 'trim': 'Select 2WD',
 'year': 2020}
2026-03-30 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX04101%27 HTTP/1.1" 200 None
2026-03-30 06:31:40 [auto1.be] INFO: Saving data for JX04101: {'auction_closing_time': 1774883321.0, 'created_time': 1774557105.977778, 'last_price_update_time': 1774852300.351106}
2026-03-30 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JX04101') HTTP/1.1" 204 0
2026-03-30 06:31:40 [auto1.be] INFO: Found listing with ID: YA14339
2026-03-30 06:31:40 [auto1.be] INFO: Found listing with ID: SD15124
2026-03-30 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD15124%27 HTTP/1.1" 200 None
2026-03-30 06:31:40 [auto1.be] INFO: Scrape type for SD15124: 2
2026-03-30 06:31:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47cebe66-925b-51d8-aa9d-271032bb0878 with identifier: SD15124
2026-03-30 06:31:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47cebe66-925b-51d8-aa9d-271032bb0878 with scrape type 2
2026-03-30 06:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47cebe66-925b-51d8-aa9d-271032bb0878 with scrape type 2
2026-03-30 06:31:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 47cebe66-925b-51d8-aa9d-271032bb0878, identifier: SD15124
2026-03-30 06:31:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 47cebe66-925b-51d8-aa9d-271032bb0878 with identifier: SD15124
2026-03-30 06:31:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 47cebe66-925b-51d8-aa9d-271032bb0878 with identifier: SD15124
2026-03-30 06:31:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 47cebe66-925b-51d8-aa9d-271032bb0878 with identifier: SD15124 to the API
2026-03-30 06:31:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:39:26Z',
 'fuel_type': 'diesel',
 'id': '47cebe66-925b-51d8-aa9d-271032bb0878',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD15124',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 225805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-24',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d xLine',
 'transmission': 'manual',
 'trim': 'xLine',
 'year': 2016}
2026-03-30 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD15124%27 HTTP/1.1" 200 None
2026-03-30 06:31:40 [auto1.be] INFO: Saving data for SD15124: {'auction_closing_time': 1774885166.0, 'created_time': 1774643682.572923, 'last_price_update_time': 1774852300.756438}
2026-03-30 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SD15124') HTTP/1.1" 204 0
2026-03-30 06:31:40 [auto1.be] INFO: Found listing with ID: RR03336
2026-03-30 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR03336%27 HTTP/1.1" 200 None
2026-03-30 06:31:40 [auto1.be] INFO: Scrape type for RR03336: 0
2026-03-30 06:31:40 [auto1.be] INFO: Found listing with ID: JZ92177
2026-03-30 06:31:40 [auto1.be] INFO: Found listing with ID: PF95077
2026-03-30 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF95077%27 HTTP/1.1" 200 None
2026-03-30 06:31:40 [auto1.be] INFO: Scrape type for PF95077: 0
2026-03-30 06:31:40 [auto1.be] INFO: Found listing with ID: WE56106
2026-03-30 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE56106%27 HTTP/1.1" 200 None
2026-03-30 06:31:40 [auto1.be] INFO: Scrape type for WE56106: 0
2026-03-30 06:31:40 [auto1.be] INFO: Found listing with ID: BC32945
2026-03-30 06:31:40 [auto1.be] INFO: Found listing with ID: NB71425
2026-03-30 06:31:40 [auto1.be] INFO: Found listing with ID: HJ67440
2026-03-30 06:31:40 [auto1.be] INFO: Found listing with ID: SF89359
2026-03-30 06:31:40 [auto1.be] INFO: Found listing with ID: EF70909
2026-03-30 06:31:40 [auto1.be] INFO: Found listing with ID: PN62826
2026-03-30 06:31:40 [auto1.be] INFO: Found listing with ID: ZP07177
2026-03-30 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP07177%27 HTTP/1.1" 200 None
2026-03-30 06:31:40 [auto1.be] INFO: Scrape type for ZP07177: 0
2026-03-30 06:31:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:31:41 [auto1.be] INFO: Channel: 24h | Page: 17 | totalHits: 1288 | hits on page: 40
2026-03-30 06:31:41 [auto1.be] INFO: Found listing with ID: FC28046
2026-03-30 06:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC28046%27 HTTP/1.1" 200 None
2026-03-30 06:31:41 [auto1.be] INFO: Scrape type for FC28046: 0
2026-03-30 06:31:41 [auto1.be] INFO: Found listing with ID: FP68376
2026-03-30 06:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP68376%27 HTTP/1.1" 200 None
2026-03-30 06:31:41 [auto1.be] INFO: Scrape type for FP68376: 0
2026-03-30 06:31:41 [auto1.be] INFO: Found listing with ID: VL69873
2026-03-30 06:31:41 [auto1.be] INFO: Found listing with ID: FR21473
2026-03-30 06:31:41 [auto1.be] INFO: Found listing with ID: FK29667
2026-03-30 06:31:41 [auto1.be] INFO: Found listing with ID: AF71611
2026-03-30 06:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF71611%27 HTTP/1.1" 200 None
2026-03-30 06:31:41 [auto1.be] INFO: Scrape type for AF71611: 2
2026-03-30 06:31:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9aebb3b2-a202-50dc-b817-b9d631831bd9 with identifier: AF71611
2026-03-30 06:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9aebb3b2-a202-50dc-b817-b9d631831bd9 with scrape type 2
2026-03-30 06:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9aebb3b2-a202-50dc-b817-b9d631831bd9 with scrape type 2
2026-03-30 06:31:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9aebb3b2-a202-50dc-b817-b9d631831bd9, identifier: AF71611
2026-03-30 06:31:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9aebb3b2-a202-50dc-b817-b9d631831bd9 with identifier: AF71611
2026-03-30 06:31:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9aebb3b2-a202-50dc-b817-b9d631831bd9 with identifier: AF71611
2026-03-30 06:31:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9aebb3b2-a202-50dc-b817-b9d631831bd9 with identifier: AF71611 to the API
2026-03-30 06:31:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 394,
 'expiration_date': '2026-03-30T15:36:26Z',
 'fuel_type': 'hybrid',
 'id': '9aebb3b2-a202-50dc-b817-b9d631831bd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF71611',
 'listing': 'auction',
 'make': 'BMW',
 'model': '7er',
 'odometer': 172156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-03',
 'seller_name': None,
 'title': 'BMW 7er 745e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-30 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF71611%27 HTTP/1.1" 200 None
2026-03-30 06:31:42 [auto1.be] INFO: Saving data for AF71611: {'auction_closing_time': 1774884986.0, 'created_time': 1773952873.549187, 'last_price_update_time': 1774852302.254634}
2026-03-30 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AF71611') HTTP/1.1" 204 0
2026-03-30 06:31:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:31:42 [auto1.be] INFO: Found listing with ID: AV34296
2026-03-30 06:31:42 [auto1.be] INFO: Found listing with ID: FG88533
2026-03-30 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG88533%27 HTTP/1.1" 200 None
2026-03-30 06:31:42 [auto1.be] INFO: Scrape type for FG88533: 0
2026-03-30 06:31:42 [auto1.be] INFO: Found listing with ID: ET09366
2026-03-30 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET09366%27 HTTP/1.1" 200 None
2026-03-30 06:31:42 [auto1.be] INFO: Scrape type for ET09366: 2
2026-03-30 06:31:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90c33cc0-58e6-5b5c-aaa9-f3e6c965f9c6 with identifier: ET09366
2026-03-30 06:31:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90c33cc0-58e6-5b5c-aaa9-f3e6c965f9c6 with scrape type 2
2026-03-30 06:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90c33cc0-58e6-5b5c-aaa9-f3e6c965f9c6 with scrape type 2
2026-03-30 06:31:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 90c33cc0-58e6-5b5c-aaa9-f3e6c965f9c6, identifier: ET09366
2026-03-30 06:31:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 90c33cc0-58e6-5b5c-aaa9-f3e6c965f9c6 with identifier: ET09366
2026-03-30 06:31:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 90c33cc0-58e6-5b5c-aaa9-f3e6c965f9c6 with identifier: ET09366
2026-03-30 06:31:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 90c33cc0-58e6-5b5c-aaa9-f3e6c965f9c6 with identifier: ET09366 to the API
2026-03-30 06:31:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 341,
 'expiration_date': '2026-03-30T15:20:26Z',
 'fuel_type': 'hybrid',
 'id': '90c33cc0-58e6-5b5c-aaa9-f3e6c965f9c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET09366',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 52799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-24',
 'seller_name': None,
 'title': 'Volvo V60 2.0 T6 Plug-in Hybrid R Design AWD',
 'transmission': 'automatic',
 'trim': 'R Design AWD',
 'year': 2020}
2026-03-30 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET09366%27 HTTP/1.1" 200 None
2026-03-30 06:31:42 [auto1.be] INFO: Saving data for ET09366: {'auction_closing_time': 1774884026.0, 'created_time': 1773833776.671054, 'last_price_update_time': 1774852302.783529}
2026-03-30 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ET09366') HTTP/1.1" 204 0
2026-03-30 06:31:42 [auto1.be] INFO: Found listing with ID: SB45161
2026-03-30 06:31:42 [auto1.be] INFO: Found listing with ID: YF28674
2026-03-30 06:31:42 [auto1.be] INFO: Found listing with ID: SR34780
2026-03-30 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR34780%27 HTTP/1.1" 200 None
2026-03-30 06:31:42 [auto1.be] INFO: Scrape type for SR34780: 0
2026-03-30 06:31:42 [auto1.be] INFO: Found listing with ID: NK56969
2026-03-30 06:31:42 [auto1.be] INFO: Found listing with ID: MT09894
2026-03-30 06:31:42 [auto1.be] INFO: Found listing with ID: ZF81780
2026-03-30 06:31:42 [auto1.be] INFO: Found listing with ID: JZ88652
2026-03-30 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ88652%27 HTTP/1.1" 200 None
2026-03-30 06:31:42 [auto1.be] INFO: Scrape type for JZ88652: 0
2026-03-30 06:31:42 [auto1.be] INFO: Found listing with ID: WB76864
2026-03-30 06:31:42 [auto1.be] INFO: Found listing with ID: UV91092
2026-03-30 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV91092%27 HTTP/1.1" 200 None
2026-03-30 06:31:42 [auto1.be] INFO: Scrape type for UV91092: 2
2026-03-30 06:31:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97cef536-caf7-59b1-ab3d-454ec74aa3a7 with identifier: UV91092
2026-03-30 06:31:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97cef536-caf7-59b1-ab3d-454ec74aa3a7 with scrape type 2
2026-03-30 06:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97cef536-caf7-59b1-ab3d-454ec74aa3a7 with scrape type 2
2026-03-30 06:31:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 97cef536-caf7-59b1-ab3d-454ec74aa3a7, identifier: UV91092
2026-03-30 06:31:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 97cef536-caf7-59b1-ab3d-454ec74aa3a7 with identifier: UV91092
2026-03-30 06:31:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 97cef536-caf7-59b1-ab3d-454ec74aa3a7 with identifier: UV91092
2026-03-30 06:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 97cef536-caf7-59b1-ab3d-454ec74aa3a7 with identifier: UV91092 to the API
2026-03-30 06:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:07:41Z',
 'fuel_type': 'petrol',
 'id': '97cef536-caf7-59b1-ab3d-454ec74aa3a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV91092',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 13399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-24',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Select',
 'transmission': 'manual',
 'trim': 'Select',
 'year': 2021}
2026-03-30 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV91092%27 HTTP/1.1" 200 None
2026-03-30 06:31:43 [auto1.be] INFO: Saving data for UV91092: {'auction_closing_time': 1774883261.0, 'created_time': 1774524703.749716, 'last_price_update_time': 1774852303.210018}
2026-03-30 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UV91092') HTTP/1.1" 204 0
2026-03-30 06:31:43 [auto1.be] INFO: Found listing with ID: JX62848
2026-03-30 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX62848%27 HTTP/1.1" 200 None
2026-03-30 06:31:43 [auto1.be] INFO: Scrape type for JX62848: 0
2026-03-30 06:31:43 [auto1.be] INFO: Found listing with ID: BS55977
2026-03-30 06:31:43 [auto1.be] INFO: Found listing with ID: ET18736
2026-03-30 06:31:43 [auto1.be] INFO: Found listing with ID: MA69424
2026-03-30 06:31:43 [auto1.be] INFO: Found listing with ID: VW08902
2026-03-30 06:31:43 [auto1.be] INFO: Found listing with ID: ZR45530
2026-03-30 06:31:43 [auto1.be] INFO: Found listing with ID: FS38787
2026-03-30 06:31:43 [auto1.be] INFO: Found listing with ID: HT09098
2026-03-30 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT09098%27 HTTP/1.1" 200 None
2026-03-30 06:31:43 [auto1.be] INFO: Scrape type for HT09098: 2
2026-03-30 06:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5ceac93-e1c0-5054-97d1-2e87f4891b39 with identifier: HT09098
2026-03-30 06:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5ceac93-e1c0-5054-97d1-2e87f4891b39 with scrape type 2
2026-03-30 06:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5ceac93-e1c0-5054-97d1-2e87f4891b39 with scrape type 2
2026-03-30 06:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c5ceac93-e1c0-5054-97d1-2e87f4891b39, identifier: HT09098
2026-03-30 06:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c5ceac93-e1c0-5054-97d1-2e87f4891b39 with identifier: HT09098
2026-03-30 06:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c5ceac93-e1c0-5054-97d1-2e87f4891b39 with identifier: HT09098
2026-03-30 06:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c5ceac93-e1c0-5054-97d1-2e87f4891b39 with identifier: HT09098 to the API
2026-03-30 06:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:24:51Z',
 'fuel_type': 'diesel',
 'id': 'c5ceac93-e1c0-5054-97d1-2e87f4891b39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT09098',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 150197,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-12',
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-30 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT09098%27 HTTP/1.1" 200 None
2026-03-30 06:31:43 [auto1.be] INFO: Saving data for HT09098: {'auction_closing_time': 1774884291.0, 'created_time': 1774643685.635811, 'last_price_update_time': 1774852303.709386}
2026-03-30 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HT09098') HTTP/1.1" 204 0
2026-03-30 06:31:43 [auto1.be] INFO: Found listing with ID: KP16038
2026-03-30 06:31:43 [auto1.be] INFO: Found listing with ID: KC19835
2026-03-30 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC19835%27 HTTP/1.1" 200 None
2026-03-30 06:31:43 [auto1.be] INFO: Scrape type for KC19835: 2
2026-03-30 06:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c27705c-c5f8-5a7b-baef-f8308811f3e0 with identifier: KC19835
2026-03-30 06:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c27705c-c5f8-5a7b-baef-f8308811f3e0 with scrape type 2
2026-03-30 06:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c27705c-c5f8-5a7b-baef-f8308811f3e0 with scrape type 2
2026-03-30 06:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4c27705c-c5f8-5a7b-baef-f8308811f3e0, identifier: KC19835
2026-03-30 06:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4c27705c-c5f8-5a7b-baef-f8308811f3e0 with identifier: KC19835
2026-03-30 06:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4c27705c-c5f8-5a7b-baef-f8308811f3e0 with identifier: KC19835
2026-03-30 06:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4c27705c-c5f8-5a7b-baef-f8308811f3e0 with identifier: KC19835 to the API
2026-03-30 06:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:34:35Z',
 'fuel_type': 'diesel',
 'id': '4c27705c-c5f8-5a7b-baef-f8308811f3e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC19835',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 83454,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-03',
 'seller_name': None,
 'title': 'Opel Astra 1.5 CDTI Start&Stop',
 'transmission': 'manual',
 'trim': 'Start&Stop',
 'year': 2020}
2026-03-30 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC19835%27 HTTP/1.1" 200 None
2026-03-30 06:31:44 [auto1.be] INFO: Saving data for KC19835: {'auction_closing_time': 1774884875.0, 'created_time': 1774643667.164306, 'last_price_update_time': 1774852304.093733}
2026-03-30 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KC19835') HTTP/1.1" 204 0
2026-03-30 06:31:44 [auto1.be] INFO: Found listing with ID: VU16052
2026-03-30 06:31:44 [auto1.be] INFO: Found listing with ID: HM47736
2026-03-30 06:31:44 [auto1.be] INFO: Found listing with ID: GF03232
2026-03-30 06:31:44 [auto1.be] INFO: Found listing with ID: UC56570
2026-03-30 06:31:44 [auto1.be] INFO: Found listing with ID: NN67810
2026-03-30 06:31:44 [auto1.be] INFO: Found listing with ID: ZM54686
2026-03-30 06:31:44 [auto1.be] INFO: Found listing with ID: FE88671
2026-03-30 06:31:44 [auto1.be] INFO: Found listing with ID: GR78986
2026-03-30 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR78986%27 HTTP/1.1" 200 None
2026-03-30 06:31:44 [auto1.be] INFO: Scrape type for GR78986: 0
2026-03-30 06:31:44 [auto1.be] INFO: Found listing with ID: CP42003
2026-03-30 06:31:44 [auto1.be] INFO: Found listing with ID: RN56335
2026-03-30 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RN56335%27 HTTP/1.1" 200 None
2026-03-30 06:31:44 [auto1.be] INFO: Scrape type for RN56335: 0
2026-03-30 06:31:44 [auto1.be] INFO: Found listing with ID: RF80171
2026-03-30 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF80171%27 HTTP/1.1" 200 None
2026-03-30 06:31:44 [auto1.be] INFO: Scrape type for RF80171: 0
2026-03-30 06:31:44 [auto1.be] INFO: Found listing with ID: ZF78419
2026-03-30 06:31:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:31:45 [auto1.be] INFO: Channel: 24h | Page: 18 | totalHits: 1288 | hits on page: 40
2026-03-30 06:31:45 [auto1.be] INFO: Found listing with ID: DT24627
2026-03-30 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT24627%27 HTTP/1.1" 200 None
2026-03-30 06:31:45 [auto1.be] INFO: Scrape type for DT24627: 0
2026-03-30 06:31:45 [auto1.be] INFO: Found listing with ID: YM99739
2026-03-30 06:31:45 [auto1.be] INFO: Found listing with ID: CH83928
2026-03-30 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH83928%27 HTTP/1.1" 200 None
2026-03-30 06:31:45 [auto1.be] INFO: Scrape type for CH83928: 0
2026-03-30 06:31:45 [auto1.be] INFO: Found listing with ID: BC69430
2026-03-30 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC69430%27 HTTP/1.1" 200 None
2026-03-30 06:31:45 [auto1.be] INFO: Scrape type for BC69430: 2
2026-03-30 06:31:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4441441f-4e8f-5b4c-9ffe-357852997dc4 with identifier: BC69430
2026-03-30 06:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4441441f-4e8f-5b4c-9ffe-357852997dc4 with scrape type 2
2026-03-30 06:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4441441f-4e8f-5b4c-9ffe-357852997dc4 with scrape type 2
2026-03-30 06:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4441441f-4e8f-5b4c-9ffe-357852997dc4, identifier: BC69430
2026-03-30 06:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4441441f-4e8f-5b4c-9ffe-357852997dc4 with identifier: BC69430
2026-03-30 06:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4441441f-4e8f-5b4c-9ffe-357852997dc4 with identifier: BC69430
2026-03-30 06:31:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4441441f-4e8f-5b4c-9ffe-357852997dc4 with identifier: BC69430 to the API
2026-03-30 06:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:50:01Z',
 'fuel_type': 'diesel',
 'id': '4441441f-4e8f-5b4c-9ffe-357852997dc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC69430',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 206234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-01',
 'seller_name': None,
 'title': 'BMW 3er 318d Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2015}
2026-03-30 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC69430%27 HTTP/1.1" 200 None
2026-03-30 06:31:45 [auto1.be] INFO: Saving data for BC69430: {'auction_closing_time': 1774885801.0, 'created_time': 1773909036.439363, 'last_price_update_time': 1774852305.855784}
2026-03-30 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BC69430') HTTP/1.1" 204 0
2026-03-30 06:31:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:31:45 [auto1.be] INFO: Found listing with ID: BU90061
2026-03-30 06:31:45 [auto1.be] INFO: Found listing with ID: EV01420
2026-03-30 06:31:45 [auto1.be] INFO: Found listing with ID: PS72966
2026-03-30 06:31:45 [auto1.be] INFO: Found listing with ID: CR22525
2026-03-30 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CR22525%27 HTTP/1.1" 200 None
2026-03-30 06:31:45 [auto1.be] INFO: Scrape type for CR22525: 2
2026-03-30 06:31:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9191288-0176-59a8-911f-1ca9935b23e1 with identifier: CR22525
2026-03-30 06:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9191288-0176-59a8-911f-1ca9935b23e1 with scrape type 2
2026-03-30 06:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9191288-0176-59a8-911f-1ca9935b23e1 with scrape type 2
2026-03-30 06:31:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f9191288-0176-59a8-911f-1ca9935b23e1, identifier: CR22525
2026-03-30 06:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f9191288-0176-59a8-911f-1ca9935b23e1 with identifier: CR22525
2026-03-30 06:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f9191288-0176-59a8-911f-1ca9935b23e1 with identifier: CR22525
2026-03-30 06:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f9191288-0176-59a8-911f-1ca9935b23e1 with identifier: CR22525 to the API
2026-03-30 06:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:09:53Z',
 'fuel_type': 'petrol',
 'id': 'f9191288-0176-59a8-911f-1ca9935b23e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR22525',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 46268,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-10-27',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Mild-Hybrid GT-Line',
 'transmission': 'automatic',
 'trim': 'GT-Line',
 'year': 2024}
2026-03-30 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CR22525%27 HTTP/1.1" 200 None
2026-03-30 06:31:46 [auto1.be] INFO: Saving data for CR22525: {'auction_closing_time': 1774883393.0, 'created_time': 1774643671.449393, 'last_price_update_time': 1774852306.348328}
2026-03-30 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CR22525') HTTP/1.1" 204 0
2026-03-30 06:31:46 [auto1.be] INFO: Found listing with ID: HF54985
2026-03-30 06:31:46 [auto1.be] INFO: Found listing with ID: GH94733
2026-03-30 06:31:46 [auto1.be] INFO: Found listing with ID: CP91123
2026-03-30 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP91123%27 HTTP/1.1" 200 None
2026-03-30 06:31:46 [auto1.be] INFO: Scrape type for CP91123: 0
2026-03-30 06:31:46 [auto1.be] INFO: Found listing with ID: FA30680
2026-03-30 06:31:46 [auto1.be] INFO: Found listing with ID: WL65720
2026-03-30 06:31:46 [auto1.be] INFO: Found listing with ID: KM67426
2026-03-30 06:31:46 [auto1.be] INFO: Found listing with ID: DM52841
2026-03-30 06:31:46 [auto1.be] INFO: Found listing with ID: YH09444
2026-03-30 06:31:46 [auto1.be] INFO: Found listing with ID: JP67733
2026-03-30 06:31:46 [auto1.be] INFO: Found listing with ID: RB53949
2026-03-30 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RB53949%27 HTTP/1.1" 200 None
2026-03-30 06:31:46 [auto1.be] INFO: Scrape type for RB53949: 0
2026-03-30 06:31:46 [auto1.be] INFO: Found listing with ID: XD36076
2026-03-30 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD36076%27 HTTP/1.1" 200 None
2026-03-30 06:31:46 [auto1.be] INFO: Scrape type for XD36076: 0
2026-03-30 06:31:46 [auto1.be] INFO: Found listing with ID: RK05604
2026-03-30 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK05604%27 HTTP/1.1" 200 None
2026-03-30 06:31:46 [auto1.be] INFO: Scrape type for RK05604: 0
2026-03-30 06:31:46 [auto1.be] INFO: Found listing with ID: WA39171
2026-03-30 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA39171%27 HTTP/1.1" 200 None
2026-03-30 06:31:46 [auto1.be] INFO: Scrape type for WA39171: 2
2026-03-30 06:31:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 181b9bb8-28ad-519c-a860-e98eb7da57e5 with identifier: WA39171
2026-03-30 06:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 181b9bb8-28ad-519c-a860-e98eb7da57e5 with scrape type 2
2026-03-30 06:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 181b9bb8-28ad-519c-a860-e98eb7da57e5 with scrape type 2
2026-03-30 06:31:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 181b9bb8-28ad-519c-a860-e98eb7da57e5, identifier: WA39171
2026-03-30 06:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 181b9bb8-28ad-519c-a860-e98eb7da57e5 with identifier: WA39171
2026-03-30 06:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 181b9bb8-28ad-519c-a860-e98eb7da57e5 with identifier: WA39171
2026-03-30 06:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 181b9bb8-28ad-519c-a860-e98eb7da57e5 with identifier: WA39171 to the API
2026-03-30 06:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:00:04Z',
 'fuel_type': 'diesel',
 'id': '181b9bb8-28ad-519c-a860-e98eb7da57e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA39171',
 'listing': 'auction',
 'make': 'BMW',
 'model': '6er',
 'odometer': 142845,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-13',
 'seller_name': None,
 'title': 'BMW 6er 620d GT M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-30 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA39171%27 HTTP/1.1" 200 None
2026-03-30 06:31:46 [auto1.be] INFO: Saving data for WA39171: {'auction_closing_time': 1774882804.0, 'created_time': 1774557128.743925, 'last_price_update_time': 1774852306.841018}
2026-03-30 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WA39171') HTTP/1.1" 204 0
2026-03-30 06:31:46 [auto1.be] INFO: Found listing with ID: AL21659
2026-03-30 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AL21659%27 HTTP/1.1" 200 None
2026-03-30 06:31:46 [auto1.be] INFO: Scrape type for AL21659: 0
2026-03-30 06:31:46 [auto1.be] INFO: Found listing with ID: DC47068
2026-03-30 06:31:46 [auto1.be] INFO: Found listing with ID: ES19550
2026-03-30 06:31:46 [auto1.be] INFO: Found listing with ID: ZH14429
2026-03-30 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH14429%27 HTTP/1.1" 200 None
2026-03-30 06:31:46 [auto1.be] INFO: Scrape type for ZH14429: 2
2026-03-30 06:31:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc7588cc-1942-54d2-b932-522eaa422537 with identifier: ZH14429
2026-03-30 06:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc7588cc-1942-54d2-b932-522eaa422537 with scrape type 2
2026-03-30 06:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc7588cc-1942-54d2-b932-522eaa422537 with scrape type 2
2026-03-30 06:31:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fc7588cc-1942-54d2-b932-522eaa422537, identifier: ZH14429
2026-03-30 06:31:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fc7588cc-1942-54d2-b932-522eaa422537 with identifier: ZH14429
2026-03-30 06:31:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fc7588cc-1942-54d2-b932-522eaa422537 with identifier: ZH14429
2026-03-30 06:31:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fc7588cc-1942-54d2-b932-522eaa422537 with identifier: ZH14429 to the API
2026-03-30 06:31:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:13:30Z',
 'fuel_type': 'diesel',
 'id': 'fc7588cc-1942-54d2-b932-522eaa422537',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH14429',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 233552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-19',
 'seller_name': None,
 'title': 'Kia Rio 1.1 CRDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-03-30 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH14429%27 HTTP/1.1" 200 None
2026-03-30 06:31:47 [auto1.be] INFO: Saving data for ZH14429: {'auction_closing_time': 1774883610.0, 'created_time': 1774557037.957116, 'last_price_update_time': 1774852307.345319}
2026-03-30 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZH14429') HTTP/1.1" 204 0
2026-03-30 06:31:47 [auto1.be] INFO: Found listing with ID: VV25356
2026-03-30 06:31:47 [auto1.be] INFO: Found listing with ID: GS99704
2026-03-30 06:31:47 [auto1.be] INFO: Found listing with ID: UD97693
2026-03-30 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UD97693%27 HTTP/1.1" 200 None
2026-03-30 06:31:47 [auto1.be] INFO: Scrape type for UD97693: 0
2026-03-30 06:31:47 [auto1.be] INFO: Found listing with ID: YJ44532
2026-03-30 06:31:47 [auto1.be] INFO: Found listing with ID: VM79296
2026-03-30 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM79296%27 HTTP/1.1" 200 None
2026-03-30 06:31:47 [auto1.be] INFO: Scrape type for VM79296: 2
2026-03-30 06:31:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16975dda-a13c-54ca-a9f5-8724e17b1f52 with identifier: VM79296
2026-03-30 06:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16975dda-a13c-54ca-a9f5-8724e17b1f52 with scrape type 2
2026-03-30 06:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16975dda-a13c-54ca-a9f5-8724e17b1f52 with scrape type 2
2026-03-30 06:31:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 16975dda-a13c-54ca-a9f5-8724e17b1f52, identifier: VM79296
2026-03-30 06:31:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 16975dda-a13c-54ca-a9f5-8724e17b1f52 with identifier: VM79296
2026-03-30 06:31:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 16975dda-a13c-54ca-a9f5-8724e17b1f52 with identifier: VM79296
2026-03-30 06:31:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 16975dda-a13c-54ca-a9f5-8724e17b1f52 with identifier: VM79296 to the API
2026-03-30 06:31:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:34:43Z',
 'fuel_type': 'diesel',
 'id': '16975dda-a13c-54ca-a9f5-8724e17b1f52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM79296',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Bipper',
 'odometer': 113242,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-26',
 'seller_name': None,
 'title': 'Peugeot Bipper 1.3 HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-30 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM79296%27 HTTP/1.1" 200 None
2026-03-30 06:31:47 [auto1.be] INFO: Saving data for VM79296: {'auction_closing_time': 1774884883.0, 'created_time': 1773434064.981091, 'last_price_update_time': 1774852307.750063}
2026-03-30 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VM79296') HTTP/1.1" 204 0
2026-03-30 06:31:47 [auto1.be] INFO: Found listing with ID: YF30387
2026-03-30 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF30387%27 HTTP/1.1" 200 None
2026-03-30 06:31:47 [auto1.be] INFO: Scrape type for YF30387: 2
2026-03-30 06:31:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aff36c0b-bcf9-52e0-9032-6e7f118b17cc with identifier: YF30387
2026-03-30 06:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aff36c0b-bcf9-52e0-9032-6e7f118b17cc with scrape type 2
2026-03-30 06:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aff36c0b-bcf9-52e0-9032-6e7f118b17cc with scrape type 2
2026-03-30 06:31:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: aff36c0b-bcf9-52e0-9032-6e7f118b17cc, identifier: YF30387
2026-03-30 06:31:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: aff36c0b-bcf9-52e0-9032-6e7f118b17cc with identifier: YF30387
2026-03-30 06:31:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: aff36c0b-bcf9-52e0-9032-6e7f118b17cc with identifier: YF30387
2026-03-30 06:31:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: aff36c0b-bcf9-52e0-9032-6e7f118b17cc with identifier: YF30387 to the API
2026-03-30 06:31:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:30:14Z',
 'fuel_type': 'diesel',
 'id': 'aff36c0b-bcf9-52e0-9032-6e7f118b17cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF30387',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 178201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-07',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2016}
2026-03-30 06:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF30387%27 HTTP/1.1" 200 None
2026-03-30 06:31:48 [auto1.be] INFO: Saving data for YF30387: {'auction_closing_time': 1774884614.0, 'created_time': 1774643624.717016, 'last_price_update_time': 1774852308.138318}
2026-03-30 06:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YF30387') HTTP/1.1" 204 0
2026-03-30 06:31:48 [auto1.be] INFO: Found listing with ID: NU98421
2026-03-30 06:31:48 [auto1.be] INFO: Found listing with ID: DY95002
2026-03-30 06:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY95002%27 HTTP/1.1" 200 None
2026-03-30 06:31:48 [auto1.be] INFO: Scrape type for DY95002: 0
2026-03-30 06:31:48 [auto1.be] INFO: Found listing with ID: HL95749
2026-03-30 06:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL95749%27 HTTP/1.1" 200 None
2026-03-30 06:31:48 [auto1.be] INFO: Scrape type for HL95749: 0
2026-03-30 06:31:48 [auto1.be] INFO: Found listing with ID: SA79242
2026-03-30 06:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA79242%27 HTTP/1.1" 200 None
2026-03-30 06:31:48 [auto1.be] INFO: Scrape type for SA79242: 0
2026-03-30 06:31:48 [auto1.be] INFO: Found listing with ID: KF81819
2026-03-30 06:31:48 [auto1.be] INFO: Found listing with ID: WC10504
2026-03-30 06:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC10504%27 HTTP/1.1" 200 None
2026-03-30 06:31:48 [auto1.be] INFO: Scrape type for WC10504: 0
2026-03-30 06:31:48 [auto1.be] INFO: Found listing with ID: KU12802
2026-03-30 06:31:48 [auto1.be] INFO: Found listing with ID: CE58685
2026-03-30 06:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE58685%27 HTTP/1.1" 200 None
2026-03-30 06:31:48 [auto1.be] INFO: Scrape type for CE58685: 0
2026-03-30 06:31:48 [auto1.be] INFO: Found listing with ID: YH98972
2026-03-30 06:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH98972%27 HTTP/1.1" 200 None
2026-03-30 06:31:48 [auto1.be] INFO: Scrape type for YH98972: 2
2026-03-30 06:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6503a6bc-b391-5434-bbc5-2f2f987f650c with identifier: YH98972
2026-03-30 06:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6503a6bc-b391-5434-bbc5-2f2f987f650c with scrape type 2
2026-03-30 06:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6503a6bc-b391-5434-bbc5-2f2f987f650c with scrape type 2
2026-03-30 06:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6503a6bc-b391-5434-bbc5-2f2f987f650c, identifier: YH98972
2026-03-30 06:31:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6503a6bc-b391-5434-bbc5-2f2f987f650c with identifier: YH98972
2026-03-30 06:31:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6503a6bc-b391-5434-bbc5-2f2f987f650c with identifier: YH98972
2026-03-30 06:31:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6503a6bc-b391-5434-bbc5-2f2f987f650c with identifier: YH98972 to the API
2026-03-30 06:31:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:22:53Z',
 'fuel_type': 'diesel',
 'id': '6503a6bc-b391-5434-bbc5-2f2f987f650c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH98972',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 198190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-15',
 'seller_name': None,
 'title': 'Audi A3 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2012}
2026-03-30 06:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH98972%27 HTTP/1.1" 200 None
2026-03-30 06:31:48 [auto1.be] INFO: Saving data for YH98972: {'auction_closing_time': 1774884173.0, 'created_time': 1774557192.483845, 'last_price_update_time': 1774852308.621159}
2026-03-30 06:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YH98972') HTTP/1.1" 204 0
2026-03-30 06:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:31:57 [auto1.be] INFO: Channel: 24h | Page: 19 | totalHits: 1288 | hits on page: 40
2026-03-30 06:31:57 [auto1.be] INFO: Found listing with ID: BJ55526
2026-03-30 06:31:57 [auto1.be] INFO: Found listing with ID: GP50240
2026-03-30 06:31:57 [auto1.be] INFO: Found listing with ID: SR93497
2026-03-30 06:31:57 [auto1.be] INFO: Found listing with ID: TW22956
2026-03-30 06:31:57 [auto1.be] INFO: Found listing with ID: GN45273
2026-03-30 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN45273%27 HTTP/1.1" 200 None
2026-03-30 06:31:57 [auto1.be] INFO: Scrape type for GN45273: 0
2026-03-30 06:31:57 [auto1.be] INFO: Found listing with ID: AE23838
2026-03-30 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE23838%27 HTTP/1.1" 200 None
2026-03-30 06:31:57 [auto1.be] INFO: Scrape type for AE23838: 0
2026-03-30 06:31:57 [auto1.be] INFO: Found listing with ID: WD60187
2026-03-30 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WD60187%27 HTTP/1.1" 200 None
2026-03-30 06:31:57 [auto1.be] INFO: Scrape type for WD60187: 0
2026-03-30 06:31:57 [auto1.be] INFO: Found listing with ID: MF96479
2026-03-30 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MF96479%27 HTTP/1.1" 200 None
2026-03-30 06:31:57 [auto1.be] INFO: Scrape type for MF96479: 0
2026-03-30 06:31:57 [auto1.be] INFO: Found listing with ID: KF59500
2026-03-30 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF59500%27 HTTP/1.1" 200 None
2026-03-30 06:31:57 [auto1.be] INFO: Scrape type for KF59500: 2
2026-03-30 06:31:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bea136e-72af-57e5-86b2-27a644aa7f11 with identifier: KF59500
2026-03-30 06:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bea136e-72af-57e5-86b2-27a644aa7f11 with scrape type 2
2026-03-30 06:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bea136e-72af-57e5-86b2-27a644aa7f11 with scrape type 2
2026-03-30 06:31:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2bea136e-72af-57e5-86b2-27a644aa7f11, identifier: KF59500
2026-03-30 06:31:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2bea136e-72af-57e5-86b2-27a644aa7f11 with identifier: KF59500
2026-03-30 06:31:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2bea136e-72af-57e5-86b2-27a644aa7f11 with identifier: KF59500
2026-03-30 06:31:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2bea136e-72af-57e5-86b2-27a644aa7f11 with identifier: KF59500 to the API
2026-03-30 06:31:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:35:01Z',
 'fuel_type': 'petrol',
 'id': '2bea136e-72af-57e5-86b2-27a644aa7f11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF59500',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 53112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-10-10',
 'seller_name': None,
 'title': 'Opel Meriva 1.6 Blue Line',
 'transmission': 'manual',
 'trim': 'Blue Line',
 'year': 2004}
2026-03-30 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF59500%27 HTTP/1.1" 200 None
2026-03-30 06:31:57 [auto1.be] INFO: Saving data for KF59500: {'auction_closing_time': 1774884901.0, 'created_time': 1773693306.709372, 'last_price_update_time': 1774852317.956258}
2026-03-30 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KF59500') HTTP/1.1" 204 0
2026-03-30 06:31:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:31:57 [auto1.be] INFO: Found listing with ID: ZT52703
2026-03-30 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZT52703%27 HTTP/1.1" 200 None
2026-03-30 06:31:57 [auto1.be] INFO: Scrape type for ZT52703: 2
2026-03-30 06:31:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7feb9c2c-cc83-5421-930e-834c5bfd5694 with identifier: ZT52703
2026-03-30 06:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7feb9c2c-cc83-5421-930e-834c5bfd5694 with scrape type 2
2026-03-30 06:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7feb9c2c-cc83-5421-930e-834c5bfd5694 with scrape type 2
2026-03-30 06:31:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7feb9c2c-cc83-5421-930e-834c5bfd5694, identifier: ZT52703
2026-03-30 06:31:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7feb9c2c-cc83-5421-930e-834c5bfd5694 with identifier: ZT52703
2026-03-30 06:31:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:31:58 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-30 06:31:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:31:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7feb9c2c-cc83-5421-930e-834c5bfd5694 with identifier: ZT52703
2026-03-30 06:31:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7feb9c2c-cc83-5421-930e-834c5bfd5694 with identifier: ZT52703 to the API
2026-03-30 06:31:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:36:52Z',
 'fuel_type': 'diesel',
 'id': '7feb9c2c-cc83-5421-930e-834c5bfd5694',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT52703',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 315098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-12',
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-30 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZT52703%27 HTTP/1.1" 200 None
2026-03-30 06:31:58 [auto1.be] INFO: Saving data for ZT52703: {'auction_closing_time': 1774885012.0, 'created_time': 1774643666.867865, 'last_price_update_time': 1774852318.500851}
2026-03-30 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZT52703') HTTP/1.1" 204 0
2026-03-30 06:31:58 [auto1.be] INFO: Found listing with ID: GP69185
2026-03-30 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP69185%27 HTTP/1.1" 200 None
2026-03-30 06:31:58 [auto1.be] INFO: Scrape type for GP69185: 0
2026-03-30 06:31:58 [auto1.be] INFO: Found listing with ID: ZR52684
2026-03-30 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR52684%27 HTTP/1.1" 200 None
2026-03-30 06:31:58 [auto1.be] INFO: Scrape type for ZR52684: 2
2026-03-30 06:31:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2dc8113-035f-5801-bd6f-331a4cfc9ff8 with identifier: ZR52684
2026-03-30 06:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2dc8113-035f-5801-bd6f-331a4cfc9ff8 with scrape type 2
2026-03-30 06:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2dc8113-035f-5801-bd6f-331a4cfc9ff8 with scrape type 2
2026-03-30 06:31:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d2dc8113-035f-5801-bd6f-331a4cfc9ff8, identifier: ZR52684
2026-03-30 06:31:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d2dc8113-035f-5801-bd6f-331a4cfc9ff8 with identifier: ZR52684
2026-03-30 06:31:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d2dc8113-035f-5801-bd6f-331a4cfc9ff8 with identifier: ZR52684
2026-03-30 06:31:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d2dc8113-035f-5801-bd6f-331a4cfc9ff8 with identifier: ZR52684 to the API
2026-03-30 06:31:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:31:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:31:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:05:23Z',
 'fuel_type': 'diesel',
 'id': 'd2dc8113-035f-5801-bd6f-331a4cfc9ff8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR52684',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 187137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-23',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.7 CRDi Advantage blue 2WD',
 'transmission': 'manual',
 'trim': 'Advantage blue 2WD',
 'year': 2018}
2026-03-30 06:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR52684%27 HTTP/1.1" 200 None
2026-03-30 06:31:59 [auto1.be] INFO: Saving data for ZR52684: {'auction_closing_time': 1774883123.0, 'created_time': 1773866092.316563, 'last_price_update_time': 1774852319.710559}
2026-03-30 06:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZR52684') HTTP/1.1" 204 0
2026-03-30 06:31:59 [auto1.be] INFO: Found listing with ID: LY80968
2026-03-30 06:31:59 [auto1.be] INFO: Found listing with ID: CN47453
2026-03-30 06:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN47453%27 HTTP/1.1" 200 None
2026-03-30 06:31:59 [auto1.be] INFO: Scrape type for CN47453: 0
2026-03-30 06:31:59 [auto1.be] INFO: Found listing with ID: DF09339
2026-03-30 06:31:59 [auto1.be] INFO: Found listing with ID: BX96549
2026-03-30 06:31:59 [auto1.be] INFO: Found listing with ID: LM94739
2026-03-30 06:31:59 [auto1.be] INFO: Found listing with ID: KW15988
2026-03-30 06:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW15988%27 HTTP/1.1" 200 None
2026-03-30 06:31:59 [auto1.be] INFO: Scrape type for KW15988: 2
2026-03-30 06:31:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23368f7c-db3c-5569-ae22-58c4b42cf036 with identifier: KW15988
2026-03-30 06:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23368f7c-db3c-5569-ae22-58c4b42cf036 with scrape type 2
2026-03-30 06:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23368f7c-db3c-5569-ae22-58c4b42cf036 with scrape type 2
2026-03-30 06:31:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 23368f7c-db3c-5569-ae22-58c4b42cf036, identifier: KW15988
2026-03-30 06:31:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 23368f7c-db3c-5569-ae22-58c4b42cf036 with identifier: KW15988
2026-03-30 06:31:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 23368f7c-db3c-5569-ae22-58c4b42cf036 with identifier: KW15988
2026-03-30 06:32:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 23368f7c-db3c-5569-ae22-58c4b42cf036 with identifier: KW15988 to the API
2026-03-30 06:32:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:37:02Z',
 'fuel_type': 'petrol',
 'id': '23368f7c-db3c-5569-ae22-58c4b42cf036',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW15988',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 147402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-07',
 'seller_name': None,
 'title': 'Citroen C3 1.4 Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2012}
2026-03-30 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW15988%27 HTTP/1.1" 200 None
2026-03-30 06:32:00 [auto1.be] INFO: Saving data for KW15988: {'auction_closing_time': 1774885022.0, 'created_time': 1774643628.565388, 'last_price_update_time': 1774852320.265908}
2026-03-30 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KW15988') HTTP/1.1" 204 0
2026-03-30 06:32:00 [auto1.be] INFO: Found listing with ID: ZR23499
2026-03-30 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR23499%27 HTTP/1.1" 200 None
2026-03-30 06:32:00 [auto1.be] INFO: Scrape type for ZR23499: 0
2026-03-30 06:32:00 [auto1.be] INFO: Found listing with ID: UT35373
2026-03-30 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT35373%27 HTTP/1.1" 200 None
2026-03-30 06:32:00 [auto1.be] INFO: Scrape type for UT35373: 0
2026-03-30 06:32:00 [auto1.be] INFO: Found listing with ID: YR29884
2026-03-30 06:32:00 [auto1.be] INFO: Found listing with ID: NK28391
2026-03-30 06:32:00 [auto1.be] INFO: Found listing with ID: KF50538
2026-03-30 06:32:00 [auto1.be] INFO: Found listing with ID: MA06269
2026-03-30 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA06269%27 HTTP/1.1" 200 None
2026-03-30 06:32:00 [auto1.be] INFO: Scrape type for MA06269: 0
2026-03-30 06:32:00 [auto1.be] INFO: Found listing with ID: ZR56949
2026-03-30 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR56949%27 HTTP/1.1" 200 None
2026-03-30 06:32:00 [auto1.be] INFO: Scrape type for ZR56949: 0
2026-03-30 06:32:00 [auto1.be] INFO: Found listing with ID: VZ78935
2026-03-30 06:32:00 [auto1.be] INFO: Found listing with ID: YU72813
2026-03-30 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU72813%27 HTTP/1.1" 200 None
2026-03-30 06:32:00 [auto1.be] INFO: Scrape type for YU72813: 0
2026-03-30 06:32:00 [auto1.be] INFO: Found listing with ID: CB53563
2026-03-30 06:32:00 [auto1.be] INFO: Found listing with ID: NR94896
2026-03-30 06:32:00 [auto1.be] INFO: Found listing with ID: GW69223
2026-03-30 06:32:00 [auto1.be] INFO: Found listing with ID: BV56621
2026-03-30 06:32:00 [auto1.be] INFO: Found listing with ID: CM40127
2026-03-30 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM40127%27 HTTP/1.1" 200 None
2026-03-30 06:32:00 [auto1.be] INFO: Scrape type for CM40127: 2
2026-03-30 06:32:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad2b87d4-38b4-5111-be04-c501effca679 with identifier: CM40127
2026-03-30 06:32:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad2b87d4-38b4-5111-be04-c501effca679 with scrape type 2
2026-03-30 06:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad2b87d4-38b4-5111-be04-c501effca679 with scrape type 2
2026-03-30 06:32:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ad2b87d4-38b4-5111-be04-c501effca679, identifier: CM40127
2026-03-30 06:32:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ad2b87d4-38b4-5111-be04-c501effca679 with identifier: CM40127
2026-03-30 06:32:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ad2b87d4-38b4-5111-be04-c501effca679 with identifier: CM40127
2026-03-30 06:32:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ad2b87d4-38b4-5111-be04-c501effca679 with identifier: CM40127 to the API
2026-03-30 06:32:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:08:43Z',
 'fuel_type': 'hybrid',
 'id': 'ad2b87d4-38b4-5111-be04-c501effca679',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM40127',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 196238,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-17',
 'seller_name': None,
 'title': 'Toyota Auris 1.8 Hybrid Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2011}
2026-03-30 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM40127%27 HTTP/1.1" 200 None
2026-03-30 06:32:00 [auto1.be] INFO: Saving data for CM40127: {'auction_closing_time': 1774883323.0, 'created_time': 1774557197.630835, 'last_price_update_time': 1774852320.786802}
2026-03-30 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CM40127') HTTP/1.1" 204 0
2026-03-30 06:32:00 [auto1.be] INFO: Found listing with ID: HT96077
2026-03-30 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT96077%27 HTTP/1.1" 200 None
2026-03-30 06:32:00 [auto1.be] INFO: Scrape type for HT96077: 2
2026-03-30 06:32:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3f6612b-fe3c-5c29-8485-9b21469c7c41 with identifier: HT96077
2026-03-30 06:32:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3f6612b-fe3c-5c29-8485-9b21469c7c41 with scrape type 2
2026-03-30 06:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3f6612b-fe3c-5c29-8485-9b21469c7c41 with scrape type 2
2026-03-30 06:32:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c3f6612b-fe3c-5c29-8485-9b21469c7c41, identifier: HT96077
2026-03-30 06:32:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c3f6612b-fe3c-5c29-8485-9b21469c7c41 with identifier: HT96077
2026-03-30 06:32:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c3f6612b-fe3c-5c29-8485-9b21469c7c41 with identifier: HT96077
2026-03-30 06:32:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c3f6612b-fe3c-5c29-8485-9b21469c7c41 with identifier: HT96077 to the API
2026-03-30 06:32:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 182,
 'expiration_date': '2026-03-30T15:04:55Z',
 'fuel_type': 'petrol',
 'id': 'c3f6612b-fe3c-5c29-8485-9b21469c7c41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT96077',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 104604,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-24',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBoost ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2020}
2026-03-30 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT96077%27 HTTP/1.1" 200 None
2026-03-30 06:32:01 [auto1.be] INFO: Saving data for HT96077: {'auction_closing_time': 1774883095.0, 'created_time': 1774643662.412123, 'last_price_update_time': 1774852321.289226}
2026-03-30 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HT96077') HTTP/1.1" 204 0
2026-03-30 06:32:01 [auto1.be] INFO: Found listing with ID: UB84592
2026-03-30 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB84592%27 HTTP/1.1" 200 None
2026-03-30 06:32:01 [auto1.be] INFO: Scrape type for UB84592: 2
2026-03-30 06:32:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 516bc0b6-5c82-5f80-9750-93a36a823b57 with identifier: UB84592
2026-03-30 06:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 516bc0b6-5c82-5f80-9750-93a36a823b57 with scrape type 2
2026-03-30 06:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 516bc0b6-5c82-5f80-9750-93a36a823b57 with scrape type 2
2026-03-30 06:32:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 516bc0b6-5c82-5f80-9750-93a36a823b57, identifier: UB84592
2026-03-30 06:32:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 516bc0b6-5c82-5f80-9750-93a36a823b57 with identifier: UB84592
2026-03-30 06:32:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 516bc0b6-5c82-5f80-9750-93a36a823b57 with identifier: UB84592
2026-03-30 06:32:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 516bc0b6-5c82-5f80-9750-93a36a823b57 with identifier: UB84592 to the API
2026-03-30 06:32:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:53:53Z',
 'fuel_type': 'diesel',
 'id': '516bc0b6-5c82-5f80-9750-93a36a823b57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB84592',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '2',
 'odometer': 207383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-10',
 'seller_name': None,
 'title': 'Mazda 2 1.4 Diesel CD Elegance',
 'transmission': 'manual',
 'trim': 'CD Elegance',
 'year': 2010}
2026-03-30 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB84592%27 HTTP/1.1" 200 None
2026-03-30 06:32:01 [auto1.be] INFO: Saving data for UB84592: {'auction_closing_time': 1774886033.0, 'created_time': 1773923215.556997, 'last_price_update_time': 1774852321.722303}
2026-03-30 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UB84592') HTTP/1.1" 204 0
2026-03-30 06:32:01 [auto1.be] INFO: Found listing with ID: LE55631
2026-03-30 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE55631%27 HTTP/1.1" 200 None
2026-03-30 06:32:01 [auto1.be] INFO: Scrape type for LE55631: 0
2026-03-30 06:32:01 [auto1.be] INFO: Found listing with ID: AK84541
2026-03-30 06:32:01 [auto1.be] INFO: Found listing with ID: PM96543
2026-03-30 06:32:01 [auto1.be] INFO: Found listing with ID: KF52558
2026-03-30 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF52558%27 HTTP/1.1" 200 None
2026-03-30 06:32:01 [auto1.be] INFO: Scrape type for KF52558: 0
2026-03-30 06:32:01 [auto1.be] INFO: Found listing with ID: NM84060
2026-03-30 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM84060%27 HTTP/1.1" 200 None
2026-03-30 06:32:01 [auto1.be] INFO: Scrape type for NM84060: 2
2026-03-30 06:32:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a630a96-508e-55cb-8691-c0402ec8b828 with identifier: NM84060
2026-03-30 06:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a630a96-508e-55cb-8691-c0402ec8b828 with scrape type 2
2026-03-30 06:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a630a96-508e-55cb-8691-c0402ec8b828 with scrape type 2
2026-03-30 06:32:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2a630a96-508e-55cb-8691-c0402ec8b828, identifier: NM84060
2026-03-30 06:32:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2a630a96-508e-55cb-8691-c0402ec8b828 with identifier: NM84060
2026-03-30 06:32:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2a630a96-508e-55cb-8691-c0402ec8b828 with identifier: NM84060
2026-03-30 06:32:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2a630a96-508e-55cb-8691-c0402ec8b828 with identifier: NM84060 to the API
2026-03-30 06:32:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:07:11Z',
 'fuel_type': 'diesel',
 'id': '2a630a96-508e-55cb-8691-c0402ec8b828',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM84060',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V90',
 'odometer': 216122,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-30',
 'seller_name': None,
 'title': 'Volvo V90 2.0 D3 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2018}
2026-03-30 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM84060%27 HTTP/1.1" 200 None
2026-03-30 06:32:02 [auto1.be] INFO: Saving data for NM84060: {'auction_closing_time': 1774883231.0, 'created_time': 1774643568.237832, 'last_price_update_time': 1774852322.154736}
2026-03-30 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NM84060') HTTP/1.1" 204 0
2026-03-30 06:32:02 [auto1.be] INFO: Found listing with ID: TW64249
2026-03-30 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW64249%27 HTTP/1.1" 200 None
2026-03-30 06:32:02 [auto1.be] INFO: Scrape type for TW64249: 0
2026-03-30 06:32:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:32:02 [auto1.be] INFO: Channel: 24h | Page: 20 | totalHits: 1289 | hits on page: 40
2026-03-30 06:32:02 [auto1.be] INFO: Found listing with ID: TW64249
2026-03-30 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW64249%27 HTTP/1.1" 200 None
2026-03-30 06:32:02 [auto1.be] INFO: Scrape type for TW64249: 0
2026-03-30 06:32:02 [auto1.be] INFO: Found listing with ID: XE64009
2026-03-30 06:32:02 [auto1.be] INFO: Found listing with ID: KU26204
2026-03-30 06:32:02 [auto1.be] INFO: Found listing with ID: ZN66630
2026-03-30 06:32:02 [auto1.be] INFO: Found listing with ID: ZG50395
2026-03-30 06:32:02 [auto1.be] INFO: Found listing with ID: PY81659
2026-03-30 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY81659%27 HTTP/1.1" 200 None
2026-03-30 06:32:02 [auto1.be] INFO: Scrape type for PY81659: 0
2026-03-30 06:32:02 [auto1.be] INFO: Found listing with ID: TM97404
2026-03-30 06:32:02 [auto1.be] INFO: Found listing with ID: UV50609
2026-03-30 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV50609%27 HTTP/1.1" 200 None
2026-03-30 06:32:02 [auto1.be] INFO: Scrape type for UV50609: 2
2026-03-30 06:32:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd041ed9-0e63-5459-87c1-cc2e6f82a8da with identifier: UV50609
2026-03-30 06:32:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd041ed9-0e63-5459-87c1-cc2e6f82a8da with scrape type 2
2026-03-30 06:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd041ed9-0e63-5459-87c1-cc2e6f82a8da with scrape type 2
2026-03-30 06:32:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cd041ed9-0e63-5459-87c1-cc2e6f82a8da, identifier: UV50609
2026-03-30 06:32:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cd041ed9-0e63-5459-87c1-cc2e6f82a8da with identifier: UV50609
2026-03-30 06:32:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cd041ed9-0e63-5459-87c1-cc2e6f82a8da with identifier: UV50609
2026-03-30 06:32:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cd041ed9-0e63-5459-87c1-cc2e6f82a8da with identifier: UV50609 to the API
2026-03-30 06:32:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:52:30Z',
 'fuel_type': 'diesel',
 'id': 'cd041ed9-0e63-5459-87c1-cc2e6f82a8da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV50609',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 187875,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-11',
 'seller_name': None,
 'title': 'BMW 3er 318d Mild-Hybrid Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2020}
2026-03-30 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV50609%27 HTTP/1.1" 200 None
2026-03-30 06:32:03 [auto1.be] INFO: Saving data for UV50609: {'auction_closing_time': 1774885950.0, 'created_time': 1774557095.193738, 'last_price_update_time': 1774852323.159864}
2026-03-30 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UV50609') HTTP/1.1" 204 0
2026-03-30 06:32:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:32:03 [auto1.be] INFO: Found listing with ID: ZZ47044
2026-03-30 06:32:03 [auto1.be] INFO: Found listing with ID: UT04463
2026-03-30 06:32:03 [auto1.be] INFO: Found listing with ID: WE53696
2026-03-30 06:32:03 [auto1.be] INFO: Found listing with ID: WK14396
2026-03-30 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK14396%27 HTTP/1.1" 200 None
2026-03-30 06:32:03 [auto1.be] INFO: Scrape type for WK14396: 0
2026-03-30 06:32:03 [auto1.be] INFO: Found listing with ID: RW49064
2026-03-30 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW49064%27 HTTP/1.1" 200 None
2026-03-30 06:32:03 [auto1.be] INFO: Scrape type for RW49064: 0
2026-03-30 06:32:03 [auto1.be] INFO: Found listing with ID: NP69529
2026-03-30 06:32:03 [auto1.be] INFO: Found listing with ID: WU38196
2026-03-30 06:32:03 [auto1.be] INFO: Found listing with ID: ZL81412
2026-03-30 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL81412%27 HTTP/1.1" 200 None
2026-03-30 06:32:03 [auto1.be] INFO: Scrape type for ZL81412: 2
2026-03-30 06:32:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cb16b87-2305-5c8a-a5bf-34edabf5b9cc with identifier: ZL81412
2026-03-30 06:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cb16b87-2305-5c8a-a5bf-34edabf5b9cc with scrape type 2
2026-03-30 06:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cb16b87-2305-5c8a-a5bf-34edabf5b9cc with scrape type 2
2026-03-30 06:32:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5cb16b87-2305-5c8a-a5bf-34edabf5b9cc, identifier: ZL81412
2026-03-30 06:32:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5cb16b87-2305-5c8a-a5bf-34edabf5b9cc with identifier: ZL81412
2026-03-30 06:32:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5cb16b87-2305-5c8a-a5bf-34edabf5b9cc with identifier: ZL81412
2026-03-30 06:32:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5cb16b87-2305-5c8a-a5bf-34edabf5b9cc with identifier: ZL81412 to the API
2026-03-30 06:32:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:47:08Z',
 'fuel_type': 'diesel',
 'id': '5cb16b87-2305-5c8a-a5bf-34edabf5b9cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL81412',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 135478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-03-16',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.9 SDI Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2003}
2026-03-30 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL81412%27 HTTP/1.1" 200 None
2026-03-30 06:32:03 [auto1.be] INFO: Saving data for ZL81412: {'auction_closing_time': 1774885628.0, 'created_time': 1774643632.708103, 'last_price_update_time': 1774852323.685503}
2026-03-30 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZL81412') HTTP/1.1" 204 0
2026-03-30 06:32:03 [auto1.be] INFO: Found listing with ID: KC69840
2026-03-30 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC69840%27 HTTP/1.1" 200 None
2026-03-30 06:32:03 [auto1.be] INFO: Scrape type for KC69840: 2
2026-03-30 06:32:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ba48af8-4b2c-5062-b7f4-c04ca8d928a8 with identifier: KC69840
2026-03-30 06:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ba48af8-4b2c-5062-b7f4-c04ca8d928a8 with scrape type 2
2026-03-30 06:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ba48af8-4b2c-5062-b7f4-c04ca8d928a8 with scrape type 2
2026-03-30 06:32:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0ba48af8-4b2c-5062-b7f4-c04ca8d928a8, identifier: KC69840
2026-03-30 06:32:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0ba48af8-4b2c-5062-b7f4-c04ca8d928a8 with identifier: KC69840
2026-03-30 06:32:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0ba48af8-4b2c-5062-b7f4-c04ca8d928a8 with identifier: KC69840
2026-03-30 06:32:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0ba48af8-4b2c-5062-b7f4-c04ca8d928a8 with identifier: KC69840 to the API
2026-03-30 06:32:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:23:48Z',
 'fuel_type': 'diesel',
 'id': '0ba48af8-4b2c-5062-b7f4-c04ca8d928a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC69840',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 184047,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-11',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 Turbodiesel Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2011}
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC69840%27 HTTP/1.1" 200 None
2026-03-30 06:32:04 [auto1.be] INFO: Saving data for KC69840: {'auction_closing_time': 1774884228.0, 'created_time': 1774729913.865339, 'last_price_update_time': 1774852324.06239}
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KC69840') HTTP/1.1" 204 0
2026-03-30 06:32:04 [auto1.be] INFO: Found listing with ID: FC74189
2026-03-30 06:32:04 [auto1.be] INFO: Found listing with ID: CS98471
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS98471%27 HTTP/1.1" 200 None
2026-03-30 06:32:04 [auto1.be] INFO: Scrape type for CS98471: 0
2026-03-30 06:32:04 [auto1.be] INFO: Found listing with ID: BR84638
2026-03-30 06:32:04 [auto1.be] INFO: Found listing with ID: FE56390
2026-03-30 06:32:04 [auto1.be] INFO: Found listing with ID: ZR84759
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR84759%27 HTTP/1.1" 200 None
2026-03-30 06:32:04 [auto1.be] INFO: Scrape type for ZR84759: 0
2026-03-30 06:32:04 [auto1.be] INFO: Found listing with ID: WG89987
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG89987%27 HTTP/1.1" 200 None
2026-03-30 06:32:04 [auto1.be] INFO: Scrape type for WG89987: 0
2026-03-30 06:32:04 [auto1.be] INFO: Found listing with ID: WC98842
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC98842%27 HTTP/1.1" 200 None
2026-03-30 06:32:04 [auto1.be] INFO: Scrape type for WC98842: 0
2026-03-30 06:32:04 [auto1.be] INFO: Found listing with ID: TS87931
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS87931%27 HTTP/1.1" 200 None
2026-03-30 06:32:04 [auto1.be] INFO: Scrape type for TS87931: 2
2026-03-30 06:32:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbbd44f0-f880-5968-a846-3e3d6ebcd262 with identifier: TS87931
2026-03-30 06:32:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbbd44f0-f880-5968-a846-3e3d6ebcd262 with scrape type 2
2026-03-30 06:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbbd44f0-f880-5968-a846-3e3d6ebcd262 with scrape type 2
2026-03-30 06:32:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dbbd44f0-f880-5968-a846-3e3d6ebcd262, identifier: TS87931
2026-03-30 06:32:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dbbd44f0-f880-5968-a846-3e3d6ebcd262 with identifier: TS87931
2026-03-30 06:32:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dbbd44f0-f880-5968-a846-3e3d6ebcd262 with identifier: TS87931
2026-03-30 06:32:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dbbd44f0-f880-5968-a846-3e3d6ebcd262 with identifier: TS87931 to the API
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 392,
 'expiration_date': '2026-03-30T15:22:32Z',
 'fuel_type': 'hybrid',
 'id': 'dbbd44f0-f880-5968-a846-3e3d6ebcd262',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS87931',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 172125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-25',
 'seller_name': None,
 'title': 'Volvo V60 2.0 T8 Plug-in Hybrid R-Design AWD',
 'transmission': 'automatic',
 'trim': 'R-Design AWD',
 'year': 2019}
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS87931%27 HTTP/1.1" 200 None
2026-03-30 06:32:04 [auto1.be] INFO: Saving data for TS87931: {'auction_closing_time': 1774884152.0, 'created_time': 1774557200.352614, 'last_price_update_time': 1774852324.505461}
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TS87931') HTTP/1.1" 204 0
2026-03-30 06:32:04 [auto1.be] INFO: Found listing with ID: VM06685
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM06685%27 HTTP/1.1" 200 None
2026-03-30 06:32:04 [auto1.be] INFO: Scrape type for VM06685: 0
2026-03-30 06:32:04 [auto1.be] INFO: Found listing with ID: UL72077
2026-03-30 06:32:04 [auto1.be] INFO: Found listing with ID: VZ08217
2026-03-30 06:32:04 [auto1.be] INFO: Found listing with ID: SZ60181
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ60181%27 HTTP/1.1" 200 None
2026-03-30 06:32:04 [auto1.be] INFO: Scrape type for SZ60181: 0
2026-03-30 06:32:04 [auto1.be] INFO: Found listing with ID: UJ89543
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UJ89543%27 HTTP/1.1" 200 None
2026-03-30 06:32:04 [auto1.be] INFO: Scrape type for UJ89543: 0
2026-03-30 06:32:04 [auto1.be] INFO: Found listing with ID: JZ97752
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ97752%27 HTTP/1.1" 200 None
2026-03-30 06:32:04 [auto1.be] INFO: Scrape type for JZ97752: 0
2026-03-30 06:32:04 [auto1.be] INFO: Found listing with ID: YL00049
2026-03-30 06:32:04 [auto1.be] INFO: Found listing with ID: SF38570
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF38570%27 HTTP/1.1" 200 None
2026-03-30 06:32:04 [auto1.be] INFO: Scrape type for SF38570: 0
2026-03-30 06:32:04 [auto1.be] INFO: Found listing with ID: CG91643
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG91643%27 HTTP/1.1" 200 None
2026-03-30 06:32:04 [auto1.be] INFO: Scrape type for CG91643: 2
2026-03-30 06:32:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd084fc6-6df2-5506-a224-00931fb25511 with identifier: CG91643
2026-03-30 06:32:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd084fc6-6df2-5506-a224-00931fb25511 with scrape type 2
2026-03-30 06:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd084fc6-6df2-5506-a224-00931fb25511 with scrape type 2
2026-03-30 06:32:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bd084fc6-6df2-5506-a224-00931fb25511, identifier: CG91643
2026-03-30 06:32:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bd084fc6-6df2-5506-a224-00931fb25511 with identifier: CG91643
2026-03-30 06:32:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bd084fc6-6df2-5506-a224-00931fb25511 with identifier: CG91643
2026-03-30 06:32:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bd084fc6-6df2-5506-a224-00931fb25511 with identifier: CG91643 to the API
2026-03-30 06:32:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:24:49Z',
 'fuel_type': 'diesel',
 'id': 'bd084fc6-6df2-5506-a224-00931fb25511',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG91643',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'F-Pace',
 'odometer': 190717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-08',
 'seller_name': None,
 'title': 'Jaguar F-Pace 20d Prestige AWD',
 'transmission': 'automatic',
 'trim': 'Prestige AWD',
 'year': 2019}
2026-03-30 06:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG91643%27 HTTP/1.1" 200 None
2026-03-30 06:32:05 [auto1.be] INFO: Saving data for CG91643: {'auction_closing_time': 1774884289.0, 'created_time': 1773779683.372451, 'last_price_update_time': 1774852325.126904}
2026-03-30 06:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CG91643') HTTP/1.1" 204 0
2026-03-30 06:32:05 [auto1.be] INFO: Found listing with ID: CP13942
2026-03-30 06:32:05 [auto1.be] INFO: Found listing with ID: RE48196
2026-03-30 06:32:05 [auto1.be] INFO: Found listing with ID: MS23670
2026-03-30 06:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS23670%27 HTTP/1.1" 200 None
2026-03-30 06:32:05 [auto1.be] INFO: Scrape type for MS23670: 0
2026-03-30 06:32:05 [auto1.be] INFO: Found listing with ID: CU40853
2026-03-30 06:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU40853%27 HTTP/1.1" 200 None
2026-03-30 06:32:05 [auto1.be] INFO: Scrape type for CU40853: 0
2026-03-30 06:32:05 [auto1.be] INFO: Found listing with ID: VA59143
2026-03-30 06:32:05 [auto1.be] INFO: Found listing with ID: PR31064
2026-03-30 06:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR31064%27 HTTP/1.1" 200 None
2026-03-30 06:32:05 [auto1.be] INFO: Scrape type for PR31064: 0
2026-03-30 06:32:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:32:06 [auto1.be] INFO: Channel: 24h | Page: 21 | totalHits: 1289 | hits on page: 40
2026-03-30 06:32:06 [auto1.be] INFO: Found listing with ID: KC33551
2026-03-30 06:32:06 [auto1.be] INFO: Found listing with ID: CE65833
2026-03-30 06:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE65833%27 HTTP/1.1" 200 None
2026-03-30 06:32:06 [auto1.be] INFO: Scrape type for CE65833: 0
2026-03-30 06:32:06 [auto1.be] INFO: Found listing with ID: VA87646
2026-03-30 06:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA87646%27 HTTP/1.1" 200 None
2026-03-30 06:32:06 [auto1.be] INFO: Scrape type for VA87646: 0
2026-03-30 06:32:06 [auto1.be] INFO: Found listing with ID: RA65802
2026-03-30 06:32:06 [auto1.be] INFO: Found listing with ID: MJ08102
2026-03-30 06:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ08102%27 HTTP/1.1" 200 None
2026-03-30 06:32:06 [auto1.be] INFO: Scrape type for MJ08102: 0
2026-03-30 06:32:06 [auto1.be] INFO: Found listing with ID: CF04837
2026-03-30 06:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF04837%27 HTTP/1.1" 200 None
2026-03-30 06:32:06 [auto1.be] INFO: Scrape type for CF04837: 0
2026-03-30 06:32:06 [auto1.be] INFO: Found listing with ID: TS87416
2026-03-30 06:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS87416%27 HTTP/1.1" 200 None
2026-03-30 06:32:06 [auto1.be] INFO: Scrape type for TS87416: 2
2026-03-30 06:32:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e85abd7-0d1a-5972-8153-e65223145e48 with identifier: TS87416
2026-03-30 06:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e85abd7-0d1a-5972-8153-e65223145e48 with scrape type 2
2026-03-30 06:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e85abd7-0d1a-5972-8153-e65223145e48 with scrape type 2
2026-03-30 06:32:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4e85abd7-0d1a-5972-8153-e65223145e48, identifier: TS87416
2026-03-30 06:32:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4e85abd7-0d1a-5972-8153-e65223145e48 with identifier: TS87416
2026-03-30 06:32:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4e85abd7-0d1a-5972-8153-e65223145e48 with identifier: TS87416
2026-03-30 06:32:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4e85abd7-0d1a-5972-8153-e65223145e48 with identifier: TS87416 to the API
2026-03-30 06:32:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:07:36Z',
 'fuel_type': 'diesel',
 'id': '4e85abd7-0d1a-5972-8153-e65223145e48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS87416',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 167898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-24',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Sports-Line AWD',
 'transmission': 'automatic',
 'trim': 'Sports-Line AWD',
 'year': 2014}
2026-03-30 06:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS87416%27 HTTP/1.1" 200 None
2026-03-30 06:32:06 [auto1.be] INFO: Saving data for TS87416: {'auction_closing_time': 1774883256.0, 'created_time': 1774557055.560544, 'last_price_update_time': 1774852326.726418}
2026-03-30 06:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TS87416') HTTP/1.1" 204 0
2026-03-30 06:32:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:32:06 [auto1.be] INFO: Found listing with ID: JM27578
2026-03-30 06:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM27578%27 HTTP/1.1" 200 None
2026-03-30 06:32:06 [auto1.be] INFO: Scrape type for JM27578: 0
2026-03-30 06:32:06 [auto1.be] INFO: Found listing with ID: YB94076
2026-03-30 06:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB94076%27 HTTP/1.1" 200 None
2026-03-30 06:32:06 [auto1.be] INFO: Scrape type for YB94076: 2
2026-03-30 06:32:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c30bb17-9073-53c8-a5ed-38c920a8541b with identifier: YB94076
2026-03-30 06:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c30bb17-9073-53c8-a5ed-38c920a8541b with scrape type 2
2026-03-30 06:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c30bb17-9073-53c8-a5ed-38c920a8541b with scrape type 2
2026-03-30 06:32:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9c30bb17-9073-53c8-a5ed-38c920a8541b, identifier: YB94076
2026-03-30 06:32:06 [scrapy.extensions.logstats] INFO: Crawled 35 pages (at 11 pages/min), scraped 163 items (at 96 items/min)
2026-03-30 06:32:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 165MiB
2026-03-30 06:32:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9c30bb17-9073-53c8-a5ed-38c920a8541b with identifier: YB94076
2026-03-30 06:32:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9c30bb17-9073-53c8-a5ed-38c920a8541b with identifier: YB94076
2026-03-30 06:32:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9c30bb17-9073-53c8-a5ed-38c920a8541b with identifier: YB94076 to the API
2026-03-30 06:32:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:55:38Z',
 'fuel_type': 'diesel',
 'id': '9c30bb17-9073-53c8-a5ed-38c920a8541b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB94076',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 232221,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-10',
 'seller_name': None,
 'title': 'BMW 3er 316d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 06:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YB94076%27 HTTP/1.1" 200 None
2026-03-30 06:32:07 [auto1.be] INFO: Saving data for YB94076: {'auction_closing_time': 1774886138.0, 'created_time': 1774643614.667974, 'last_price_update_time': 1774852327.224813}
2026-03-30 06:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YB94076') HTTP/1.1" 204 0
2026-03-30 06:32:07 [auto1.be] INFO: Found listing with ID: VJ27978
2026-03-30 06:32:07 [auto1.be] INFO: Found listing with ID: ZA01438
2026-03-30 06:32:07 [auto1.be] INFO: Found listing with ID: DF96327
2026-03-30 06:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF96327%27 HTTP/1.1" 200 None
2026-03-30 06:32:07 [auto1.be] INFO: Scrape type for DF96327: 2
2026-03-30 06:32:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c1eb5f1-7969-5bc3-b3ee-e5e6a3ea3f7f with identifier: DF96327
2026-03-30 06:32:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c1eb5f1-7969-5bc3-b3ee-e5e6a3ea3f7f with scrape type 2
2026-03-30 06:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c1eb5f1-7969-5bc3-b3ee-e5e6a3ea3f7f with scrape type 2
2026-03-30 06:32:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8c1eb5f1-7969-5bc3-b3ee-e5e6a3ea3f7f, identifier: DF96327
2026-03-30 06:32:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8c1eb5f1-7969-5bc3-b3ee-e5e6a3ea3f7f with identifier: DF96327
2026-03-30 06:32:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8c1eb5f1-7969-5bc3-b3ee-e5e6a3ea3f7f with identifier: DF96327
2026-03-30 06:32:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8c1eb5f1-7969-5bc3-b3ee-e5e6a3ea3f7f with identifier: DF96327 to the API
2026-03-30 06:32:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:15:52Z',
 'fuel_type': 'diesel',
 'id': '8c1eb5f1-7969-5bc3-b3ee-e5e6a3ea3f7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF96327',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 171018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-05',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-30 06:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF96327%27 HTTP/1.1" 200 None
2026-03-30 06:32:07 [auto1.be] INFO: Saving data for DF96327: {'auction_closing_time': 1774883752.0, 'created_time': 1774557059.321687, 'last_price_update_time': 1774852327.639773}
2026-03-30 06:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DF96327') HTTP/1.1" 204 0
2026-03-30 06:32:07 [auto1.be] INFO: Found listing with ID: MC94265
2026-03-30 06:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC94265%27 HTTP/1.1" 200 None
2026-03-30 06:32:07 [auto1.be] INFO: Scrape type for MC94265: 2
2026-03-30 06:32:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d2c4510-6a63-5a2d-ad98-5a094d473ffc with identifier: MC94265
2026-03-30 06:32:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d2c4510-6a63-5a2d-ad98-5a094d473ffc with scrape type 2
2026-03-30 06:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d2c4510-6a63-5a2d-ad98-5a094d473ffc with scrape type 2
2026-03-30 06:32:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3d2c4510-6a63-5a2d-ad98-5a094d473ffc, identifier: MC94265
2026-03-30 06:32:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3d2c4510-6a63-5a2d-ad98-5a094d473ffc with identifier: MC94265
2026-03-30 06:32:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3d2c4510-6a63-5a2d-ad98-5a094d473ffc with identifier: MC94265
2026-03-30 06:32:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3d2c4510-6a63-5a2d-ad98-5a094d473ffc with identifier: MC94265 to the API
2026-03-30 06:32:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:28:36Z',
 'fuel_type': 'diesel',
 'id': '3d2c4510-6a63-5a2d-ad98-5a094d473ffc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC94265',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 174400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-05',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 HSE',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2018}
2026-03-30 06:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC94265%27 HTTP/1.1" 200 None
2026-03-30 06:32:08 [auto1.be] INFO: Saving data for MC94265: {'auction_closing_time': 1774884516.0, 'created_time': 1774557119.770076, 'last_price_update_time': 1774852328.02534}
2026-03-30 06:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MC94265') HTTP/1.1" 204 0
2026-03-30 06:32:08 [auto1.be] INFO: Found listing with ID: VP90118
2026-03-30 06:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP90118%27 HTTP/1.1" 200 None
2026-03-30 06:32:08 [auto1.be] INFO: Scrape type for VP90118: 0
2026-03-30 06:32:08 [auto1.be] INFO: Found listing with ID: PK93774
2026-03-30 06:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK93774%27 HTTP/1.1" 200 None
2026-03-30 06:32:08 [auto1.be] INFO: Scrape type for PK93774: 2
2026-03-30 06:32:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80540d39-9f1a-5ede-88b3-8ddfc1b51dc6 with identifier: PK93774
2026-03-30 06:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80540d39-9f1a-5ede-88b3-8ddfc1b51dc6 with scrape type 2
2026-03-30 06:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80540d39-9f1a-5ede-88b3-8ddfc1b51dc6 with scrape type 2
2026-03-30 06:32:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 80540d39-9f1a-5ede-88b3-8ddfc1b51dc6, identifier: PK93774
2026-03-30 06:32:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 80540d39-9f1a-5ede-88b3-8ddfc1b51dc6 with identifier: PK93774
2026-03-30 06:32:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 80540d39-9f1a-5ede-88b3-8ddfc1b51dc6 with identifier: PK93774
2026-03-30 06:32:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 80540d39-9f1a-5ede-88b3-8ddfc1b51dc6 with identifier: PK93774 to the API
2026-03-30 06:32:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:16:46Z',
 'fuel_type': 'petrol',
 'id': '80540d39-9f1a-5ede-88b3-8ddfc1b51dc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK93774',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 17843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-09',
 'seller_name': None,
 'title': 'Cupra Formentor 2.0 TSI 4Drive',
 'transmission': 'automatic',
 'trim': '4Drive',
 'year': 2023}
2026-03-30 06:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK93774%27 HTTP/1.1" 200 None
2026-03-30 06:32:08 [auto1.be] INFO: Saving data for PK93774: {'auction_closing_time': 1774883806.0, 'created_time': 1773833840.727757, 'last_price_update_time': 1774852328.448213}
2026-03-30 06:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PK93774') HTTP/1.1" 204 0
2026-03-30 06:32:08 [auto1.be] INFO: Found listing with ID: PY58607
2026-03-30 06:32:08 [auto1.be] INFO: Found listing with ID: BT72678
2026-03-30 06:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT72678%27 HTTP/1.1" 200 None
2026-03-30 06:32:08 [auto1.be] INFO: Scrape type for BT72678: 2
2026-03-30 06:32:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f3fd721-f191-50d4-af38-8d3542965825 with identifier: BT72678
2026-03-30 06:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f3fd721-f191-50d4-af38-8d3542965825 with scrape type 2
2026-03-30 06:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f3fd721-f191-50d4-af38-8d3542965825 with scrape type 2
2026-03-30 06:32:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9f3fd721-f191-50d4-af38-8d3542965825, identifier: BT72678
2026-03-30 06:32:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9f3fd721-f191-50d4-af38-8d3542965825 with identifier: BT72678
2026-03-30 06:32:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9f3fd721-f191-50d4-af38-8d3542965825 with identifier: BT72678
2026-03-30 06:32:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9f3fd721-f191-50d4-af38-8d3542965825 with identifier: BT72678 to the API
2026-03-30 06:32:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:04:41Z',
 'fuel_type': 'diesel',
 'id': '9f3fd721-f191-50d4-af38-8d3542965825',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT72678',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 53294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-21',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Feel M',
 'transmission': 'automatic',
 'trim': 'Feel M',
 'year': 2019}
2026-03-30 06:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT72678%27 HTTP/1.1" 200 None
2026-03-30 06:32:08 [auto1.be] INFO: Saving data for BT72678: {'auction_closing_time': 1774883081.0, 'created_time': 1774557102.712934, 'last_price_update_time': 1774852328.837414}
2026-03-30 06:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BT72678') HTTP/1.1" 204 0
2026-03-30 06:32:08 [auto1.be] INFO: Found listing with ID: VP91071
2026-03-30 06:32:08 [auto1.be] INFO: Found listing with ID: TK06008
2026-03-30 06:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK06008%27 HTTP/1.1" 200 None
2026-03-30 06:32:08 [auto1.be] INFO: Scrape type for TK06008: 0
2026-03-30 06:32:08 [auto1.be] INFO: Found listing with ID: NM63028
2026-03-30 06:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM63028%27 HTTP/1.1" 200 None
2026-03-30 06:32:08 [auto1.be] INFO: Scrape type for NM63028: 0
2026-03-30 06:32:08 [auto1.be] INFO: Found listing with ID: JY53618
2026-03-30 06:32:08 [auto1.be] INFO: Found listing with ID: VB55746
2026-03-30 06:32:08 [auto1.be] INFO: Found listing with ID: GS48835
2026-03-30 06:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS48835%27 HTTP/1.1" 200 None
2026-03-30 06:32:08 [auto1.be] INFO: Scrape type for GS48835: 2
2026-03-30 06:32:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 760ce312-37f0-5970-81ce-221075de60ae with identifier: GS48835
2026-03-30 06:32:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 760ce312-37f0-5970-81ce-221075de60ae with scrape type 2
2026-03-30 06:32:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 760ce312-37f0-5970-81ce-221075de60ae with scrape type 2
2026-03-30 06:32:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 760ce312-37f0-5970-81ce-221075de60ae, identifier: GS48835
2026-03-30 06:32:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 760ce312-37f0-5970-81ce-221075de60ae with identifier: GS48835
2026-03-30 06:32:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 760ce312-37f0-5970-81ce-221075de60ae with identifier: GS48835
2026-03-30 06:32:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 760ce312-37f0-5970-81ce-221075de60ae with identifier: GS48835 to the API
2026-03-30 06:32:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:49:29Z',
 'fuel_type': 'diesel',
 'id': '760ce312-37f0-5970-81ce-221075de60ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS48835',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 167666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-03',
 'seller_name': None,
 'title': 'Volvo V60 2.0 D4 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2019}
2026-03-30 06:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS48835%27 HTTP/1.1" 200 None
2026-03-30 06:32:09 [auto1.be] INFO: Saving data for GS48835: {'auction_closing_time': 1774885769.0, 'created_time': 1774557163.944948, 'last_price_update_time': 1774852329.247534}
2026-03-30 06:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GS48835') HTTP/1.1" 204 0
2026-03-30 06:32:09 [auto1.be] INFO: Found listing with ID: FA63464
2026-03-30 06:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA63464%27 HTTP/1.1" 200 None
2026-03-30 06:32:09 [auto1.be] INFO: Scrape type for FA63464: 0
2026-03-30 06:32:09 [auto1.be] INFO: Found listing with ID: XA29570
2026-03-30 06:32:09 [auto1.be] INFO: Found listing with ID: MG12074
2026-03-30 06:32:09 [auto1.be] INFO: Found listing with ID: YD21406
2026-03-30 06:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YD21406%27 HTTP/1.1" 200 None
2026-03-30 06:32:09 [auto1.be] INFO: Scrape type for YD21406: 2
2026-03-30 06:32:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1634e9f3-cdc8-5904-9a27-46341229dccf with identifier: YD21406
2026-03-30 06:32:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1634e9f3-cdc8-5904-9a27-46341229dccf with scrape type 2
2026-03-30 06:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1634e9f3-cdc8-5904-9a27-46341229dccf with scrape type 2
2026-03-30 06:32:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1634e9f3-cdc8-5904-9a27-46341229dccf, identifier: YD21406
2026-03-30 06:32:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1634e9f3-cdc8-5904-9a27-46341229dccf with identifier: YD21406
2026-03-30 06:32:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1634e9f3-cdc8-5904-9a27-46341229dccf with identifier: YD21406
2026-03-30 06:32:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1634e9f3-cdc8-5904-9a27-46341229dccf with identifier: YD21406 to the API
2026-03-30 06:32:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:48:03Z',
 'fuel_type': 'petrol',
 'id': '1634e9f3-cdc8-5904-9a27-46341229dccf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD21406',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 100905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-08-29',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.4 Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2008}
2026-03-30 06:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YD21406%27 HTTP/1.1" 200 None
2026-03-30 06:32:09 [auto1.be] INFO: Saving data for YD21406: {'auction_closing_time': 1774885683.0, 'created_time': 1774557177.16566, 'last_price_update_time': 1774852329.759594}
2026-03-30 06:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YD21406') HTTP/1.1" 204 0
2026-03-30 06:32:09 [auto1.be] INFO: Found listing with ID: XJ95743
2026-03-30 06:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ95743%27 HTTP/1.1" 200 None
2026-03-30 06:32:09 [auto1.be] INFO: Scrape type for XJ95743: 2
2026-03-30 06:32:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd746447-b329-5819-9017-79b4d963625a with identifier: XJ95743
2026-03-30 06:32:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd746447-b329-5819-9017-79b4d963625a with scrape type 2
2026-03-30 06:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd746447-b329-5819-9017-79b4d963625a with scrape type 2
2026-03-30 06:32:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cd746447-b329-5819-9017-79b4d963625a, identifier: XJ95743
2026-03-30 06:32:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cd746447-b329-5819-9017-79b4d963625a with identifier: XJ95743
2026-03-30 06:32:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cd746447-b329-5819-9017-79b4d963625a with identifier: XJ95743
2026-03-30 06:32:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cd746447-b329-5819-9017-79b4d963625a with identifier: XJ95743 to the API
2026-03-30 06:32:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:57:04Z',
 'fuel_type': 'diesel',
 'id': 'cd746447-b329-5819-9017-79b4d963625a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ95743',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 82671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-03',
 'seller_name': None,
 'title': 'Renault Espace 1.6 dCi Energy Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2016}
2026-03-30 06:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ95743%27 HTTP/1.1" 200 None
2026-03-30 06:32:10 [auto1.be] INFO: Saving data for XJ95743: {'auction_closing_time': 1774886224.0, 'created_time': 1774557238.154345, 'last_price_update_time': 1774852330.158479}
2026-03-30 06:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XJ95743') HTTP/1.1" 204 0
2026-03-30 06:32:10 [auto1.be] INFO: Found listing with ID: DB02418
2026-03-30 06:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB02418%27 HTTP/1.1" 200 None
2026-03-30 06:32:10 [auto1.be] INFO: Scrape type for DB02418: 2
2026-03-30 06:32:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c41c49b8-0139-5934-9516-e0edf2d68ffc with identifier: DB02418
2026-03-30 06:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c41c49b8-0139-5934-9516-e0edf2d68ffc with scrape type 2
2026-03-30 06:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c41c49b8-0139-5934-9516-e0edf2d68ffc with scrape type 2
2026-03-30 06:32:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c41c49b8-0139-5934-9516-e0edf2d68ffc, identifier: DB02418
2026-03-30 06:32:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:32:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c41c49b8-0139-5934-9516-e0edf2d68ffc with identifier: DB02418
2026-03-30 06:32:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c41c49b8-0139-5934-9516-e0edf2d68ffc with identifier: DB02418
2026-03-30 06:32:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c41c49b8-0139-5934-9516-e0edf2d68ffc with identifier: DB02418 to the API
2026-03-30 06:32:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-30T15:02:10Z',
 'fuel_type': 'diesel',
 'id': 'c41c49b8-0139-5934-9516-e0edf2d68ffc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB02418',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 206534,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-20',
 'seller_name': None,
 'title': 'Dacia Sandero 1.5 dCi Laureate',
 'transmission': 'manual',
 'trim': 'Laureate',
 'year': 2012}
2026-03-30 06:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DB02418%27 HTTP/1.1" 200 None
2026-03-30 06:32:10 [auto1.be] INFO: Saving data for DB02418: {'auction_closing_time': 1774882930.0, 'created_time': 1774643644.93607, 'last_price_update_time': 1774852330.548657}
2026-03-30 06:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DB02418') HTTP/1.1" 204 0
2026-03-30 06:32:10 [auto1.be] INFO: Found listing with ID: XT36171
2026-03-30 06:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT36171%27 HTTP/1.1" 200 None
2026-03-30 06:32:10 [auto1.be] INFO: Scrape type for XT36171: 2
2026-03-30 06:32:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 179c51cc-9dad-54e5-903b-355803cbf100 with identifier: XT36171
2026-03-30 06:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 179c51cc-9dad-54e5-903b-355803cbf100 with scrape type 2
2026-03-30 06:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 179c51cc-9dad-54e5-903b-355803cbf100 with scrape type 2
2026-03-30 06:32:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 179c51cc-9dad-54e5-903b-355803cbf100, identifier: XT36171
2026-03-30 06:32:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 179c51cc-9dad-54e5-903b-355803cbf100 with identifier: XT36171
2026-03-30 06:32:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 06:32:10 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-30 06:32:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 06:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 06:32:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 179c51cc-9dad-54e5-903b-355803cbf100 with identifier: XT36171
2026-03-30 06:32:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 179c51cc-9dad-54e5-903b-355803cbf100 with identifier: XT36171 to the API
2026-03-30 06:32:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:07:39Z',
 'fuel_type': 'gas',
 'id': '179c51cc-9dad-54e5-903b-355803cbf100',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT36171',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Jogger',
 'odometer': 65029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-08',
 'seller_name': None,
 'title': 'Dacia Jogger 1.0 TCe LPG Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2023}
2026-03-30 06:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT36171%27 HTTP/1.1" 200 None
2026-03-30 06:32:11 [auto1.be] INFO: Saving data for XT36171: {'auction_closing_time': 1774883259.0, 'created_time': 1773401498.481253, 'last_price_update_time': 1774852331.11933}
2026-03-30 06:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XT36171') HTTP/1.1" 204 0
2026-03-30 06:32:11 [auto1.be] INFO: Found listing with ID: MC66522
2026-03-30 06:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MC66522%27 HTTP/1.1" 200 None
2026-03-30 06:32:11 [auto1.be] INFO: Scrape type for MC66522: 0
2026-03-30 06:32:11 [auto1.be] INFO: Found listing with ID: ZK00678
2026-03-30 06:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK00678%27 HTTP/1.1" 200 None
2026-03-30 06:32:11 [auto1.be] INFO: Scrape type for ZK00678: 0
2026-03-30 06:32:11 [auto1.be] INFO: Found listing with ID: DE33834
2026-03-30 06:32:11 [auto1.be] INFO: Found listing with ID: HH62001
2026-03-30 06:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HH62001%27 HTTP/1.1" 200 None
2026-03-30 06:32:11 [auto1.be] INFO: Scrape type for HH62001: 0
2026-03-30 06:32:11 [auto1.be] INFO: Found listing with ID: WF76478
2026-03-30 06:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WF76478%27 HTTP/1.1" 200 None
2026-03-30 06:32:11 [auto1.be] INFO: Scrape type for WF76478: 0
2026-03-30 06:32:11 [auto1.be] INFO: Found listing with ID: SC59712
2026-03-30 06:32:11 [auto1.be] INFO: Found listing with ID: SU72836
2026-03-30 06:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU72836%27 HTTP/1.1" 200 None
2026-03-30 06:32:11 [auto1.be] INFO: Scrape type for SU72836: 2
2026-03-30 06:32:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b48de29-6c3c-5d19-996d-b67f94e8fa83 with identifier: SU72836
2026-03-30 06:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b48de29-6c3c-5d19-996d-b67f94e8fa83 with scrape type 2
2026-03-30 06:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b48de29-6c3c-5d19-996d-b67f94e8fa83 with scrape type 2
2026-03-30 06:32:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1b48de29-6c3c-5d19-996d-b67f94e8fa83, identifier: SU72836
2026-03-30 06:32:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1b48de29-6c3c-5d19-996d-b67f94e8fa83 with identifier: SU72836
2026-03-30 06:32:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1b48de29-6c3c-5d19-996d-b67f94e8fa83 with identifier: SU72836
2026-03-30 06:32:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1b48de29-6c3c-5d19-996d-b67f94e8fa83 with identifier: SU72836 to the API
2026-03-30 06:32:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:41:56Z',
 'fuel_type': 'diesel',
 'id': '1b48de29-6c3c-5d19-996d-b67f94e8fa83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU72836',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 136454,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-07',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.6 Blue-HDi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2017}
2026-03-30 06:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU72836%27 HTTP/1.1" 200 None
2026-03-30 06:32:11 [auto1.be] INFO: Saving data for SU72836: {'auction_closing_time': 1774885316.0, 'created_time': 1773922343.923508, 'last_price_update_time': 1774852331.589105}
2026-03-30 06:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SU72836') HTTP/1.1" 204 0
2026-03-30 06:32:11 [auto1.be] INFO: Channel: 24h | Page: 22 | totalHits: 1289 | hits on page: 40
2026-03-30 06:32:11 [auto1.be] INFO: Found listing with ID: ME81448
2026-03-30 06:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ME81448%27 HTTP/1.1" 200 None
2026-03-30 06:32:11 [auto1.be] INFO: Scrape type for ME81448: 2
2026-03-30 06:32:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 951023aa-d4e4-588c-a776-24f8f81552a2 with identifier: ME81448
2026-03-30 06:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 951023aa-d4e4-588c-a776-24f8f81552a2 with scrape type 2
2026-03-30 06:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 951023aa-d4e4-588c-a776-24f8f81552a2 with scrape type 2
2026-03-30 06:32:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 951023aa-d4e4-588c-a776-24f8f81552a2, identifier: ME81448
2026-03-30 06:32:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 951023aa-d4e4-588c-a776-24f8f81552a2 with identifier: ME81448
2026-03-30 06:32:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 951023aa-d4e4-588c-a776-24f8f81552a2 with identifier: ME81448
2026-03-30 06:32:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 951023aa-d4e4-588c-a776-24f8f81552a2 with identifier: ME81448 to the API
2026-03-30 06:32:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:44:33Z',
 'fuel_type': 'petrol',
 'id': '951023aa-d4e4-588c-a776-24f8f81552a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME81448',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'B-Max',
 'odometer': 49900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-14',
 'seller_name': None,
 'title': 'Ford B-Max 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2017}
2026-03-30 06:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ME81448%27 HTTP/1.1" 200 None
2026-03-30 06:32:12 [auto1.be] INFO: Saving data for ME81448: {'auction_closing_time': 1774885473.0, 'created_time': 1774643605.028998, 'last_price_update_time': 1774852332.048729}
2026-03-30 06:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ME81448') HTTP/1.1" 204 0
2026-03-30 06:32:12 [auto1.be] INFO: Found listing with ID: GA09150
2026-03-30 06:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GA09150%27 HTTP/1.1" 200 None
2026-03-30 06:32:12 [auto1.be] INFO: Scrape type for GA09150: 0
2026-03-30 06:32:12 [auto1.be] INFO: Found listing with ID: JS25395
2026-03-30 06:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS25395%27 HTTP/1.1" 200 None
2026-03-30 06:32:12 [auto1.be] INFO: Scrape type for JS25395: 0
2026-03-30 06:32:12 [auto1.be] INFO: Found listing with ID: XC10139
2026-03-30 06:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC10139%27 HTTP/1.1" 200 None
2026-03-30 06:32:12 [auto1.be] INFO: Scrape type for XC10139: 2
2026-03-30 06:32:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b722d821-e14d-539a-8136-ef63786faded with identifier: XC10139
2026-03-30 06:32:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b722d821-e14d-539a-8136-ef63786faded with scrape type 2
2026-03-30 06:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b722d821-e14d-539a-8136-ef63786faded with scrape type 2
2026-03-30 06:32:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b722d821-e14d-539a-8136-ef63786faded, identifier: XC10139
2026-03-30 06:32:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:32:12 [auto1.be] INFO: Found listing with ID: XH49609
2026-03-30 06:32:12 [auto1.be] INFO: Found listing with ID: GV27154
2026-03-30 06:32:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b722d821-e14d-539a-8136-ef63786faded with identifier: XC10139
2026-03-30 06:32:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b722d821-e14d-539a-8136-ef63786faded with identifier: XC10139
2026-03-30 06:32:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b722d821-e14d-539a-8136-ef63786faded with identifier: XC10139 to the API
2026-03-30 06:32:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:38:44Z',
 'fuel_type': 'diesel',
 'id': 'b722d821-e14d-539a-8136-ef63786faded',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC10139',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 119578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-11',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Sport & Style BlueMotion Tech',
 'year': 2014}
2026-03-30 06:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC10139%27 HTTP/1.1" 200 None
2026-03-30 06:32:12 [auto1.be] INFO: Saving data for XC10139: {'auction_closing_time': 1774885124.0, 'created_time': 1774557184.94311, 'last_price_update_time': 1774852332.465194}
2026-03-30 06:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XC10139') HTTP/1.1" 204 0
2026-03-30 06:32:12 [auto1.be] INFO: Found listing with ID: RL32581
2026-03-30 06:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL32581%27 HTTP/1.1" 200 None
2026-03-30 06:32:12 [auto1.be] INFO: Scrape type for RL32581: 2
2026-03-30 06:32:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 620966a7-3c70-5cb5-8c5c-af38cada22a5 with identifier: RL32581
2026-03-30 06:32:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 620966a7-3c70-5cb5-8c5c-af38cada22a5 with scrape type 2
2026-03-30 06:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 620966a7-3c70-5cb5-8c5c-af38cada22a5 with scrape type 2
2026-03-30 06:32:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 620966a7-3c70-5cb5-8c5c-af38cada22a5, identifier: RL32581
2026-03-30 06:32:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 620966a7-3c70-5cb5-8c5c-af38cada22a5 with identifier: RL32581
2026-03-30 06:32:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 620966a7-3c70-5cb5-8c5c-af38cada22a5 with identifier: RL32581
2026-03-30 06:32:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 620966a7-3c70-5cb5-8c5c-af38cada22a5 with identifier: RL32581 to the API
2026-03-30 06:32:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:30:38Z',
 'fuel_type': 'petrol',
 'id': '620966a7-3c70-5cb5-8c5c-af38cada22a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL32581',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 105444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-02',
 'seller_name': None,
 'title': 'Skoda Kodiaq 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2021}
2026-03-30 06:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL32581%27 HTTP/1.1" 200 None
2026-03-30 06:32:12 [auto1.be] INFO: Saving data for RL32581: {'auction_closing_time': 1774884638.0, 'created_time': 1773866517.693449, 'last_price_update_time': 1774852332.86086}
2026-03-30 06:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RL32581') HTTP/1.1" 204 0
2026-03-30 06:32:12 [auto1.be] INFO: Found listing with ID: CR21244
2026-03-30 06:32:12 [auto1.be] INFO: Found listing with ID: FY43318
2026-03-30 06:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY43318%27 HTTP/1.1" 200 None
2026-03-30 06:32:12 [auto1.be] INFO: Scrape type for FY43318: 0
2026-03-30 06:32:12 [auto1.be] INFO: Found listing with ID: FR80699
2026-03-30 06:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR80699%27 HTTP/1.1" 200 None
2026-03-30 06:32:12 [auto1.be] INFO: Scrape type for FR80699: 0
2026-03-30 06:32:12 [auto1.be] INFO: Found listing with ID: NM33768
2026-03-30 06:32:12 [auto1.be] INFO: Found listing with ID: ZX33086
2026-03-30 06:32:12 [auto1.be] INFO: Found listing with ID: BP38818
2026-03-30 06:32:12 [auto1.be] INFO: Found listing with ID: XT87195
2026-03-30 06:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT87195%27 HTTP/1.1" 200 None
2026-03-30 06:32:12 [auto1.be] INFO: Scrape type for XT87195: 0
2026-03-30 06:32:12 [auto1.be] INFO: Found listing with ID: KP16725
2026-03-30 06:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP16725%27 HTTP/1.1" 200 None
2026-03-30 06:32:12 [auto1.be] INFO: Scrape type for KP16725: 2
2026-03-30 06:32:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14f4e165-c34a-5cd5-b1b6-03f31b3cf555 with identifier: KP16725
2026-03-30 06:32:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14f4e165-c34a-5cd5-b1b6-03f31b3cf555 with scrape type 2
2026-03-30 06:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14f4e165-c34a-5cd5-b1b6-03f31b3cf555 with scrape type 2
2026-03-30 06:32:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 14f4e165-c34a-5cd5-b1b6-03f31b3cf555, identifier: KP16725
2026-03-30 06:32:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 14f4e165-c34a-5cd5-b1b6-03f31b3cf555 with identifier: KP16725
2026-03-30 06:32:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 14f4e165-c34a-5cd5-b1b6-03f31b3cf555 with identifier: KP16725
2026-03-30 06:32:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 14f4e165-c34a-5cd5-b1b6-03f31b3cf555 with identifier: KP16725 to the API
2026-03-30 06:32:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:16:18Z',
 'fuel_type': 'diesel',
 'id': '14f4e165-c34a-5cd5-b1b6-03f31b3cf555',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP16725',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 152527,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-24',
 'seller_name': None,
 'title': 'Opel Vivaro 1.6 Biturbo CDTI Kasten L2H2 2,9t',
 'transmission': 'manual',
 'trim': 'Kasten L2H2 2,9t',
 'year': 2018}
2026-03-30 06:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP16725%27 HTTP/1.1" 200 None
2026-03-30 06:32:13 [auto1.be] INFO: Saving data for KP16725: {'auction_closing_time': 1774883778.0, 'created_time': 1774643552.3746, 'last_price_update_time': 1774852333.292216}
2026-03-30 06:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KP16725') HTTP/1.1" 204 0
2026-03-30 06:32:13 [auto1.be] INFO: Found listing with ID: GS68920
2026-03-30 06:32:13 [auto1.be] INFO: Found listing with ID: WP21428
2026-03-30 06:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP21428%27 HTTP/1.1" 200 None
2026-03-30 06:32:13 [auto1.be] INFO: Scrape type for WP21428: 0
2026-03-30 06:32:13 [auto1.be] INFO: Found listing with ID: XC64567
2026-03-30 06:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC64567%27 HTTP/1.1" 200 None
2026-03-30 06:32:13 [auto1.be] INFO: Scrape type for XC64567: 0
2026-03-30 06:32:13 [auto1.be] INFO: Found listing with ID: NJ59863
2026-03-30 06:32:13 [auto1.be] INFO: Found listing with ID: AU41446
2026-03-30 06:32:13 [auto1.be] INFO: Found listing with ID: EX63844
2026-03-30 06:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX63844%27 HTTP/1.1" 200 None
2026-03-30 06:32:13 [auto1.be] INFO: Scrape type for EX63844: 0
2026-03-30 06:32:13 [auto1.be] INFO: Found listing with ID: VA07887
2026-03-30 06:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA07887%27 HTTP/1.1" 200 None
2026-03-30 06:32:13 [auto1.be] INFO: Scrape type for VA07887: 0
2026-03-30 06:32:13 [auto1.be] INFO: Found listing with ID: FJ79675
2026-03-30 06:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ79675%27 HTTP/1.1" 200 None
2026-03-30 06:32:13 [auto1.be] INFO: Scrape type for FJ79675: 0
2026-03-30 06:32:13 [auto1.be] INFO: Found listing with ID: XB11874
2026-03-30 06:32:13 [auto1.be] INFO: Found listing with ID: XT90325
2026-03-30 06:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT90325%27 HTTP/1.1" 200 None
2026-03-30 06:32:13 [auto1.be] INFO: Scrape type for XT90325: 0
2026-03-30 06:32:13 [auto1.be] INFO: Found listing with ID: CS46585
2026-03-30 06:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS46585%27 HTTP/1.1" 200 None
2026-03-30 06:32:13 [auto1.be] INFO: Scrape type for CS46585: 2
2026-03-30 06:32:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9439004-4fc6-5383-9e68-aa6686a4b734 with identifier: CS46585
2026-03-30 06:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9439004-4fc6-5383-9e68-aa6686a4b734 with scrape type 2
2026-03-30 06:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9439004-4fc6-5383-9e68-aa6686a4b734 with scrape type 2
2026-03-30 06:32:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c9439004-4fc6-5383-9e68-aa6686a4b734, identifier: CS46585
2026-03-30 06:32:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c9439004-4fc6-5383-9e68-aa6686a4b734 with identifier: CS46585
2026-03-30 06:32:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c9439004-4fc6-5383-9e68-aa6686a4b734 with identifier: CS46585
2026-03-30 06:32:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c9439004-4fc6-5383-9e68-aa6686a4b734 with identifier: CS46585 to the API
2026-03-30 06:32:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:06:56Z',
 'fuel_type': 'petrol',
 'id': 'c9439004-4fc6-5383-9e68-aa6686a4b734',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS46585',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Verso-S',
 'odometer': 209791,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-30',
 'seller_name': None,
 'title': 'Toyota Verso-S 1.33 Dual VVT-i',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 06:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CS46585%27 HTTP/1.1" 200 None
2026-03-30 06:32:13 [auto1.be] INFO: Saving data for CS46585: {'auction_closing_time': 1774883216.0, 'created_time': 1774557140.909173, 'last_price_update_time': 1774852333.856636}
2026-03-30 06:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CS46585') HTTP/1.1" 204 0
2026-03-30 06:32:13 [auto1.be] INFO: Found listing with ID: MX90898
2026-03-30 06:32:13 [auto1.be] INFO: Found listing with ID: CG39340
2026-03-30 06:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG39340%27 HTTP/1.1" 200 None
2026-03-30 06:32:13 [auto1.be] INFO: Scrape type for CG39340: 0
2026-03-30 06:32:13 [auto1.be] INFO: Found listing with ID: LP39108
2026-03-30 06:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP39108%27 HTTP/1.1" 200 None
2026-03-30 06:32:13 [auto1.be] INFO: Scrape type for LP39108: 2
2026-03-30 06:32:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1f9a976-deb2-5b26-aff6-54d606e656f5 with identifier: LP39108
2026-03-30 06:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1f9a976-deb2-5b26-aff6-54d606e656f5 with scrape type 2
2026-03-30 06:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1f9a976-deb2-5b26-aff6-54d606e656f5 with scrape type 2
2026-03-30 06:32:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f1f9a976-deb2-5b26-aff6-54d606e656f5, identifier: LP39108
2026-03-30 06:32:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f1f9a976-deb2-5b26-aff6-54d606e656f5 with identifier: LP39108
2026-03-30 06:32:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f1f9a976-deb2-5b26-aff6-54d606e656f5 with identifier: LP39108
2026-03-30 06:32:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f1f9a976-deb2-5b26-aff6-54d606e656f5 with identifier: LP39108 to the API
2026-03-30 06:32:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:29:04Z',
 'fuel_type': 'petrol',
 'id': 'f1f9a976-deb2-5b26-aff6-54d606e656f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP39108',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 191515,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-23',
 'seller_name': None,
 'title': 'Skoda Kodiaq 1.4 TSI ACT Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2018}
2026-03-30 06:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP39108%27 HTTP/1.1" 200 None
2026-03-30 06:32:14 [auto1.be] INFO: Saving data for LP39108: {'auction_closing_time': 1774884544.0, 'created_time': 1774643604.714687, 'last_price_update_time': 1774852334.348139}
2026-03-30 06:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LP39108') HTTP/1.1" 204 0
2026-03-30 06:32:14 [auto1.be] INFO: Found listing with ID: NZ84501
2026-03-30 06:32:14 [auto1.be] INFO: Found listing with ID: LM00165
2026-03-30 06:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM00165%27 HTTP/1.1" 200 None
2026-03-30 06:32:14 [auto1.be] INFO: Scrape type for LM00165: 0
2026-03-30 06:32:14 [auto1.be] INFO: Found listing with ID: LF23330
2026-03-30 06:32:14 [auto1.be] INFO: Found listing with ID: GH45635
2026-03-30 06:32:14 [auto1.be] INFO: Found listing with ID: SC36479
2026-03-30 06:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC36479%27 HTTP/1.1" 200 None
2026-03-30 06:32:14 [auto1.be] INFO: Scrape type for SC36479: 0
2026-03-30 06:32:14 [auto1.be] INFO: Found listing with ID: AB25804
2026-03-30 06:32:14 [auto1.be] INFO: Found listing with ID: TX85632
2026-03-30 06:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX85632%27 HTTP/1.1" 200 None
2026-03-30 06:32:14 [auto1.be] INFO: Scrape type for TX85632: 0
2026-03-30 06:32:14 [auto1.be] INFO: Found listing with ID: AD33980
2026-03-30 06:32:14 [auto1.be] INFO: Found listing with ID: CH34151
2026-03-30 06:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH34151%27 HTTP/1.1" 200 None
2026-03-30 06:32:14 [auto1.be] INFO: Scrape type for CH34151: 0
2026-03-30 06:32:14 [auto1.be] INFO: Found listing with ID: VP78411
2026-03-30 06:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP78411%27 HTTP/1.1" 200 None
2026-03-30 06:32:14 [auto1.be] INFO: Scrape type for VP78411: 0
2026-03-30 06:32:14 [auto1.be] INFO: Found listing with ID: DM43787
2026-03-30 06:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM43787%27 HTTP/1.1" 200 None
2026-03-30 06:32:14 [auto1.be] INFO: Scrape type for DM43787: 0
2026-03-30 06:32:14 [auto1.be] INFO: Found listing with ID: SA37733
2026-03-30 06:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SA37733%27 HTTP/1.1" 200 None
2026-03-30 06:32:14 [auto1.be] INFO: Scrape type for SA37733: 0
2026-03-30 06:32:14 [auto1.be] INFO: Found listing with ID: ED59297
2026-03-30 06:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED59297%27 HTTP/1.1" 200 None
2026-03-30 06:32:14 [auto1.be] INFO: Scrape type for ED59297: 0
2026-03-30 06:32:14 [auto1.be] INFO: Found listing with ID: SL51907
2026-03-30 06:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:32:15 [auto1.be] INFO: Channel: 24h | Page: 23 | totalHits: 1289 | hits on page: 40
2026-03-30 06:32:15 [auto1.be] INFO: Found listing with ID: DU38710
2026-03-30 06:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DU38710%27 HTTP/1.1" 200 None
2026-03-30 06:32:15 [auto1.be] INFO: Scrape type for DU38710: 0
2026-03-30 06:32:15 [auto1.be] INFO: Found listing with ID: JC93215
2026-03-30 06:32:15 [auto1.be] INFO: Found listing with ID: TD70367
2026-03-30 06:32:15 [auto1.be] INFO: Found listing with ID: YK80434
2026-03-30 06:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK80434%27 HTTP/1.1" 200 None
2026-03-30 06:32:15 [auto1.be] INFO: Scrape type for YK80434: 0
2026-03-30 06:32:15 [auto1.be] INFO: Found listing with ID: VZ63754
2026-03-30 06:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ63754%27 HTTP/1.1" 200 None
2026-03-30 06:32:15 [auto1.be] INFO: Scrape type for VZ63754: 0
2026-03-30 06:32:15 [auto1.be] INFO: Found listing with ID: TU11660
2026-03-30 06:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU11660%27 HTTP/1.1" 200 None
2026-03-30 06:32:15 [auto1.be] INFO: Scrape type for TU11660: 0
2026-03-30 06:32:15 [auto1.be] INFO: Found listing with ID: JW78855
2026-03-30 06:32:15 [auto1.be] INFO: Found listing with ID: RX86056
2026-03-30 06:32:15 [auto1.be] INFO: Found listing with ID: LP07116
2026-03-30 06:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP07116%27 HTTP/1.1" 200 None
2026-03-30 06:32:15 [auto1.be] INFO: Scrape type for LP07116: 0
2026-03-30 06:32:15 [auto1.be] INFO: Found listing with ID: LP97900
2026-03-30 06:32:15 [auto1.be] INFO: Found listing with ID: BK01349
2026-03-30 06:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BK01349%27 HTTP/1.1" 200 None
2026-03-30 06:32:15 [auto1.be] INFO: Scrape type for BK01349: 0
2026-03-30 06:32:15 [auto1.be] INFO: Found listing with ID: AW74184
2026-03-30 06:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AW74184%27 HTTP/1.1" 200 None
2026-03-30 06:32:15 [auto1.be] INFO: Scrape type for AW74184: 2
2026-03-30 06:32:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27685742-f930-5c5f-94e2-21bc3d30f61d with identifier: AW74184
2026-03-30 06:32:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27685742-f930-5c5f-94e2-21bc3d30f61d with scrape type 2
2026-03-30 06:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27685742-f930-5c5f-94e2-21bc3d30f61d with scrape type 2
2026-03-30 06:32:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 27685742-f930-5c5f-94e2-21bc3d30f61d, identifier: AW74184
2026-03-30 06:32:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 27685742-f930-5c5f-94e2-21bc3d30f61d with identifier: AW74184
2026-03-30 06:32:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 27685742-f930-5c5f-94e2-21bc3d30f61d with identifier: AW74184
2026-03-30 06:32:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 27685742-f930-5c5f-94e2-21bc3d30f61d with identifier: AW74184 to the API
2026-03-30 06:32:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:41:34Z',
 'fuel_type': 'diesel',
 'id': '27685742-f930-5c5f-94e2-21bc3d30f61d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW74184',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 146147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-22',
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi Active",
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2019}
2026-03-30 06:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AW74184%27 HTTP/1.1" 200 None
2026-03-30 06:32:16 [auto1.be] INFO: Saving data for AW74184: {'auction_closing_time': 1774885294.0, 'created_time': 1774643626.940804, 'last_price_update_time': 1774852336.241261}
2026-03-30 06:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AW74184') HTTP/1.1" 204 0
2026-03-30 06:32:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:32:16 [auto1.be] INFO: Found listing with ID: XL43279
2026-03-30 06:32:16 [auto1.be] INFO: Found listing with ID: SC85120
2026-03-30 06:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC85120%27 HTTP/1.1" 200 None
2026-03-30 06:32:16 [auto1.be] INFO: Scrape type for SC85120: 0
2026-03-30 06:32:16 [auto1.be] INFO: Found listing with ID: BA37972
2026-03-30 06:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA37972%27 HTTP/1.1" 200 None
2026-03-30 06:32:16 [auto1.be] INFO: Scrape type for BA37972: 0
2026-03-30 06:32:16 [auto1.be] INFO: Found listing with ID: TW09601
2026-03-30 06:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW09601%27 HTTP/1.1" 200 None
2026-03-30 06:32:16 [auto1.be] INFO: Scrape type for TW09601: 0
2026-03-30 06:32:16 [auto1.be] INFO: Found listing with ID: TZ99758
2026-03-30 06:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TZ99758%27 HTTP/1.1" 200 None
2026-03-30 06:32:16 [auto1.be] INFO: Scrape type for TZ99758: 0
2026-03-30 06:32:16 [auto1.be] INFO: Found listing with ID: RH32729
2026-03-30 06:32:16 [auto1.be] INFO: Found listing with ID: LT47332
2026-03-30 06:32:16 [auto1.be] INFO: Found listing with ID: DY28234
2026-03-30 06:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY28234%27 HTTP/1.1" 200 None
2026-03-30 06:32:16 [auto1.be] INFO: Scrape type for DY28234: 0
2026-03-30 06:32:16 [auto1.be] INFO: Found listing with ID: UU12218
2026-03-30 06:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU12218%27 HTTP/1.1" 200 None
2026-03-30 06:32:16 [auto1.be] INFO: Scrape type for UU12218: 2
2026-03-30 06:32:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e with identifier: UU12218
2026-03-30 06:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e with scrape type 2
2026-03-30 06:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e with scrape type 2
2026-03-30 06:32:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e, identifier: UU12218
2026-03-30 06:32:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e with identifier: UU12218
2026-03-30 06:32:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e with identifier: UU12218
2026-03-30 06:32:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d2f22d05-cfdf-5018-9cd9-dbfd2cd5585e with identifier: UU12218 to the API
2026-03-30 06:32:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:13:17Z',
 'fuel_type': 'diesel',
 'id': 'd2f22d05-cfdf-5018-9cd9-dbfd2cd5585e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU12218',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 192210,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-31',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2015}
2026-03-30 06:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU12218%27 HTTP/1.1" 200 None
2026-03-30 06:32:16 [auto1.be] INFO: Saving data for UU12218: {'auction_closing_time': 1774883597.0, 'created_time': 1774643642.26628, 'last_price_update_time': 1774852336.876685}
2026-03-30 06:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UU12218') HTTP/1.1" 204 0
2026-03-30 06:32:16 [auto1.be] INFO: Found listing with ID: WS04459
2026-03-30 06:32:16 [auto1.be] INFO: Found listing with ID: PB25162
2026-03-30 06:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB25162%27 HTTP/1.1" 200 None
2026-03-30 06:32:16 [auto1.be] INFO: Scrape type for PB25162: 2
2026-03-30 06:32:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77863e2a-4114-5928-bcad-56eaadd19805 with identifier: PB25162
2026-03-30 06:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77863e2a-4114-5928-bcad-56eaadd19805 with scrape type 2
2026-03-30 06:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77863e2a-4114-5928-bcad-56eaadd19805 with scrape type 2
2026-03-30 06:32:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 77863e2a-4114-5928-bcad-56eaadd19805, identifier: PB25162
2026-03-30 06:32:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 77863e2a-4114-5928-bcad-56eaadd19805 with identifier: PB25162
2026-03-30 06:32:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 77863e2a-4114-5928-bcad-56eaadd19805 with identifier: PB25162
2026-03-30 06:32:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 77863e2a-4114-5928-bcad-56eaadd19805 with identifier: PB25162 to the API
2026-03-30 06:32:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-30T15:22:17Z',
 'fuel_type': 'petrol',
 'id': '77863e2a-4114-5928-bcad-56eaadd19805',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB25162',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Ignis',
 'odometer': 15780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-04',
 'seller_name': None,
 'title': 'Suzuki Ignis 1.2 DualJet Mild-Hybrid Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2023}
2026-03-30 06:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB25162%27 HTTP/1.1" 200 None
2026-03-30 06:32:17 [auto1.be] INFO: Saving data for PB25162: {'auction_closing_time': 1774884137.0, 'created_time': 1774643684.869381, 'last_price_update_time': 1774852337.252889}
2026-03-30 06:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PB25162') HTTP/1.1" 204 0
2026-03-30 06:32:17 [auto1.be] INFO: Found listing with ID: KS43499
2026-03-30 06:32:17 [auto1.be] INFO: Found listing with ID: UA44051
2026-03-30 06:32:17 [auto1.be] INFO: Found listing with ID: BZ65544
2026-03-30 06:32:17 [auto1.be] INFO: Found listing with ID: HZ19238
2026-03-30 06:32:17 [auto1.be] INFO: Found listing with ID: KU11213
2026-03-30 06:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU11213%27 HTTP/1.1" 200 None
2026-03-30 06:32:17 [auto1.be] INFO: Scrape type for KU11213: 0
2026-03-30 06:32:17 [auto1.be] INFO: Found listing with ID: PY12122
2026-03-30 06:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY12122%27 HTTP/1.1" 200 None
2026-03-30 06:32:17 [auto1.be] INFO: Scrape type for PY12122: 0
2026-03-30 06:32:17 [auto1.be] INFO: Found listing with ID: DC17534
2026-03-30 06:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC17534%27 HTTP/1.1" 200 None
2026-03-30 06:32:17 [auto1.be] INFO: Scrape type for DC17534: 0
2026-03-30 06:32:17 [auto1.be] INFO: Found listing with ID: AT20959
2026-03-30 06:32:17 [auto1.be] INFO: Found listing with ID: WP69561
2026-03-30 06:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP69561%27 HTTP/1.1" 200 None
2026-03-30 06:32:17 [auto1.be] INFO: Scrape type for WP69561: 0
2026-03-30 06:32:17 [auto1.be] INFO: Found listing with ID: JM34078
2026-03-30 06:32:17 [auto1.be] INFO: Found listing with ID: YS56392
2026-03-30 06:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS56392%27 HTTP/1.1" 200 None
2026-03-30 06:32:17 [auto1.be] INFO: Scrape type for YS56392: 0
2026-03-30 06:32:17 [auto1.be] INFO: Found listing with ID: VB04696
2026-03-30 06:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB04696%27 HTTP/1.1" 200 None
2026-03-30 06:32:17 [auto1.be] INFO: Scrape type for VB04696: 0
2026-03-30 06:32:17 [auto1.be] INFO: Found listing with ID: RR89556
2026-03-30 06:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR89556%27 HTTP/1.1" 200 None
2026-03-30 06:32:17 [auto1.be] INFO: Scrape type for RR89556: 2
2026-03-30 06:32:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29d8319a-52dc-5975-a22f-1e0071b3a6e5 with identifier: RR89556
2026-03-30 06:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29d8319a-52dc-5975-a22f-1e0071b3a6e5 with scrape type 2
2026-03-30 06:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29d8319a-52dc-5975-a22f-1e0071b3a6e5 with scrape type 2
2026-03-30 06:32:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 29d8319a-52dc-5975-a22f-1e0071b3a6e5, identifier: RR89556
2026-03-30 06:32:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 29d8319a-52dc-5975-a22f-1e0071b3a6e5 with identifier: RR89556
2026-03-30 06:32:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 29d8319a-52dc-5975-a22f-1e0071b3a6e5 with identifier: RR89556
2026-03-30 06:32:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 29d8319a-52dc-5975-a22f-1e0071b3a6e5 with identifier: RR89556 to the API
2026-03-30 06:32:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:42:42Z',
 'fuel_type': 'petrol',
 'id': '29d8319a-52dc-5975-a22f-1e0071b3a6e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR89556',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 19110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-28',
 'seller_name': None,
 'title': 'Fiat Tipo 1.4 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2019}
2026-03-30 06:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR89556%27 HTTP/1.1" 200 None
2026-03-30 06:32:17 [auto1.be] INFO: Saving data for RR89556: {'auction_closing_time': 1774885362.0, 'created_time': 1774557195.308689, 'last_price_update_time': 1774852337.847675}
2026-03-30 06:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RR89556') HTTP/1.1" 204 0
2026-03-30 06:32:17 [auto1.be] INFO: Found listing with ID: RS45224
2026-03-30 06:32:17 [auto1.be] INFO: Found listing with ID: UW48678
2026-03-30 06:32:17 [auto1.be] INFO: Found listing with ID: XM10489
2026-03-30 06:32:17 [auto1.be] INFO: Found listing with ID: SZ65946
2026-03-30 06:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ65946%27 HTTP/1.1" 200 None
2026-03-30 06:32:17 [auto1.be] INFO: Scrape type for SZ65946: 0
2026-03-30 06:32:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:32:18 [auto1.be] INFO: Channel: 24h | Page: 24 | totalHits: 1289 | hits on page: 40
2026-03-30 06:32:18 [auto1.be] INFO: Found listing with ID: FH97290
2026-03-30 06:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH97290%27 HTTP/1.1" 200 None
2026-03-30 06:32:18 [auto1.be] INFO: Scrape type for FH97290: 0
2026-03-30 06:32:18 [auto1.be] INFO: Found listing with ID: MV82025
2026-03-30 06:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV82025%27 HTTP/1.1" 200 None
2026-03-30 06:32:18 [auto1.be] INFO: Scrape type for MV82025: 2
2026-03-30 06:32:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71215794-5397-5401-80c2-2542c4e8b4b2 with identifier: MV82025
2026-03-30 06:32:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71215794-5397-5401-80c2-2542c4e8b4b2 with scrape type 2
2026-03-30 06:32:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71215794-5397-5401-80c2-2542c4e8b4b2 with scrape type 2
2026-03-30 06:32:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 71215794-5397-5401-80c2-2542c4e8b4b2, identifier: MV82025
2026-03-30 06:32:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 71215794-5397-5401-80c2-2542c4e8b4b2 with identifier: MV82025
2026-03-30 06:32:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 71215794-5397-5401-80c2-2542c4e8b4b2 with identifier: MV82025
2026-03-30 06:32:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 71215794-5397-5401-80c2-2542c4e8b4b2 with identifier: MV82025 to the API
2026-03-30 06:32:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:12:44Z',
 'fuel_type': 'petrol',
 'id': '71215794-5397-5401-80c2-2542c4e8b4b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV82025',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 117875,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-16',
 'seller_name': None,
 'title': 'Kia Rio 1.2 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2015}
2026-03-30 06:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV82025%27 HTTP/1.1" 200 None
2026-03-30 06:32:19 [auto1.be] INFO: Saving data for MV82025: {'auction_closing_time': 1774883564.0, 'created_time': 1774643672.972189, 'last_price_update_time': 1774852339.343767}
2026-03-30 06:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MV82025') HTTP/1.1" 204 0
2026-03-30 06:32:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:32:19 [auto1.be] INFO: Found listing with ID: MZ51776
2026-03-30 06:32:19 [auto1.be] INFO: Found listing with ID: HU58936
2026-03-30 06:32:19 [auto1.be] INFO: Found listing with ID: WH33984
2026-03-30 06:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH33984%27 HTTP/1.1" 200 None
2026-03-30 06:32:19 [auto1.be] INFO: Scrape type for WH33984: 0
2026-03-30 06:32:19 [auto1.be] INFO: Found listing with ID: ET79377
2026-03-30 06:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET79377%27 HTTP/1.1" 200 None
2026-03-30 06:32:19 [auto1.be] INFO: Scrape type for ET79377: 2
2026-03-30 06:32:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd6f3b38-33fa-5979-8f6c-8461ef873c8f with identifier: ET79377
2026-03-30 06:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd6f3b38-33fa-5979-8f6c-8461ef873c8f with scrape type 2
2026-03-30 06:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd6f3b38-33fa-5979-8f6c-8461ef873c8f with scrape type 2
2026-03-30 06:32:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bd6f3b38-33fa-5979-8f6c-8461ef873c8f, identifier: ET79377
2026-03-30 06:32:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bd6f3b38-33fa-5979-8f6c-8461ef873c8f with identifier: ET79377
2026-03-30 06:32:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bd6f3b38-33fa-5979-8f6c-8461ef873c8f with identifier: ET79377
2026-03-30 06:32:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bd6f3b38-33fa-5979-8f6c-8461ef873c8f with identifier: ET79377 to the API
2026-03-30 06:32:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:10:35Z',
 'fuel_type': 'diesel',
 'id': 'bd6f3b38-33fa-5979-8f6c-8461ef873c8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET79377',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 170186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-17',
 'seller_name': None,
 'title': 'BMW 4er 430d Gran Coupé M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2016}
2026-03-30 06:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET79377%27 HTTP/1.1" 200 None
2026-03-30 06:32:19 [auto1.be] INFO: Saving data for ET79377: {'auction_closing_time': 1774883435.0, 'created_time': 1773909031.458779, 'last_price_update_time': 1774852339.780162}
2026-03-30 06:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ET79377') HTTP/1.1" 204 0
2026-03-30 06:32:19 [auto1.be] INFO: Found listing with ID: UR44884
2026-03-30 06:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR44884%27 HTTP/1.1" 200 None
2026-03-30 06:32:19 [auto1.be] INFO: Scrape type for UR44884: 2
2026-03-30 06:32:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 006e77a7-b816-5d8f-903f-13762796f2d2 with identifier: UR44884
2026-03-30 06:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 006e77a7-b816-5d8f-903f-13762796f2d2 with scrape type 2
2026-03-30 06:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 006e77a7-b816-5d8f-903f-13762796f2d2 with scrape type 2
2026-03-30 06:32:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 006e77a7-b816-5d8f-903f-13762796f2d2, identifier: UR44884
2026-03-30 06:32:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 006e77a7-b816-5d8f-903f-13762796f2d2 with identifier: UR44884
2026-03-30 06:32:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 006e77a7-b816-5d8f-903f-13762796f2d2 with identifier: UR44884
2026-03-30 06:32:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 006e77a7-b816-5d8f-903f-13762796f2d2 with identifier: UR44884 to the API
2026-03-30 06:32:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:40:27Z',
 'fuel_type': 'petrol',
 'id': '006e77a7-b816-5d8f-903f-13762796f2d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR44884',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 29909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-10',
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2019}
2026-03-30 06:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR44884%27 HTTP/1.1" 200 None
2026-03-30 06:32:20 [auto1.be] INFO: Saving data for UR44884: {'auction_closing_time': 1774885227.0, 'created_time': 1774557206.163541, 'last_price_update_time': 1774852340.178585}
2026-03-30 06:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UR44884') HTTP/1.1" 204 0
2026-03-30 06:32:20 [auto1.be] INFO: Found listing with ID: HM84114
2026-03-30 06:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM84114%27 HTTP/1.1" 200 None
2026-03-30 06:32:20 [auto1.be] INFO: Scrape type for HM84114: 0
2026-03-30 06:32:20 [auto1.be] INFO: Found listing with ID: LC46636
2026-03-30 06:32:20 [auto1.be] INFO: Found listing with ID: FN16517
2026-03-30 06:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN16517%27 HTTP/1.1" 200 None
2026-03-30 06:32:20 [auto1.be] INFO: Scrape type for FN16517: 0
2026-03-30 06:32:20 [auto1.be] INFO: Found listing with ID: SC73086
2026-03-30 06:32:20 [auto1.be] INFO: Found listing with ID: UF35860
2026-03-30 06:32:20 [auto1.be] INFO: Found listing with ID: PR84870
2026-03-30 06:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR84870%27 HTTP/1.1" 200 None
2026-03-30 06:32:20 [auto1.be] INFO: Scrape type for PR84870: 0
2026-03-30 06:32:20 [auto1.be] INFO: Found listing with ID: NN69701
2026-03-30 06:32:20 [auto1.be] INFO: Found listing with ID: KG53590
2026-03-30 06:32:20 [auto1.be] INFO: Found listing with ID: WK50026
2026-03-30 06:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK50026%27 HTTP/1.1" 200 None
2026-03-30 06:32:20 [auto1.be] INFO: Scrape type for WK50026: 2
2026-03-30 06:32:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a916bf6-add1-537b-9d8a-3fb9c166f590 with identifier: WK50026
2026-03-30 06:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a916bf6-add1-537b-9d8a-3fb9c166f590 with scrape type 2
2026-03-30 06:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a916bf6-add1-537b-9d8a-3fb9c166f590 with scrape type 2
2026-03-30 06:32:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5a916bf6-add1-537b-9d8a-3fb9c166f590, identifier: WK50026
2026-03-30 06:32:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5a916bf6-add1-537b-9d8a-3fb9c166f590 with identifier: WK50026
2026-03-30 06:32:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5a916bf6-add1-537b-9d8a-3fb9c166f590 with identifier: WK50026
2026-03-30 06:32:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5a916bf6-add1-537b-9d8a-3fb9c166f590 with identifier: WK50026 to the API
2026-03-30 06:32:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:42:23Z',
 'fuel_type': 'petrol',
 'id': '5a916bf6-add1-537b-9d8a-3fb9c166f590',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK50026',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 131300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-10',
 'seller_name': None,
 'title': 'Opel Mokka 1.4 Turbo Innovation ecoFlex',
 'transmission': 'manual',
 'trim': 'Innovation ecoFlex',
 'year': 2016}
2026-03-30 06:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WK50026%27 HTTP/1.1" 200 None
2026-03-30 06:32:20 [auto1.be] INFO: Saving data for WK50026: {'auction_closing_time': 1774885343.0, 'created_time': 1773133087.392684, 'last_price_update_time': 1774852340.742481}
2026-03-30 06:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WK50026') HTTP/1.1" 204 0
2026-03-30 06:32:20 [auto1.be] INFO: Found listing with ID: ZX32272
2026-03-30 06:32:20 [auto1.be] INFO: Found listing with ID: MK20825
2026-03-30 06:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK20825%27 HTTP/1.1" 200 None
2026-03-30 06:32:20 [auto1.be] INFO: Scrape type for MK20825: 0
2026-03-30 06:32:20 [auto1.be] INFO: Found listing with ID: YS48127
2026-03-30 06:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS48127%27 HTTP/1.1" 200 None
2026-03-30 06:32:20 [auto1.be] INFO: Scrape type for YS48127: 0
2026-03-30 06:32:20 [auto1.be] INFO: Found listing with ID: RF74485
2026-03-30 06:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF74485%27 HTTP/1.1" 200 None
2026-03-30 06:32:20 [auto1.be] INFO: Scrape type for RF74485: 2
2026-03-30 06:32:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 893943d4-e5ea-5829-8278-50cb4a6de35c with identifier: RF74485
2026-03-30 06:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 893943d4-e5ea-5829-8278-50cb4a6de35c with scrape type 2
2026-03-30 06:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 893943d4-e5ea-5829-8278-50cb4a6de35c with scrape type 2
2026-03-30 06:32:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 893943d4-e5ea-5829-8278-50cb4a6de35c, identifier: RF74485
2026-03-30 06:32:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 893943d4-e5ea-5829-8278-50cb4a6de35c with identifier: RF74485
2026-03-30 06:32:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 893943d4-e5ea-5829-8278-50cb4a6de35c with identifier: RF74485
2026-03-30 06:32:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 893943d4-e5ea-5829-8278-50cb4a6de35c with identifier: RF74485 to the API
2026-03-30 06:32:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:46:30Z',
 'fuel_type': 'petrol',
 'id': '893943d4-e5ea-5829-8278-50cb4a6de35c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF74485',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 120277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-18',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.4 Turbo Turismo',
 'transmission': 'manual',
 'trim': 'Turismo',
 'year': 2010}
2026-03-30 06:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF74485%27 HTTP/1.1" 200 None
2026-03-30 06:32:21 [auto1.be] INFO: Saving data for RF74485: {'auction_closing_time': 1774885590.0, 'created_time': 1774557124.322943, 'last_price_update_time': 1774852341.210971}
2026-03-30 06:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RF74485') HTTP/1.1" 204 0
2026-03-30 06:32:21 [auto1.be] INFO: Found listing with ID: NC57966
2026-03-30 06:32:21 [auto1.be] INFO: Found listing with ID: FU04844
2026-03-30 06:32:21 [auto1.be] INFO: Found listing with ID: FC28385
2026-03-30 06:32:21 [auto1.be] INFO: Found listing with ID: MU18005
2026-03-30 06:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MU18005%27 HTTP/1.1" 200 None
2026-03-30 06:32:21 [auto1.be] INFO: Scrape type for MU18005: 2
2026-03-30 06:32:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed0ae2a0-49ec-5a6e-81f1-fe4d6f2dbc11 with identifier: MU18005
2026-03-30 06:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed0ae2a0-49ec-5a6e-81f1-fe4d6f2dbc11 with scrape type 2
2026-03-30 06:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed0ae2a0-49ec-5a6e-81f1-fe4d6f2dbc11 with scrape type 2
2026-03-30 06:32:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ed0ae2a0-49ec-5a6e-81f1-fe4d6f2dbc11, identifier: MU18005
2026-03-30 06:32:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ed0ae2a0-49ec-5a6e-81f1-fe4d6f2dbc11 with identifier: MU18005
2026-03-30 06:32:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ed0ae2a0-49ec-5a6e-81f1-fe4d6f2dbc11 with identifier: MU18005
2026-03-30 06:32:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ed0ae2a0-49ec-5a6e-81f1-fe4d6f2dbc11 with identifier: MU18005 to the API
2026-03-30 06:32:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:22:50Z',
 'fuel_type': 'diesel',
 'id': 'ed0ae2a0-49ec-5a6e-81f1-fe4d6f2dbc11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU18005',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 162262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-23',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Laurin & Klement 4x4',
 'transmission': 'automatic',
 'trim': 'Laurin & Klement 4x4',
 'year': 2016}
2026-03-30 06:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MU18005%27 HTTP/1.1" 200 None
2026-03-30 06:32:21 [auto1.be] INFO: Saving data for MU18005: {'auction_closing_time': 1774884170.0, 'created_time': 1774557170.686852, 'last_price_update_time': 1774852341.710098}
2026-03-30 06:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MU18005') HTTP/1.1" 204 0
2026-03-30 06:32:21 [auto1.be] INFO: Found listing with ID: UM95648
2026-03-30 06:32:21 [auto1.be] INFO: Found listing with ID: KV94769
2026-03-30 06:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV94769%27 HTTP/1.1" 200 None
2026-03-30 06:32:21 [auto1.be] INFO: Scrape type for KV94769: 2
2026-03-30 06:32:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9bc0b34-3b35-5969-bb19-c15d82005856 with identifier: KV94769
2026-03-30 06:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9bc0b34-3b35-5969-bb19-c15d82005856 with scrape type 2
2026-03-30 06:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9bc0b34-3b35-5969-bb19-c15d82005856 with scrape type 2
2026-03-30 06:32:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d9bc0b34-3b35-5969-bb19-c15d82005856, identifier: KV94769
2026-03-30 06:32:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d9bc0b34-3b35-5969-bb19-c15d82005856 with identifier: KV94769
2026-03-30 06:32:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d9bc0b34-3b35-5969-bb19-c15d82005856 with identifier: KV94769
2026-03-30 06:32:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d9bc0b34-3b35-5969-bb19-c15d82005856 with identifier: KV94769 to the API
2026-03-30 06:32:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:10:29Z',
 'fuel_type': 'diesel',
 'id': 'd9bc0b34-3b35-5969-bb19-c15d82005856',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV94769',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 43114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-03',
 'seller_name': None,
 'title': 'BMW 1er 116d Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2023}
2026-03-30 06:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV94769%27 HTTP/1.1" 200 None
2026-03-30 06:32:22 [auto1.be] INFO: Saving data for KV94769: {'auction_closing_time': 1774883429.0, 'created_time': 1774557227.408771, 'last_price_update_time': 1774852342.106873}
2026-03-30 06:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KV94769') HTTP/1.1" 204 0
2026-03-30 06:32:22 [auto1.be] INFO: Found listing with ID: VA32651
2026-03-30 06:32:22 [auto1.be] INFO: Found listing with ID: ZC67013
2026-03-30 06:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZC67013%27 HTTP/1.1" 200 None
2026-03-30 06:32:22 [auto1.be] INFO: Scrape type for ZC67013: 0
2026-03-30 06:32:22 [auto1.be] INFO: Found listing with ID: LG02466
2026-03-30 06:32:22 [auto1.be] INFO: Found listing with ID: MZ96160
2026-03-30 06:32:22 [auto1.be] INFO: Found listing with ID: DD08232
2026-03-30 06:32:22 [auto1.be] INFO: Found listing with ID: ZK51287
2026-03-30 06:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZK51287%27 HTTP/1.1" 200 None
2026-03-30 06:32:22 [auto1.be] INFO: Scrape type for ZK51287: 0
2026-03-30 06:32:22 [auto1.be] INFO: Found listing with ID: JX00156
2026-03-30 06:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JX00156%27 HTTP/1.1" 200 None
2026-03-30 06:32:22 [auto1.be] INFO: Scrape type for JX00156: 0
2026-03-30 06:32:22 [auto1.be] INFO: Found listing with ID: UN77217
2026-03-30 06:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UN77217%27 HTTP/1.1" 200 None
2026-03-30 06:32:22 [auto1.be] INFO: Scrape type for UN77217: 0
2026-03-30 06:32:22 [auto1.be] INFO: Found listing with ID: VA33507
2026-03-30 06:32:22 [auto1.be] INFO: Found listing with ID: FM00077
2026-03-30 06:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM00077%27 HTTP/1.1" 200 None
2026-03-30 06:32:22 [auto1.be] INFO: Scrape type for FM00077: 2
2026-03-30 06:32:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c62131b-6bd9-5295-bb76-6402d0846a1d with identifier: FM00077
2026-03-30 06:32:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c62131b-6bd9-5295-bb76-6402d0846a1d with scrape type 2
2026-03-30 06:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c62131b-6bd9-5295-bb76-6402d0846a1d with scrape type 2
2026-03-30 06:32:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2c62131b-6bd9-5295-bb76-6402d0846a1d, identifier: FM00077
2026-03-30 06:32:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2c62131b-6bd9-5295-bb76-6402d0846a1d with identifier: FM00077
2026-03-30 06:32:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2c62131b-6bd9-5295-bb76-6402d0846a1d with identifier: FM00077
2026-03-30 06:32:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2c62131b-6bd9-5295-bb76-6402d0846a1d with identifier: FM00077 to the API
2026-03-30 06:32:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:04:46Z',
 'fuel_type': 'diesel',
 'id': '2c62131b-6bd9-5295-bb76-6402d0846a1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM00077',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 129301,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-15',
 'seller_name': None,
 'title': 'Audi A1 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2011}
2026-03-30 06:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM00077%27 HTTP/1.1" 200 None
2026-03-30 06:32:22 [auto1.be] INFO: Saving data for FM00077: {'auction_closing_time': 1774883086.0, 'created_time': 1774254698.200148, 'last_price_update_time': 1774852342.567633}
2026-03-30 06:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FM00077') HTTP/1.1" 204 0
2026-03-30 06:32:22 [auto1.be] INFO: Found listing with ID: NS73936
2026-03-30 06:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS73936%27 HTTP/1.1" 200 None
2026-03-30 06:32:22 [auto1.be] INFO: Scrape type for NS73936: 0
2026-03-30 06:32:22 [auto1.be] INFO: Found listing with ID: LY58233
2026-03-30 06:32:22 [auto1.be] INFO: Found listing with ID: XH30316
2026-03-30 06:32:22 [auto1.be] INFO: Found listing with ID: RK82839
2026-03-30 06:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK82839%27 HTTP/1.1" 200 None
2026-03-30 06:32:22 [auto1.be] INFO: Scrape type for RK82839: 2
2026-03-30 06:32:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ff44973-eac5-5cf4-8615-308de1b32056 with identifier: RK82839
2026-03-30 06:32:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ff44973-eac5-5cf4-8615-308de1b32056 with scrape type 2
2026-03-30 06:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ff44973-eac5-5cf4-8615-308de1b32056 with scrape type 2
2026-03-30 06:32:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1ff44973-eac5-5cf4-8615-308de1b32056, identifier: RK82839
2026-03-30 06:32:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:32:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1ff44973-eac5-5cf4-8615-308de1b32056 with identifier: RK82839
2026-03-30 06:32:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1ff44973-eac5-5cf4-8615-308de1b32056 with identifier: RK82839
2026-03-30 06:32:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1ff44973-eac5-5cf4-8615-308de1b32056 with identifier: RK82839 to the API
2026-03-30 06:32:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:41:29Z',
 'fuel_type': 'diesel',
 'id': '1ff44973-eac5-5cf4-8615-308de1b32056',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK82839',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 253653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-05',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI T BlueEfficiency Avantgarde',
 'transmission': 'manual',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2010}
2026-03-30 06:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK82839%27 HTTP/1.1" 200 None
2026-03-30 06:32:23 [auto1.be] INFO: Saving data for RK82839: {'auction_closing_time': 1774885289.0, 'created_time': 1774557030.721367, 'last_price_update_time': 1774852343.085529}
2026-03-30 06:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RK82839') HTTP/1.1" 204 0
2026-03-30 06:32:23 [auto1.be] INFO: Channel: 24h | Page: 25 | totalHits: 1288 | hits on page: 40
2026-03-30 06:32:23 [auto1.be] INFO: Found listing with ID: CN29269
2026-03-30 06:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN29269%27 HTTP/1.1" 200 None
2026-03-30 06:32:23 [auto1.be] INFO: Scrape type for CN29269: 2
2026-03-30 06:32:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef7e5eb2-c2f1-52c0-93dd-b94de7931ba4 with identifier: CN29269
2026-03-30 06:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef7e5eb2-c2f1-52c0-93dd-b94de7931ba4 with scrape type 2
2026-03-30 06:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef7e5eb2-c2f1-52c0-93dd-b94de7931ba4 with scrape type 2
2026-03-30 06:32:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ef7e5eb2-c2f1-52c0-93dd-b94de7931ba4, identifier: CN29269
2026-03-30 06:32:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ef7e5eb2-c2f1-52c0-93dd-b94de7931ba4 with identifier: CN29269
2026-03-30 06:32:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ef7e5eb2-c2f1-52c0-93dd-b94de7931ba4 with identifier: CN29269
2026-03-30 06:32:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ef7e5eb2-c2f1-52c0-93dd-b94de7931ba4 with identifier: CN29269 to the API
2026-03-30 06:32:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:33:37Z',
 'fuel_type': 'diesel',
 'id': 'ef7e5eb2-c2f1-52c0-93dd-b94de7931ba4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN29269',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 143734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-30',
 'seller_name': None,
 'title': 'MINI Countryman Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-30 06:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN29269%27 HTTP/1.1" 200 None
2026-03-30 06:32:23 [auto1.be] INFO: Saving data for CN29269: {'auction_closing_time': 1774884817.0, 'created_time': 1774557184.009502, 'last_price_update_time': 1774852343.49949}
2026-03-30 06:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CN29269') HTTP/1.1" 204 0
2026-03-30 06:32:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:32:23 [auto1.be] INFO: Found listing with ID: HE95946
2026-03-30 06:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE95946%27 HTTP/1.1" 200 None
2026-03-30 06:32:23 [auto1.be] INFO: Scrape type for HE95946: 2
2026-03-30 06:32:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 956b7619-a748-5320-baf7-af177a9a6368 with identifier: HE95946
2026-03-30 06:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 956b7619-a748-5320-baf7-af177a9a6368 with scrape type 2
2026-03-30 06:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 956b7619-a748-5320-baf7-af177a9a6368 with scrape type 2
2026-03-30 06:32:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 956b7619-a748-5320-baf7-af177a9a6368, identifier: HE95946
2026-03-30 06:32:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 956b7619-a748-5320-baf7-af177a9a6368 with identifier: HE95946
2026-03-30 06:32:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 956b7619-a748-5320-baf7-af177a9a6368 with identifier: HE95946
2026-03-30 06:32:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 956b7619-a748-5320-baf7-af177a9a6368 with identifier: HE95946 to the API
2026-03-30 06:32:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:42:40Z',
 'fuel_type': 'petrol',
 'id': '956b7619-a748-5320-baf7-af177a9a6368',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE95946',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 115092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-06',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 06:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE95946%27 HTTP/1.1" 200 None
2026-03-30 06:32:24 [auto1.be] INFO: Saving data for HE95946: {'auction_closing_time': 1774885360.0, 'created_time': 1774557207.996509, 'last_price_update_time': 1774852344.1481}
2026-03-30 06:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HE95946') HTTP/1.1" 204 0
2026-03-30 06:32:24 [auto1.be] INFO: Found listing with ID: BY25509
2026-03-30 06:32:24 [auto1.be] INFO: Found listing with ID: ZN76480
2026-03-30 06:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN76480%27 HTTP/1.1" 200 None
2026-03-30 06:32:24 [auto1.be] INFO: Scrape type for ZN76480: 0
2026-03-30 06:32:24 [auto1.be] INFO: Found listing with ID: TR87241
2026-03-30 06:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR87241%27 HTTP/1.1" 200 None
2026-03-30 06:32:24 [auto1.be] INFO: Scrape type for TR87241: 0
2026-03-30 06:32:24 [auto1.be] INFO: Found listing with ID: PU90284
2026-03-30 06:32:24 [auto1.be] INFO: Found listing with ID: VC92856
2026-03-30 06:32:24 [auto1.be] INFO: Found listing with ID: DJ08738
2026-03-30 06:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ08738%27 HTTP/1.1" 200 None
2026-03-30 06:32:24 [auto1.be] INFO: Scrape type for DJ08738: 0
2026-03-30 06:32:24 [auto1.be] INFO: Found listing with ID: FN69818
2026-03-30 06:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FN69818%27 HTTP/1.1" 200 None
2026-03-30 06:32:24 [auto1.be] INFO: Scrape type for FN69818: 0
2026-03-30 06:32:24 [auto1.be] INFO: Found listing with ID: XB17770
2026-03-30 06:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB17770%27 HTTP/1.1" 200 None
2026-03-30 06:32:24 [auto1.be] INFO: Scrape type for XB17770: 0
2026-03-30 06:32:24 [auto1.be] INFO: Found listing with ID: MV28568
2026-03-30 06:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MV28568%27 HTTP/1.1" 200 None
2026-03-30 06:32:24 [auto1.be] INFO: Scrape type for MV28568: 0
2026-03-30 06:32:24 [auto1.be] INFO: Found listing with ID: SN22557
2026-03-30 06:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN22557%27 HTTP/1.1" 200 None
2026-03-30 06:32:24 [auto1.be] INFO: Scrape type for SN22557: 0
2026-03-30 06:32:24 [auto1.be] INFO: Found listing with ID: FW88759
2026-03-30 06:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW88759%27 HTTP/1.1" 200 None
2026-03-30 06:32:24 [auto1.be] INFO: Scrape type for FW88759: 2
2026-03-30 06:32:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9935248-4413-5eec-a9b4-2094f8739f77 with identifier: FW88759
2026-03-30 06:32:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9935248-4413-5eec-a9b4-2094f8739f77 with scrape type 2
2026-03-30 06:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9935248-4413-5eec-a9b4-2094f8739f77 with scrape type 2
2026-03-30 06:32:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a9935248-4413-5eec-a9b4-2094f8739f77, identifier: FW88759
2026-03-30 06:32:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a9935248-4413-5eec-a9b4-2094f8739f77 with identifier: FW88759
2026-03-30 06:32:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a9935248-4413-5eec-a9b4-2094f8739f77 with identifier: FW88759
2026-03-30 06:32:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a9935248-4413-5eec-a9b4-2094f8739f77 with identifier: FW88759 to the API
2026-03-30 06:32:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:07:35Z',
 'fuel_type': 'diesel',
 'id': 'a9935248-4413-5eec-a9b4-2094f8739f77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW88759',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 119748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-13',
 'seller_name': None,
 'title': 'BMW 2er 216d Gran Tourer Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2017}
2026-03-30 06:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW88759%27 HTTP/1.1" 200 None
2026-03-30 06:32:24 [auto1.be] INFO: Saving data for FW88759: {'auction_closing_time': 1774883255.0, 'created_time': 1774557249.17155, 'last_price_update_time': 1774852344.716039}
2026-03-30 06:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FW88759') HTTP/1.1" 204 0
2026-03-30 06:32:24 [auto1.be] INFO: Found listing with ID: FZ81347
2026-03-30 06:32:24 [auto1.be] INFO: Found listing with ID: CX83686
2026-03-30 06:32:24 [auto1.be] INFO: Found listing with ID: FR50529
2026-03-30 06:32:24 [auto1.be] INFO: Found listing with ID: PS82481
2026-03-30 06:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS82481%27 HTTP/1.1" 200 None
2026-03-30 06:32:24 [auto1.be] INFO: Scrape type for PS82481: 2
2026-03-30 06:32:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41278a24-fa97-598e-8039-834c90c278ad with identifier: PS82481
2026-03-30 06:32:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41278a24-fa97-598e-8039-834c90c278ad with scrape type 2
2026-03-30 06:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41278a24-fa97-598e-8039-834c90c278ad with scrape type 2
2026-03-30 06:32:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 41278a24-fa97-598e-8039-834c90c278ad, identifier: PS82481
2026-03-30 06:32:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 41278a24-fa97-598e-8039-834c90c278ad with identifier: PS82481
2026-03-30 06:32:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 41278a24-fa97-598e-8039-834c90c278ad with identifier: PS82481
2026-03-30 06:32:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 41278a24-fa97-598e-8039-834c90c278ad with identifier: PS82481 to the API
2026-03-30 06:32:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:59:31Z',
 'fuel_type': 'diesel',
 'id': '41278a24-fa97-598e-8039-834c90c278ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS82481',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 101754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-14',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-30 06:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS82481%27 HTTP/1.1" 200 None
2026-03-30 06:32:25 [auto1.be] INFO: Saving data for PS82481: {'auction_closing_time': 1774886371.0, 'created_time': 1774729973.427234, 'last_price_update_time': 1774852345.25337}
2026-03-30 06:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PS82481') HTTP/1.1" 204 0
2026-03-30 06:32:25 [auto1.be] INFO: Found listing with ID: UU07035
2026-03-30 06:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU07035%27 HTTP/1.1" 200 None
2026-03-30 06:32:25 [auto1.be] INFO: Scrape type for UU07035: 0
2026-03-30 06:32:25 [auto1.be] INFO: Found listing with ID: WL68728
2026-03-30 06:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL68728%27 HTTP/1.1" 200 None
2026-03-30 06:32:25 [auto1.be] INFO: Scrape type for WL68728: 2
2026-03-30 06:32:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6dcb4611-7b89-5852-bbde-a372106c0a9d with identifier: WL68728
2026-03-30 06:32:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dcb4611-7b89-5852-bbde-a372106c0a9d with scrape type 2
2026-03-30 06:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6dcb4611-7b89-5852-bbde-a372106c0a9d with scrape type 2
2026-03-30 06:32:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6dcb4611-7b89-5852-bbde-a372106c0a9d, identifier: WL68728
2026-03-30 06:32:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6dcb4611-7b89-5852-bbde-a372106c0a9d with identifier: WL68728
2026-03-30 06:32:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6dcb4611-7b89-5852-bbde-a372106c0a9d with identifier: WL68728
2026-03-30 06:32:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6dcb4611-7b89-5852-bbde-a372106c0a9d with identifier: WL68728 to the API
2026-03-30 06:32:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-30T15:34:16Z',
 'fuel_type': 'petrol',
 'id': '6dcb4611-7b89-5852-bbde-a372106c0a9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL68728',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Almera',
 'odometer': 162154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-05-22',
 'seller_name': None,
 'title': 'Nissan Almera 1.5 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2006}
2026-03-30 06:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL68728%27 HTTP/1.1" 200 None
2026-03-30 06:32:25 [auto1.be] INFO: Saving data for WL68728: {'auction_closing_time': 1774884856.0, 'created_time': 1774557188.44586, 'last_price_update_time': 1774852345.690589}
2026-03-30 06:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WL68728') HTTP/1.1" 204 0
2026-03-30 06:32:25 [auto1.be] INFO: Found listing with ID: MR51068
2026-03-30 06:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR51068%27 HTTP/1.1" 200 None
2026-03-30 06:32:25 [auto1.be] INFO: Scrape type for MR51068: 0
2026-03-30 06:32:25 [auto1.be] INFO: Found listing with ID: PY41942
2026-03-30 06:32:25 [auto1.be] INFO: Found listing with ID: TP16646
2026-03-30 06:32:25 [auto1.be] INFO: Found listing with ID: AZ39903
2026-03-30 06:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AZ39903%27 HTTP/1.1" 200 None
2026-03-30 06:32:25 [auto1.be] INFO: Scrape type for AZ39903: 2
2026-03-30 06:32:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b04a1c9a-af11-5303-808e-64c423bd9d9d with identifier: AZ39903
2026-03-30 06:32:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b04a1c9a-af11-5303-808e-64c423bd9d9d with scrape type 2
2026-03-30 06:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b04a1c9a-af11-5303-808e-64c423bd9d9d with scrape type 2
2026-03-30 06:32:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b04a1c9a-af11-5303-808e-64c423bd9d9d, identifier: AZ39903
2026-03-30 06:32:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b04a1c9a-af11-5303-808e-64c423bd9d9d with identifier: AZ39903
2026-03-30 06:32:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b04a1c9a-af11-5303-808e-64c423bd9d9d with identifier: AZ39903
2026-03-30 06:32:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b04a1c9a-af11-5303-808e-64c423bd9d9d with identifier: AZ39903 to the API
2026-03-30 06:32:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:04:02Z',
 'fuel_type': 'diesel',
 'id': 'b04a1c9a-af11-5303-808e-64c423bd9d9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ39903',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 183821,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-21',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 D3 Momentum Pro 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum Pro 2WD',
 'year': 2020}
2026-03-30 06:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AZ39903%27 HTTP/1.1" 200 None
2026-03-30 06:32:26 [auto1.be] INFO: Saving data for AZ39903: {'auction_closing_time': 1774883042.0, 'created_time': 1774729976.07205, 'last_price_update_time': 1774852346.142656}
2026-03-30 06:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AZ39903') HTTP/1.1" 204 0
2026-03-30 06:32:26 [auto1.be] INFO: Found listing with ID: HB98543
2026-03-30 06:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB98543%27 HTTP/1.1" 200 None
2026-03-30 06:32:26 [auto1.be] INFO: Scrape type for HB98543: 0
2026-03-30 06:32:26 [auto1.be] INFO: Found listing with ID: RU48742
2026-03-30 06:32:26 [auto1.be] INFO: Found listing with ID: DK63787
2026-03-30 06:32:26 [auto1.be] INFO: Found listing with ID: KG87325
2026-03-30 06:32:26 [auto1.be] INFO: Found listing with ID: HU17820
2026-03-30 06:32:26 [auto1.be] INFO: Found listing with ID: NL83155
2026-03-30 06:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NL83155%27 HTTP/1.1" 200 None
2026-03-30 06:32:26 [auto1.be] INFO: Scrape type for NL83155: 0
2026-03-30 06:32:26 [auto1.be] INFO: Found listing with ID: NV75936
2026-03-30 06:32:26 [auto1.be] INFO: Found listing with ID: AW25378
2026-03-30 06:32:26 [auto1.be] INFO: Found listing with ID: PF94112
2026-03-30 06:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF94112%27 HTTP/1.1" 200 None
2026-03-30 06:32:26 [auto1.be] INFO: Scrape type for PF94112: 2
2026-03-30 06:32:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83b1e627-e4bb-5a4c-ad0c-e40a72da9738 with identifier: PF94112
2026-03-30 06:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83b1e627-e4bb-5a4c-ad0c-e40a72da9738 with scrape type 2
2026-03-30 06:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83b1e627-e4bb-5a4c-ad0c-e40a72da9738 with scrape type 2
2026-03-30 06:32:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 83b1e627-e4bb-5a4c-ad0c-e40a72da9738, identifier: PF94112
2026-03-30 06:32:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 83b1e627-e4bb-5a4c-ad0c-e40a72da9738 with identifier: PF94112
2026-03-30 06:32:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 83b1e627-e4bb-5a4c-ad0c-e40a72da9738 with identifier: PF94112
2026-03-30 06:32:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 83b1e627-e4bb-5a4c-ad0c-e40a72da9738 with identifier: PF94112 to the API
2026-03-30 06:32:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:16:05Z',
 'fuel_type': 'diesel',
 'id': '83b1e627-e4bb-5a4c-ad0c-e40a72da9738',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF94112',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 237312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-07',
 'seller_name': None,
 'title': 'Skoda Superb 1.6 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2017}
2026-03-30 06:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PF94112%27 HTTP/1.1" 200 None
2026-03-30 06:32:26 [auto1.be] INFO: Saving data for PF94112: {'auction_closing_time': 1774883765.0, 'created_time': 1774730017.923611, 'last_price_update_time': 1774852346.583577}
2026-03-30 06:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PF94112') HTTP/1.1" 204 0
2026-03-30 06:32:26 [auto1.be] INFO: Found listing with ID: XT95399
2026-03-30 06:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT95399%27 HTTP/1.1" 200 None
2026-03-30 06:32:26 [auto1.be] INFO: Scrape type for XT95399: 2
2026-03-30 06:32:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e12fc53b-c065-5571-8c64-bac63f333f11 with identifier: XT95399
2026-03-30 06:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e12fc53b-c065-5571-8c64-bac63f333f11 with scrape type 2
2026-03-30 06:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e12fc53b-c065-5571-8c64-bac63f333f11 with scrape type 2
2026-03-30 06:32:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e12fc53b-c065-5571-8c64-bac63f333f11, identifier: XT95399
2026-03-30 06:32:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e12fc53b-c065-5571-8c64-bac63f333f11 with identifier: XT95399
2026-03-30 06:32:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e12fc53b-c065-5571-8c64-bac63f333f11 with identifier: XT95399
2026-03-30 06:32:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e12fc53b-c065-5571-8c64-bac63f333f11 with identifier: XT95399 to the API
2026-03-30 06:32:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:43:39Z',
 'fuel_type': 'diesel',
 'id': 'e12fc53b-c065-5571-8c64-bac63f333f11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT95399',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 126892,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-04',
 'seller_name': None,
 'title': 'MINI One D',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-30 06:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT95399%27 HTTP/1.1" 200 None
2026-03-30 06:32:27 [auto1.be] INFO: Saving data for XT95399: {'auction_closing_time': 1774885419.0, 'created_time': 1774729999.552872, 'last_price_update_time': 1774852347.076861}
2026-03-30 06:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XT95399') HTTP/1.1" 204 0
2026-03-30 06:32:27 [auto1.be] INFO: Found listing with ID: NT98676
2026-03-30 06:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NT98676%27 HTTP/1.1" 200 None
2026-03-30 06:32:27 [auto1.be] INFO: Scrape type for NT98676: 0
2026-03-30 06:32:27 [auto1.be] INFO: Found listing with ID: ZA12378
2026-03-30 06:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZA12378%27 HTTP/1.1" 200 None
2026-03-30 06:32:27 [auto1.be] INFO: Scrape type for ZA12378: 2
2026-03-30 06:32:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15a73ce5-f4a7-5335-9066-4ffe26b9dfb8 with identifier: ZA12378
2026-03-30 06:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15a73ce5-f4a7-5335-9066-4ffe26b9dfb8 with scrape type 2
2026-03-30 06:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15a73ce5-f4a7-5335-9066-4ffe26b9dfb8 with scrape type 2
2026-03-30 06:32:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 15a73ce5-f4a7-5335-9066-4ffe26b9dfb8, identifier: ZA12378
2026-03-30 06:32:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 15a73ce5-f4a7-5335-9066-4ffe26b9dfb8 with identifier: ZA12378
2026-03-30 06:32:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 15a73ce5-f4a7-5335-9066-4ffe26b9dfb8 with identifier: ZA12378
2026-03-30 06:32:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 15a73ce5-f4a7-5335-9066-4ffe26b9dfb8 with identifier: ZA12378 to the API
2026-03-30 06:32:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:30:22Z',
 'fuel_type': 'diesel',
 'id': '15a73ce5-f4a7-5335-9066-4ffe26b9dfb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA12378',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 238854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-03',
 'seller_name': None,
 'title': 'Peugeot 207 1.4 HDi Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2010}
2026-03-30 06:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZA12378%27 HTTP/1.1" 200 None
2026-03-30 06:32:27 [auto1.be] INFO: Saving data for ZA12378: {'auction_closing_time': 1774884622.0, 'created_time': 1774730000.321149, 'last_price_update_time': 1774852347.490111}
2026-03-30 06:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZA12378') HTTP/1.1" 204 0
2026-03-30 06:32:27 [auto1.be] INFO: Found listing with ID: LS82290
2026-03-30 06:32:27 [auto1.be] INFO: Found listing with ID: FJ54867
2026-03-30 06:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ54867%27 HTTP/1.1" 200 None
2026-03-30 06:32:27 [auto1.be] INFO: Scrape type for FJ54867: 2
2026-03-30 06:32:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e54d7cb2-a45d-586c-b50d-b1bb0e237b1e with identifier: FJ54867
2026-03-30 06:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e54d7cb2-a45d-586c-b50d-b1bb0e237b1e with scrape type 2
2026-03-30 06:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e54d7cb2-a45d-586c-b50d-b1bb0e237b1e with scrape type 2
2026-03-30 06:32:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e54d7cb2-a45d-586c-b50d-b1bb0e237b1e, identifier: FJ54867
2026-03-30 06:32:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e54d7cb2-a45d-586c-b50d-b1bb0e237b1e with identifier: FJ54867
2026-03-30 06:32:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e54d7cb2-a45d-586c-b50d-b1bb0e237b1e with identifier: FJ54867
2026-03-30 06:32:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e54d7cb2-a45d-586c-b50d-b1bb0e237b1e with identifier: FJ54867 to the API
2026-03-30 06:32:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:53:12Z',
 'fuel_type': 'petrol',
 'id': 'e54d7cb2-a45d-586c-b50d-b1bb0e237b1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ54867',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 53396,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-26',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 BlueEfficiency Style',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Style',
 'year': 2017}
2026-03-30 06:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ54867%27 HTTP/1.1" 200 None
2026-03-30 06:32:27 [auto1.be] INFO: Saving data for FJ54867: {'auction_closing_time': 1774885992.0, 'created_time': 1774729974.158719, 'last_price_update_time': 1774852347.878736}
2026-03-30 06:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FJ54867') HTTP/1.1" 204 0
2026-03-30 06:32:27 [auto1.be] INFO: Found listing with ID: CM51817
2026-03-30 06:32:27 [auto1.be] INFO: Found listing with ID: KD88013
2026-03-30 06:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD88013%27 HTTP/1.1" 200 None
2026-03-30 06:32:27 [auto1.be] INFO: Scrape type for KD88013: 2
2026-03-30 06:32:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c958f8e7-3b3a-5bc5-a61a-08eebae96932 with identifier: KD88013
2026-03-30 06:32:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c958f8e7-3b3a-5bc5-a61a-08eebae96932 with scrape type 2
2026-03-30 06:32:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c958f8e7-3b3a-5bc5-a61a-08eebae96932 with scrape type 2
2026-03-30 06:32:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c958f8e7-3b3a-5bc5-a61a-08eebae96932, identifier: KD88013
2026-03-30 06:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c958f8e7-3b3a-5bc5-a61a-08eebae96932 with identifier: KD88013
2026-03-30 06:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c958f8e7-3b3a-5bc5-a61a-08eebae96932 with identifier: KD88013
2026-03-30 06:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c958f8e7-3b3a-5bc5-a61a-08eebae96932 with identifier: KD88013 to the API
2026-03-30 06:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:42:50Z',
 'fuel_type': 'petrol',
 'id': 'c958f8e7-3b3a-5bc5-a61a-08eebae96932',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD88013',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Grande Punto',
 'odometer': 231113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-29',
 'seller_name': None,
 'title': 'Fiat Grande Punto 1.2 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2012}
2026-03-30 06:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD88013%27 HTTP/1.1" 200 None
2026-03-30 06:32:28 [auto1.be] INFO: Saving data for KD88013: {'auction_closing_time': 1774885370.0, 'created_time': 1774729967.602582, 'last_price_update_time': 1774852348.300237}
2026-03-30 06:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KD88013') HTTP/1.1" 204 0
2026-03-30 06:32:28 [auto1.be] INFO: Found listing with ID: YY44687
2026-03-30 06:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YY44687%27 HTTP/1.1" 200 None
2026-03-30 06:32:28 [auto1.be] INFO: Scrape type for YY44687: 2
2026-03-30 06:32:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bdb769a-0e22-516c-aee5-02d7c62683f1 with identifier: YY44687
2026-03-30 06:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bdb769a-0e22-516c-aee5-02d7c62683f1 with scrape type 2
2026-03-30 06:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bdb769a-0e22-516c-aee5-02d7c62683f1 with scrape type 2
2026-03-30 06:32:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5bdb769a-0e22-516c-aee5-02d7c62683f1, identifier: YY44687
2026-03-30 06:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5bdb769a-0e22-516c-aee5-02d7c62683f1 with identifier: YY44687
2026-03-30 06:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5bdb769a-0e22-516c-aee5-02d7c62683f1 with identifier: YY44687
2026-03-30 06:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5bdb769a-0e22-516c-aee5-02d7c62683f1 with identifier: YY44687 to the API
2026-03-30 06:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:29:19Z',
 'fuel_type': 'petrol',
 'id': '5bdb769a-0e22-516c-aee5-02d7c62683f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY44687',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'B-Max',
 'odometer': 82738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-24',
 'seller_name': None,
 'title': 'Ford B-Max 1.0 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2017}
2026-03-30 06:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YY44687%27 HTTP/1.1" 200 None
2026-03-30 06:32:28 [auto1.be] INFO: Saving data for YY44687: {'auction_closing_time': 1774884559.0, 'created_time': 1774729950.713936, 'last_price_update_time': 1774852348.709025}
2026-03-30 06:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YY44687') HTTP/1.1" 204 0
2026-03-30 06:32:28 [auto1.be] INFO: Channel: 24h | Page: 26 | totalHits: 1288 | hits on page: 40
2026-03-30 06:32:28 [auto1.be] INFO: Found listing with ID: BX66623
2026-03-30 06:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX66623%27 HTTP/1.1" 200 None
2026-03-30 06:32:28 [auto1.be] INFO: Scrape type for BX66623: 0
2026-03-30 06:32:28 [auto1.be] INFO: Found listing with ID: DM24490
2026-03-30 06:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM24490%27 HTTP/1.1" 200 None
2026-03-30 06:32:28 [auto1.be] INFO: Scrape type for DM24490: 2
2026-03-30 06:32:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fbdb8be-a155-52e5-908e-73e7f9e9a06c with identifier: DM24490
2026-03-30 06:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fbdb8be-a155-52e5-908e-73e7f9e9a06c with scrape type 2
2026-03-30 06:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fbdb8be-a155-52e5-908e-73e7f9e9a06c with scrape type 2
2026-03-30 06:32:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1fbdb8be-a155-52e5-908e-73e7f9e9a06c, identifier: DM24490
2026-03-30 06:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1fbdb8be-a155-52e5-908e-73e7f9e9a06c with identifier: DM24490
2026-03-30 06:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1fbdb8be-a155-52e5-908e-73e7f9e9a06c with identifier: DM24490
2026-03-30 06:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1fbdb8be-a155-52e5-908e-73e7f9e9a06c with identifier: DM24490 to the API
2026-03-30 06:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:18:59Z',
 'fuel_type': 'petrol',
 'id': '1fbdb8be-a155-52e5-908e-73e7f9e9a06c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM24490',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 46570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-29',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Color Edition',
 'transmission': 'manual',
 'trim': 'Color Edition',
 'year': 2019}
2026-03-30 06:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM24490%27 HTTP/1.1" 200 None
2026-03-30 06:32:29 [auto1.be] INFO: Saving data for DM24490: {'auction_closing_time': 1774883939.0, 'created_time': 1774729948.711558, 'last_price_update_time': 1774852349.13244}
2026-03-30 06:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DM24490') HTTP/1.1" 204 0
2026-03-30 06:32:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:32:29 [auto1.be] INFO: Found listing with ID: PM87207
2026-03-30 06:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM87207%27 HTTP/1.1" 200 None
2026-03-30 06:32:29 [auto1.be] INFO: Scrape type for PM87207: 2
2026-03-30 06:32:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02338559-0b33-5b9d-b66c-1ac2772b474f with identifier: PM87207
2026-03-30 06:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02338559-0b33-5b9d-b66c-1ac2772b474f with scrape type 2
2026-03-30 06:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02338559-0b33-5b9d-b66c-1ac2772b474f with scrape type 2
2026-03-30 06:32:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 02338559-0b33-5b9d-b66c-1ac2772b474f, identifier: PM87207
2026-03-30 06:32:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 02338559-0b33-5b9d-b66c-1ac2772b474f with identifier: PM87207
2026-03-30 06:32:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 02338559-0b33-5b9d-b66c-1ac2772b474f with identifier: PM87207
2026-03-30 06:32:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 02338559-0b33-5b9d-b66c-1ac2772b474f with identifier: PM87207 to the API
2026-03-30 06:32:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 91,
 'expiration_date': '2026-03-30T15:55:02Z',
 'fuel_type': 'petrol',
 'id': '02338559-0b33-5b9d-b66c-1ac2772b474f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM87207',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 91555,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-14',
 'seller_name': None,
 'title': 'Renault Captur 1.0 TCe Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2021}
2026-03-30 06:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM87207%27 HTTP/1.1" 200 None
2026-03-30 06:32:29 [auto1.be] INFO: Saving data for PM87207: {'auction_closing_time': 1774886102.0, 'created_time': 1774729962.292999, 'last_price_update_time': 1774852349.515826}
2026-03-30 06:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PM87207') HTTP/1.1" 204 0
2026-03-30 06:32:29 [auto1.be] INFO: Found listing with ID: RD23593
2026-03-30 06:32:29 [auto1.be] INFO: Found listing with ID: XW30503
2026-03-30 06:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XW30503%27 HTTP/1.1" 200 None
2026-03-30 06:32:29 [auto1.be] INFO: Scrape type for XW30503: 2
2026-03-30 06:32:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c0f2cb4-1123-521d-b42d-39ab21270083 with identifier: XW30503
2026-03-30 06:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c0f2cb4-1123-521d-b42d-39ab21270083 with scrape type 2
2026-03-30 06:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c0f2cb4-1123-521d-b42d-39ab21270083 with scrape type 2
2026-03-30 06:32:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3c0f2cb4-1123-521d-b42d-39ab21270083, identifier: XW30503
2026-03-30 06:32:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3c0f2cb4-1123-521d-b42d-39ab21270083 with identifier: XW30503
2026-03-30 06:32:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3c0f2cb4-1123-521d-b42d-39ab21270083 with identifier: XW30503
2026-03-30 06:32:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3c0f2cb4-1123-521d-b42d-39ab21270083 with identifier: XW30503 to the API
2026-03-30 06:32:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:18:49Z',
 'fuel_type': 'hybrid',
 'id': '3c0f2cb4-1123-521d-b42d-39ab21270083',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW30503',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris Touring Sports',
 'odometer': 138252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-05',
 'seller_name': None,
 'title': 'Toyota Auris Touring Sports 1.8 Hybrid Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2014}
2026-03-30 06:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XW30503%27 HTTP/1.1" 200 None
2026-03-30 06:32:30 [auto1.be] INFO: Saving data for XW30503: {'auction_closing_time': 1774883929.0, 'created_time': 1774729951.972752, 'last_price_update_time': 1774852350.050562}
2026-03-30 06:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XW30503') HTTP/1.1" 204 0
2026-03-30 06:32:30 [auto1.be] INFO: Found listing with ID: GD95033
2026-03-30 06:32:30 [auto1.be] INFO: Found listing with ID: UE36464
2026-03-30 06:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE36464%27 HTTP/1.1" 200 None
2026-03-30 06:32:30 [auto1.be] INFO: Scrape type for UE36464: 0
2026-03-30 06:32:30 [auto1.be] INFO: Found listing with ID: ER02883
2026-03-30 06:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER02883%27 HTTP/1.1" 200 None
2026-03-30 06:32:30 [auto1.be] INFO: Scrape type for ER02883: 0
2026-03-30 06:32:30 [auto1.be] INFO: Found listing with ID: LG99308
2026-03-30 06:32:30 [auto1.be] INFO: Found listing with ID: KW17867
2026-03-30 06:32:30 [auto1.be] INFO: Found listing with ID: HT18059
2026-03-30 06:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT18059%27 HTTP/1.1" 200 None
2026-03-30 06:32:30 [auto1.be] INFO: Scrape type for HT18059: 0
2026-03-30 06:32:30 [auto1.be] INFO: Found listing with ID: PE64709
2026-03-30 06:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE64709%27 HTTP/1.1" 200 None
2026-03-30 06:32:30 [auto1.be] INFO: Scrape type for PE64709: 0
2026-03-30 06:32:30 [auto1.be] INFO: Found listing with ID: HS15781
2026-03-30 06:32:30 [auto1.be] INFO: Found listing with ID: HT80629
2026-03-30 06:32:30 [auto1.be] INFO: Found listing with ID: FT23017
2026-03-30 06:32:30 [auto1.be] INFO: Found listing with ID: ZM05640
2026-03-30 06:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM05640%27 HTTP/1.1" 200 None
2026-03-30 06:32:30 [auto1.be] INFO: Scrape type for ZM05640: 0
2026-03-30 06:32:30 [auto1.be] INFO: Found listing with ID: KT01454
2026-03-30 06:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT01454%27 HTTP/1.1" 200 None
2026-03-30 06:32:30 [auto1.be] INFO: Scrape type for KT01454: 0
2026-03-30 06:32:30 [auto1.be] INFO: Found listing with ID: AC59433
2026-03-30 06:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AC59433%27 HTTP/1.1" 200 None
2026-03-30 06:32:30 [auto1.be] INFO: Scrape type for AC59433: 0
2026-03-30 06:32:30 [auto1.be] INFO: Found listing with ID: MY75694
2026-03-30 06:32:30 [auto1.be] INFO: Found listing with ID: LH19076
2026-03-30 06:32:30 [auto1.be] INFO: Found listing with ID: GM68229
2026-03-30 06:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM68229%27 HTTP/1.1" 200 None
2026-03-30 06:32:30 [auto1.be] INFO: Scrape type for GM68229: 0
2026-03-30 06:32:30 [auto1.be] INFO: Found listing with ID: LK30146
2026-03-30 06:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK30146%27 HTTP/1.1" 200 None
2026-03-30 06:32:30 [auto1.be] INFO: Scrape type for LK30146: 2
2026-03-30 06:32:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d58dff96-1158-5453-986d-328659d0c2af with identifier: LK30146
2026-03-30 06:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d58dff96-1158-5453-986d-328659d0c2af with scrape type 2
2026-03-30 06:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d58dff96-1158-5453-986d-328659d0c2af with scrape type 2
2026-03-30 06:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d58dff96-1158-5453-986d-328659d0c2af, identifier: LK30146
2026-03-30 06:32:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d58dff96-1158-5453-986d-328659d0c2af with identifier: LK30146
2026-03-30 06:32:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d58dff96-1158-5453-986d-328659d0c2af with identifier: LK30146
2026-03-30 06:32:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d58dff96-1158-5453-986d-328659d0c2af with identifier: LK30146 to the API
2026-03-30 06:32:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:26:24Z',
 'fuel_type': 'petrol',
 'id': 'd58dff96-1158-5453-986d-328659d0c2af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK30146',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 112585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-09',
 'seller_name': None,
 'title': 'MINI John Cooper Works',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 06:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK30146%27 HTTP/1.1" 200 None
2026-03-30 06:32:30 [auto1.be] INFO: Saving data for LK30146: {'auction_closing_time': 1774884384.0, 'created_time': 1774729980.255402, 'last_price_update_time': 1774852350.605171}
2026-03-30 06:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LK30146') HTTP/1.1" 204 0
2026-03-30 06:32:30 [auto1.be] INFO: Found listing with ID: TF49476
2026-03-30 06:32:30 [auto1.be] INFO: Found listing with ID: FT86060
2026-03-30 06:32:30 [auto1.be] INFO: Found listing with ID: JT63704
2026-03-30 06:32:30 [auto1.be] INFO: Found listing with ID: UA37218
2026-03-30 06:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA37218%27 HTTP/1.1" 200 None
2026-03-30 06:32:30 [auto1.be] INFO: Scrape type for UA37218: 2
2026-03-30 06:32:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d65e732f-ddab-5322-9b1d-2e479a8f605e with identifier: UA37218
2026-03-30 06:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d65e732f-ddab-5322-9b1d-2e479a8f605e with scrape type 2
2026-03-30 06:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d65e732f-ddab-5322-9b1d-2e479a8f605e with scrape type 2
2026-03-30 06:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d65e732f-ddab-5322-9b1d-2e479a8f605e, identifier: UA37218
2026-03-30 06:32:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d65e732f-ddab-5322-9b1d-2e479a8f605e with identifier: UA37218
2026-03-30 06:32:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d65e732f-ddab-5322-9b1d-2e479a8f605e with identifier: UA37218
2026-03-30 06:32:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d65e732f-ddab-5322-9b1d-2e479a8f605e with identifier: UA37218 to the API
2026-03-30 06:32:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:00Z',
 'fuel_type': 'diesel',
 'id': 'd65e732f-ddab-5322-9b1d-2e479a8f605e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA37218',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 134979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-11',
 'seller_name': None,
 'title': 'Opel Vivaro 2.0 Diesel L Edition L3',
 'transmission': 'manual',
 'trim': 'L Edition L3',
 'year': 2020}
2026-03-30 06:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA37218%27 HTTP/1.1" 200 None
2026-03-30 06:32:31 [auto1.be] INFO: Saving data for UA37218: {'auction_closing_time': 1774885680.0, 'created_time': 1774729982.917112, 'last_price_update_time': 1774852351.427579}
2026-03-30 06:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UA37218') HTTP/1.1" 204 0
2026-03-30 06:32:31 [auto1.be] INFO: Found listing with ID: SX16585
2026-03-30 06:32:31 [auto1.be] INFO: Found listing with ID: TF43790
2026-03-30 06:32:31 [auto1.be] INFO: Found listing with ID: NZ75648
2026-03-30 06:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ75648%27 HTTP/1.1" 200 None
2026-03-30 06:32:31 [auto1.be] INFO: Scrape type for NZ75648: 2
2026-03-30 06:32:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5094a600-a4f5-549d-b3b6-6a01d4eddcec with identifier: NZ75648
2026-03-30 06:32:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5094a600-a4f5-549d-b3b6-6a01d4eddcec with scrape type 2
2026-03-30 06:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5094a600-a4f5-549d-b3b6-6a01d4eddcec with scrape type 2
2026-03-30 06:32:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5094a600-a4f5-549d-b3b6-6a01d4eddcec, identifier: NZ75648
2026-03-30 06:32:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5094a600-a4f5-549d-b3b6-6a01d4eddcec with identifier: NZ75648
2026-03-30 06:32:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5094a600-a4f5-549d-b3b6-6a01d4eddcec with identifier: NZ75648
2026-03-30 06:32:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5094a600-a4f5-549d-b3b6-6a01d4eddcec with identifier: NZ75648 to the API
2026-03-30 06:32:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 152,
 'expiration_date': '2026-03-30T15:38:11Z',
 'fuel_type': 'diesel',
 'id': '5094a600-a4f5-549d-b3b6-6a01d4eddcec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ75648',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Freelander',
 'odometer': 206189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-16',
 'seller_name': None,
 'title': 'Land Rover Freelander 2.2 Td4 S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2014}
2026-03-30 06:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ75648%27 HTTP/1.1" 200 None
2026-03-30 06:32:31 [auto1.be] INFO: Saving data for NZ75648: {'auction_closing_time': 1774885091.0, 'created_time': 1774729979.904286, 'last_price_update_time': 1774852351.90261}
2026-03-30 06:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NZ75648') HTTP/1.1" 204 0
2026-03-30 06:32:31 [auto1.be] INFO: Found listing with ID: ER91021
2026-03-30 06:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER91021%27 HTTP/1.1" 200 None
2026-03-30 06:32:31 [auto1.be] INFO: Scrape type for ER91021: 2
2026-03-30 06:32:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f139f460-7c0e-5587-909d-b55d1a4b326e with identifier: ER91021
2026-03-30 06:32:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f139f460-7c0e-5587-909d-b55d1a4b326e with scrape type 2
2026-03-30 06:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f139f460-7c0e-5587-909d-b55d1a4b326e with scrape type 2
2026-03-30 06:32:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f139f460-7c0e-5587-909d-b55d1a4b326e, identifier: ER91021
2026-03-30 06:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f139f460-7c0e-5587-909d-b55d1a4b326e with identifier: ER91021
2026-03-30 06:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f139f460-7c0e-5587-909d-b55d1a4b326e with identifier: ER91021
2026-03-30 06:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f139f460-7c0e-5587-909d-b55d1a4b326e with identifier: ER91021 to the API
2026-03-30 06:32:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:26:03Z',
 'fuel_type': 'diesel',
 'id': 'f139f460-7c0e-5587-909d-b55d1a4b326e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER91021',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 184786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-10',
 'seller_name': None,
 'title': 'Renault Kadjar 1.6 dCi Energy Bose Edition',
 'transmission': 'manual',
 'trim': 'Bose Edition',
 'year': 2015}
2026-03-30 06:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER91021%27 HTTP/1.1" 200 None
2026-03-30 06:32:32 [auto1.be] INFO: Saving data for ER91021: {'auction_closing_time': 1774884363.0, 'created_time': 1774729995.239772, 'last_price_update_time': 1774852352.277483}
2026-03-30 06:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ER91021') HTTP/1.1" 204 0
2026-03-30 06:32:32 [auto1.be] INFO: Found listing with ID: LF44164
2026-03-30 06:32:32 [auto1.be] INFO: Found listing with ID: SV00163
2026-03-30 06:32:32 [auto1.be] INFO: Found listing with ID: EM88075
2026-03-30 06:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM88075%27 HTTP/1.1" 200 None
2026-03-30 06:32:32 [auto1.be] INFO: Scrape type for EM88075: 2
2026-03-30 06:32:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebacc93e-63fe-5bb6-a00d-c7af44fbed3e with identifier: EM88075
2026-03-30 06:32:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebacc93e-63fe-5bb6-a00d-c7af44fbed3e with scrape type 2
2026-03-30 06:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebacc93e-63fe-5bb6-a00d-c7af44fbed3e with scrape type 2
2026-03-30 06:32:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ebacc93e-63fe-5bb6-a00d-c7af44fbed3e, identifier: EM88075
2026-03-30 06:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ebacc93e-63fe-5bb6-a00d-c7af44fbed3e with identifier: EM88075
2026-03-30 06:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ebacc93e-63fe-5bb6-a00d-c7af44fbed3e with identifier: EM88075
2026-03-30 06:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ebacc93e-63fe-5bb6-a00d-c7af44fbed3e with identifier: EM88075 to the API
2026-03-30 06:32:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:43:58Z',
 'fuel_type': 'diesel',
 'id': 'ebacc93e-63fe-5bb6-a00d-c7af44fbed3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM88075',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 212145,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-30',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Rapid Extra',
 'transmission': 'manual',
 'trim': 'Rapid Extra',
 'year': 2009}
2026-03-30 06:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM88075%27 HTTP/1.1" 200 None
2026-03-30 06:32:32 [auto1.be] INFO: Saving data for EM88075: {'auction_closing_time': 1774885438.0, 'created_time': 1774729977.303312, 'last_price_update_time': 1774852352.661687}
2026-03-30 06:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EM88075') HTTP/1.1" 204 0
2026-03-30 06:32:32 [auto1.be] INFO: Found listing with ID: VM07385
2026-03-30 06:32:32 [auto1.be] INFO: Found listing with ID: WC19794
2026-03-30 06:32:32 [auto1.be] INFO: Found listing with ID: UV16393
2026-03-30 06:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UV16393%27 HTTP/1.1" 200 None
2026-03-30 06:32:32 [auto1.be] INFO: Scrape type for UV16393: 0
2026-03-30 06:32:32 [auto1.be] INFO: Found listing with ID: AY92488
2026-03-30 06:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY92488%27 HTTP/1.1" 200 None
2026-03-30 06:32:32 [auto1.be] INFO: Scrape type for AY92488: 2
2026-03-30 06:32:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d2b7495-0d90-542a-8905-9bebf4522d2d with identifier: AY92488
2026-03-30 06:32:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d2b7495-0d90-542a-8905-9bebf4522d2d with scrape type 2
2026-03-30 06:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d2b7495-0d90-542a-8905-9bebf4522d2d with scrape type 2
2026-03-30 06:32:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7d2b7495-0d90-542a-8905-9bebf4522d2d, identifier: AY92488
2026-03-30 06:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7d2b7495-0d90-542a-8905-9bebf4522d2d with identifier: AY92488
2026-03-30 06:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7d2b7495-0d90-542a-8905-9bebf4522d2d with identifier: AY92488
2026-03-30 06:32:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7d2b7495-0d90-542a-8905-9bebf4522d2d with identifier: AY92488 to the API
2026-03-30 06:32:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:00:38Z',
 'fuel_type': 'petrol',
 'id': '7d2b7495-0d90-542a-8905-9bebf4522d2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY92488',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 62043,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-05',
 'seller_name': None,
 'title': 'BMW 1er 118i Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2020}
2026-03-30 06:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY92488%27 HTTP/1.1" 200 None
2026-03-30 06:32:33 [auto1.be] INFO: Saving data for AY92488: {'auction_closing_time': 1774882838.0, 'created_time': 1774729997.656774, 'last_price_update_time': 1774852353.19314}
2026-03-30 06:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AY92488') HTTP/1.1" 204 0
2026-03-30 06:32:33 [auto1.be] INFO: Found listing with ID: SB51494
2026-03-30 06:32:33 [auto1.be] INFO: Found listing with ID: KM81672
2026-03-30 06:32:33 [auto1.be] INFO: Found listing with ID: JC37428
2026-03-30 06:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:32:41 [auto1.be] INFO: Channel: 24h | Page: 27 | totalHits: 1288 | hits on page: 40
2026-03-30 06:32:41 [auto1.be] INFO: Found listing with ID: RL22884
2026-03-30 06:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL22884%27 HTTP/1.1" 200 None
2026-03-30 06:32:41 [auto1.be] INFO: Scrape type for RL22884: 2
2026-03-30 06:32:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e2fab90-4194-567b-8cab-62e6e9403f2b with identifier: RL22884
2026-03-30 06:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e2fab90-4194-567b-8cab-62e6e9403f2b with scrape type 2
2026-03-30 06:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e2fab90-4194-567b-8cab-62e6e9403f2b with scrape type 2
2026-03-30 06:32:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9e2fab90-4194-567b-8cab-62e6e9403f2b, identifier: RL22884
2026-03-30 06:32:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9e2fab90-4194-567b-8cab-62e6e9403f2b with identifier: RL22884
2026-03-30 06:32:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9e2fab90-4194-567b-8cab-62e6e9403f2b with identifier: RL22884
2026-03-30 06:32:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9e2fab90-4194-567b-8cab-62e6e9403f2b with identifier: RL22884 to the API
2026-03-30 06:32:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:45:34Z',
 'fuel_type': 'petrol',
 'id': '9e2fab90-4194-567b-8cab-62e6e9403f2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL22884',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 93212,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-21',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-30 06:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL22884%27 HTTP/1.1" 200 None
2026-03-30 06:32:42 [auto1.be] INFO: Saving data for RL22884: {'auction_closing_time': 1774885534.0, 'created_time': 1774729974.985118, 'last_price_update_time': 1774852362.114201}
2026-03-30 06:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RL22884') HTTP/1.1" 204 0
2026-03-30 06:32:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:32:42 [auto1.be] INFO: Found listing with ID: WH35268
2026-03-30 06:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH35268%27 HTTP/1.1" 200 None
2026-03-30 06:32:42 [auto1.be] INFO: Scrape type for WH35268: 2
2026-03-30 06:32:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e35350d4-7593-59dd-b84c-706984af7884 with identifier: WH35268
2026-03-30 06:32:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e35350d4-7593-59dd-b84c-706984af7884 with scrape type 2
2026-03-30 06:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e35350d4-7593-59dd-b84c-706984af7884 with scrape type 2
2026-03-30 06:32:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e35350d4-7593-59dd-b84c-706984af7884, identifier: WH35268
2026-03-30 06:32:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e35350d4-7593-59dd-b84c-706984af7884 with identifier: WH35268
2026-03-30 06:32:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e35350d4-7593-59dd-b84c-706984af7884 with identifier: WH35268
2026-03-30 06:32:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e35350d4-7593-59dd-b84c-706984af7884 with identifier: WH35268 to the API
2026-03-30 06:32:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:22:16Z',
 'fuel_type': 'diesel',
 'id': 'e35350d4-7593-59dd-b84c-706984af7884',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH35268',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 74285,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-27',
 'seller_name': None,
 'title': 'Toyota Yaris 1.4 D-4D Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2014}
2026-03-30 06:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH35268%27 HTTP/1.1" 200 None
2026-03-30 06:32:42 [auto1.be] INFO: Saving data for WH35268: {'auction_closing_time': 1774884136.0, 'created_time': 1774729990.69535, 'last_price_update_time': 1774852362.477517}
2026-03-30 06:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WH35268') HTTP/1.1" 204 0
2026-03-30 06:32:42 [auto1.be] INFO: Found listing with ID: DZ29736
2026-03-30 06:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ29736%27 HTTP/1.1" 200 None
2026-03-30 06:32:42 [auto1.be] INFO: Scrape type for DZ29736: 2
2026-03-30 06:32:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 293849fa-2ab7-506d-935d-9c24abc49862 with identifier: DZ29736
2026-03-30 06:32:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 293849fa-2ab7-506d-935d-9c24abc49862 with scrape type 2
2026-03-30 06:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 293849fa-2ab7-506d-935d-9c24abc49862 with scrape type 2
2026-03-30 06:32:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 293849fa-2ab7-506d-935d-9c24abc49862, identifier: DZ29736
2026-03-30 06:32:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 293849fa-2ab7-506d-935d-9c24abc49862 with identifier: DZ29736
2026-03-30 06:32:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 293849fa-2ab7-506d-935d-9c24abc49862 with identifier: DZ29736
2026-03-30 06:32:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 293849fa-2ab7-506d-935d-9c24abc49862 with identifier: DZ29736 to the API
2026-03-30 06:32:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:17:37Z',
 'fuel_type': 'diesel',
 'id': '293849fa-2ab7-506d-935d-9c24abc49862',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ29736',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 182116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-25',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 d BlueTEC Avantgarde',
 'transmission': 'manual',
 'trim': 'BlueTEC Avantgarde',
 'year': 2016}
2026-03-30 06:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ29736%27 HTTP/1.1" 200 None
2026-03-30 06:32:42 [auto1.be] INFO: Saving data for DZ29736: {'auction_closing_time': 1774883857.0, 'created_time': 1774729997.260891, 'last_price_update_time': 1774852362.88821}
2026-03-30 06:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DZ29736') HTTP/1.1" 204 0
2026-03-30 06:32:42 [auto1.be] INFO: Found listing with ID: BT48733
2026-03-30 06:32:42 [auto1.be] INFO: Found listing with ID: JM52918
2026-03-30 06:32:42 [auto1.be] INFO: Found listing with ID: PJ47204
2026-03-30 06:32:42 [auto1.be] INFO: Found listing with ID: WV93881
2026-03-30 06:32:42 [auto1.be] INFO: Found listing with ID: ZN30582
2026-03-30 06:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN30582%27 HTTP/1.1" 200 None
2026-03-30 06:32:42 [auto1.be] INFO: Scrape type for ZN30582: 2
2026-03-30 06:32:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb7cc53d-141f-5a8a-ba9f-c466980f1059 with identifier: ZN30582
2026-03-30 06:32:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb7cc53d-141f-5a8a-ba9f-c466980f1059 with scrape type 2
2026-03-30 06:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb7cc53d-141f-5a8a-ba9f-c466980f1059 with scrape type 2
2026-03-30 06:32:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cb7cc53d-141f-5a8a-ba9f-c466980f1059, identifier: ZN30582
2026-03-30 06:32:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cb7cc53d-141f-5a8a-ba9f-c466980f1059 with identifier: ZN30582
2026-03-30 06:32:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cb7cc53d-141f-5a8a-ba9f-c466980f1059 with identifier: ZN30582
2026-03-30 06:32:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cb7cc53d-141f-5a8a-ba9f-c466980f1059 with identifier: ZN30582 to the API
2026-03-30 06:32:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:16:05Z',
 'fuel_type': 'petrol',
 'id': 'cb7cc53d-141f-5a8a-ba9f-c466980f1059',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN30582',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 146956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-08',
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2015}
2026-03-30 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN30582%27 HTTP/1.1" 200 None
2026-03-30 06:32:43 [auto1.be] INFO: Saving data for ZN30582: {'auction_closing_time': 1774883765.0, 'created_time': 1774730023.360618, 'last_price_update_time': 1774852363.271136}
2026-03-30 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZN30582') HTTP/1.1" 204 0
2026-03-30 06:32:43 [auto1.be] INFO: Found listing with ID: DW89604
2026-03-30 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW89604%27 HTTP/1.1" 200 None
2026-03-30 06:32:43 [auto1.be] INFO: Scrape type for DW89604: 2
2026-03-30 06:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b595d89-6e5d-5199-85ea-67227817cfc8 with identifier: DW89604
2026-03-30 06:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b595d89-6e5d-5199-85ea-67227817cfc8 with scrape type 2
2026-03-30 06:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b595d89-6e5d-5199-85ea-67227817cfc8 with scrape type 2
2026-03-30 06:32:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6b595d89-6e5d-5199-85ea-67227817cfc8, identifier: DW89604
2026-03-30 06:32:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6b595d89-6e5d-5199-85ea-67227817cfc8 with identifier: DW89604
2026-03-30 06:32:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6b595d89-6e5d-5199-85ea-67227817cfc8 with identifier: DW89604
2026-03-30 06:32:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6b595d89-6e5d-5199-85ea-67227817cfc8 with identifier: DW89604 to the API
2026-03-30 06:32:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:08:25Z',
 'fuel_type': 'petrol',
 'id': '6b595d89-6e5d-5199-85ea-67227817cfc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW89604',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 28723,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-13',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2019}
2026-03-30 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW89604%27 HTTP/1.1" 200 None
2026-03-30 06:32:43 [auto1.be] INFO: Saving data for DW89604: {'auction_closing_time': 1774883305.0, 'created_time': 1774729986.010003, 'last_price_update_time': 1774852363.746128}
2026-03-30 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DW89604') HTTP/1.1" 204 0
2026-03-30 06:32:43 [auto1.be] INFO: Found listing with ID: WV93759
2026-03-30 06:32:43 [auto1.be] INFO: Found listing with ID: JB30712
2026-03-30 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB30712%27 HTTP/1.1" 200 None
2026-03-30 06:32:43 [auto1.be] INFO: Scrape type for JB30712: 2
2026-03-30 06:32:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0957ddb1-4635-5fc3-b0b3-38d43f946675 with identifier: JB30712
2026-03-30 06:32:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0957ddb1-4635-5fc3-b0b3-38d43f946675 with scrape type 2
2026-03-30 06:32:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0957ddb1-4635-5fc3-b0b3-38d43f946675 with scrape type 2
2026-03-30 06:32:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0957ddb1-4635-5fc3-b0b3-38d43f946675, identifier: JB30712
2026-03-30 06:32:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0957ddb1-4635-5fc3-b0b3-38d43f946675 with identifier: JB30712
2026-03-30 06:32:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0957ddb1-4635-5fc3-b0b3-38d43f946675 with identifier: JB30712
2026-03-30 06:32:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0957ddb1-4635-5fc3-b0b3-38d43f946675 with identifier: JB30712 to the API
2026-03-30 06:32:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:55:17Z',
 'fuel_type': 'petrol',
 'id': '0957ddb1-4635-5fc3-b0b3-38d43f946675',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB30712',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 92523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-08',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2015}
2026-03-30 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB30712%27 HTTP/1.1" 200 None
2026-03-30 06:32:44 [auto1.be] INFO: Saving data for JB30712: {'auction_closing_time': 1774886117.0, 'created_time': 1774729999.027249, 'last_price_update_time': 1774852364.131586}
2026-03-30 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JB30712') HTTP/1.1" 204 0
2026-03-30 06:32:44 [auto1.be] INFO: Found listing with ID: XK23104
2026-03-30 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK23104%27 HTTP/1.1" 200 None
2026-03-30 06:32:44 [auto1.be] INFO: Scrape type for XK23104: 2
2026-03-30 06:32:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0d21d3d-637b-53c4-8c5c-55b1c2034ec9 with identifier: XK23104
2026-03-30 06:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0d21d3d-637b-53c4-8c5c-55b1c2034ec9 with scrape type 2
2026-03-30 06:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0d21d3d-637b-53c4-8c5c-55b1c2034ec9 with scrape type 2
2026-03-30 06:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c0d21d3d-637b-53c4-8c5c-55b1c2034ec9, identifier: XK23104
2026-03-30 06:32:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c0d21d3d-637b-53c4-8c5c-55b1c2034ec9 with identifier: XK23104
2026-03-30 06:32:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c0d21d3d-637b-53c4-8c5c-55b1c2034ec9 with identifier: XK23104
2026-03-30 06:32:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c0d21d3d-637b-53c4-8c5c-55b1c2034ec9 with identifier: XK23104 to the API
2026-03-30 06:32:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:09:15Z',
 'fuel_type': 'diesel',
 'id': 'c0d21d3d-637b-53c4-8c5c-55b1c2034ec9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK23104',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 169092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-15',
 'seller_name': None,
 'title': 'BMW 5er 518d',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-30 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK23104%27 HTTP/1.1" 200 None
2026-03-30 06:32:44 [auto1.be] INFO: Saving data for XK23104: {'auction_closing_time': 1774883355.0, 'created_time': 1774729959.73158, 'last_price_update_time': 1774852364.505247}
2026-03-30 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XK23104') HTTP/1.1" 204 0
2026-03-30 06:32:44 [auto1.be] INFO: Found listing with ID: SG83875
2026-03-30 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SG83875%27 HTTP/1.1" 200 None
2026-03-30 06:32:44 [auto1.be] INFO: Scrape type for SG83875: 2
2026-03-30 06:32:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8542210c-f5ac-5415-b439-19ad7e59dfa0 with identifier: SG83875
2026-03-30 06:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8542210c-f5ac-5415-b439-19ad7e59dfa0 with scrape type 2
2026-03-30 06:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8542210c-f5ac-5415-b439-19ad7e59dfa0 with scrape type 2
2026-03-30 06:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8542210c-f5ac-5415-b439-19ad7e59dfa0, identifier: SG83875
2026-03-30 06:32:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8542210c-f5ac-5415-b439-19ad7e59dfa0 with identifier: SG83875
2026-03-30 06:32:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8542210c-f5ac-5415-b439-19ad7e59dfa0 with identifier: SG83875
2026-03-30 06:32:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8542210c-f5ac-5415-b439-19ad7e59dfa0 with identifier: SG83875 to the API
2026-03-30 06:32:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 107,
 'expiration_date': '2026-03-30T15:42:51Z',
 'fuel_type': 'petrol',
 'id': '8542210c-f5ac-5415-b439-19ad7e59dfa0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG83875',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'SX4',
 'odometer': 213416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-30',
 'seller_name': None,
 'title': 'Suzuki SX4 1.6 Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2009}
2026-03-30 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SG83875%27 HTTP/1.1" 200 None
2026-03-30 06:32:44 [auto1.be] INFO: Saving data for SG83875: {'auction_closing_time': 1774885371.0, 'created_time': 1774729964.459902, 'last_price_update_time': 1774852364.895384}
2026-03-30 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SG83875') HTTP/1.1" 204 0
2026-03-30 06:32:44 [auto1.be] INFO: Found listing with ID: UM29446
2026-03-30 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM29446%27 HTTP/1.1" 200 None
2026-03-30 06:32:44 [auto1.be] INFO: Scrape type for UM29446: 2
2026-03-30 06:32:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf256247-d3d0-5776-8798-06a8b9b65eec with identifier: UM29446
2026-03-30 06:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf256247-d3d0-5776-8798-06a8b9b65eec with scrape type 2
2026-03-30 06:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf256247-d3d0-5776-8798-06a8b9b65eec with scrape type 2
2026-03-30 06:32:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bf256247-d3d0-5776-8798-06a8b9b65eec, identifier: UM29446
2026-03-30 06:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bf256247-d3d0-5776-8798-06a8b9b65eec with identifier: UM29446
2026-03-30 06:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bf256247-d3d0-5776-8798-06a8b9b65eec with identifier: UM29446
2026-03-30 06:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bf256247-d3d0-5776-8798-06a8b9b65eec with identifier: UM29446 to the API
2026-03-30 06:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:19:21Z',
 'fuel_type': 'diesel',
 'id': 'bf256247-d3d0-5776-8798-06a8b9b65eec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM29446',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 198454,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-11',
 'seller_name': None,
 'title': 'Volvo V60 1.6 D Kinetic',
 'transmission': 'automatic',
 'trim': 'Kinetic',
 'year': 2013}
2026-03-30 06:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM29446%27 HTTP/1.1" 200 None
2026-03-30 06:32:45 [auto1.be] INFO: Saving data for UM29446: {'auction_closing_time': 1774883961.0, 'created_time': 1774729966.897949, 'last_price_update_time': 1774852365.276885}
2026-03-30 06:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UM29446') HTTP/1.1" 204 0
2026-03-30 06:32:45 [auto1.be] INFO: Found listing with ID: XS20349
2026-03-30 06:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS20349%27 HTTP/1.1" 200 None
2026-03-30 06:32:45 [auto1.be] INFO: Scrape type for XS20349: 0
2026-03-30 06:32:45 [auto1.be] INFO: Found listing with ID: TA24587
2026-03-30 06:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TA24587%27 HTTP/1.1" 200 None
2026-03-30 06:32:45 [auto1.be] INFO: Scrape type for TA24587: 0
2026-03-30 06:32:45 [auto1.be] INFO: Found listing with ID: MM51411
2026-03-30 06:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MM51411%27 HTTP/1.1" 200 None
2026-03-30 06:32:45 [auto1.be] INFO: Scrape type for MM51411: 2
2026-03-30 06:32:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e46d563-73d9-516a-8e04-7806d7e488c7 with identifier: MM51411
2026-03-30 06:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e46d563-73d9-516a-8e04-7806d7e488c7 with scrape type 2
2026-03-30 06:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e46d563-73d9-516a-8e04-7806d7e488c7 with scrape type 2
2026-03-30 06:32:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4e46d563-73d9-516a-8e04-7806d7e488c7, identifier: MM51411
2026-03-30 06:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4e46d563-73d9-516a-8e04-7806d7e488c7 with identifier: MM51411
2026-03-30 06:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4e46d563-73d9-516a-8e04-7806d7e488c7 with identifier: MM51411
2026-03-30 06:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4e46d563-73d9-516a-8e04-7806d7e488c7 with identifier: MM51411 to the API
2026-03-30 06:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:33:51Z',
 'fuel_type': 'diesel',
 'id': '4e46d563-73d9-516a-8e04-7806d7e488c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM51411',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 94131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-03',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 ed4 Pure',
 'transmission': 'manual',
 'trim': 'Pure',
 'year': 2016}
2026-03-30 06:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MM51411%27 HTTP/1.1" 200 None
2026-03-30 06:32:45 [auto1.be] INFO: Saving data for MM51411: {'auction_closing_time': 1774884831.0, 'created_time': 1774729970.100608, 'last_price_update_time': 1774852365.680522}
2026-03-30 06:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MM51411') HTTP/1.1" 204 0
2026-03-30 06:32:45 [auto1.be] INFO: Found listing with ID: EM05161
2026-03-30 06:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM05161%27 HTTP/1.1" 200 None
2026-03-30 06:32:45 [auto1.be] INFO: Scrape type for EM05161: 2
2026-03-30 06:32:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c875d288-7127-58c9-8e16-0a9db6f2af22 with identifier: EM05161
2026-03-30 06:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c875d288-7127-58c9-8e16-0a9db6f2af22 with scrape type 2
2026-03-30 06:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c875d288-7127-58c9-8e16-0a9db6f2af22 with scrape type 2
2026-03-30 06:32:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c875d288-7127-58c9-8e16-0a9db6f2af22, identifier: EM05161
2026-03-30 06:32:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c875d288-7127-58c9-8e16-0a9db6f2af22 with identifier: EM05161
2026-03-30 06:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c875d288-7127-58c9-8e16-0a9db6f2af22 with identifier: EM05161
2026-03-30 06:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c875d288-7127-58c9-8e16-0a9db6f2af22 with identifier: EM05161 to the API
2026-03-30 06:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:16:05Z',
 'fuel_type': 'diesel',
 'id': 'c875d288-7127-58c9-8e16-0a9db6f2af22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM05161',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Jetta',
 'odometer': 191346,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-10',
 'seller_name': None,
 'title': 'Volkswagen Jetta 2.0 TDI BlueMotion',
 'transmission': 'manual',
 'trim': 'BlueMotion',
 'year': 2015}
2026-03-30 06:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM05161%27 HTTP/1.1" 200 None
2026-03-30 06:32:46 [auto1.be] INFO: Saving data for EM05161: {'auction_closing_time': 1774883765.0, 'created_time': 1774729969.483417, 'last_price_update_time': 1774852366.067713}
2026-03-30 06:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EM05161') HTTP/1.1" 204 0
2026-03-30 06:32:46 [auto1.be] INFO: Found listing with ID: HZ76034
2026-03-30 06:32:46 [auto1.be] INFO: Found listing with ID: US61524
2026-03-30 06:32:46 [auto1.be] INFO: Found listing with ID: DP44577
2026-03-30 06:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP44577%27 HTTP/1.1" 200 None
2026-03-30 06:32:46 [auto1.be] INFO: Scrape type for DP44577: 2
2026-03-30 06:32:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 689b1517-263a-589b-abf0-a8f06331dc85 with identifier: DP44577
2026-03-30 06:32:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 689b1517-263a-589b-abf0-a8f06331dc85 with scrape type 2
2026-03-30 06:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 689b1517-263a-589b-abf0-a8f06331dc85 with scrape type 2
2026-03-30 06:32:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 689b1517-263a-589b-abf0-a8f06331dc85, identifier: DP44577
2026-03-30 06:32:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 689b1517-263a-589b-abf0-a8f06331dc85 with identifier: DP44577
2026-03-30 06:32:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 689b1517-263a-589b-abf0-a8f06331dc85 with identifier: DP44577
2026-03-30 06:32:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 689b1517-263a-589b-abf0-a8f06331dc85 with identifier: DP44577 to the API
2026-03-30 06:32:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:58:17Z',
 'fuel_type': 'petrol',
 'id': '689b1517-263a-589b-abf0-a8f06331dc85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP44577',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 132711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-13',
 'seller_name': None,
 'title': 'Citroen C3 1.2 VTi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2013}
2026-03-30 06:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP44577%27 HTTP/1.1" 200 None
2026-03-30 06:32:46 [auto1.be] INFO: Saving data for DP44577: {'auction_closing_time': 1774886297.0, 'created_time': 1774729956.016615, 'last_price_update_time': 1774852366.461749}
2026-03-30 06:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DP44577') HTTP/1.1" 204 0
2026-03-30 06:32:46 [auto1.be] INFO: Found listing with ID: KU92863
2026-03-30 06:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU92863%27 HTTP/1.1" 200 None
2026-03-30 06:32:46 [auto1.be] INFO: Scrape type for KU92863: 0
2026-03-30 06:32:46 [auto1.be] INFO: Found listing with ID: XU79591
2026-03-30 06:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XU79591%27 HTTP/1.1" 200 None
2026-03-30 06:32:46 [auto1.be] INFO: Scrape type for XU79591: 0
2026-03-30 06:32:46 [auto1.be] INFO: Found listing with ID: LM11563
2026-03-30 06:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM11563%27 HTTP/1.1" 200 None
2026-03-30 06:32:46 [auto1.be] INFO: Scrape type for LM11563: 0
2026-03-30 06:32:46 [auto1.be] INFO: Found listing with ID: VZ26705
2026-03-30 06:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ26705%27 HTTP/1.1" 200 None
2026-03-30 06:32:46 [auto1.be] INFO: Scrape type for VZ26705: 2
2026-03-30 06:32:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4da4e87-702d-5e2a-9f51-40772ebd97d7 with identifier: VZ26705
2026-03-30 06:32:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4da4e87-702d-5e2a-9f51-40772ebd97d7 with scrape type 2
2026-03-30 06:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4da4e87-702d-5e2a-9f51-40772ebd97d7 with scrape type 2
2026-03-30 06:32:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d4da4e87-702d-5e2a-9f51-40772ebd97d7, identifier: VZ26705
2026-03-30 06:32:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d4da4e87-702d-5e2a-9f51-40772ebd97d7 with identifier: VZ26705
2026-03-30 06:32:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d4da4e87-702d-5e2a-9f51-40772ebd97d7 with identifier: VZ26705
2026-03-30 06:32:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d4da4e87-702d-5e2a-9f51-40772ebd97d7 with identifier: VZ26705 to the API
2026-03-30 06:32:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:19:06Z',
 'fuel_type': 'diesel',
 'id': 'd4da4e87-702d-5e2a-9f51-40772ebd97d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ26705',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 203168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-12',
 'seller_name': None,
 'title': 'Citroen C4 1.6 HDi Confort',
 'transmission': 'manual',
 'trim': 'Confort',
 'year': 2008}
2026-03-30 06:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ26705%27 HTTP/1.1" 200 None
2026-03-30 06:32:47 [auto1.be] INFO: Saving data for VZ26705: {'auction_closing_time': 1774883946.0, 'created_time': 1774729961.44872, 'last_price_update_time': 1774852367.010138}
2026-03-30 06:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VZ26705') HTTP/1.1" 204 0
2026-03-30 06:32:47 [auto1.be] INFO: Channel: 24h | Page: 28 | totalHits: 1288 | hits on page: 40
2026-03-30 06:32:47 [auto1.be] INFO: Found listing with ID: GW19918
2026-03-30 06:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW19918%27 HTTP/1.1" 200 None
2026-03-30 06:32:47 [auto1.be] INFO: Scrape type for GW19918: 2
2026-03-30 06:32:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 063483d3-546a-5f9f-98e0-f9f8aa002783 with identifier: GW19918
2026-03-30 06:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 063483d3-546a-5f9f-98e0-f9f8aa002783 with scrape type 2
2026-03-30 06:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 063483d3-546a-5f9f-98e0-f9f8aa002783 with scrape type 2
2026-03-30 06:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 063483d3-546a-5f9f-98e0-f9f8aa002783, identifier: GW19918
2026-03-30 06:32:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 063483d3-546a-5f9f-98e0-f9f8aa002783 with identifier: GW19918
2026-03-30 06:32:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 063483d3-546a-5f9f-98e0-f9f8aa002783 with identifier: GW19918
2026-03-30 06:32:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 063483d3-546a-5f9f-98e0-f9f8aa002783 with identifier: GW19918 to the API
2026-03-30 06:32:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:58:56Z',
 'fuel_type': 'hybrid',
 'id': '063483d3-546a-5f9f-98e0-f9f8aa002783',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW19918',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 191954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-01',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI e-tron Ambiente',
 'transmission': 'automatic',
 'trim': 'Ambiente',
 'year': 2015}
2026-03-30 06:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW19918%27 HTTP/1.1" 200 None
2026-03-30 06:32:47 [auto1.be] INFO: Saving data for GW19918: {'auction_closing_time': 1774886336.0, 'created_time': 1774729957.908091, 'last_price_update_time': 1774852367.401492}
2026-03-30 06:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GW19918') HTTP/1.1" 204 0
2026-03-30 06:32:47 [auto1.be] INFO: Found listing with ID: AE63964
2026-03-30 06:32:47 [auto1.be] INFO: Found listing with ID: SL57288
2026-03-30 06:32:47 [auto1.be] INFO: Found listing with ID: BT92464
2026-03-30 06:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT92464%27 HTTP/1.1" 200 None
2026-03-30 06:32:47 [auto1.be] INFO: Scrape type for BT92464: 2
2026-03-30 06:32:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56c54f33-0575-5e02-a335-a810a3592be1 with identifier: BT92464
2026-03-30 06:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56c54f33-0575-5e02-a335-a810a3592be1 with scrape type 2
2026-03-30 06:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56c54f33-0575-5e02-a335-a810a3592be1 with scrape type 2
2026-03-30 06:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 56c54f33-0575-5e02-a335-a810a3592be1, identifier: BT92464
2026-03-30 06:32:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:32:47 [auto1.be] INFO: Found listing with ID: UY14877
2026-03-30 06:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY14877%27 HTTP/1.1" 200 None
2026-03-30 06:32:47 [auto1.be] INFO: Scrape type for UY14877: 2
2026-03-30 06:32:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e79bfaa-db27-58a8-9d2c-1abfff02bc22 with identifier: UY14877
2026-03-30 06:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e79bfaa-db27-58a8-9d2c-1abfff02bc22 with scrape type 2
2026-03-30 06:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e79bfaa-db27-58a8-9d2c-1abfff02bc22 with scrape type 2
2026-03-30 06:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5e79bfaa-db27-58a8-9d2c-1abfff02bc22, identifier: UY14877
2026-03-30 06:32:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 56c54f33-0575-5e02-a335-a810a3592be1 with identifier: BT92464
2026-03-30 06:32:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 56c54f33-0575-5e02-a335-a810a3592be1 with identifier: BT92464
2026-03-30 06:32:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 56c54f33-0575-5e02-a335-a810a3592be1 with identifier: BT92464 to the API
2026-03-30 06:32:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:09Z',
 'fuel_type': 'diesel',
 'id': '56c54f33-0575-5e02-a335-a810a3592be1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT92464',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 157809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-12',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-03-30 06:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT92464%27 HTTP/1.1" 200 None
2026-03-30 06:32:47 [auto1.be] INFO: Saving data for BT92464: {'auction_closing_time': 1774885689.0, 'created_time': 1774730009.801468, 'last_price_update_time': 1774852367.881681}
2026-03-30 06:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BT92464') HTTP/1.1" 204 0
2026-03-30 06:32:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5e79bfaa-db27-58a8-9d2c-1abfff02bc22 with identifier: UY14877
2026-03-30 06:32:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5e79bfaa-db27-58a8-9d2c-1abfff02bc22 with identifier: UY14877
2026-03-30 06:32:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5e79bfaa-db27-58a8-9d2c-1abfff02bc22 with identifier: UY14877 to the API
2026-03-30 06:32:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:43:29Z',
 'fuel_type': 'petrol',
 'id': '5e79bfaa-db27-58a8-9d2c-1abfff02bc22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY14877',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 123525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-01',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Graphic',
 'transmission': 'manual',
 'trim': 'Graphic',
 'year': 2020}
2026-03-30 06:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY14877%27 HTTP/1.1" 200 None
2026-03-30 06:32:48 [auto1.be] INFO: Saving data for UY14877: {'auction_closing_time': 1774885409.0, 'created_time': 1774729966.513555, 'last_price_update_time': 1774852368.158635}
2026-03-30 06:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UY14877') HTTP/1.1" 204 0
2026-03-30 06:32:48 [auto1.be] INFO: Found listing with ID: RK43455
2026-03-30 06:32:48 [auto1.be] INFO: Found listing with ID: KG93945
2026-03-30 06:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG93945%27 HTTP/1.1" 200 None
2026-03-30 06:32:48 [auto1.be] INFO: Scrape type for KG93945: 2
2026-03-30 06:32:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56f53961-7f04-5e27-af0e-1c82ddbc1cc7 with identifier: KG93945
2026-03-30 06:32:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56f53961-7f04-5e27-af0e-1c82ddbc1cc7 with scrape type 2
2026-03-30 06:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56f53961-7f04-5e27-af0e-1c82ddbc1cc7 with scrape type 2
2026-03-30 06:32:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 56f53961-7f04-5e27-af0e-1c82ddbc1cc7, identifier: KG93945
2026-03-30 06:32:48 [auto1.be] INFO: Found listing with ID: WJ93890
2026-03-30 06:32:48 [auto1.be] INFO: Found listing with ID: DN00999
2026-03-30 06:32:48 [auto1.be] INFO: Found listing with ID: GN49517
2026-03-30 06:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN49517%27 HTTP/1.1" 200 None
2026-03-30 06:32:48 [auto1.be] INFO: Scrape type for GN49517: 2
2026-03-30 06:32:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2a479dc-fc74-5ad9-a245-660f6ef7c604 with identifier: GN49517
2026-03-30 06:32:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2a479dc-fc74-5ad9-a245-660f6ef7c604 with scrape type 2
2026-03-30 06:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2a479dc-fc74-5ad9-a245-660f6ef7c604 with scrape type 2
2026-03-30 06:32:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e2a479dc-fc74-5ad9-a245-660f6ef7c604, identifier: GN49517
2026-03-30 06:32:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 56f53961-7f04-5e27-af0e-1c82ddbc1cc7 with identifier: KG93945
2026-03-30 06:32:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 56f53961-7f04-5e27-af0e-1c82ddbc1cc7 with identifier: KG93945
2026-03-30 06:32:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 56f53961-7f04-5e27-af0e-1c82ddbc1cc7 with identifier: KG93945 to the API
2026-03-30 06:32:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:51:51Z',
 'fuel_type': 'petrol',
 'id': '56f53961-7f04-5e27-af0e-1c82ddbc1cc7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG93945',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 21904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-10',
 'seller_name': None,
 'title': 'Renault Twingo 0.9 Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2018}
2026-03-30 06:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG93945%27 HTTP/1.1" 200 None
2026-03-30 06:32:48 [auto1.be] INFO: Saving data for KG93945: {'auction_closing_time': 1774885911.0, 'created_time': 1774730003.121148, 'last_price_update_time': 1774852368.661206}
2026-03-30 06:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KG93945') HTTP/1.1" 204 0
2026-03-30 06:32:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e2a479dc-fc74-5ad9-a245-660f6ef7c604 with identifier: GN49517
2026-03-30 06:32:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e2a479dc-fc74-5ad9-a245-660f6ef7c604 with identifier: GN49517
2026-03-30 06:32:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e2a479dc-fc74-5ad9-a245-660f6ef7c604 with identifier: GN49517 to the API
2026-03-30 06:32:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:51:07Z',
 'fuel_type': 'diesel',
 'id': 'e2a479dc-fc74-5ad9-a245-660f6ef7c604',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN49517',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 170201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-07',
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.0 DI-D Instyle',
 'transmission': 'manual',
 'trim': 'Instyle',
 'year': 2007}
2026-03-30 06:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN49517%27 HTTP/1.1" 200 None
2026-03-30 06:32:49 [auto1.be] INFO: Saving data for GN49517: {'auction_closing_time': 1774885867.0, 'created_time': 1774729992.961431, 'last_price_update_time': 1774852369.017162}
2026-03-30 06:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GN49517') HTTP/1.1" 204 0
2026-03-30 06:32:49 [auto1.be] INFO: Found listing with ID: FB93927
2026-03-30 06:32:49 [auto1.be] INFO: Found listing with ID: SV46049
2026-03-30 06:32:49 [auto1.be] INFO: Found listing with ID: WV65314
2026-03-30 06:32:49 [auto1.be] INFO: Found listing with ID: FM81572
2026-03-30 06:32:49 [auto1.be] INFO: Found listing with ID: HJ19751
2026-03-30 06:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ19751%27 HTTP/1.1" 200 None
2026-03-30 06:32:49 [auto1.be] INFO: Scrape type for HJ19751: 2
2026-03-30 06:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb736e67-f928-5fa1-99d8-ec6f8fbbef12 with identifier: HJ19751
2026-03-30 06:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb736e67-f928-5fa1-99d8-ec6f8fbbef12 with scrape type 2
2026-03-30 06:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb736e67-f928-5fa1-99d8-ec6f8fbbef12 with scrape type 2
2026-03-30 06:32:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: eb736e67-f928-5fa1-99d8-ec6f8fbbef12, identifier: HJ19751
2026-03-30 06:32:49 [auto1.be] INFO: Found listing with ID: BE30988
2026-03-30 06:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BE30988%27 HTTP/1.1" 200 None
2026-03-30 06:32:49 [auto1.be] INFO: Scrape type for BE30988: 2
2026-03-30 06:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69dae1ce-8e8b-594b-a85c-20d168195f3e with identifier: BE30988
2026-03-30 06:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69dae1ce-8e8b-594b-a85c-20d168195f3e with scrape type 2
2026-03-30 06:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69dae1ce-8e8b-594b-a85c-20d168195f3e with scrape type 2
2026-03-30 06:32:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 69dae1ce-8e8b-594b-a85c-20d168195f3e, identifier: BE30988
2026-03-30 06:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: eb736e67-f928-5fa1-99d8-ec6f8fbbef12 with identifier: HJ19751
2026-03-30 06:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: eb736e67-f928-5fa1-99d8-ec6f8fbbef12 with identifier: HJ19751
2026-03-30 06:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: eb736e67-f928-5fa1-99d8-ec6f8fbbef12 with identifier: HJ19751 to the API
2026-03-30 06:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:08:34Z',
 'fuel_type': 'diesel',
 'id': 'eb736e67-f928-5fa1-99d8-ec6f8fbbef12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ19751',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Amarok',
 'odometer': 129357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-25',
 'seller_name': None,
 'title': 'Volkswagen Amarok 3.0 V6 TDI Highline DoubleCab 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline DoubleCab 4Motion',
 'year': 2018}
2026-03-30 06:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ19751%27 HTTP/1.1" 200 None
2026-03-30 06:32:49 [auto1.be] INFO: Saving data for HJ19751: {'auction_closing_time': 1774883314.0, 'created_time': 1774006254.730432, 'last_price_update_time': 1774852369.628252}
2026-03-30 06:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HJ19751') HTTP/1.1" 204 0
2026-03-30 06:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 69dae1ce-8e8b-594b-a85c-20d168195f3e with identifier: BE30988
2026-03-30 06:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 69dae1ce-8e8b-594b-a85c-20d168195f3e with identifier: BE30988
2026-03-30 06:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 69dae1ce-8e8b-594b-a85c-20d168195f3e with identifier: BE30988 to the API
2026-03-30 06:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:08:02Z',
 'fuel_type': 'diesel',
 'id': '69dae1ce-8e8b-594b-a85c-20d168195f3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE30988',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 90108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-30',
 'seller_name': None,
 'title': 'Kia Sportage 1.7 CRDi Spirit 2WD',
 'transmission': 'manual',
 'trim': 'Spirit 2WD',
 'year': 2015}
2026-03-30 06:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BE30988%27 HTTP/1.1" 200 None
2026-03-30 06:32:49 [auto1.be] INFO: Saving data for BE30988: {'auction_closing_time': 1774883282.0, 'created_time': 1774729965.259905, 'last_price_update_time': 1774852369.90382}
2026-03-30 06:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BE30988') HTTP/1.1" 204 0
2026-03-30 06:32:49 [auto1.be] INFO: Found listing with ID: MW50956
2026-03-30 06:32:49 [auto1.be] INFO: Found listing with ID: JJ70860
2026-03-30 06:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ70860%27 HTTP/1.1" 200 None
2026-03-30 06:32:49 [auto1.be] INFO: Scrape type for JJ70860: 2
2026-03-30 06:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a089f6ec-349f-525e-8589-8c7e4cc37c22 with identifier: JJ70860
2026-03-30 06:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a089f6ec-349f-525e-8589-8c7e4cc37c22 with scrape type 2
2026-03-30 06:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a089f6ec-349f-525e-8589-8c7e4cc37c22 with scrape type 2
2026-03-30 06:32:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a089f6ec-349f-525e-8589-8c7e4cc37c22, identifier: JJ70860
2026-03-30 06:32:50 [auto1.be] INFO: Found listing with ID: ZW40078
2026-03-30 06:32:50 [auto1.be] INFO: Found listing with ID: YW96446
2026-03-30 06:32:50 [auto1.be] INFO: Found listing with ID: LA99224
2026-03-30 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA99224%27 HTTP/1.1" 200 None
2026-03-30 06:32:50 [auto1.be] INFO: Scrape type for LA99224: 2
2026-03-30 06:32:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d8169e1-25d8-53f3-9c58-1a9a099811a1 with identifier: LA99224
2026-03-30 06:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d8169e1-25d8-53f3-9c58-1a9a099811a1 with scrape type 2
2026-03-30 06:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d8169e1-25d8-53f3-9c58-1a9a099811a1 with scrape type 2
2026-03-30 06:32:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3d8169e1-25d8-53f3-9c58-1a9a099811a1, identifier: LA99224
2026-03-30 06:32:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a089f6ec-349f-525e-8589-8c7e4cc37c22 with identifier: JJ70860
2026-03-30 06:32:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a089f6ec-349f-525e-8589-8c7e4cc37c22 with identifier: JJ70860
2026-03-30 06:32:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a089f6ec-349f-525e-8589-8c7e4cc37c22 with identifier: JJ70860 to the API
2026-03-30 06:32:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:29:57Z',
 'fuel_type': 'petrol',
 'id': 'a089f6ec-349f-525e-8589-8c7e4cc37c22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ70860',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 53262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-21',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2012}
2026-03-30 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ70860%27 HTTP/1.1" 200 None
2026-03-30 06:32:50 [auto1.be] INFO: Saving data for JJ70860: {'auction_closing_time': 1774884597.0, 'created_time': 1774729992.608288, 'last_price_update_time': 1774852370.444273}
2026-03-30 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JJ70860') HTTP/1.1" 204 0
2026-03-30 06:32:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3d8169e1-25d8-53f3-9c58-1a9a099811a1 with identifier: LA99224
2026-03-30 06:32:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3d8169e1-25d8-53f3-9c58-1a9a099811a1 with identifier: LA99224
2026-03-30 06:32:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3d8169e1-25d8-53f3-9c58-1a9a099811a1 with identifier: LA99224 to the API
2026-03-30 06:32:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:42:54Z',
 'fuel_type': 'diesel',
 'id': '3d8169e1-25d8-53f3-9c58-1a9a099811a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA99224',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 198826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-04',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.4 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-30 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA99224%27 HTTP/1.1" 200 None
2026-03-30 06:32:50 [auto1.be] INFO: Saving data for LA99224: {'auction_closing_time': 1774885374.0, 'created_time': 1774729958.869925, 'last_price_update_time': 1774852370.817069}
2026-03-30 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LA99224') HTTP/1.1" 204 0
2026-03-30 06:32:50 [auto1.be] INFO: Found listing with ID: DN28044
2026-03-30 06:32:50 [auto1.be] INFO: Found listing with ID: WG38275
2026-03-30 06:32:50 [auto1.be] INFO: Found listing with ID: NC08569
2026-03-30 06:32:50 [auto1.be] INFO: Found listing with ID: JR09444
2026-03-30 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JR09444%27 HTTP/1.1" 200 None
2026-03-30 06:32:50 [auto1.be] INFO: Scrape type for JR09444: 2
2026-03-30 06:32:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40c10758-0dd5-5717-9551-204e3475778d with identifier: JR09444
2026-03-30 06:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40c10758-0dd5-5717-9551-204e3475778d with scrape type 2
2026-03-30 06:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40c10758-0dd5-5717-9551-204e3475778d with scrape type 2
2026-03-30 06:32:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 40c10758-0dd5-5717-9551-204e3475778d, identifier: JR09444
2026-03-30 06:32:50 [auto1.be] INFO: Found listing with ID: UE64828
2026-03-30 06:32:50 [auto1.be] INFO: Found listing with ID: GJ36560
2026-03-30 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ36560%27 HTTP/1.1" 200 None
2026-03-30 06:32:50 [auto1.be] INFO: Scrape type for GJ36560: 0
2026-03-30 06:32:50 [auto1.be] INFO: Found listing with ID: KF94293
2026-03-30 06:32:50 [auto1.be] INFO: Found listing with ID: ER36240
2026-03-30 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER36240%27 HTTP/1.1" 200 None
2026-03-30 06:32:50 [auto1.be] INFO: Scrape type for ER36240: 2
2026-03-30 06:32:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96e56297-36bf-51e1-858e-f04b6f91a78a with identifier: ER36240
2026-03-30 06:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96e56297-36bf-51e1-858e-f04b6f91a78a with scrape type 2
2026-03-30 06:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96e56297-36bf-51e1-858e-f04b6f91a78a with scrape type 2
2026-03-30 06:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 96e56297-36bf-51e1-858e-f04b6f91a78a, identifier: ER36240
2026-03-30 06:32:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 40c10758-0dd5-5717-9551-204e3475778d with identifier: JR09444
2026-03-30 06:32:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 40c10758-0dd5-5717-9551-204e3475778d with identifier: JR09444
2026-03-30 06:32:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 40c10758-0dd5-5717-9551-204e3475778d with identifier: JR09444 to the API
2026-03-30 06:32:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:53:59Z',
 'fuel_type': 'diesel',
 'id': '40c10758-0dd5-5717-9551-204e3475778d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR09444',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Delta',
 'odometer': 248851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-26',
 'seller_name': None,
 'title': 'Lancia Delta 1.6 JTD Silver',
 'transmission': 'manual',
 'trim': 'Silver',
 'year': 2013}
2026-03-30 06:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JR09444%27 HTTP/1.1" 200 None
2026-03-30 06:32:51 [auto1.be] INFO: Saving data for JR09444: {'auction_closing_time': 1774886039.0, 'created_time': 1774729983.810799, 'last_price_update_time': 1774852371.325486}
2026-03-30 06:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JR09444') HTTP/1.1" 204 0
2026-03-30 06:32:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 96e56297-36bf-51e1-858e-f04b6f91a78a with identifier: ER36240
2026-03-30 06:32:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 96e56297-36bf-51e1-858e-f04b6f91a78a with identifier: ER36240
2026-03-30 06:32:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 96e56297-36bf-51e1-858e-f04b6f91a78a with identifier: ER36240 to the API
2026-03-30 06:32:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:06:06Z',
 'fuel_type': 'diesel',
 'id': '96e56297-36bf-51e1-858e-f04b6f91a78a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER36240',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 211710,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-13',
 'seller_name': None,
 'title': 'MINI Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 06:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER36240%27 HTTP/1.1" 200 None
2026-03-30 06:32:51 [auto1.be] INFO: Saving data for ER36240: {'auction_closing_time': 1774883166.0, 'created_time': 1774730014.616442, 'last_price_update_time': 1774852371.591575}
2026-03-30 06:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ER36240') HTTP/1.1" 204 0
2026-03-30 06:32:51 [auto1.be] INFO: Found listing with ID: CF30779
2026-03-30 06:32:51 [auto1.be] INFO: Found listing with ID: WT53046
2026-03-30 06:32:51 [auto1.be] INFO: Found listing with ID: DR48094
2026-03-30 06:32:51 [auto1.be] INFO: Found listing with ID: JZ34939
2026-03-30 06:32:51 [auto1.be] INFO: Found listing with ID: TX04561
2026-03-30 06:32:51 [auto1.be] INFO: Found listing with ID: ET82729
2026-03-30 06:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET82729%27 HTTP/1.1" 200 None
2026-03-30 06:32:51 [auto1.be] INFO: Scrape type for ET82729: 2
2026-03-30 06:32:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15492fe2-fbde-5093-8f7a-9cccd3b9e8c2 with identifier: ET82729
2026-03-30 06:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15492fe2-fbde-5093-8f7a-9cccd3b9e8c2 with scrape type 2
2026-03-30 06:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15492fe2-fbde-5093-8f7a-9cccd3b9e8c2 with scrape type 2
2026-03-30 06:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 15492fe2-fbde-5093-8f7a-9cccd3b9e8c2, identifier: ET82729
2026-03-30 06:32:51 [auto1.be] INFO: Found listing with ID: SD86163
2026-03-30 06:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD86163%27 HTTP/1.1" 200 None
2026-03-30 06:32:51 [auto1.be] INFO: Scrape type for SD86163: 2
2026-03-30 06:32:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e448bc6e-2d4c-5467-a005-de3ea2bc8299 with identifier: SD86163
2026-03-30 06:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e448bc6e-2d4c-5467-a005-de3ea2bc8299 with scrape type 2
2026-03-30 06:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e448bc6e-2d4c-5467-a005-de3ea2bc8299 with scrape type 2
2026-03-30 06:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e448bc6e-2d4c-5467-a005-de3ea2bc8299, identifier: SD86163
2026-03-30 06:32:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 15492fe2-fbde-5093-8f7a-9cccd3b9e8c2 with identifier: ET82729
2026-03-30 06:32:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 15492fe2-fbde-5093-8f7a-9cccd3b9e8c2 with identifier: ET82729
2026-03-30 06:32:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 15492fe2-fbde-5093-8f7a-9cccd3b9e8c2 with identifier: ET82729 to the API
2026-03-30 06:32:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:06:30Z',
 'fuel_type': 'petrol',
 'id': '15492fe2-fbde-5093-8f7a-9cccd3b9e8c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET82729',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 144520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1997-10-08',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4',
 'transmission': 'automatic',
 'trim': '',
 'year': 1997}
2026-03-30 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET82729%27 HTTP/1.1" 200 None
2026-03-30 06:32:52 [auto1.be] INFO: Saving data for ET82729: {'auction_closing_time': 1774883190.0, 'created_time': 1774038826.728784, 'last_price_update_time': 1774852372.066267}
2026-03-30 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ET82729') HTTP/1.1" 204 0
2026-03-30 06:32:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e448bc6e-2d4c-5467-a005-de3ea2bc8299 with identifier: SD86163
2026-03-30 06:32:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e448bc6e-2d4c-5467-a005-de3ea2bc8299 with identifier: SD86163
2026-03-30 06:32:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e448bc6e-2d4c-5467-a005-de3ea2bc8299 with identifier: SD86163 to the API
2026-03-30 06:32:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:13:32Z',
 'fuel_type': 'petrol',
 'id': 'e448bc6e-2d4c-5467-a005-de3ea2bc8299',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD86163',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 200713,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-31',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2011}
2026-03-30 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD86163%27 HTTP/1.1" 200 None
2026-03-30 06:32:52 [auto1.be] INFO: Saving data for SD86163: {'auction_closing_time': 1774883612.0, 'created_time': 1774730019.47104, 'last_price_update_time': 1774852372.449305}
2026-03-30 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SD86163') HTTP/1.1" 204 0
2026-03-30 06:32:52 [auto1.be] INFO: Found listing with ID: BC33060
2026-03-30 06:32:52 [auto1.be] INFO: Found listing with ID: HL00392
2026-03-30 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL00392%27 HTTP/1.1" 200 None
2026-03-30 06:32:52 [auto1.be] INFO: Scrape type for HL00392: 2
2026-03-30 06:32:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6f9f124-4a32-56fd-a559-737a4f7ce145 with identifier: HL00392
2026-03-30 06:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6f9f124-4a32-56fd-a559-737a4f7ce145 with scrape type 2
2026-03-30 06:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6f9f124-4a32-56fd-a559-737a4f7ce145 with scrape type 2
2026-03-30 06:32:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b6f9f124-4a32-56fd-a559-737a4f7ce145, identifier: HL00392
2026-03-30 06:32:52 [auto1.be] INFO: Found listing with ID: LM13926
2026-03-30 06:32:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b6f9f124-4a32-56fd-a559-737a4f7ce145 with identifier: HL00392
2026-03-30 06:32:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b6f9f124-4a32-56fd-a559-737a4f7ce145 with identifier: HL00392
2026-03-30 06:32:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b6f9f124-4a32-56fd-a559-737a4f7ce145 with identifier: HL00392 to the API
2026-03-30 06:32:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:09:28Z',
 'fuel_type': 'diesel',
 'id': 'b6f9f124-4a32-56fd-a559-737a4f7ce145',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL00392',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 107150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-03',
 'seller_name': None,
 'title': 'Jaguar XF 20d Ingenium Edition',
 'transmission': 'automatic',
 'trim': 'Ingenium Edition',
 'year': 2017}
2026-03-30 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL00392%27 HTTP/1.1" 200 None
2026-03-30 06:32:52 [auto1.be] INFO: Saving data for HL00392: {'auction_closing_time': 1774883368.0, 'created_time': 1774729990.332015, 'last_price_update_time': 1774852372.840873}
2026-03-30 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HL00392') HTTP/1.1" 204 0
2026-03-30 06:32:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:32:52 [auto1.be] INFO: Found listing with ID: EP00364
2026-03-30 06:32:52 [auto1.be] INFO: Found listing with ID: AU29077
2026-03-30 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU29077%27 HTTP/1.1" 200 None
2026-03-30 06:32:52 [auto1.be] INFO: Scrape type for AU29077: 2
2026-03-30 06:32:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eccc3b65-2f9f-5779-87cd-ba73ac479b15 with identifier: AU29077
2026-03-30 06:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eccc3b65-2f9f-5779-87cd-ba73ac479b15 with scrape type 2
2026-03-30 06:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eccc3b65-2f9f-5779-87cd-ba73ac479b15 with scrape type 2
2026-03-30 06:32:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: eccc3b65-2f9f-5779-87cd-ba73ac479b15, identifier: AU29077
2026-03-30 06:32:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: eccc3b65-2f9f-5779-87cd-ba73ac479b15 with identifier: AU29077
2026-03-30 06:32:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: eccc3b65-2f9f-5779-87cd-ba73ac479b15 with identifier: AU29077
2026-03-30 06:32:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: eccc3b65-2f9f-5779-87cd-ba73ac479b15 with identifier: AU29077 to the API
2026-03-30 06:32:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 178,
 'expiration_date': '2026-03-30T15:20:19Z',
 'fuel_type': 'diesel',
 'id': 'eccc3b65-2f9f-5779-87cd-ba73ac479b15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU29077',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 182286,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-07',
 'seller_name': None,
 'title': 'Fiat Ducato 2.3 Multijet L4H2 Multicab RS: 4035 mm',
 'transmission': 'manual',
 'trim': 'L4H2 Multicab RS: 4035 mm',
 'year': 2016}
2026-03-30 06:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU29077%27 HTTP/1.1" 200 None
2026-03-30 06:32:53 [auto1.be] INFO: Saving data for AU29077: {'auction_closing_time': 1774884019.0, 'created_time': 1774730008.483455, 'last_price_update_time': 1774852373.228743}
2026-03-30 06:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AU29077') HTTP/1.1" 204 0
2026-03-30 06:32:53 [auto1.be] INFO: Found listing with ID: FL05782
2026-03-30 06:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL05782%27 HTTP/1.1" 200 None
2026-03-30 06:32:53 [auto1.be] INFO: Scrape type for FL05782: 2
2026-03-30 06:32:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc453bd1-9879-51e2-ab27-77802f466239 with identifier: FL05782
2026-03-30 06:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc453bd1-9879-51e2-ab27-77802f466239 with scrape type 2
2026-03-30 06:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc453bd1-9879-51e2-ab27-77802f466239 with scrape type 2
2026-03-30 06:32:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dc453bd1-9879-51e2-ab27-77802f466239, identifier: FL05782
2026-03-30 06:32:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dc453bd1-9879-51e2-ab27-77802f466239 with identifier: FL05782
2026-03-30 06:32:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dc453bd1-9879-51e2-ab27-77802f466239 with identifier: FL05782
2026-03-30 06:32:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dc453bd1-9879-51e2-ab27-77802f466239 with identifier: FL05782 to the API
2026-03-30 06:32:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 299,
 'expiration_date': '2026-03-30T15:55:33Z',
 'fuel_type': 'hybrid',
 'id': 'dc453bd1-9879-51e2-ab27-77802f466239',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL05782',
 'listing': 'auction',
 'make': 'Lexus',
 'model': 'RX-Serie',
 'odometer': 168374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-11',
 'seller_name': None,
 'title': 'Lexus RX-Serie RX 450h Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2015}
2026-03-30 06:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL05782%27 HTTP/1.1" 200 None
2026-03-30 06:32:53 [auto1.be] INFO: Saving data for FL05782: {'auction_closing_time': 1774886133.0, 'created_time': 1774730015.553368, 'last_price_update_time': 1774852373.654573}
2026-03-30 06:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FL05782') HTTP/1.1" 204 0
2026-03-30 06:32:53 [auto1.be] INFO: Found listing with ID: HB59214
2026-03-30 06:32:53 [auto1.be] INFO: Found listing with ID: SX95001
2026-03-30 06:32:53 [auto1.be] INFO: Found listing with ID: UR33188
2026-03-30 06:32:53 [auto1.be] INFO: Found listing with ID: UY27001
2026-03-30 06:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY27001%27 HTTP/1.1" 200 None
2026-03-30 06:32:53 [auto1.be] INFO: Scrape type for UY27001: 2
2026-03-30 06:32:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 419d2c8c-fda5-5957-a21d-11003767f16f with identifier: UY27001
2026-03-30 06:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 419d2c8c-fda5-5957-a21d-11003767f16f with scrape type 2
2026-03-30 06:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 419d2c8c-fda5-5957-a21d-11003767f16f with scrape type 2
2026-03-30 06:32:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 419d2c8c-fda5-5957-a21d-11003767f16f, identifier: UY27001
2026-03-30 06:32:53 [auto1.be] INFO: Channel: 24h | Page: 29 | totalHits: 1288 | hits on page: 40
2026-03-30 06:32:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 419d2c8c-fda5-5957-a21d-11003767f16f with identifier: UY27001
2026-03-30 06:32:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 419d2c8c-fda5-5957-a21d-11003767f16f with identifier: UY27001
2026-03-30 06:32:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 419d2c8c-fda5-5957-a21d-11003767f16f with identifier: UY27001 to the API
2026-03-30 06:32:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:38:57Z',
 'fuel_type': 'diesel',
 'id': '419d2c8c-fda5-5957-a21d-11003767f16f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY27001',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 183729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-04',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2012}
2026-03-30 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY27001%27 HTTP/1.1" 200 None
2026-03-30 06:32:54 [auto1.be] INFO: Saving data for UY27001: {'auction_closing_time': 1774885137.0, 'created_time': 1774730010.73712, 'last_price_update_time': 1774852374.038168}
2026-03-30 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UY27001') HTTP/1.1" 204 0
2026-03-30 06:32:54 [auto1.be] INFO: Found listing with ID: CM21252
2026-03-30 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM21252%27 HTTP/1.1" 200 None
2026-03-30 06:32:54 [auto1.be] INFO: Scrape type for CM21252: 2
2026-03-30 06:32:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7383b066-8091-522a-b80c-88c0ec5112cb with identifier: CM21252
2026-03-30 06:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7383b066-8091-522a-b80c-88c0ec5112cb with scrape type 2
2026-03-30 06:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7383b066-8091-522a-b80c-88c0ec5112cb with scrape type 2
2026-03-30 06:32:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7383b066-8091-522a-b80c-88c0ec5112cb, identifier: CM21252
2026-03-30 06:32:54 [auto1.be] INFO: Found listing with ID: YG03175
2026-03-30 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG03175%27 HTTP/1.1" 200 None
2026-03-30 06:32:54 [auto1.be] INFO: Scrape type for YG03175: 2
2026-03-30 06:32:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17694848-4686-5cfa-bf4c-15b12b30fae3 with identifier: YG03175
2026-03-30 06:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17694848-4686-5cfa-bf4c-15b12b30fae3 with scrape type 2
2026-03-30 06:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17694848-4686-5cfa-bf4c-15b12b30fae3 with scrape type 2
2026-03-30 06:32:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 17694848-4686-5cfa-bf4c-15b12b30fae3, identifier: YG03175
2026-03-30 06:32:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7383b066-8091-522a-b80c-88c0ec5112cb with identifier: CM21252
2026-03-30 06:32:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7383b066-8091-522a-b80c-88c0ec5112cb with identifier: CM21252
2026-03-30 06:32:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7383b066-8091-522a-b80c-88c0ec5112cb with identifier: CM21252 to the API
2026-03-30 06:32:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:24:21Z',
 'fuel_type': 'diesel',
 'id': '7383b066-8091-522a-b80c-88c0ec5112cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM21252',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Venga',
 'odometer': 150893,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-11',
 'seller_name': None,
 'title': 'Kia Venga 1.6 CRDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-30 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM21252%27 HTTP/1.1" 200 None
2026-03-30 06:32:54 [auto1.be] INFO: Saving data for CM21252: {'auction_closing_time': 1774884261.0, 'created_time': 1774730013.054301, 'last_price_update_time': 1774852374.575621}
2026-03-30 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CM21252') HTTP/1.1" 204 0
2026-03-30 06:32:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 17694848-4686-5cfa-bf4c-15b12b30fae3 with identifier: YG03175
2026-03-30 06:32:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 17694848-4686-5cfa-bf4c-15b12b30fae3 with identifier: YG03175
2026-03-30 06:32:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 17694848-4686-5cfa-bf4c-15b12b30fae3 with identifier: YG03175 to the API
2026-03-30 06:32:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:57:48Z',
 'fuel_type': 'petrol',
 'id': '17694848-4686-5cfa-bf4c-15b12b30fae3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG03175',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 148963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-19',
 'seller_name': None,
 'title': 'MINI John Cooper Works',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG03175%27 HTTP/1.1" 200 None
2026-03-30 06:32:54 [auto1.be] INFO: Saving data for YG03175: {'auction_closing_time': 1774886268.0, 'created_time': 1774730021.996778, 'last_price_update_time': 1774852374.955807}
2026-03-30 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YG03175') HTTP/1.1" 204 0
2026-03-30 06:32:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:32:54 [auto1.be] INFO: Found listing with ID: SU85893
2026-03-30 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU85893%27 HTTP/1.1" 200 None
2026-03-30 06:32:54 [auto1.be] INFO: Scrape type for SU85893: 2
2026-03-30 06:32:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc with identifier: SU85893
2026-03-30 06:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc with scrape type 2
2026-03-30 06:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc with scrape type 2
2026-03-30 06:32:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc, identifier: SU85893
2026-03-30 06:32:55 [auto1.be] INFO: Found listing with ID: HK87235
2026-03-30 06:32:55 [auto1.be] INFO: Found listing with ID: UG65181
2026-03-30 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UG65181%27 HTTP/1.1" 200 None
2026-03-30 06:32:55 [auto1.be] INFO: Scrape type for UG65181: 2
2026-03-30 06:32:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c78281b6-f6c1-5312-85fe-0ee22fa70334 with identifier: UG65181
2026-03-30 06:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c78281b6-f6c1-5312-85fe-0ee22fa70334 with scrape type 2
2026-03-30 06:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c78281b6-f6c1-5312-85fe-0ee22fa70334 with scrape type 2
2026-03-30 06:32:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c78281b6-f6c1-5312-85fe-0ee22fa70334, identifier: UG65181
2026-03-30 06:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc with identifier: SU85893
2026-03-30 06:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc with identifier: SU85893
2026-03-30 06:32:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc with identifier: SU85893 to the API
2026-03-30 06:32:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:09:16Z',
 'fuel_type': 'petrol',
 'id': '2ce42eb3-0ceb-573e-9c5f-80d4b2fd98dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU85893',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 65117,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-29',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2017}
2026-03-30 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SU85893%27 HTTP/1.1" 200 None
2026-03-30 06:32:55 [auto1.be] INFO: Saving data for SU85893: {'auction_closing_time': 1774883356.0, 'created_time': 1774729987.060092, 'last_price_update_time': 1774852375.454663}
2026-03-30 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SU85893') HTTP/1.1" 204 0
2026-03-30 06:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c78281b6-f6c1-5312-85fe-0ee22fa70334 with identifier: UG65181
2026-03-30 06:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c78281b6-f6c1-5312-85fe-0ee22fa70334 with identifier: UG65181
2026-03-30 06:32:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c78281b6-f6c1-5312-85fe-0ee22fa70334 with identifier: UG65181 to the API
2026-03-30 06:32:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:57:07Z',
 'fuel_type': 'diesel',
 'id': 'c78281b6-f6c1-5312-85fe-0ee22fa70334',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG65181',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 142345,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-04',
 'seller_name': None,
 'title': 'BMW 1er 116d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-30 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UG65181%27 HTTP/1.1" 200 None
2026-03-30 06:32:55 [auto1.be] INFO: Saving data for UG65181: {'auction_closing_time': 1774886227.0, 'created_time': 1773348519.032579, 'last_price_update_time': 1774852375.738185}
2026-03-30 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UG65181') HTTP/1.1" 204 0
2026-03-30 06:32:55 [auto1.be] INFO: Found listing with ID: DT20121
2026-03-30 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT20121%27 HTTP/1.1" 200 None
2026-03-30 06:32:55 [auto1.be] INFO: Scrape type for DT20121: 2
2026-03-30 06:32:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b05fc74-4368-558d-8763-3111bcac2038 with identifier: DT20121
2026-03-30 06:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b05fc74-4368-558d-8763-3111bcac2038 with scrape type 2
2026-03-30 06:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b05fc74-4368-558d-8763-3111bcac2038 with scrape type 2
2026-03-30 06:32:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9b05fc74-4368-558d-8763-3111bcac2038, identifier: DT20121
2026-03-30 06:32:55 [auto1.be] INFO: Found listing with ID: KT35610
2026-03-30 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT35610%27 HTTP/1.1" 200 None
2026-03-30 06:32:55 [auto1.be] INFO: Scrape type for KT35610: 2
2026-03-30 06:32:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ac110c0-c182-59cd-9ab0-33653e50f40c with identifier: KT35610
2026-03-30 06:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ac110c0-c182-59cd-9ab0-33653e50f40c with scrape type 2
2026-03-30 06:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ac110c0-c182-59cd-9ab0-33653e50f40c with scrape type 2
2026-03-30 06:32:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6ac110c0-c182-59cd-9ab0-33653e50f40c, identifier: KT35610
2026-03-30 06:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9b05fc74-4368-558d-8763-3111bcac2038 with identifier: DT20121
2026-03-30 06:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9b05fc74-4368-558d-8763-3111bcac2038 with identifier: DT20121
2026-03-30 06:32:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9b05fc74-4368-558d-8763-3111bcac2038 with identifier: DT20121 to the API
2026-03-30 06:32:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:19:14Z',
 'fuel_type': 'diesel',
 'id': '9b05fc74-4368-558d-8763-3111bcac2038',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT20121',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'C70',
 'odometer': 204567,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-11',
 'seller_name': None,
 'title': 'Volvo C70 2.0 D3 Summum',
 'transmission': 'manual',
 'trim': 'Summum',
 'year': 2011}
2026-03-30 06:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT20121%27 HTTP/1.1" 200 None
2026-03-30 06:32:56 [auto1.be] INFO: Saving data for DT20121: {'auction_closing_time': 1774883954.0, 'created_time': 1774729994.476414, 'last_price_update_time': 1774852376.245793}
2026-03-30 06:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DT20121') HTTP/1.1" 204 0
2026-03-30 06:32:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6ac110c0-c182-59cd-9ab0-33653e50f40c with identifier: KT35610
2026-03-30 06:32:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6ac110c0-c182-59cd-9ab0-33653e50f40c with identifier: KT35610
2026-03-30 06:32:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6ac110c0-c182-59cd-9ab0-33653e50f40c with identifier: KT35610 to the API
2026-03-30 06:32:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:03:12Z',
 'fuel_type': 'petrol',
 'id': '6ac110c0-c182-59cd-9ab0-33653e50f40c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT35610',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 143964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-29',
 'seller_name': None,
 'title': 'Audi A4 35 TFSI Design',
 'transmission': 'automatic',
 'trim': 'Design',
 'year': 2019}
2026-03-30 06:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT35610%27 HTTP/1.1" 200 None
2026-03-30 06:32:56 [auto1.be] INFO: Saving data for KT35610: {'auction_closing_time': 1774882992.0, 'created_time': 1774730007.754609, 'last_price_update_time': 1774852376.524291}
2026-03-30 06:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KT35610') HTTP/1.1" 204 0
2026-03-30 06:32:56 [auto1.be] INFO: Found listing with ID: VM76060
2026-03-30 06:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM76060%27 HTTP/1.1" 200 None
2026-03-30 06:32:56 [auto1.be] INFO: Scrape type for VM76060: 2
2026-03-30 06:32:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2 with identifier: VM76060
2026-03-30 06:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2 with scrape type 2
2026-03-30 06:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2 with scrape type 2
2026-03-30 06:32:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2, identifier: VM76060
2026-03-30 06:32:56 [auto1.be] INFO: Found listing with ID: CD22470
2026-03-30 06:32:56 [auto1.be] INFO: Found listing with ID: SJ05954
2026-03-30 06:32:56 [auto1.be] INFO: Found listing with ID: GH80996
2026-03-30 06:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH80996%27 HTTP/1.1" 200 None
2026-03-30 06:32:56 [auto1.be] INFO: Scrape type for GH80996: 2
2026-03-30 06:32:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3447f573-ccfe-5136-88ae-151c39cb24e8 with identifier: GH80996
2026-03-30 06:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3447f573-ccfe-5136-88ae-151c39cb24e8 with scrape type 2
2026-03-30 06:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3447f573-ccfe-5136-88ae-151c39cb24e8 with scrape type 2
2026-03-30 06:32:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3447f573-ccfe-5136-88ae-151c39cb24e8, identifier: GH80996
2026-03-30 06:32:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2 with identifier: VM76060
2026-03-30 06:32:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2 with identifier: VM76060
2026-03-30 06:32:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2 with identifier: VM76060 to the API
2026-03-30 06:32:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:58:13Z',
 'fuel_type': 'diesel',
 'id': '6abf35e2-44f6-5cbd-acdf-c1ccdc753bc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM76060',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 217331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-24',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2013}
2026-03-30 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM76060%27 HTTP/1.1" 200 None
2026-03-30 06:32:57 [auto1.be] INFO: Saving data for VM76060: {'auction_closing_time': 1774886293.0, 'created_time': 1774730017.555454, 'last_price_update_time': 1774852377.018683}
2026-03-30 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VM76060') HTTP/1.1" 204 0
2026-03-30 06:32:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3447f573-ccfe-5136-88ae-151c39cb24e8 with identifier: GH80996
2026-03-30 06:32:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3447f573-ccfe-5136-88ae-151c39cb24e8 with identifier: GH80996
2026-03-30 06:32:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3447f573-ccfe-5136-88ae-151c39cb24e8 with identifier: GH80996 to the API
2026-03-30 06:32:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:02:58Z',
 'fuel_type': 'petrol',
 'id': '3447f573-ccfe-5136-88ae-151c39cb24e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH80996',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 210882,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-16',
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Stepway Prestige',
 'transmission': 'manual',
 'trim': 'Stepway Prestige',
 'year': 2014}
2026-03-30 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH80996%27 HTTP/1.1" 200 None
2026-03-30 06:32:57 [auto1.be] INFO: Saving data for GH80996: {'auction_closing_time': 1774882978.0, 'created_time': 1774730013.918888, 'last_price_update_time': 1774852377.297496}
2026-03-30 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GH80996') HTTP/1.1" 204 0
2026-03-30 06:32:57 [auto1.be] INFO: Found listing with ID: FJ57746
2026-03-30 06:32:57 [auto1.be] INFO: Found listing with ID: KZ05274
2026-03-30 06:32:57 [auto1.be] INFO: Found listing with ID: TJ00131
2026-03-30 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TJ00131%27 HTTP/1.1" 200 None
2026-03-30 06:32:57 [auto1.be] INFO: Scrape type for TJ00131: 2
2026-03-30 06:32:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eebd68b4-c645-56b5-976c-7e64ee243417 with identifier: TJ00131
2026-03-30 06:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eebd68b4-c645-56b5-976c-7e64ee243417 with scrape type 2
2026-03-30 06:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eebd68b4-c645-56b5-976c-7e64ee243417 with scrape type 2
2026-03-30 06:32:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: eebd68b4-c645-56b5-976c-7e64ee243417, identifier: TJ00131
2026-03-30 06:32:57 [auto1.be] INFO: Found listing with ID: ZY24236
2026-03-30 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY24236%27 HTTP/1.1" 200 None
2026-03-30 06:32:57 [auto1.be] INFO: Scrape type for ZY24236: 2
2026-03-30 06:32:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58b0c11d-f45f-5db5-8d6a-26a4be56ed61 with identifier: ZY24236
2026-03-30 06:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58b0c11d-f45f-5db5-8d6a-26a4be56ed61 with scrape type 2
2026-03-30 06:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58b0c11d-f45f-5db5-8d6a-26a4be56ed61 with scrape type 2
2026-03-30 06:32:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 58b0c11d-f45f-5db5-8d6a-26a4be56ed61, identifier: ZY24236
2026-03-30 06:32:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: eebd68b4-c645-56b5-976c-7e64ee243417 with identifier: TJ00131
2026-03-30 06:32:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: eebd68b4-c645-56b5-976c-7e64ee243417 with identifier: TJ00131
2026-03-30 06:32:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: eebd68b4-c645-56b5-976c-7e64ee243417 with identifier: TJ00131 to the API
2026-03-30 06:32:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 238,
 'expiration_date': '2026-03-30T15:27:01Z',
 'fuel_type': 'petrol',
 'id': 'eebd68b4-c645-56b5-976c-7e64ee243417',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ00131',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'S-TYPE',
 'odometer': 154578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-05-02',
 'seller_name': None,
 'title': 'Jaguar S-TYPE 3.0 V6',
 'transmission': 'automatic',
 'trim': '',
 'year': 2002}
2026-03-30 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TJ00131%27 HTTP/1.1" 200 None
2026-03-30 06:32:57 [auto1.be] INFO: Saving data for TJ00131: {'auction_closing_time': 1774884421.0, 'created_time': 1774730013.542483, 'last_price_update_time': 1774852377.797591}
2026-03-30 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TJ00131') HTTP/1.1" 204 0
2026-03-30 06:32:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 58b0c11d-f45f-5db5-8d6a-26a4be56ed61 with identifier: ZY24236
2026-03-30 06:32:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 58b0c11d-f45f-5db5-8d6a-26a4be56ed61 with identifier: ZY24236
2026-03-30 06:32:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 58b0c11d-f45f-5db5-8d6a-26a4be56ed61 with identifier: ZY24236 to the API
2026-03-30 06:32:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-30T15:38:02Z',
 'fuel_type': 'hybrid',
 'id': '58b0c11d-f45f-5db5-8d6a-26a4be56ed61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY24236',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 251819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-31',
 'seller_name': None,
 'title': 'BMW X5 xDrive 40e',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-30 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY24236%27 HTTP/1.1" 200 None
2026-03-30 06:32:58 [auto1.be] INFO: Saving data for ZY24236: {'auction_closing_time': 1774885082.0, 'created_time': 1774730026.98187, 'last_price_update_time': 1774852378.183265}
2026-03-30 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZY24236') HTTP/1.1" 204 0
2026-03-30 06:32:58 [auto1.be] INFO: Found listing with ID: VY36246
2026-03-30 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VY36246%27 HTTP/1.1" 200 None
2026-03-30 06:32:58 [auto1.be] INFO: Scrape type for VY36246: 2
2026-03-30 06:32:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 915df589-6278-5af1-9457-45a9ffa8357a with identifier: VY36246
2026-03-30 06:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 915df589-6278-5af1-9457-45a9ffa8357a with scrape type 2
2026-03-30 06:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 915df589-6278-5af1-9457-45a9ffa8357a with scrape type 2
2026-03-30 06:32:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 915df589-6278-5af1-9457-45a9ffa8357a, identifier: VY36246
2026-03-30 06:32:58 [auto1.be] INFO: Found listing with ID: FV90992
2026-03-30 06:32:58 [auto1.be] INFO: Found listing with ID: PG48700
2026-03-30 06:32:58 [auto1.be] INFO: Found listing with ID: ZZ74713
2026-03-30 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ74713%27 HTTP/1.1" 200 None
2026-03-30 06:32:58 [auto1.be] INFO: Scrape type for ZZ74713: 2
2026-03-30 06:32:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5202aaac-ea13-5098-944c-6f6e7b2ab5b2 with identifier: ZZ74713
2026-03-30 06:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5202aaac-ea13-5098-944c-6f6e7b2ab5b2 with scrape type 2
2026-03-30 06:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5202aaac-ea13-5098-944c-6f6e7b2ab5b2 with scrape type 2
2026-03-30 06:32:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5202aaac-ea13-5098-944c-6f6e7b2ab5b2, identifier: ZZ74713
2026-03-30 06:32:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 915df589-6278-5af1-9457-45a9ffa8357a with identifier: VY36246
2026-03-30 06:32:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 915df589-6278-5af1-9457-45a9ffa8357a with identifier: VY36246
2026-03-30 06:32:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 915df589-6278-5af1-9457-45a9ffa8357a with identifier: VY36246 to the API
2026-03-30 06:32:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:03:28Z',
 'fuel_type': 'petrol',
 'id': '915df589-6278-5af1-9457-45a9ffa8357a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY36246',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5 X',
 'odometer': 24125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-10-27',
 'seller_name': None,
 'title': 'Citroen C5 X 1.2 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2024}
2026-03-30 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VY36246%27 HTTP/1.1" 200 None
2026-03-30 06:32:58 [auto1.be] INFO: Saving data for VY36246: {'auction_closing_time': 1774883008.0, 'created_time': 1774730024.307092, 'last_price_update_time': 1774852378.690387}
2026-03-30 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VY36246') HTTP/1.1" 204 0
2026-03-30 06:32:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5202aaac-ea13-5098-944c-6f6e7b2ab5b2 with identifier: ZZ74713
2026-03-30 06:32:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5202aaac-ea13-5098-944c-6f6e7b2ab5b2 with identifier: ZZ74713
2026-03-30 06:32:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5202aaac-ea13-5098-944c-6f6e7b2ab5b2 with identifier: ZZ74713 to the API
2026-03-30 06:32:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 121,
 'expiration_date': '2026-03-30T15:26:00Z',
 'fuel_type': 'petrol',
 'id': '5202aaac-ea13-5098-944c-6f6e7b2ab5b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ74713',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 163114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-27',
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Skyactiv-G Center-Line',
 'transmission': 'manual',
 'trim': 'Center-Line',
 'year': 2019}
2026-03-30 06:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ74713%27 HTTP/1.1" 200 None
2026-03-30 06:32:59 [auto1.be] INFO: Saving data for ZZ74713: {'auction_closing_time': 1774884360.0, 'created_time': 1774730028.556237, 'last_price_update_time': 1774852379.003549}
2026-03-30 06:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZZ74713') HTTP/1.1" 204 0
2026-03-30 06:32:59 [auto1.be] INFO: Found listing with ID: MJ04907
2026-03-30 06:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ04907%27 HTTP/1.1" 200 None
2026-03-30 06:32:59 [auto1.be] INFO: Scrape type for MJ04907: 2
2026-03-30 06:32:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b5cc812-8365-50da-b6f4-19fff86690e6 with identifier: MJ04907
2026-03-30 06:32:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b5cc812-8365-50da-b6f4-19fff86690e6 with scrape type 2
2026-03-30 06:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b5cc812-8365-50da-b6f4-19fff86690e6 with scrape type 2
2026-03-30 06:32:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6b5cc812-8365-50da-b6f4-19fff86690e6, identifier: MJ04907
2026-03-30 06:32:59 [auto1.be] INFO: Found listing with ID: XD67660
2026-03-30 06:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD67660%27 HTTP/1.1" 200 None
2026-03-30 06:32:59 [auto1.be] INFO: Scrape type for XD67660: 2
2026-03-30 06:32:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9cd90119-5bf5-52a8-b1c5-13e50e63be47 with identifier: XD67660
2026-03-30 06:32:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cd90119-5bf5-52a8-b1c5-13e50e63be47 with scrape type 2
2026-03-30 06:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9cd90119-5bf5-52a8-b1c5-13e50e63be47 with scrape type 2
2026-03-30 06:32:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9cd90119-5bf5-52a8-b1c5-13e50e63be47, identifier: XD67660
2026-03-30 06:32:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6b5cc812-8365-50da-b6f4-19fff86690e6 with identifier: MJ04907
2026-03-30 06:32:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6b5cc812-8365-50da-b6f4-19fff86690e6 with identifier: MJ04907
2026-03-30 06:32:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6b5cc812-8365-50da-b6f4-19fff86690e6 with identifier: MJ04907 to the API
2026-03-30 06:32:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:53:08Z',
 'fuel_type': 'diesel',
 'id': '6b5cc812-8365-50da-b6f4-19fff86690e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ04907',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 193071,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-29',
 'seller_name': None,
 'title': 'Kia Sorento 2.2 CRDi Edition 7 4WD',
 'transmission': 'automatic',
 'trim': 'Edition 7 4WD',
 'year': 2018}
2026-03-30 06:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ04907%27 HTTP/1.1" 200 None
2026-03-30 06:32:59 [auto1.be] INFO: Saving data for MJ04907: {'auction_closing_time': 1774885988.0, 'created_time': 1774730027.868112, 'last_price_update_time': 1774852379.511223}
2026-03-30 06:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MJ04907') HTTP/1.1" 204 0
2026-03-30 06:32:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9cd90119-5bf5-52a8-b1c5-13e50e63be47 with identifier: XD67660
2026-03-30 06:32:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9cd90119-5bf5-52a8-b1c5-13e50e63be47 with identifier: XD67660
2026-03-30 06:32:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9cd90119-5bf5-52a8-b1c5-13e50e63be47 with identifier: XD67660 to the API
2026-03-30 06:32:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:32:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 91,
 'expiration_date': '2026-03-30T15:41:22Z',
 'fuel_type': 'petrol',
 'id': '9cd90119-5bf5-52a8-b1c5-13e50e63be47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD67660',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 31513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-26',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe Essential',
 'transmission': 'manual',
 'trim': 'Essential',
 'year': 2024}
2026-03-30 06:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XD67660%27 HTTP/1.1" 200 None
2026-03-30 06:32:59 [auto1.be] INFO: Saving data for XD67660: {'auction_closing_time': 1774885282.0, 'created_time': 1774730044.066561, 'last_price_update_time': 1774852379.777405}
2026-03-30 06:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XD67660') HTTP/1.1" 204 0
2026-03-30 06:32:59 [auto1.be] INFO: Found listing with ID: DT55223
2026-03-30 06:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT55223%27 HTTP/1.1" 200 None
2026-03-30 06:32:59 [auto1.be] INFO: Scrape type for DT55223: 2
2026-03-30 06:32:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1da0c75b-2607-5e9c-adad-3f4bfff505a1 with identifier: DT55223
2026-03-30 06:32:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1da0c75b-2607-5e9c-adad-3f4bfff505a1 with scrape type 2
2026-03-30 06:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1da0c75b-2607-5e9c-adad-3f4bfff505a1 with scrape type 2
2026-03-30 06:32:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1da0c75b-2607-5e9c-adad-3f4bfff505a1, identifier: DT55223
2026-03-30 06:32:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1da0c75b-2607-5e9c-adad-3f4bfff505a1 with identifier: DT55223
2026-03-30 06:32:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1da0c75b-2607-5e9c-adad-3f4bfff505a1 with identifier: DT55223
2026-03-30 06:32:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1da0c75b-2607-5e9c-adad-3f4bfff505a1 with identifier: DT55223 to the API
2026-03-30 06:32:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:33:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:16:16Z',
 'fuel_type': 'diesel',
 'id': '1da0c75b-2607-5e9c-adad-3f4bfff505a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT55223',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 161506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-24',
 'seller_name': None,
 'title': 'Fiat Ducato 3.0 JTD 180 Power',
 'transmission': 'manual',
 'trim': '180 Power',
 'year': 2016}
2026-03-30 06:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT55223%27 HTTP/1.1" 200 None
2026-03-30 06:33:00 [auto1.be] INFO: Saving data for DT55223: {'auction_closing_time': 1774883776.0, 'created_time': 1774730021.568409, 'last_price_update_time': 1774852380.18147}
2026-03-30 06:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DT55223') HTTP/1.1" 204 0
2026-03-30 06:33:00 [auto1.be] INFO: Found listing with ID: EL95031
2026-03-30 06:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL95031%27 HTTP/1.1" 200 None
2026-03-30 06:33:00 [auto1.be] INFO: Scrape type for EL95031: 2
2026-03-30 06:33:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 364aa1f0-becd-5728-a6f8-7ee4897968dc with identifier: EL95031
2026-03-30 06:33:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 364aa1f0-becd-5728-a6f8-7ee4897968dc with scrape type 2
2026-03-30 06:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 364aa1f0-becd-5728-a6f8-7ee4897968dc with scrape type 2
2026-03-30 06:33:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 364aa1f0-becd-5728-a6f8-7ee4897968dc, identifier: EL95031
2026-03-30 06:33:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 364aa1f0-becd-5728-a6f8-7ee4897968dc with identifier: EL95031
2026-03-30 06:33:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 364aa1f0-becd-5728-a6f8-7ee4897968dc with identifier: EL95031
2026-03-30 06:33:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 364aa1f0-becd-5728-a6f8-7ee4897968dc with identifier: EL95031 to the API
2026-03-30 06:33:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:33:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:38:00Z',
 'fuel_type': 'diesel',
 'id': '364aa1f0-becd-5728-a6f8-7ee4897968dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL95031',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 133647,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-26',
 'seller_name': None,
 'title': 'Jeep Compass 2.2 CRD Limited 4x4',
 'transmission': 'manual',
 'trim': 'Limited 4x4',
 'year': 2013}
2026-03-30 06:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL95031%27 HTTP/1.1" 200 None
2026-03-30 06:33:00 [auto1.be] INFO: Saving data for EL95031: {'auction_closing_time': 1774885080.0, 'created_time': 1774730016.52216, 'last_price_update_time': 1774852380.553612}
2026-03-30 06:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EL95031') HTTP/1.1" 204 0
2026-03-30 06:33:00 [auto1.be] INFO: Found listing with ID: DC62563
2026-03-30 06:33:00 [auto1.be] INFO: Found listing with ID: UX01518
2026-03-30 06:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX01518%27 HTTP/1.1" 200 None
2026-03-30 06:33:00 [auto1.be] INFO: Scrape type for UX01518: 2
2026-03-30 06:33:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2c64f7f-f2f5-5aef-aab7-03383cfa977f with identifier: UX01518
2026-03-30 06:33:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2c64f7f-f2f5-5aef-aab7-03383cfa977f with scrape type 2
2026-03-30 06:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2c64f7f-f2f5-5aef-aab7-03383cfa977f with scrape type 2
2026-03-30 06:33:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b2c64f7f-f2f5-5aef-aab7-03383cfa977f, identifier: UX01518
2026-03-30 06:33:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b2c64f7f-f2f5-5aef-aab7-03383cfa977f with identifier: UX01518
2026-03-30 06:33:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b2c64f7f-f2f5-5aef-aab7-03383cfa977f with identifier: UX01518
2026-03-30 06:33:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b2c64f7f-f2f5-5aef-aab7-03383cfa977f with identifier: UX01518 to the API
2026-03-30 06:33:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:33:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:56:32Z',
 'fuel_type': 'diesel',
 'id': 'b2c64f7f-f2f5-5aef-aab7-03383cfa977f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX01518',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 94317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-01',
 'seller_name': None,
 'title': 'Citroen C3 1.4 HDi SensoDrive Exclusive',
 'transmission': 'automatic',
 'trim': 'SensoDrive Exclusive',
 'year': 2006}
2026-03-30 06:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX01518%27 HTTP/1.1" 200 None
2026-03-30 06:33:00 [auto1.be] INFO: Saving data for UX01518: {'auction_closing_time': 1774886192.0, 'created_time': 1774730020.110108, 'last_price_update_time': 1774852380.954456}
2026-03-30 06:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UX01518') HTTP/1.1" 204 0
2026-03-30 06:33:00 [auto1.be] INFO: Found listing with ID: ZP95092
2026-03-30 06:33:00 [auto1.be] INFO: Found listing with ID: ZR35447
2026-03-30 06:33:00 [auto1.be] INFO: Found listing with ID: EK14732
2026-03-30 06:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK14732%27 HTTP/1.1" 200 None
2026-03-30 06:33:00 [auto1.be] INFO: Scrape type for EK14732: 0
2026-03-30 06:33:00 [auto1.be] INFO: Found listing with ID: CA54828
2026-03-30 06:33:00 [auto1.be] INFO: Found listing with ID: UR02836
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR02836%27 HTTP/1.1" 200 None
2026-03-30 06:33:01 [auto1.be] INFO: Scrape type for UR02836: 0
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: XK01311
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK01311%27 HTTP/1.1" 200 None
2026-03-30 06:33:01 [auto1.be] INFO: Scrape type for XK01311: 0
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: FW70524
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: ED41371
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED41371%27 HTTP/1.1" 200 None
2026-03-30 06:33:01 [auto1.be] INFO: Scrape type for ED41371: 0
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: VX51166
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VX51166%27 HTTP/1.1" 200 None
2026-03-30 06:33:01 [auto1.be] INFO: Scrape type for VX51166: 0
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: BD29807
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD29807%27 HTTP/1.1" 200 None
2026-03-30 06:33:01 [auto1.be] INFO: Scrape type for BD29807: 0
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: NZ74768
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: AC55620
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: ZJ26009
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ26009%27 HTTP/1.1" 200 None
2026-03-30 06:33:01 [auto1.be] INFO: Scrape type for ZJ26009: 0
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: LR36013
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LR36013%27 HTTP/1.1" 200 None
2026-03-30 06:33:01 [auto1.be] INFO: Scrape type for LR36013: 0
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: YZ92764
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: ZZ63767
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: VW23905
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: BZ70123
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: TX50404
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX50404%27 HTTP/1.1" 200 None
2026-03-30 06:33:01 [auto1.be] INFO: Scrape type for TX50404: 0
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: XC95069
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: BS70441
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: GM14941
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: SY87797
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: WV78161
2026-03-30 06:33:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:33:01 [auto1.be] INFO: Channel: 24h | Page: 30 | totalHits: 1288 | hits on page: 40
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: ZV95387
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: HR69689
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HR69689%27 HTTP/1.1" 200 None
2026-03-30 06:33:01 [auto1.be] INFO: Scrape type for HR69689: 0
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: KB40459
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: FC15884
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC15884%27 HTTP/1.1" 200 None
2026-03-30 06:33:01 [auto1.be] INFO: Scrape type for FC15884: 0
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: KX73156
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX73156%27 HTTP/1.1" 200 None
2026-03-30 06:33:01 [auto1.be] INFO: Scrape type for KX73156: 0
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: ZZ39097
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: SZ00073
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ00073%27 HTTP/1.1" 200 None
2026-03-30 06:33:01 [auto1.be] INFO: Scrape type for SZ00073: 0
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: SC10935
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: BU18930
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: CA73486
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA73486%27 HTTP/1.1" 200 None
2026-03-30 06:33:01 [auto1.be] INFO: Scrape type for CA73486: 0
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: NU74968
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU74968%27 HTTP/1.1" 200 None
2026-03-30 06:33:01 [auto1.be] INFO: Scrape type for NU74968: 0
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: WX14373
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WX14373%27 HTTP/1.1" 200 None
2026-03-30 06:33:01 [auto1.be] INFO: Scrape type for WX14373: 0
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: YK61845
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: CN37182
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: EK79460
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: SW60531
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW60531%27 HTTP/1.1" 200 None
2026-03-30 06:33:01 [auto1.be] INFO: Scrape type for SW60531: 0
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: KE51169
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: KH65741
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH65741%27 HTTP/1.1" 200 None
2026-03-30 06:33:01 [auto1.be] INFO: Scrape type for KH65741: 0
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: JJ51820
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ51820%27 HTTP/1.1" 200 None
2026-03-30 06:33:01 [auto1.be] INFO: Scrape type for JJ51820: 0
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: CV58665
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV58665%27 HTTP/1.1" 200 None
2026-03-30 06:33:01 [auto1.be] INFO: Scrape type for CV58665: 0
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: NE94103
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE94103%27 HTTP/1.1" 200 None
2026-03-30 06:33:01 [auto1.be] INFO: Scrape type for NE94103: 0
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: RC51689
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC51689%27 HTTP/1.1" 200 None
2026-03-30 06:33:01 [auto1.be] INFO: Scrape type for RC51689: 0
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: XS76018
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: UY92003
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: NV64774
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: KB41449
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KB41449%27 HTTP/1.1" 200 None
2026-03-30 06:33:01 [auto1.be] INFO: Scrape type for KB41449: 0
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: ET88330
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: KT00341
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: YH90615
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: CU35051
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: JU94491
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JU94491%27 HTTP/1.1" 200 None
2026-03-30 06:33:01 [auto1.be] INFO: Scrape type for JU94491: 0
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: PK02246
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: PU93740
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU93740%27 HTTP/1.1" 200 None
2026-03-30 06:33:01 [auto1.be] INFO: Scrape type for PU93740: 0
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: LY17098
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: FC78029
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: EH00335
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: WH49963
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: XG70738
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG70738%27 HTTP/1.1" 200 None
2026-03-30 06:33:01 [auto1.be] INFO: Scrape type for XG70738: 0
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: KL53758
2026-03-30 06:33:01 [auto1.be] INFO: Found listing with ID: GV92885
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV92885%27 HTTP/1.1" 200 None
2026-03-30 06:33:01 [auto1.be] INFO: Scrape type for GV92885: 0
2026-03-30 06:33:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:33:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:33:02 [auto1.be] INFO: Channel: 24h | Page: 31 | totalHits: 1288 | hits on page: 40
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: RA73981
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: EJ96142
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: HE39793
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: DD83263
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: DV83163
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DV83163%27 HTTP/1.1" 200 None
2026-03-30 06:33:02 [auto1.be] INFO: Scrape type for DV83163: 0
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: SW21472
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: AF15006
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF15006%27 HTTP/1.1" 200 None
2026-03-30 06:33:02 [auto1.be] INFO: Scrape type for AF15006: 0
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: JY19882
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY19882%27 HTTP/1.1" 200 None
2026-03-30 06:33:02 [auto1.be] INFO: Scrape type for JY19882: 0
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: EY57880
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: JZ80953
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ80953%27 HTTP/1.1" 200 None
2026-03-30 06:33:02 [auto1.be] INFO: Scrape type for JZ80953: 0
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: TL44110
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL44110%27 HTTP/1.1" 200 None
2026-03-30 06:33:02 [auto1.be] INFO: Scrape type for TL44110: 0
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: ZN56944
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: FC31614
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC31614%27 HTTP/1.1" 200 None
2026-03-30 06:33:02 [auto1.be] INFO: Scrape type for FC31614: 0
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: HX50025
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: DH53723
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: CU06988
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU06988%27 HTTP/1.1" 200 None
2026-03-30 06:33:02 [auto1.be] INFO: Scrape type for CU06988: 0
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: RD62823
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: KH04328
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH04328%27 HTTP/1.1" 200 None
2026-03-30 06:33:02 [auto1.be] INFO: Scrape type for KH04328: 0
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: GN32494
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN32494%27 HTTP/1.1" 200 None
2026-03-30 06:33:02 [auto1.be] INFO: Scrape type for GN32494: 0
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: ZG72967
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: LA84805
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LA84805%27 HTTP/1.1" 200 None
2026-03-30 06:33:02 [auto1.be] INFO: Scrape type for LA84805: 0
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: UH00217
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: RX31058
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX31058%27 HTTP/1.1" 200 None
2026-03-30 06:33:02 [auto1.be] INFO: Scrape type for RX31058: 0
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: BB55914
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB55914%27 HTTP/1.1" 200 None
2026-03-30 06:33:02 [auto1.be] INFO: Scrape type for BB55914: 0
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: EU75132
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: JY01361
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: KC67497
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC67497%27 HTTP/1.1" 200 None
2026-03-30 06:33:02 [auto1.be] INFO: Scrape type for KC67497: 0
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: FK09845
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: EB31921
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: DJ63605
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: US61346
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27US61346%27 HTTP/1.1" 200 None
2026-03-30 06:33:02 [auto1.be] INFO: Scrape type for US61346: 0
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: SY12350
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY12350%27 HTTP/1.1" 200 None
2026-03-30 06:33:02 [auto1.be] INFO: Scrape type for SY12350: 0
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: ST29091
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST29091%27 HTTP/1.1" 200 None
2026-03-30 06:33:02 [auto1.be] INFO: Scrape type for ST29091: 0
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: TV57254
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TV57254%27 HTTP/1.1" 200 None
2026-03-30 06:33:02 [auto1.be] INFO: Scrape type for TV57254: 0
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: TC61218
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: PP72448
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: EV21741
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: RF01360
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RF01360%27 HTTP/1.1" 200 None
2026-03-30 06:33:02 [auto1.be] INFO: Scrape type for RF01360: 0
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: UU14069
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU14069%27 HTTP/1.1" 200 None
2026-03-30 06:33:02 [auto1.be] INFO: Scrape type for UU14069: 0
2026-03-30 06:33:02 [auto1.be] INFO: Found listing with ID: BZ95673
2026-03-30 06:33:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:33:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:33:04 [auto1.be] INFO: Channel: 24h | Page: 32 | totalHits: 1288 | hits on page: 40
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: AG16412
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: TM16327
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: UC18604
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: TF70513
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: ZD95004
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: ES25967
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: PC01829
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: RW32127
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: CE27208
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: XG78459
2026-03-30 06:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG78459%27 HTTP/1.1" 200 None
2026-03-30 06:33:04 [auto1.be] INFO: Scrape type for XG78459: 0
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: CG81228
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: RC25321
2026-03-30 06:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC25321%27 HTTP/1.1" 200 None
2026-03-30 06:33:04 [auto1.be] INFO: Scrape type for RC25321: 0
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: YZ86935
2026-03-30 06:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YZ86935%27 HTTP/1.1" 200 None
2026-03-30 06:33:04 [auto1.be] INFO: Scrape type for YZ86935: 0
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: XB72565
2026-03-30 06:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB72565%27 HTTP/1.1" 200 None
2026-03-30 06:33:04 [auto1.be] INFO: Scrape type for XB72565: 0
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: WN54122
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: WM28184
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: UA48921
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: PV46198
2026-03-30 06:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV46198%27 HTTP/1.1" 200 None
2026-03-30 06:33:04 [auto1.be] INFO: Scrape type for PV46198: 0
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: LE69336
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: RY49845
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: ZT87936
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: VZ26828
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: RU30240
2026-03-30 06:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU30240%27 HTTP/1.1" 200 None
2026-03-30 06:33:04 [auto1.be] INFO: Scrape type for RU30240: 0
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: KR16689
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: YV20290
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: XX22473
2026-03-30 06:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XX22473%27 HTTP/1.1" 200 None
2026-03-30 06:33:04 [auto1.be] INFO: Scrape type for XX22473: 0
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: LK52725
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: TS84713
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: HY97997
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: YA99172
2026-03-30 06:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA99172%27 HTTP/1.1" 200 None
2026-03-30 06:33:04 [auto1.be] INFO: Scrape type for YA99172: 0
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: PD03709
2026-03-30 06:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PD03709%27 HTTP/1.1" 200 None
2026-03-30 06:33:04 [auto1.be] INFO: Scrape type for PD03709: 0
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: ZU52155
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: HJ47401
2026-03-30 06:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ47401%27 HTTP/1.1" 200 None
2026-03-30 06:33:04 [auto1.be] INFO: Scrape type for HJ47401: 0
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: FY94559
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: WY04920
2026-03-30 06:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WY04920%27 HTTP/1.1" 200 None
2026-03-30 06:33:04 [auto1.be] INFO: Scrape type for WY04920: 0
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: PG64643
2026-03-30 06:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PG64643%27 HTTP/1.1" 200 None
2026-03-30 06:33:04 [auto1.be] INFO: Scrape type for PG64643: 0
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: GF35922
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: BR73229
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: PV20794
2026-03-30 06:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV20794%27 HTTP/1.1" 200 None
2026-03-30 06:33:04 [auto1.be] INFO: Scrape type for PV20794: 0
2026-03-30 06:33:04 [auto1.be] INFO: Found listing with ID: BB63081
2026-03-30 06:33:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:33:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:33:05 [auto1.be] INFO: Channel: 24h | Page: 33 | totalHits: 1288 | hits on page: 8
2026-03-30 06:33:05 [auto1.be] INFO: Found listing with ID: SD89253
2026-03-30 06:33:05 [auto1.be] INFO: Found listing with ID: SJ57770
2026-03-30 06:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ57770%27 HTTP/1.1" 200 None
2026-03-30 06:33:05 [auto1.be] INFO: Scrape type for SJ57770: 0
2026-03-30 06:33:05 [auto1.be] INFO: Found listing with ID: XR93319
2026-03-30 06:33:05 [auto1.be] INFO: Found listing with ID: AB98915
2026-03-30 06:33:05 [auto1.be] INFO: Found listing with ID: AB83336
2026-03-30 06:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB83336%27 HTTP/1.1" 200 None
2026-03-30 06:33:05 [auto1.be] INFO: Scrape type for AB83336: 2
2026-03-30 06:33:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d949308-da85-51a3-8bc7-d5dee023bb14 with identifier: AB83336
2026-03-30 06:33:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d949308-da85-51a3-8bc7-d5dee023bb14 with scrape type 2
2026-03-30 06:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d949308-da85-51a3-8bc7-d5dee023bb14 with scrape type 2
2026-03-30 06:33:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9d949308-da85-51a3-8bc7-d5dee023bb14, identifier: AB83336
2026-03-30 06:33:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9d949308-da85-51a3-8bc7-d5dee023bb14 with identifier: AB83336
2026-03-30 06:33:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9d949308-da85-51a3-8bc7-d5dee023bb14 with identifier: AB83336
2026-03-30 06:33:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9d949308-da85-51a3-8bc7-d5dee023bb14 with identifier: AB83336 to the API
2026-03-30 06:33:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 06:33:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 06:33:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:25:39Z',
 'fuel_type': 'diesel',
 'id': '9d949308-da85-51a3-8bc7-d5dee023bb14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB83336',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 168842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-13',
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 319 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 06:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB83336%27 HTTP/1.1" 200 None
2026-03-30 06:33:05 [auto1.be] INFO: Saving data for AB83336: {'auction_closing_time': 1774884339.0, 'created_time': 1774265473.136375, 'last_price_update_time': 1774852385.709201}
2026-03-30 06:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AB83336') HTTP/1.1" 204 0
2026-03-30 06:33:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 06:33:05 [auto1.be] INFO: Found listing with ID: MR34349
2026-03-30 06:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR34349%27 HTTP/1.1" 200 None
2026-03-30 06:33:05 [auto1.be] INFO: Scrape type for MR34349: 0
2026-03-30 06:33:05 [auto1.be] INFO: Found listing with ID: XL09418
2026-03-30 06:33:05 [auto1.be] INFO: Found listing with ID: UW48636
2026-03-30 06:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW48636%27 HTTP/1.1" 200 None
2026-03-30 06:33:05 [auto1.be] INFO: Scrape type for UW48636: 0
2026-03-30 06:33:06 [scrapy.extensions.logstats] INFO: Crawled 47 pages (at 12 pages/min), scraped 262 items (at 99 items/min)
2026-03-30 06:33:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 165MiB
2026-03-30 06:33:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 06:33:07 [auto1.be] INFO: Channel: 24h | Page: 34 | totalHits: 1288 | hits on page: 0
2026-03-30 06:33:07 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 06:33:07 [auto1.be] INFO: auto1.be Batch config: batch 1/2
2026-03-30 06:33:07 [auto1.be] INFO: auto1.be Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 2, <ScrapeType.BATCH_SKIPPED: 5>: 1}
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20last_price_update_time%20lt%201774420387 HTTP/1.1" 200 None
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AB73434') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AC62971') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AE06591') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AE69590') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AJ77314') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AN71185') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AR77360') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AR85009') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AS66047') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AS90865') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AT55259') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='AU76342') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BA34359') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BG53542') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BL96555') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BM12470') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BM78413') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BU31426') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='BZ92790') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CA99027') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CB18656') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CC03099') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CC79375') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CD11071') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CF46632') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CF95051') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CG29350') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CH12104') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CH57308') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CJ01041') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CM71820') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CR52608') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CU80660') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='CY17072') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DD53740') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DD65847') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DE38122') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DK07692') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DT14579') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DT32681') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='DX63416') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EA52825') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EB45730') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EC07717') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EC09502') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EH72637') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ER13926') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EU22404') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EV12417') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EV84990') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='EW54753') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FA40633') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FB83589') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FF14638') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FF64130') HTTP/1.1" 204 0
2026-03-30 06:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FK84360') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FW69387') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FX01854') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FY08987') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='FY25274') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GC19122') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GJ35356') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GJ87792') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GK82738') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GN16648') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GR87570') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='GT71652') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HA34163') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HA43687') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HB58096') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HC09416') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HD26188') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HP71353') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HR08877') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HS38933') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='HY40770') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JC49599') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JD59396') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JD70678') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JD88445') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JE01457') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JH50694') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JJ16156') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JJ43245') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JN80073') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='JT82843') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KJ30931') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KJ95379') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KL71061') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KR15624') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KT58797') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KW78049') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KW93550') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='KX69821') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LC86845') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LD68777') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LE89746') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LP10069') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='LR69658') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MA09600') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MB00501') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MC36734') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MD59045') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MD94468') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ME98636') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MF33873') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MH40354') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MK34077') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MK56721') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MN14980') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MP11422') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MR66380') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MS16308') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MT14557') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MT89034') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MX82176') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='MZ69954') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ND37200') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NF06130') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NT21846') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NV15249') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='NW47848') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PA58474') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PG64931') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PJ36606') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PK81975') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PL08815') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PL26027') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PL31999') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PM09064') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PR40125') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='PY45386') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RH57601') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RK93511') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RN39683') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RR92710') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RT33571') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RT47488') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RW17559') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='RZ13674') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SA76863') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SH10809') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SH16088') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SP37465') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ST51673') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SU11356') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SV54561') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SZ04760') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='SZ37407') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TA00274') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TC92639') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TD03510') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TF84007') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TT32350') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TU82755') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TW04591') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TX05969') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TX60909') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='TY06006') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UE37661') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UJ40732') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UL94370') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UM05390') HTTP/1.1" 204 0
2026-03-30 06:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UN29415') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UR19500') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UV88520') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='UY54664') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VA32663') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VB07327') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VJ43463') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VK28802') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VN62094') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VX21380') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VY57694') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='VY90462') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WB14082') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WC74138') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WF16712') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WF89914') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WG16192') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WG46268') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WJ13879') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WL71249') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WM58519') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WR44497') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WT59798') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WU54468') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WU58416') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WU64935') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WW90650') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WY59900') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='WZ25169') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XC47690') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XF46221') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XG24917') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XH45002') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XR18187') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='XZ10958') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YM28213') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YR70158') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YS68318') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YV00787') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YW08352') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YY10227') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='YY65855') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZD87738') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZF99049') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZR19719') HTTP/1.1" 204 0
2026-03-30 06:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.be',RowKey='ZW15709') HTTP/1.1" 204 0
2026-03-30 06:33:09 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (262 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.be/task_25_2026-03-30T06_30_00.jl
2026-03-30 06:33:09 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 158659,
 'downloader/request_count': 68,
 'downloader/request_method_count/GET': 32,
 'downloader/request_method_count/POST': 36,
 'downloader/response_bytes': 7564861,
 'downloader/response_count': 68,
 'downloader/response_status_count/200': 68,
 'dupefilter/filtered': 5,
 'elapsed_time_seconds': 182.707148,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 30, 6, 33, 9, 525869, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 262,
 'log_count/DEBUG': 3725,
 'log_count/INFO': 4360,
 'memusage/max': 173289472,
 'memusage/startup': 150237184,
 'photo_download_count': 20,
 'request_depth_max': 37,
 'response_received_count': 48,
 'scheduler/dequeued': 68,
 'scheduler/dequeued/memory': 68,
 'scheduler/enqueued': 68,
 'scheduler/enqueued/memory': 68,
 'scrape_type/batch_skipped': 662,
 'scrape_type/new': 5,
 'scrape_type/price_update': 257,
 'scrape_type/skipped': 399,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 48,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 3.7146916485216934,
 'scrapy-zyte-api/mean_response_seconds': 3.78897699219912,
 'scrapy-zyte-api/processed': 48,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 48,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 47,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 48,
 'scrapy-zyte-api/request_args/httpRequestBody': 36,
 'scrapy-zyte-api/request_args/httpRequestMethod': 36,
 'scrapy-zyte-api/request_args/httpResponseBody': 48,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 48,
 'scrapy-zyte-api/request_args/sessionContext': 48,
 'scrapy-zyte-api/request_args/url': 48,
 'scrapy-zyte-api/status_codes/200': 48,
 'scrapy-zyte-api/success': 48,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 1328,
 'source/total_available': 1288,
 'start_time': datetime.datetime(2026, 3, 30, 6, 30, 6, 818721, tzinfo=datetime.timezone.utc)}
2026-03-30 06:33:09 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 06:33:09 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f2e7a0870d0>
2026-03-30 06:33:09 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f2e79e80190>