2026-03-29 11:35:05 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-29 11:35:05 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-29 11:35:05 [auto1.be] INFO: Batch mode enabled: batch 2/2
2026-03-29 11:35:05 [auto1.be] INFO: Starting spider auto1.be
2026-03-29 11:35:05 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-29 11:35:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-29 11:35:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-29 11:35:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-29 11:35:06 [scrapy.extensions.telnet] INFO: Telnet Password: e210051f578f49a0
2026-03-29 11:35:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-29 11:35:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.be/task_26_2026-03-29T11_35_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-29 11:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 11:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 11:35:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-29 11:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-29 11:35:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-29 11:35:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-29 11:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 11:35:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2121
2026-03-29 11:35:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-29 11:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-29 11:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-29 11:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-29 11:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-29 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-29 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-29 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-29 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-29 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-29 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-29 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-29 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-29 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-29 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-29 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-29 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-29 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-29 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-29 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-29 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-29 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-29 11:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-29 11:35:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-29 11:35:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-29 11:35:06 [scrapy.core.engine] INFO: Spider opened
2026-03-29 11:35:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-29 11:35:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-29 11:35:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 143MiB
2026-03-29 11:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-29 11:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-29 11:35:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-29 11:35:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-29 11:35:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-29 11:35:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:35:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-29 11:35:16 [auto1.be] INFO: Channel: 24h | Page: 0 | totalHits: 1256 | hits on page: 40
2026-03-29 11:35:16 [auto1.be] INFO: Found listing with ID: TX40265
2026-03-29 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX40265%27 HTTP/1.1" 200 None
2026-03-29 11:35:16 [auto1.be] INFO: Scrape type for TX40265: 2
2026-03-29 11:35:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb74d561-fe35-51dc-afbc-3d7048a98f74 with identifier: TX40265
2026-03-29 11:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb74d561-fe35-51dc-afbc-3d7048a98f74 with scrape type 2
2026-03-29 11:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb74d561-fe35-51dc-afbc-3d7048a98f74 with scrape type 2
2026-03-29 11:35:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fb74d561-fe35-51dc-afbc-3d7048a98f74, identifier: TX40265
2026-03-29 11:35:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fb74d561-fe35-51dc-afbc-3d7048a98f74 with identifier: TX40265
2026-03-29 11:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 11:35:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-29 11:35:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 11:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 11:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 11:35:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-29 11:35:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 11:35:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fb74d561-fe35-51dc-afbc-3d7048a98f74 with identifier: TX40265
2026-03-29 11:35:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fb74d561-fe35-51dc-afbc-3d7048a98f74 with identifier: TX40265 to the API
2026-03-29 11:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:35:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-30T15:40:14Z',
 'fuel_type': 'petrol',
 'id': 'fb74d561-fe35-51dc-afbc-3d7048a98f74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX40265',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 203613,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-20',
 'seller_name': None,
 'title': 'Porsche Macan S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-29 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX40265%27 HTTP/1.1" 200 None
2026-03-29 11:35:17 [auto1.be] INFO: Saving data for TX40265: {'auction_closing_time': 1774885214.0, 'created_time': 1774643923.234122, 'last_price_update_time': 1774784117.465739}
2026-03-29 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TX40265') HTTP/1.1" 204 0
2026-03-29 11:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:35:17 [auto1.be] INFO: Found listing with ID: RJ95996
2026-03-29 11:35:17 [auto1.be] INFO: Found listing with ID: LU32507
2026-03-29 11:35:17 [auto1.be] INFO: Found listing with ID: FT44143
2026-03-29 11:35:17 [auto1.be] INFO: Found listing with ID: DT10357
2026-03-29 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT10357%27 HTTP/1.1" 200 None
2026-03-29 11:35:17 [auto1.be] INFO: Scrape type for DT10357: 2
2026-03-29 11:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76512a1c-acc4-5a24-bbad-804d489016e6 with identifier: DT10357
2026-03-29 11:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76512a1c-acc4-5a24-bbad-804d489016e6 with scrape type 2
2026-03-29 11:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76512a1c-acc4-5a24-bbad-804d489016e6 with scrape type 2
2026-03-29 11:35:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 76512a1c-acc4-5a24-bbad-804d489016e6, identifier: DT10357
2026-03-29 11:35:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 76512a1c-acc4-5a24-bbad-804d489016e6 with identifier: DT10357
2026-03-29 11:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 11:35:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-29 11:35:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 11:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 11:35:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 76512a1c-acc4-5a24-bbad-804d489016e6 with identifier: DT10357
2026-03-29 11:35:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 76512a1c-acc4-5a24-bbad-804d489016e6 with identifier: DT10357 to the API
2026-03-29 11:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:35:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:14:40Z',
 'fuel_type': 'petrol',
 'id': '76512a1c-acc4-5a24-bbad-804d489016e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT10357',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 168949,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-13',
 'seller_name': None,
 'title': 'Renault Scenic 1.6 Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2014}
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT10357%27 HTTP/1.1" 200 None
2026-03-29 11:35:18 [auto1.be] INFO: Saving data for DT10357: {'auction_closing_time': 1774883680.0, 'created_time': 1774265728.369825, 'last_price_update_time': 1774784118.013148}
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DT10357') HTTP/1.1" 204 0
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: SW43031
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW43031%27 HTTP/1.1" 200 None
2026-03-29 11:35:18 [auto1.be] INFO: Scrape type for SW43031: 0
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: KH45960
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH45960%27 HTTP/1.1" 200 None
2026-03-29 11:35:18 [auto1.be] INFO: Scrape type for KH45960: 0
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: VR58028
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: EX99169
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX99169%27 HTTP/1.1" 200 None
2026-03-29 11:35:18 [auto1.be] INFO: Scrape type for EX99169: 0
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: ES45973
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: DL06250
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL06250%27 HTTP/1.1" 200 None
2026-03-29 11:35:18 [auto1.be] INFO: Scrape type for DL06250: 0
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: AM39981
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM39981%27 HTTP/1.1" 200 None
2026-03-29 11:35:18 [auto1.be] INFO: Scrape type for AM39981: 0
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: NJ87931
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ87931%27 HTTP/1.1" 200 None
2026-03-29 11:35:18 [auto1.be] INFO: Scrape type for NJ87931: 0
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: RS13546
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS13546%27 HTTP/1.1" 200 None
2026-03-29 11:35:18 [auto1.be] INFO: Scrape type for RS13546: 0
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: MB50362
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: BR08123
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR08123%27 HTTP/1.1" 200 None
2026-03-29 11:35:18 [auto1.be] INFO: Scrape type for BR08123: 0
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: MR13936
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR13936%27 HTTP/1.1" 200 None
2026-03-29 11:35:18 [auto1.be] INFO: Scrape type for MR13936: 0
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: VB51630
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB51630%27 HTTP/1.1" 200 None
2026-03-29 11:35:18 [auto1.be] INFO: Scrape type for VB51630: 0
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: AD75254
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: KM93600
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: JZ74663
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: JW28444
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: ST41989
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: SB58546
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: ZN33988
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: WV98137
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: WM98444
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: YL67549
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: RJ01486
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ01486%27 HTTP/1.1" 200 None
2026-03-29 11:35:18 [auto1.be] INFO: Scrape type for RJ01486: 0
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: WP77155
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP77155%27 HTTP/1.1" 200 None
2026-03-29 11:35:18 [auto1.be] INFO: Scrape type for WP77155: 0
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: CY85383
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY85383%27 HTTP/1.1" 200 None
2026-03-29 11:35:18 [auto1.be] INFO: Scrape type for CY85383: 0
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: MK20841
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK20841%27 HTTP/1.1" 200 None
2026-03-29 11:35:18 [auto1.be] INFO: Scrape type for MK20841: 0
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: NE45749
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: VP73114
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: GB22067
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: XS85102
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: RX06086
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX06086%27 HTTP/1.1" 200 None
2026-03-29 11:35:18 [auto1.be] INFO: Scrape type for RX06086: 0
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: BJ49980
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: PE70540
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE70540%27 HTTP/1.1" 200 None
2026-03-29 11:35:18 [auto1.be] INFO: Scrape type for PE70540: 0
2026-03-29 11:35:18 [auto1.be] INFO: Found listing with ID: ZZ18378
2026-03-29 11:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:35:49 [auto1.be] INFO: Channel: 24h | Page: 1 | totalHits: 1256 | hits on page: 40
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: TX40265
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX40265%27 HTTP/1.1" 200 None
2026-03-29 11:35:49 [auto1.be] INFO: Scrape type for TX40265: 0
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: RJ95996
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: LU32507
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: FT44143
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: DT10357
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT10357%27 HTTP/1.1" 200 None
2026-03-29 11:35:49 [auto1.be] INFO: Scrape type for DT10357: 0
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: SW43031
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW43031%27 HTTP/1.1" 200 None
2026-03-29 11:35:49 [auto1.be] INFO: Scrape type for SW43031: 0
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: KH45960
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH45960%27 HTTP/1.1" 200 None
2026-03-29 11:35:49 [auto1.be] INFO: Scrape type for KH45960: 0
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: VR58028
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: EX99169
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX99169%27 HTTP/1.1" 200 None
2026-03-29 11:35:49 [auto1.be] INFO: Scrape type for EX99169: 0
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: ES45973
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: DL06250
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL06250%27 HTTP/1.1" 200 None
2026-03-29 11:35:49 [auto1.be] INFO: Scrape type for DL06250: 0
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: AM39981
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM39981%27 HTTP/1.1" 200 None
2026-03-29 11:35:49 [auto1.be] INFO: Scrape type for AM39981: 0
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: NJ87931
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ87931%27 HTTP/1.1" 200 None
2026-03-29 11:35:49 [auto1.be] INFO: Scrape type for NJ87931: 0
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: RS13546
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS13546%27 HTTP/1.1" 200 None
2026-03-29 11:35:49 [auto1.be] INFO: Scrape type for RS13546: 0
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: MB50362
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: BR08123
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR08123%27 HTTP/1.1" 200 None
2026-03-29 11:35:49 [auto1.be] INFO: Scrape type for BR08123: 0
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: MR13936
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR13936%27 HTTP/1.1" 200 None
2026-03-29 11:35:49 [auto1.be] INFO: Scrape type for MR13936: 0
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: VB51630
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB51630%27 HTTP/1.1" 200 None
2026-03-29 11:35:49 [auto1.be] INFO: Scrape type for VB51630: 0
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: AD75254
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: KM93600
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: JZ74663
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: JW28444
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: ST41989
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: SB58546
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: ZN33988
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: WV98137
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: WM98444
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: YL67549
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: RJ01486
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ01486%27 HTTP/1.1" 200 None
2026-03-29 11:35:49 [auto1.be] INFO: Scrape type for RJ01486: 0
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: WP77155
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP77155%27 HTTP/1.1" 200 None
2026-03-29 11:35:49 [auto1.be] INFO: Scrape type for WP77155: 0
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: CY85383
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY85383%27 HTTP/1.1" 200 None
2026-03-29 11:35:49 [auto1.be] INFO: Scrape type for CY85383: 0
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: MK20841
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK20841%27 HTTP/1.1" 200 None
2026-03-29 11:35:49 [auto1.be] INFO: Scrape type for MK20841: 0
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: NE45749
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: VP73114
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: GB22067
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: XS85102
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: RX06086
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX06086%27 HTTP/1.1" 200 None
2026-03-29 11:35:49 [auto1.be] INFO: Scrape type for RX06086: 0
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: BJ49980
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: PE70540
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE70540%27 HTTP/1.1" 200 None
2026-03-29 11:35:49 [auto1.be] INFO: Scrape type for PE70540: 0
2026-03-29 11:35:49 [auto1.be] INFO: Found listing with ID: ZZ18378
2026-03-29 11:35:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:35:50 [auto1.be] INFO: Channel: 24h | Page: 2 | totalHits: 1256 | hits on page: 40
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: GN69495
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: XD29708
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: SK35491
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: KT58942
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT58942%27 HTTP/1.1" 200 None
2026-03-29 11:35:50 [auto1.be] INFO: Scrape type for KT58942: 0
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: UY87343
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY87343%27 HTTP/1.1" 200 None
2026-03-29 11:35:50 [auto1.be] INFO: Scrape type for UY87343: 0
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: MH83966
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MH83966%27 HTTP/1.1" 200 None
2026-03-29 11:35:50 [auto1.be] INFO: Scrape type for MH83966: 0
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: DE26055
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: AD76625
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD76625%27 HTTP/1.1" 200 None
2026-03-29 11:35:50 [auto1.be] INFO: Scrape type for AD76625: 0
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: ET26989
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: PF75414
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: WZ74297
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: KR32592
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: WU68692
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: HX23250
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX23250%27 HTTP/1.1" 200 None
2026-03-29 11:35:50 [auto1.be] INFO: Scrape type for HX23250: 0
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: DH89229
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH89229%27 HTTP/1.1" 200 None
2026-03-29 11:35:50 [auto1.be] INFO: Scrape type for DH89229: 0
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: UZ99297
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UZ99297%27 HTTP/1.1" 200 None
2026-03-29 11:35:50 [auto1.be] INFO: Scrape type for UZ99297: 0
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: DZ79289
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ79289%27 HTTP/1.1" 200 None
2026-03-29 11:35:50 [auto1.be] INFO: Scrape type for DZ79289: 0
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: DX83468
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: EP64027
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP64027%27 HTTP/1.1" 200 None
2026-03-29 11:35:50 [auto1.be] INFO: Scrape type for EP64027: 0
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: ZY04103
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY04103%27 HTTP/1.1" 200 None
2026-03-29 11:35:50 [auto1.be] INFO: Scrape type for ZY04103: 0
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: UR96395
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR96395%27 HTTP/1.1" 200 None
2026-03-29 11:35:50 [auto1.be] INFO: Scrape type for UR96395: 0
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: SD20873
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: EN78807
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: PZ32696
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PZ32696%27 HTTP/1.1" 200 None
2026-03-29 11:35:50 [auto1.be] INFO: Scrape type for PZ32696: 0
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: SD10160
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD10160%27 HTTP/1.1" 200 None
2026-03-29 11:35:50 [auto1.be] INFO: Scrape type for SD10160: 0
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: YA34487
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA34487%27 HTTP/1.1" 200 None
2026-03-29 11:35:50 [auto1.be] INFO: Scrape type for YA34487: 0
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: RC41327
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC41327%27 HTTP/1.1" 200 None
2026-03-29 11:35:50 [auto1.be] INFO: Scrape type for RC41327: 0
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: BL31735
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BL31735%27 HTTP/1.1" 200 None
2026-03-29 11:35:50 [auto1.be] INFO: Scrape type for BL31735: 0
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: PJ34917
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ34917%27 HTTP/1.1" 200 None
2026-03-29 11:35:50 [auto1.be] INFO: Scrape type for PJ34917: 0
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: TM16461
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM16461%27 HTTP/1.1" 200 None
2026-03-29 11:35:50 [auto1.be] INFO: Scrape type for TM16461: 0
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: PC06950
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: JN34238
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: KD33371
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD33371%27 HTTP/1.1" 200 None
2026-03-29 11:35:50 [auto1.be] INFO: Scrape type for KD33371: 0
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: ZM02853
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM02853%27 HTTP/1.1" 200 None
2026-03-29 11:35:50 [auto1.be] INFO: Scrape type for ZM02853: 0
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: ZC87174
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: ZP04877
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP04877%27 HTTP/1.1" 200 None
2026-03-29 11:35:50 [auto1.be] INFO: Scrape type for ZP04877: 0
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: BY53413
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY53413%27 HTTP/1.1" 200 None
2026-03-29 11:35:50 [auto1.be] INFO: Scrape type for BY53413: 0
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: GZ17047
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: TN87621
2026-03-29 11:35:50 [auto1.be] INFO: Found listing with ID: LY35485
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY35485%27 HTTP/1.1" 200 None
2026-03-29 11:35:50 [auto1.be] INFO: Scrape type for LY35485: 0
2026-03-29 11:35:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:35:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:35:51 [auto1.be] INFO: Channel: 24h | Page: 3 | totalHits: 1256 | hits on page: 40
2026-03-29 11:35:51 [auto1.be] INFO: Found listing with ID: DP17314
2026-03-29 11:35:51 [auto1.be] INFO: Found listing with ID: KU68109
2026-03-29 11:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU68109%27 HTTP/1.1" 200 None
2026-03-29 11:35:51 [auto1.be] INFO: Scrape type for KU68109: 0
2026-03-29 11:35:51 [auto1.be] INFO: Found listing with ID: WT61211
2026-03-29 11:35:51 [auto1.be] INFO: Found listing with ID: RG41014
2026-03-29 11:35:51 [auto1.be] INFO: Found listing with ID: VL25326
2026-03-29 11:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL25326%27 HTTP/1.1" 200 None
2026-03-29 11:35:52 [auto1.be] INFO: Scrape type for VL25326: 0
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: PH78267
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: GA47341
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: NL54460
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: RE30310
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE30310%27 HTTP/1.1" 200 None
2026-03-29 11:35:52 [auto1.be] INFO: Scrape type for RE30310: 0
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: MM05603
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: MT15926
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: RR05667
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR05667%27 HTTP/1.1" 200 None
2026-03-29 11:35:52 [auto1.be] INFO: Scrape type for RR05667: 0
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: RA52713
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA52713%27 HTTP/1.1" 200 None
2026-03-29 11:35:52 [auto1.be] INFO: Scrape type for RA52713: 0
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: XY08671
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XY08671%27 HTTP/1.1" 200 None
2026-03-29 11:35:52 [auto1.be] INFO: Scrape type for XY08671: 0
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: GB86339
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: PW41553
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: FF69776
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: BY20726
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY20726%27 HTTP/1.1" 200 None
2026-03-29 11:35:52 [auto1.be] INFO: Scrape type for BY20726: 0
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: YH64614
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: KF56069
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF56069%27 HTTP/1.1" 200 None
2026-03-29 11:35:52 [auto1.be] INFO: Scrape type for KF56069: 0
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: BT87712
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: BV02466
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV02466%27 HTTP/1.1" 200 None
2026-03-29 11:35:52 [auto1.be] INFO: Scrape type for BV02466: 0
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: SY52065
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY52065%27 HTTP/1.1" 200 None
2026-03-29 11:35:52 [auto1.be] INFO: Scrape type for SY52065: 0
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: NG60197
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG60197%27 HTTP/1.1" 200 None
2026-03-29 11:35:52 [auto1.be] INFO: Scrape type for NG60197: 0
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: NC51382
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: JU27695
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: XU40393
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: YR77899
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YR77899%27 HTTP/1.1" 200 None
2026-03-29 11:35:52 [auto1.be] INFO: Scrape type for YR77899: 0
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: FH50113
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: YU69949
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU69949%27 HTTP/1.1" 200 None
2026-03-29 11:35:52 [auto1.be] INFO: Scrape type for YU69949: 0
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: VM31149
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: JC67757
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: UA36767
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA36767%27 HTTP/1.1" 200 None
2026-03-29 11:35:52 [auto1.be] INFO: Scrape type for UA36767: 0
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: VE25219
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE25219%27 HTTP/1.1" 200 None
2026-03-29 11:35:52 [auto1.be] INFO: Scrape type for VE25219: 0
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: WA86347
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA86347%27 HTTP/1.1" 200 None
2026-03-29 11:35:52 [auto1.be] INFO: Scrape type for WA86347: 0
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: PS31946
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS31946%27 HTTP/1.1" 200 None
2026-03-29 11:35:52 [auto1.be] INFO: Scrape type for PS31946: 0
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: DY35896
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: KZ95632
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ95632%27 HTTP/1.1" 200 None
2026-03-29 11:35:52 [auto1.be] INFO: Scrape type for KZ95632: 0
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: VM01272
2026-03-29 11:35:52 [auto1.be] INFO: Found listing with ID: KL42374
2026-03-29 11:35:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:35:53 [auto1.be] INFO: Channel: 24h | Page: 4 | totalHits: 1256 | hits on page: 40
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: UF75491
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: ZP25114
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP25114%27 HTTP/1.1" 200 None
2026-03-29 11:35:53 [auto1.be] INFO: Scrape type for ZP25114: 0
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: FP22064
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP22064%27 HTTP/1.1" 200 None
2026-03-29 11:35:53 [auto1.be] INFO: Scrape type for FP22064: 0
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: EL71552
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: SK78967
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: TG30379
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: MX26890
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX26890%27 HTTP/1.1" 200 None
2026-03-29 11:35:53 [auto1.be] INFO: Scrape type for MX26890: 0
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: DB21184
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: ZX91910
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX91910%27 HTTP/1.1" 200 None
2026-03-29 11:35:53 [auto1.be] INFO: Scrape type for ZX91910: 0
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: LU53556
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU53556%27 HTTP/1.1" 200 None
2026-03-29 11:35:53 [auto1.be] INFO: Scrape type for LU53556: 0
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: TT03576
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT03576%27 HTTP/1.1" 200 None
2026-03-29 11:35:53 [auto1.be] INFO: Scrape type for TT03576: 0
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: BD95571
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD95571%27 HTTP/1.1" 200 None
2026-03-29 11:35:53 [auto1.be] INFO: Scrape type for BD95571: 0
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: EA40127
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: TC19196
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC19196%27 HTTP/1.1" 200 None
2026-03-29 11:35:53 [auto1.be] INFO: Scrape type for TC19196: 0
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: DF78239
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: CM14446
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM14446%27 HTTP/1.1" 200 None
2026-03-29 11:35:53 [auto1.be] INFO: Scrape type for CM14446: 0
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: VE29498
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE29498%27 HTTP/1.1" 200 None
2026-03-29 11:35:53 [auto1.be] INFO: Scrape type for VE29498: 0
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: BE62996
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: AM49333
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM49333%27 HTTP/1.1" 200 None
2026-03-29 11:35:53 [auto1.be] INFO: Scrape type for AM49333: 0
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: EL91929
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: FC05247
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC05247%27 HTTP/1.1" 200 None
2026-03-29 11:35:53 [auto1.be] INFO: Scrape type for FC05247: 0
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: NC38410
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC38410%27 HTTP/1.1" 200 None
2026-03-29 11:35:53 [auto1.be] INFO: Scrape type for NC38410: 0
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: LE91648
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: ZZ00486
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: TX69988
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX69988%27 HTTP/1.1" 200 None
2026-03-29 11:35:53 [auto1.be] INFO: Scrape type for TX69988: 0
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: HK94342
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK94342%27 HTTP/1.1" 200 None
2026-03-29 11:35:53 [auto1.be] INFO: Scrape type for HK94342: 0
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: YK14398
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: FC68971
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: SL05027
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL05027%27 HTTP/1.1" 200 None
2026-03-29 11:35:53 [auto1.be] INFO: Scrape type for SL05027: 0
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: TE49371
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: EK47235
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK47235%27 HTTP/1.1" 200 None
2026-03-29 11:35:53 [auto1.be] INFO: Scrape type for EK47235: 0
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: SJ26894
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ26894%27 HTTP/1.1" 200 None
2026-03-29 11:35:53 [auto1.be] INFO: Scrape type for SJ26894: 0
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: VP06293
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP06293%27 HTTP/1.1" 200 None
2026-03-29 11:35:53 [auto1.be] INFO: Scrape type for VP06293: 0
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: CC34063
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: LD32822
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LD32822%27 HTTP/1.1" 200 None
2026-03-29 11:35:53 [auto1.be] INFO: Scrape type for LD32822: 0
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: DH17925
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH17925%27 HTTP/1.1" 200 None
2026-03-29 11:35:53 [auto1.be] INFO: Scrape type for DH17925: 0
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: UX89863
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: UX80051
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX80051%27 HTTP/1.1" 200 None
2026-03-29 11:35:53 [auto1.be] INFO: Scrape type for UX80051: 0
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: MG99487
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG99487%27 HTTP/1.1" 200 None
2026-03-29 11:35:53 [auto1.be] INFO: Scrape type for MG99487: 0
2026-03-29 11:35:53 [auto1.be] INFO: Found listing with ID: AJ87899
2026-03-29 11:35:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:35:54 [auto1.be] INFO: Channel: 24h | Page: 5 | totalHits: 1256 | hits on page: 40
2026-03-29 11:35:54 [auto1.be] INFO: Found listing with ID: RL01911
2026-03-29 11:35:54 [auto1.be] INFO: Found listing with ID: FG10633
2026-03-29 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG10633%27 HTTP/1.1" 200 None
2026-03-29 11:35:54 [auto1.be] INFO: Scrape type for FG10633: 0
2026-03-29 11:35:54 [auto1.be] INFO: Found listing with ID: KE27400
2026-03-29 11:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE27400%27 HTTP/1.1" 200 None
2026-03-29 11:35:55 [auto1.be] INFO: Scrape type for KE27400: 0
2026-03-29 11:35:55 [auto1.be] INFO: Found listing with ID: JV95971
2026-03-29 11:35:55 [auto1.be] INFO: Found listing with ID: LK25886
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK25886%27 HTTP/1.1" 200 None
2026-03-29 11:35:55 [auto1.be] INFO: Scrape type for LK25886: 0
2026-03-29 11:35:55 [auto1.be] INFO: Found listing with ID: SB67636
2026-03-29 11:35:55 [auto1.be] INFO: Found listing with ID: ZU13483
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU13483%27 HTTP/1.1" 200 None
2026-03-29 11:35:55 [auto1.be] INFO: Scrape type for ZU13483: 0
2026-03-29 11:35:55 [auto1.be] INFO: Found listing with ID: CE14127
2026-03-29 11:35:55 [auto1.be] INFO: Found listing with ID: KA88762
2026-03-29 11:35:55 [auto1.be] INFO: Found listing with ID: ML65590
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML65590%27 HTTP/1.1" 200 None
2026-03-29 11:35:55 [auto1.be] INFO: Scrape type for ML65590: 0
2026-03-29 11:35:55 [auto1.be] INFO: Found listing with ID: GG74067
2026-03-29 11:35:55 [auto1.be] INFO: Found listing with ID: HN37913
2026-03-29 11:35:55 [auto1.be] INFO: Found listing with ID: YU22338
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU22338%27 HTTP/1.1" 200 None
2026-03-29 11:35:55 [auto1.be] INFO: Scrape type for YU22338: 0
2026-03-29 11:35:55 [auto1.be] INFO: Found listing with ID: SW98803
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW98803%27 HTTP/1.1" 200 None
2026-03-29 11:35:55 [auto1.be] INFO: Scrape type for SW98803: 0
2026-03-29 11:35:55 [auto1.be] INFO: Found listing with ID: LP50838
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP50838%27 HTTP/1.1" 200 None
2026-03-29 11:35:55 [auto1.be] INFO: Scrape type for LP50838: 0
2026-03-29 11:35:55 [auto1.be] INFO: Found listing with ID: NH43704
2026-03-29 11:35:55 [auto1.be] INFO: Found listing with ID: MW29844
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW29844%27 HTTP/1.1" 200 None
2026-03-29 11:35:55 [auto1.be] INFO: Scrape type for MW29844: 0
2026-03-29 11:35:55 [auto1.be] INFO: Found listing with ID: FH45476
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH45476%27 HTTP/1.1" 200 None
2026-03-29 11:35:55 [auto1.be] INFO: Scrape type for FH45476: 0
2026-03-29 11:35:55 [auto1.be] INFO: Found listing with ID: NP55006
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP55006%27 HTTP/1.1" 200 None
2026-03-29 11:35:55 [auto1.be] INFO: Scrape type for NP55006: 0
2026-03-29 11:35:55 [auto1.be] INFO: Found listing with ID: XM15621
2026-03-29 11:35:55 [auto1.be] INFO: Found listing with ID: DP40243
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP40243%27 HTTP/1.1" 200 None
2026-03-29 11:35:55 [auto1.be] INFO: Scrape type for DP40243: 0
2026-03-29 11:35:55 [auto1.be] INFO: Found listing with ID: BR63185
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR63185%27 HTTP/1.1" 200 None
2026-03-29 11:35:55 [auto1.be] INFO: Scrape type for BR63185: 0
2026-03-29 11:35:55 [auto1.be] INFO: Found listing with ID: FM14350
2026-03-29 11:35:55 [auto1.be] INFO: Found listing with ID: WL66260
2026-03-29 11:35:55 [auto1.be] INFO: Found listing with ID: FY63763
2026-03-29 11:35:55 [auto1.be] INFO: Found listing with ID: CD50133
2026-03-29 11:35:55 [auto1.be] INFO: Found listing with ID: SZ16034
2026-03-29 11:35:55 [auto1.be] INFO: Found listing with ID: FP25504
2026-03-29 11:35:55 [auto1.be] INFO: Found listing with ID: BX88810
2026-03-29 11:35:55 [auto1.be] INFO: Found listing with ID: EJ45470
2026-03-29 11:35:55 [auto1.be] INFO: Found listing with ID: AK19302
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK19302%27 HTTP/1.1" 200 None
2026-03-29 11:35:55 [auto1.be] INFO: Scrape type for AK19302: 0
2026-03-29 11:35:55 [auto1.be] INFO: Found listing with ID: EZ00027
2026-03-29 11:35:55 [auto1.be] INFO: Found listing with ID: PD85961
2026-03-29 11:35:55 [auto1.be] INFO: Found listing with ID: NR82041
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR82041%27 HTTP/1.1" 200 None
2026-03-29 11:35:55 [auto1.be] INFO: Scrape type for NR82041: 0
2026-03-29 11:35:55 [auto1.be] INFO: Found listing with ID: HU84368
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU84368%27 HTTP/1.1" 200 None
2026-03-29 11:35:55 [auto1.be] INFO: Scrape type for HU84368: 2
2026-03-29 11:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: deeb4fb4-43c5-5997-ba2e-31e160077d13 with identifier: HU84368
2026-03-29 11:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item deeb4fb4-43c5-5997-ba2e-31e160077d13 with scrape type 2
2026-03-29 11:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item deeb4fb4-43c5-5997-ba2e-31e160077d13 with scrape type 2
2026-03-29 11:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: deeb4fb4-43c5-5997-ba2e-31e160077d13, identifier: HU84368
2026-03-29 11:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: deeb4fb4-43c5-5997-ba2e-31e160077d13 with identifier: HU84368
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-29 11:35:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 11:35:55 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-29 11:35:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 11:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: deeb4fb4-43c5-5997-ba2e-31e160077d13 with identifier: HU84368
2026-03-29 11:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: deeb4fb4-43c5-5997-ba2e-31e160077d13 with identifier: HU84368 to the API
2026-03-29 11:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:48:53Z',
 'fuel_type': 'diesel',
 'id': 'deeb4fb4-43c5-5997-ba2e-31e160077d13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU84368',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 212275,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-02',
 'seller_name': None,
 'title': 'Hyundai i30 1.6 CRDi Trend blue',
 'transmission': 'manual',
 'trim': 'Trend blue',
 'year': 2016}
2026-03-29 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU84368%27 HTTP/1.1" 200 None
2026-03-29 11:35:56 [auto1.be] INFO: Saving data for HU84368: {'auction_closing_time': 1774885733.0, 'created_time': 1773780127.010949, 'last_price_update_time': 1774784156.329572}
2026-03-29 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HU84368') HTTP/1.1" 204 0
2026-03-29 11:35:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:35:56 [auto1.be] INFO: Found listing with ID: CC85070
2026-03-29 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC85070%27 HTTP/1.1" 200 None
2026-03-29 11:35:56 [auto1.be] INFO: Scrape type for CC85070: 0
2026-03-29 11:35:56 [auto1.be] INFO: Found listing with ID: KE26750
2026-03-29 11:35:56 [auto1.be] INFO: Found listing with ID: EA25293
2026-03-29 11:35:56 [auto1.be] INFO: Found listing with ID: SP00889
2026-03-29 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP00889%27 HTTP/1.1" 200 None
2026-03-29 11:35:56 [auto1.be] INFO: Scrape type for SP00889: 0
2026-03-29 11:35:56 [auto1.be] INFO: Found listing with ID: SR49598
2026-03-29 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR49598%27 HTTP/1.1" 200 None
2026-03-29 11:35:56 [auto1.be] INFO: Scrape type for SR49598: 0
2026-03-29 11:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:35:57 [auto1.be] INFO: Channel: 24h | Page: 6 | totalHits: 1256 | hits on page: 40
2026-03-29 11:35:57 [auto1.be] INFO: Found listing with ID: XU03064
2026-03-29 11:35:57 [auto1.be] INFO: Found listing with ID: NN99297
2026-03-29 11:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN99297%27 HTTP/1.1" 200 None
2026-03-29 11:35:58 [auto1.be] INFO: Scrape type for NN99297: 0
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: UX94260
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: YW61664
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW61664%27 HTTP/1.1" 200 None
2026-03-29 11:35:58 [auto1.be] INFO: Scrape type for YW61664: 0
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: JS18374
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: YW00445
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW00445%27 HTTP/1.1" 200 None
2026-03-29 11:35:58 [auto1.be] INFO: Scrape type for YW00445: 0
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: JD01885
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: TX45109
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: GK88228
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: XZ48466
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ48466%27 HTTP/1.1" 200 None
2026-03-29 11:35:58 [auto1.be] INFO: Scrape type for XZ48466: 0
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: RP30975
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: TV92859
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: XZ54371
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: DW61635
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: BT09121
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT09121%27 HTTP/1.1" 200 None
2026-03-29 11:35:58 [auto1.be] INFO: Scrape type for BT09121: 0
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: GT11330
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: CX99155
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: CX21788
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX21788%27 HTTP/1.1" 200 None
2026-03-29 11:35:58 [auto1.be] INFO: Scrape type for CX21788: 0
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: KX60472
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX60472%27 HTTP/1.1" 200 None
2026-03-29 11:35:58 [auto1.be] INFO: Scrape type for KX60472: 0
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: WE70666
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE70666%27 HTTP/1.1" 200 None
2026-03-29 11:35:58 [auto1.be] INFO: Scrape type for WE70666: 0
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: HS59761
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: LZ48262
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: RM46702
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: ML85388
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: AJ68637
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: HW95173
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW95173%27 HTTP/1.1" 200 None
2026-03-29 11:35:58 [auto1.be] INFO: Scrape type for HW95173: 0
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: SW90596
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW90596%27 HTTP/1.1" 200 None
2026-03-29 11:35:58 [auto1.be] INFO: Scrape type for SW90596: 0
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: HY77866
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY77866%27 HTTP/1.1" 200 None
2026-03-29 11:35:58 [auto1.be] INFO: Scrape type for HY77866: 0
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: CT30439
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CT30439%27 HTTP/1.1" 200 None
2026-03-29 11:35:58 [auto1.be] INFO: Scrape type for CT30439: 0
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: BD10300
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: JW86952
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW86952%27 HTTP/1.1" 200 None
2026-03-29 11:35:58 [auto1.be] INFO: Scrape type for JW86952: 0
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: RK79502
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK79502%27 HTTP/1.1" 200 None
2026-03-29 11:35:58 [auto1.be] INFO: Scrape type for RK79502: 0
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: RK12486
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK12486%27 HTTP/1.1" 200 None
2026-03-29 11:35:58 [auto1.be] INFO: Scrape type for RK12486: 0
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: ZS70359
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: SE23508
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: SN78128
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN78128%27 HTTP/1.1" 200 None
2026-03-29 11:35:58 [auto1.be] INFO: Scrape type for SN78128: 0
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: WW99205
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: LH25651
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH25651%27 HTTP/1.1" 200 None
2026-03-29 11:35:58 [auto1.be] INFO: Scrape type for LH25651: 0
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: VM12927
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM12927%27 HTTP/1.1" 200 None
2026-03-29 11:35:58 [auto1.be] INFO: Scrape type for VM12927: 0
2026-03-29 11:35:58 [auto1.be] INFO: Found listing with ID: SD77902
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD77902%27 HTTP/1.1" 200 None
2026-03-29 11:35:58 [auto1.be] INFO: Scrape type for SD77902: 0
2026-03-29 11:35:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:35:59 [auto1.be] INFO: Channel: 24h | Page: 7 | totalHits: 1256 | hits on page: 40
2026-03-29 11:35:59 [auto1.be] INFO: Found listing with ID: LK16000
2026-03-29 11:35:59 [auto1.be] INFO: Found listing with ID: EK72945
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK72945%27 HTTP/1.1" 200 None
2026-03-29 11:35:59 [auto1.be] INFO: Scrape type for EK72945: 0
2026-03-29 11:35:59 [auto1.be] INFO: Found listing with ID: WA10715
2026-03-29 11:35:59 [auto1.be] INFO: Found listing with ID: EB09170
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB09170%27 HTTP/1.1" 200 None
2026-03-29 11:35:59 [auto1.be] INFO: Scrape type for EB09170: 0
2026-03-29 11:35:59 [auto1.be] INFO: Found listing with ID: XN92471
2026-03-29 11:35:59 [auto1.be] INFO: Found listing with ID: NB03494
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB03494%27 HTTP/1.1" 200 None
2026-03-29 11:35:59 [auto1.be] INFO: Scrape type for NB03494: 0
2026-03-29 11:35:59 [auto1.be] INFO: Found listing with ID: CK14854
2026-03-29 11:35:59 [auto1.be] INFO: Found listing with ID: WJ85942
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ85942%27 HTTP/1.1" 200 None
2026-03-29 11:35:59 [auto1.be] INFO: Scrape type for WJ85942: 0
2026-03-29 11:35:59 [auto1.be] INFO: Found listing with ID: ZL62218
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL62218%27 HTTP/1.1" 200 None
2026-03-29 11:35:59 [auto1.be] INFO: Scrape type for ZL62218: 0
2026-03-29 11:35:59 [auto1.be] INFO: Found listing with ID: KG55279
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG55279%27 HTTP/1.1" 200 None
2026-03-29 11:35:59 [auto1.be] INFO: Scrape type for KG55279: 0
2026-03-29 11:35:59 [auto1.be] INFO: Found listing with ID: JS91211
2026-03-29 11:35:59 [auto1.be] INFO: Found listing with ID: EX56301
2026-03-29 11:35:59 [auto1.be] INFO: Found listing with ID: DL13581
2026-03-29 11:35:59 [auto1.be] INFO: Found listing with ID: EL84394
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL84394%27 HTTP/1.1" 200 None
2026-03-29 11:35:59 [auto1.be] INFO: Scrape type for EL84394: 0
2026-03-29 11:35:59 [auto1.be] INFO: Found listing with ID: WG23357
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG23357%27 HTTP/1.1" 200 None
2026-03-29 11:35:59 [auto1.be] INFO: Scrape type for WG23357: 0
2026-03-29 11:35:59 [auto1.be] INFO: Found listing with ID: HP15544
2026-03-29 11:35:59 [auto1.be] INFO: Found listing with ID: PB67516
2026-03-29 11:35:59 [auto1.be] INFO: Found listing with ID: XB95573
2026-03-29 11:35:59 [auto1.be] INFO: Found listing with ID: ND89972
2026-03-29 11:35:59 [auto1.be] INFO: Found listing with ID: LG37246
2026-03-29 11:35:59 [auto1.be] INFO: Found listing with ID: JB70681
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB70681%27 HTTP/1.1" 200 None
2026-03-29 11:35:59 [auto1.be] INFO: Scrape type for JB70681: 0
2026-03-29 11:35:59 [auto1.be] INFO: Found listing with ID: JS91755
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS91755%27 HTTP/1.1" 200 None
2026-03-29 11:35:59 [auto1.be] INFO: Scrape type for JS91755: 0
2026-03-29 11:35:59 [auto1.be] INFO: Found listing with ID: EV46077
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV46077%27 HTTP/1.1" 200 None
2026-03-29 11:35:59 [auto1.be] INFO: Scrape type for EV46077: 0
2026-03-29 11:35:59 [auto1.be] INFO: Found listing with ID: FB34577
2026-03-29 11:35:59 [auto1.be] INFO: Found listing with ID: JV80966
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV80966%27 HTTP/1.1" 200 None
2026-03-29 11:35:59 [auto1.be] INFO: Scrape type for JV80966: 0
2026-03-29 11:35:59 [auto1.be] INFO: Found listing with ID: GR79063
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR79063%27 HTTP/1.1" 200 None
2026-03-29 11:35:59 [auto1.be] INFO: Scrape type for GR79063: 0
2026-03-29 11:35:59 [auto1.be] INFO: Found listing with ID: PR27183
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR27183%27 HTTP/1.1" 200 None
2026-03-29 11:35:59 [auto1.be] INFO: Scrape type for PR27183: 0
2026-03-29 11:35:59 [auto1.be] INFO: Found listing with ID: KP74596
2026-03-29 11:35:59 [auto1.be] INFO: Found listing with ID: TL70885
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL70885%27 HTTP/1.1" 200 None
2026-03-29 11:35:59 [auto1.be] INFO: Scrape type for TL70885: 0
2026-03-29 11:35:59 [auto1.be] INFO: Found listing with ID: JW06840
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW06840%27 HTTP/1.1" 200 None
2026-03-29 11:35:59 [auto1.be] INFO: Scrape type for JW06840: 0
2026-03-29 11:35:59 [auto1.be] INFO: Found listing with ID: RR43173
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR43173%27 HTTP/1.1" 200 None
2026-03-29 11:35:59 [auto1.be] INFO: Scrape type for RR43173: 2
2026-03-29 11:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51a93e4f-b357-532f-98e7-382c259ae859 with identifier: RR43173
2026-03-29 11:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51a93e4f-b357-532f-98e7-382c259ae859 with scrape type 2
2026-03-29 11:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51a93e4f-b357-532f-98e7-382c259ae859 with scrape type 2
2026-03-29 11:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 51a93e4f-b357-532f-98e7-382c259ae859, identifier: RR43173
2026-03-29 11:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 51a93e4f-b357-532f-98e7-382c259ae859 with identifier: RR43173
2026-03-29 11:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 11:36:00 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-29 11:36:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 11:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 51a93e4f-b357-532f-98e7-382c259ae859 with identifier: RR43173
2026-03-29 11:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 51a93e4f-b357-532f-98e7-382c259ae859 with identifier: RR43173 to the API
2026-03-29 11:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:52:12Z',
 'fuel_type': 'diesel',
 'id': '51a93e4f-b357-532f-98e7-382c259ae859',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR43173',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 106717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-27',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 220 CDI BlueEfficiency',
 'transmission': 'manual',
 'trim': 'BlueEfficiency',
 'year': 2013}
2026-03-29 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR43173%27 HTTP/1.1" 200 None
2026-03-29 11:36:00 [auto1.be] INFO: Saving data for RR43173: {'auction_closing_time': 1774885932.0, 'created_time': 1774600548.054374, 'last_price_update_time': 1774784160.412104}
2026-03-29 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RR43173') HTTP/1.1" 204 0
2026-03-29 11:36:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:36:00 [auto1.be] INFO: Found listing with ID: BN63741
2026-03-29 11:36:00 [auto1.be] INFO: Found listing with ID: NV81106
2026-03-29 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV81106%27 HTTP/1.1" 200 None
2026-03-29 11:36:00 [auto1.be] INFO: Scrape type for NV81106: 0
2026-03-29 11:36:00 [auto1.be] INFO: Found listing with ID: GL29646
2026-03-29 11:36:00 [auto1.be] INFO: Found listing with ID: ZG73435
2026-03-29 11:36:00 [auto1.be] INFO: Found listing with ID: HS23763
2026-03-29 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS23763%27 HTTP/1.1" 200 None
2026-03-29 11:36:00 [auto1.be] INFO: Scrape type for HS23763: 0
2026-03-29 11:36:00 [auto1.be] INFO: Found listing with ID: RA46458
2026-03-29 11:36:00 [auto1.be] INFO: Found listing with ID: VE53331
2026-03-29 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE53331%27 HTTP/1.1" 200 None
2026-03-29 11:36:00 [auto1.be] INFO: Scrape type for VE53331: 0
2026-03-29 11:36:00 [auto1.be] INFO: Found listing with ID: HD23270
2026-03-29 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HD23270%27 HTTP/1.1" 200 None
2026-03-29 11:36:00 [auto1.be] INFO: Scrape type for HD23270: 0
2026-03-29 11:36:00 [auto1.be] INFO: Found listing with ID: HP14917
2026-03-29 11:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:36:01 [auto1.be] INFO: Channel: 24h | Page: 8 | totalHits: 1256 | hits on page: 40
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: WK92284
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: GX61337
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: UL34611
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: MW76341
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: AA49507
2026-03-29 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AA49507%27 HTTP/1.1" 200 None
2026-03-29 11:36:01 [auto1.be] INFO: Scrape type for AA49507: 0
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: EZ55101
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: TH53375
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: RH88749
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: LE66186
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: RK42644
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: AP73624
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: JV18684
2026-03-29 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV18684%27 HTTP/1.1" 200 None
2026-03-29 11:36:01 [auto1.be] INFO: Scrape type for JV18684: 0
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: DF44974
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: DW87206
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: NY99560
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: NC25574
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: ZM46816
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: RY85405
2026-03-29 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY85405%27 HTTP/1.1" 200 None
2026-03-29 11:36:01 [auto1.be] INFO: Scrape type for RY85405: 0
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: BA52354
2026-03-29 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA52354%27 HTTP/1.1" 200 None
2026-03-29 11:36:01 [auto1.be] INFO: Scrape type for BA52354: 0
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: NG50909
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: TU47744
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: GD11285
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: UC23117
2026-03-29 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC23117%27 HTTP/1.1" 200 None
2026-03-29 11:36:01 [auto1.be] INFO: Scrape type for UC23117: 0
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: RS46918
2026-03-29 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS46918%27 HTTP/1.1" 200 None
2026-03-29 11:36:01 [auto1.be] INFO: Scrape type for RS46918: 0
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: GF24104
2026-03-29 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF24104%27 HTTP/1.1" 200 None
2026-03-29 11:36:01 [auto1.be] INFO: Scrape type for GF24104: 0
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: NG90127
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: PJ82537
2026-03-29 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ82537%27 HTTP/1.1" 200 None
2026-03-29 11:36:01 [auto1.be] INFO: Scrape type for PJ82537: 0
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: BT94428
2026-03-29 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT94428%27 HTTP/1.1" 200 None
2026-03-29 11:36:01 [auto1.be] INFO: Scrape type for BT94428: 0
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: WC55286
2026-03-29 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC55286%27 HTTP/1.1" 200 None
2026-03-29 11:36:01 [auto1.be] INFO: Scrape type for WC55286: 0
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: CC17071
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: KH63709
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: YN02015
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: MG81689
2026-03-29 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG81689%27 HTTP/1.1" 200 None
2026-03-29 11:36:01 [auto1.be] INFO: Scrape type for MG81689: 0
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: VW32861
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: PE83293
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: WA92632
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: ZL15279
2026-03-29 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL15279%27 HTTP/1.1" 200 None
2026-03-29 11:36:01 [auto1.be] INFO: Scrape type for ZL15279: 0
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: RW14221
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: WV47829
2026-03-29 11:36:01 [auto1.be] INFO: Found listing with ID: AK54797
2026-03-29 11:36:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:36:03 [auto1.be] INFO: Channel: 24h | Page: 9 | totalHits: 1256 | hits on page: 40
2026-03-29 11:36:03 [auto1.be] INFO: Found listing with ID: LK29098
2026-03-29 11:36:03 [auto1.be] INFO: Found listing with ID: YP74524
2026-03-29 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YP74524%27 HTTP/1.1" 200 None
2026-03-29 11:36:03 [auto1.be] INFO: Scrape type for YP74524: 0
2026-03-29 11:36:03 [auto1.be] INFO: Found listing with ID: YG22909
2026-03-29 11:36:03 [auto1.be] INFO: Found listing with ID: DY69036
2026-03-29 11:36:03 [auto1.be] INFO: Found listing with ID: BP14655
2026-03-29 11:36:03 [auto1.be] INFO: Found listing with ID: RZ47312
2026-03-29 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ47312%27 HTTP/1.1" 200 None
2026-03-29 11:36:03 [auto1.be] INFO: Scrape type for RZ47312: 0
2026-03-29 11:36:03 [auto1.be] INFO: Found listing with ID: ND78338
2026-03-29 11:36:03 [auto1.be] INFO: Found listing with ID: LK55982
2026-03-29 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK55982%27 HTTP/1.1" 200 None
2026-03-29 11:36:03 [auto1.be] INFO: Scrape type for LK55982: 0
2026-03-29 11:36:03 [auto1.be] INFO: Found listing with ID: DW77345
2026-03-29 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW77345%27 HTTP/1.1" 200 None
2026-03-29 11:36:03 [auto1.be] INFO: Scrape type for DW77345: 0
2026-03-29 11:36:03 [auto1.be] INFO: Found listing with ID: NN42853
2026-03-29 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN42853%27 HTTP/1.1" 200 None
2026-03-29 11:36:03 [auto1.be] INFO: Scrape type for NN42853: 0
2026-03-29 11:36:03 [auto1.be] INFO: Found listing with ID: CS90165
2026-03-29 11:36:03 [auto1.be] INFO: Found listing with ID: LA76788
2026-03-29 11:36:03 [auto1.be] INFO: Found listing with ID: HB19534
2026-03-29 11:36:03 [auto1.be] INFO: Found listing with ID: AY47657
2026-03-29 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY47657%27 HTTP/1.1" 200 None
2026-03-29 11:36:03 [auto1.be] INFO: Scrape type for AY47657: 0
2026-03-29 11:36:03 [auto1.be] INFO: Found listing with ID: BU27000
2026-03-29 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU27000%27 HTTP/1.1" 200 None
2026-03-29 11:36:03 [auto1.be] INFO: Scrape type for BU27000: 0
2026-03-29 11:36:03 [auto1.be] INFO: Found listing with ID: PL61351
2026-03-29 11:36:03 [auto1.be] INFO: Found listing with ID: AE13452
2026-03-29 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE13452%27 HTTP/1.1" 200 None
2026-03-29 11:36:03 [auto1.be] INFO: Scrape type for AE13452: 0
2026-03-29 11:36:03 [auto1.be] INFO: Found listing with ID: FG26500
2026-03-29 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG26500%27 HTTP/1.1" 200 None
2026-03-29 11:36:03 [auto1.be] INFO: Scrape type for FG26500: 0
2026-03-29 11:36:03 [auto1.be] INFO: Found listing with ID: MC44479
2026-03-29 11:36:03 [auto1.be] INFO: Found listing with ID: WP32655
2026-03-29 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP32655%27 HTTP/1.1" 200 None
2026-03-29 11:36:03 [auto1.be] INFO: Scrape type for WP32655: 2
2026-03-29 11:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43e8f1a5-06f7-5510-bb0c-82171044cc06 with identifier: WP32655
2026-03-29 11:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43e8f1a5-06f7-5510-bb0c-82171044cc06 with scrape type 2
2026-03-29 11:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43e8f1a5-06f7-5510-bb0c-82171044cc06 with scrape type 2
2026-03-29 11:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 43e8f1a5-06f7-5510-bb0c-82171044cc06, identifier: WP32655
2026-03-29 11:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 43e8f1a5-06f7-5510-bb0c-82171044cc06 with identifier: WP32655
2026-03-29 11:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 43e8f1a5-06f7-5510-bb0c-82171044cc06 with identifier: WP32655
2026-03-29 11:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 43e8f1a5-06f7-5510-bb0c-82171044cc06 with identifier: WP32655 to the API
2026-03-29 11:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:03:52Z',
 'fuel_type': 'diesel',
 'id': '43e8f1a5-06f7-5510-bb0c-82171044cc06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP32655',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 57693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-19',
 'seller_name': None,
 'title': 'Citroen Jumpy 1.6 HDi L1H1 27 Kasten',
 'transmission': 'manual',
 'trim': 'L1H1 27 Kasten',
 'year': 2014}
2026-03-29 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP32655%27 HTTP/1.1" 200 None
2026-03-29 11:36:04 [auto1.be] INFO: Saving data for WP32655: {'auction_closing_time': 1774883032.0, 'created_time': 1774600540.963012, 'last_price_update_time': 1774784164.064919}
2026-03-29 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WP32655') HTTP/1.1" 204 0
2026-03-29 11:36:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:36:04 [auto1.be] INFO: Found listing with ID: SC04496
2026-03-29 11:36:04 [auto1.be] INFO: Found listing with ID: CC56747
2026-03-29 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC56747%27 HTTP/1.1" 200 None
2026-03-29 11:36:04 [auto1.be] INFO: Scrape type for CC56747: 0
2026-03-29 11:36:04 [auto1.be] INFO: Found listing with ID: XJ47711
2026-03-29 11:36:04 [auto1.be] INFO: Found listing with ID: CK49467
2026-03-29 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK49467%27 HTTP/1.1" 200 None
2026-03-29 11:36:04 [auto1.be] INFO: Scrape type for CK49467: 0
2026-03-29 11:36:04 [auto1.be] INFO: Found listing with ID: JA34397
2026-03-29 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JA34397%27 HTTP/1.1" 200 None
2026-03-29 11:36:04 [auto1.be] INFO: Scrape type for JA34397: 0
2026-03-29 11:36:04 [auto1.be] INFO: Found listing with ID: XC31503
2026-03-29 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC31503%27 HTTP/1.1" 200 None
2026-03-29 11:36:04 [auto1.be] INFO: Scrape type for XC31503: 0
2026-03-29 11:36:04 [auto1.be] INFO: Found listing with ID: LE58292
2026-03-29 11:36:04 [auto1.be] INFO: Found listing with ID: DL17322
2026-03-29 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL17322%27 HTTP/1.1" 200 None
2026-03-29 11:36:04 [auto1.be] INFO: Scrape type for DL17322: 0
2026-03-29 11:36:04 [auto1.be] INFO: Found listing with ID: SE12861
2026-03-29 11:36:04 [auto1.be] INFO: Found listing with ID: BJ27729
2026-03-29 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ27729%27 HTTP/1.1" 200 None
2026-03-29 11:36:04 [auto1.be] INFO: Scrape type for BJ27729: 0
2026-03-29 11:36:04 [auto1.be] INFO: Found listing with ID: EN18719
2026-03-29 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN18719%27 HTTP/1.1" 200 None
2026-03-29 11:36:04 [auto1.be] INFO: Scrape type for EN18719: 0
2026-03-29 11:36:04 [auto1.be] INFO: Found listing with ID: DP96573
2026-03-29 11:36:04 [auto1.be] INFO: Found listing with ID: YM63500
2026-03-29 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM63500%27 HTTP/1.1" 200 None
2026-03-29 11:36:04 [auto1.be] INFO: Scrape type for YM63500: 0
2026-03-29 11:36:04 [auto1.be] INFO: Found listing with ID: WH07577
2026-03-29 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH07577%27 HTTP/1.1" 200 None
2026-03-29 11:36:04 [auto1.be] INFO: Scrape type for WH07577: 0
2026-03-29 11:36:04 [auto1.be] INFO: Found listing with ID: LJ91533
2026-03-29 11:36:04 [auto1.be] INFO: Found listing with ID: TY52799
2026-03-29 11:36:04 [auto1.be] INFO: Found listing with ID: EM18277
2026-03-29 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM18277%27 HTTP/1.1" 200 None
2026-03-29 11:36:04 [auto1.be] INFO: Scrape type for EM18277: 0
2026-03-29 11:36:04 [auto1.be] INFO: Found listing with ID: XJ49438
2026-03-29 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ49438%27 HTTP/1.1" 200 None
2026-03-29 11:36:04 [auto1.be] INFO: Scrape type for XJ49438: 0
2026-03-29 11:36:04 [auto1.be] INFO: Found listing with ID: ZB59407
2026-03-29 11:36:04 [auto1.be] INFO: Found listing with ID: YW29468
2026-03-29 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW29468%27 HTTP/1.1" 200 None
2026-03-29 11:36:04 [auto1.be] INFO: Scrape type for YW29468: 0
2026-03-29 11:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:36:05 [auto1.be] INFO: Channel: 24h | Page: 10 | totalHits: 1256 | hits on page: 40
2026-03-29 11:36:05 [auto1.be] INFO: Found listing with ID: NU46591
2026-03-29 11:36:05 [auto1.be] INFO: Found listing with ID: AS01915
2026-03-29 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AS01915%27 HTTP/1.1" 200 None
2026-03-29 11:36:05 [auto1.be] INFO: Scrape type for AS01915: 0
2026-03-29 11:36:05 [auto1.be] INFO: Found listing with ID: AB44644
2026-03-29 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB44644%27 HTTP/1.1" 200 None
2026-03-29 11:36:05 [auto1.be] INFO: Scrape type for AB44644: 0
2026-03-29 11:36:05 [auto1.be] INFO: Found listing with ID: XM93272
2026-03-29 11:36:05 [auto1.be] INFO: Found listing with ID: TL07516
2026-03-29 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL07516%27 HTTP/1.1" 200 None
2026-03-29 11:36:05 [auto1.be] INFO: Scrape type for TL07516: 0
2026-03-29 11:36:05 [auto1.be] INFO: Found listing with ID: JK00802
2026-03-29 11:36:05 [auto1.be] INFO: Found listing with ID: CS76215
2026-03-29 11:36:05 [auto1.be] INFO: Found listing with ID: WD81319
2026-03-29 11:36:05 [auto1.be] INFO: Found listing with ID: WA82695
2026-03-29 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA82695%27 HTTP/1.1" 200 None
2026-03-29 11:36:05 [auto1.be] INFO: Scrape type for WA82695: 0
2026-03-29 11:36:05 [auto1.be] INFO: Found listing with ID: ZM54310
2026-03-29 11:36:05 [auto1.be] INFO: Found listing with ID: AF68960
2026-03-29 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF68960%27 HTTP/1.1" 200 None
2026-03-29 11:36:05 [auto1.be] INFO: Scrape type for AF68960: 0
2026-03-29 11:36:05 [auto1.be] INFO: Found listing with ID: RW94228
2026-03-29 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW94228%27 HTTP/1.1" 200 None
2026-03-29 11:36:05 [auto1.be] INFO: Scrape type for RW94228: 0
2026-03-29 11:36:05 [auto1.be] INFO: Found listing with ID: FE52220
2026-03-29 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE52220%27 HTTP/1.1" 200 None
2026-03-29 11:36:05 [auto1.be] INFO: Scrape type for FE52220: 0
2026-03-29 11:36:05 [auto1.be] INFO: Found listing with ID: MZ83142
2026-03-29 11:36:05 [auto1.be] INFO: Found listing with ID: YG62523
2026-03-29 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG62523%27 HTTP/1.1" 200 None
2026-03-29 11:36:05 [auto1.be] INFO: Scrape type for YG62523: 0
2026-03-29 11:36:05 [auto1.be] INFO: Found listing with ID: CA72484
2026-03-29 11:36:05 [auto1.be] INFO: Found listing with ID: XK61886
2026-03-29 11:36:05 [auto1.be] INFO: Found listing with ID: VU61418
2026-03-29 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU61418%27 HTTP/1.1" 200 None
2026-03-29 11:36:05 [auto1.be] INFO: Scrape type for VU61418: 0
2026-03-29 11:36:05 [auto1.be] INFO: Found listing with ID: ZF47475
2026-03-29 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF47475%27 HTTP/1.1" 200 None
2026-03-29 11:36:05 [auto1.be] INFO: Scrape type for ZF47475: 0
2026-03-29 11:36:05 [auto1.be] INFO: Found listing with ID: XC82229
2026-03-29 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC82229%27 HTTP/1.1" 200 None
2026-03-29 11:36:05 [auto1.be] INFO: Scrape type for XC82229: 0
2026-03-29 11:36:05 [auto1.be] INFO: Found listing with ID: SD60477
2026-03-29 11:36:05 [auto1.be] INFO: Found listing with ID: PP48497
2026-03-29 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PP48497%27 HTTP/1.1" 200 None
2026-03-29 11:36:05 [auto1.be] INFO: Scrape type for PP48497: 0
2026-03-29 11:36:05 [auto1.be] INFO: Found listing with ID: YB47559
2026-03-29 11:36:05 [auto1.be] INFO: Found listing with ID: PT26763
2026-03-29 11:36:05 [auto1.be] INFO: Found listing with ID: PN18532
2026-03-29 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN18532%27 HTTP/1.1" 200 None
2026-03-29 11:36:05 [auto1.be] INFO: Scrape type for PN18532: 0
2026-03-29 11:36:05 [auto1.be] INFO: Found listing with ID: VD09174
2026-03-29 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VD09174%27 HTTP/1.1" 200 None
2026-03-29 11:36:05 [auto1.be] INFO: Scrape type for VD09174: 2
2026-03-29 11:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4308cbe-e410-57b1-8fd1-a7cfd3e170ee with identifier: VD09174
2026-03-29 11:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4308cbe-e410-57b1-8fd1-a7cfd3e170ee with scrape type 2
2026-03-29 11:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4308cbe-e410-57b1-8fd1-a7cfd3e170ee with scrape type 2
2026-03-29 11:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c4308cbe-e410-57b1-8fd1-a7cfd3e170ee, identifier: VD09174
2026-03-29 11:36:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c4308cbe-e410-57b1-8fd1-a7cfd3e170ee with identifier: VD09174
2026-03-29 11:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 11:36:06 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-29 11:36:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 11:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c4308cbe-e410-57b1-8fd1-a7cfd3e170ee with identifier: VD09174
2026-03-29 11:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c4308cbe-e410-57b1-8fd1-a7cfd3e170ee with identifier: VD09174 to the API
2026-03-29 11:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:30:50Z',
 'fuel_type': 'diesel',
 'id': 'c4308cbe-e410-57b1-8fd1-a7cfd3e170ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD09174',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 185116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-17',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2014}
2026-03-29 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VD09174%27 HTTP/1.1" 200 None
2026-03-29 11:36:06 [auto1.be] INFO: Saving data for VD09174: {'auction_closing_time': 1774884650.0, 'created_time': 1773434380.758849, 'last_price_update_time': 1774784166.429512}
2026-03-29 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VD09174') HTTP/1.1" 204 0
2026-03-29 11:36:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:36:06 [auto1.be] INFO: Found listing with ID: DH81993
2026-03-29 11:36:06 [auto1.be] INFO: Found listing with ID: FY33898
2026-03-29 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY33898%27 HTTP/1.1" 200 None
2026-03-29 11:36:06 [auto1.be] INFO: Scrape type for FY33898: 2
2026-03-29 11:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0176d99f-9376-5e1c-ab01-6f3e5fd48f10 with identifier: FY33898
2026-03-29 11:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0176d99f-9376-5e1c-ab01-6f3e5fd48f10 with scrape type 2
2026-03-29 11:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0176d99f-9376-5e1c-ab01-6f3e5fd48f10 with scrape type 2
2026-03-29 11:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0176d99f-9376-5e1c-ab01-6f3e5fd48f10, identifier: FY33898
2026-03-29 11:36:06 [scrapy.extensions.logstats] INFO: Crawled 14 pages (at 14 pages/min), scraped 6 items (at 6 items/min)
2026-03-29 11:36:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 158MiB
2026-03-29 11:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0176d99f-9376-5e1c-ab01-6f3e5fd48f10 with identifier: FY33898
2026-03-29 11:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0176d99f-9376-5e1c-ab01-6f3e5fd48f10 with identifier: FY33898
2026-03-29 11:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0176d99f-9376-5e1c-ab01-6f3e5fd48f10 with identifier: FY33898 to the API
2026-03-29 11:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:23:48Z',
 'fuel_type': 'petrol',
 'id': '0176d99f-9376-5e1c-ab01-6f3e5fd48f10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY33898',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 291418,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-17',
 'seller_name': None,
 'title': 'Audi TT 1.8 TFSI Coupe',
 'transmission': 'manual',
 'trim': 'Coupe',
 'year': 2012}
2026-03-29 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY33898%27 HTTP/1.1" 200 None
2026-03-29 11:36:06 [auto1.be] INFO: Saving data for FY33898: {'auction_closing_time': 1774884228.0, 'created_time': 1773434461.814355, 'last_price_update_time': 1774784166.941919}
2026-03-29 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FY33898') HTTP/1.1" 204 0
2026-03-29 11:36:06 [auto1.be] INFO: Found listing with ID: ST89131
2026-03-29 11:36:06 [auto1.be] INFO: Found listing with ID: TU68669
2026-03-29 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU68669%27 HTTP/1.1" 200 None
2026-03-29 11:36:06 [auto1.be] INFO: Scrape type for TU68669: 0
2026-03-29 11:36:06 [auto1.be] INFO: Found listing with ID: PC96861
2026-03-29 11:36:06 [auto1.be] INFO: Found listing with ID: PH64665
2026-03-29 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH64665%27 HTTP/1.1" 200 None
2026-03-29 11:36:06 [auto1.be] INFO: Scrape type for PH64665: 0
2026-03-29 11:36:06 [auto1.be] INFO: Found listing with ID: RH07818
2026-03-29 11:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH07818%27 HTTP/1.1" 200 None
2026-03-29 11:36:07 [auto1.be] INFO: Scrape type for RH07818: 0
2026-03-29 11:36:07 [auto1.be] INFO: Found listing with ID: LT97220
2026-03-29 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT97220%27 HTTP/1.1" 200 None
2026-03-29 11:36:07 [auto1.be] INFO: Scrape type for LT97220: 0
2026-03-29 11:36:07 [auto1.be] INFO: Found listing with ID: ML35155
2026-03-29 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML35155%27 HTTP/1.1" 200 None
2026-03-29 11:36:07 [auto1.be] INFO: Scrape type for ML35155: 0
2026-03-29 11:36:07 [auto1.be] INFO: Found listing with ID: UB84637
2026-03-29 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB84637%27 HTTP/1.1" 200 None
2026-03-29 11:36:07 [auto1.be] INFO: Scrape type for UB84637: 0
2026-03-29 11:36:07 [auto1.be] INFO: Found listing with ID: XJ82974
2026-03-29 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ82974%27 HTTP/1.1" 200 None
2026-03-29 11:36:07 [auto1.be] INFO: Scrape type for XJ82974: 0
2026-03-29 11:36:07 [auto1.be] INFO: Found listing with ID: YV36261
2026-03-29 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV36261%27 HTTP/1.1" 200 None
2026-03-29 11:36:07 [auto1.be] INFO: Scrape type for YV36261: 0
2026-03-29 11:36:07 [auto1.be] INFO: Found listing with ID: MB19665
2026-03-29 11:36:07 [auto1.be] INFO: Found listing with ID: SJ78748
2026-03-29 11:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:36:08 [auto1.be] INFO: Channel: 24h | Page: 11 | totalHits: 1256 | hits on page: 40
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: UM90025
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: NC04706
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC04706%27 HTTP/1.1" 200 None
2026-03-29 11:36:08 [auto1.be] INFO: Scrape type for NC04706: 0
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: CD06973
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD06973%27 HTTP/1.1" 200 None
2026-03-29 11:36:08 [auto1.be] INFO: Scrape type for CD06973: 0
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: LW74134
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: AM54260
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: WP77061
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP77061%27 HTTP/1.1" 200 None
2026-03-29 11:36:08 [auto1.be] INFO: Scrape type for WP77061: 0
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: WE68493
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: TK93480
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK93480%27 HTTP/1.1" 200 None
2026-03-29 11:36:08 [auto1.be] INFO: Scrape type for TK93480: 0
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: ZJ47299
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ47299%27 HTTP/1.1" 200 None
2026-03-29 11:36:08 [auto1.be] INFO: Scrape type for ZJ47299: 0
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: JJ10339
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ10339%27 HTTP/1.1" 200 None
2026-03-29 11:36:08 [auto1.be] INFO: Scrape type for JJ10339: 0
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: RW29034
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW29034%27 HTTP/1.1" 200 None
2026-03-29 11:36:08 [auto1.be] INFO: Scrape type for RW29034: 0
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: KD31542
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: FV97066
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV97066%27 HTTP/1.1" 200 None
2026-03-29 11:36:08 [auto1.be] INFO: Scrape type for FV97066: 0
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: DW89258
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: AU32211
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: RA68631
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA68631%27 HTTP/1.1" 200 None
2026-03-29 11:36:08 [auto1.be] INFO: Scrape type for RA68631: 2
2026-03-29 11:36:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1708629c-498c-58cd-8397-84b9e29651f3 with identifier: RA68631
2026-03-29 11:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1708629c-498c-58cd-8397-84b9e29651f3 with scrape type 2
2026-03-29 11:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1708629c-498c-58cd-8397-84b9e29651f3 with scrape type 2
2026-03-29 11:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1708629c-498c-58cd-8397-84b9e29651f3, identifier: RA68631
2026-03-29 11:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1708629c-498c-58cd-8397-84b9e29651f3 with identifier: RA68631
2026-03-29 11:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1708629c-498c-58cd-8397-84b9e29651f3 with identifier: RA68631
2026-03-29 11:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1708629c-498c-58cd-8397-84b9e29651f3 with identifier: RA68631 to the API
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:05:17Z',
 'fuel_type': 'diesel',
 'id': '1708629c-498c-58cd-8397-84b9e29651f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA68631',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 228568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-19',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 SE AWD',
 'transmission': 'automatic',
 'trim': 'SE AWD',
 'year': 2017}
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA68631%27 HTTP/1.1" 200 None
2026-03-29 11:36:08 [auto1.be] INFO: Saving data for RA68631: {'auction_closing_time': 1774883117.0, 'created_time': 1774600542.551652, 'last_price_update_time': 1774784168.638162}
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RA68631') HTTP/1.1" 204 0
2026-03-29 11:36:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: HA88594
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HA88594%27 HTTP/1.1" 200 None
2026-03-29 11:36:08 [auto1.be] INFO: Scrape type for HA88594: 0
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: DB63111
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: JZ16543
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ16543%27 HTTP/1.1" 200 None
2026-03-29 11:36:08 [auto1.be] INFO: Scrape type for JZ16543: 0
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: SX32022
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX32022%27 HTTP/1.1" 200 None
2026-03-29 11:36:08 [auto1.be] INFO: Scrape type for SX32022: 0
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: NP17382
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP17382%27 HTTP/1.1" 200 None
2026-03-29 11:36:08 [auto1.be] INFO: Scrape type for NP17382: 0
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: TF03002
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: KK24955
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: BA13225
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: TE72836
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE72836%27 HTTP/1.1" 200 None
2026-03-29 11:36:08 [auto1.be] INFO: Scrape type for TE72836: 0
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: HY58683
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: SS18683
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SS18683%27 HTTP/1.1" 200 None
2026-03-29 11:36:08 [auto1.be] INFO: Scrape type for SS18683: 0
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: XC12599
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC12599%27 HTTP/1.1" 200 None
2026-03-29 11:36:08 [auto1.be] INFO: Scrape type for XC12599: 0
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: ZJ76170
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ76170%27 HTTP/1.1" 200 None
2026-03-29 11:36:08 [auto1.be] INFO: Scrape type for ZJ76170: 0
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: XK75143
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK75143%27 HTTP/1.1" 200 None
2026-03-29 11:36:08 [auto1.be] INFO: Scrape type for XK75143: 0
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: NP23299
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: UA98228
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: VT00410
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: ZH69808
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH69808%27 HTTP/1.1" 200 None
2026-03-29 11:36:08 [auto1.be] INFO: Scrape type for ZH69808: 0
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: WJ68976
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: CS08088
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: TH19224
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: XE73160
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: VH38978
2026-03-29 11:36:08 [auto1.be] INFO: Found listing with ID: DY96127
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY96127%27 HTTP/1.1" 200 None
2026-03-29 11:36:08 [auto1.be] INFO: Scrape type for DY96127: 0
2026-03-29 11:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:36:09 [auto1.be] INFO: Channel: 24h | Page: 12 | totalHits: 1256 | hits on page: 40
2026-03-29 11:36:09 [auto1.be] INFO: Found listing with ID: HT10085
2026-03-29 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT10085%27 HTTP/1.1" 200 None
2026-03-29 11:36:09 [auto1.be] INFO: Scrape type for HT10085: 0
2026-03-29 11:36:09 [auto1.be] INFO: Found listing with ID: BB40778
2026-03-29 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB40778%27 HTTP/1.1" 200 None
2026-03-29 11:36:09 [auto1.be] INFO: Scrape type for BB40778: 0
2026-03-29 11:36:09 [auto1.be] INFO: Found listing with ID: DP96261
2026-03-29 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP96261%27 HTTP/1.1" 200 None
2026-03-29 11:36:09 [auto1.be] INFO: Scrape type for DP96261: 0
2026-03-29 11:36:09 [auto1.be] INFO: Found listing with ID: DK43204
2026-03-29 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK43204%27 HTTP/1.1" 200 None
2026-03-29 11:36:09 [auto1.be] INFO: Scrape type for DK43204: 0
2026-03-29 11:36:09 [auto1.be] INFO: Found listing with ID: WH41445
2026-03-29 11:36:09 [auto1.be] INFO: Found listing with ID: MD04738
2026-03-29 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD04738%27 HTTP/1.1" 200 None
2026-03-29 11:36:09 [auto1.be] INFO: Scrape type for MD04738: 0
2026-03-29 11:36:09 [auto1.be] INFO: Found listing with ID: WG62431
2026-03-29 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG62431%27 HTTP/1.1" 200 None
2026-03-29 11:36:09 [auto1.be] INFO: Scrape type for WG62431: 0
2026-03-29 11:36:09 [auto1.be] INFO: Found listing with ID: CB86664
2026-03-29 11:36:09 [auto1.be] INFO: Found listing with ID: NW54949
2026-03-29 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NW54949%27 HTTP/1.1" 200 None
2026-03-29 11:36:09 [auto1.be] INFO: Scrape type for NW54949: 0
2026-03-29 11:36:09 [auto1.be] INFO: Found listing with ID: ZK51965
2026-03-29 11:36:09 [auto1.be] INFO: Found listing with ID: TT75307
2026-03-29 11:36:09 [auto1.be] INFO: Found listing with ID: EP09858
2026-03-29 11:36:09 [auto1.be] INFO: Found listing with ID: CW40114
2026-03-29 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW40114%27 HTTP/1.1" 200 None
2026-03-29 11:36:09 [auto1.be] INFO: Scrape type for CW40114: 0
2026-03-29 11:36:09 [auto1.be] INFO: Found listing with ID: DH21315
2026-03-29 11:36:09 [auto1.be] INFO: Found listing with ID: EW63431
2026-03-29 11:36:09 [auto1.be] INFO: Found listing with ID: GH94077
2026-03-29 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH94077%27 HTTP/1.1" 200 None
2026-03-29 11:36:09 [auto1.be] INFO: Scrape type for GH94077: 0
2026-03-29 11:36:09 [auto1.be] INFO: Found listing with ID: RG44645
2026-03-29 11:36:09 [auto1.be] INFO: Found listing with ID: DS23322
2026-03-29 11:36:09 [auto1.be] INFO: Found listing with ID: LU38585
2026-03-29 11:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU38585%27 HTTP/1.1" 200 None
2026-03-29 11:36:10 [auto1.be] INFO: Scrape type for LU38585: 0
2026-03-29 11:36:10 [auto1.be] INFO: Found listing with ID: GW63299
2026-03-29 11:36:10 [auto1.be] INFO: Found listing with ID: JF41683
2026-03-29 11:36:10 [auto1.be] INFO: Found listing with ID: GJ23391
2026-03-29 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ23391%27 HTTP/1.1" 200 None
2026-03-29 11:36:10 [auto1.be] INFO: Scrape type for GJ23391: 0
2026-03-29 11:36:10 [auto1.be] INFO: Found listing with ID: VM57702
2026-03-29 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM57702%27 HTTP/1.1" 200 None
2026-03-29 11:36:10 [auto1.be] INFO: Scrape type for VM57702: 0
2026-03-29 11:36:10 [auto1.be] INFO: Found listing with ID: FT96499
2026-03-29 11:36:10 [auto1.be] INFO: Found listing with ID: XR84470
2026-03-29 11:36:10 [auto1.be] INFO: Found listing with ID: FL46625
2026-03-29 11:36:10 [auto1.be] INFO: Found listing with ID: AX12673
2026-03-29 11:36:10 [auto1.be] INFO: Found listing with ID: GF63829
2026-03-29 11:36:10 [auto1.be] INFO: Found listing with ID: JH02802
2026-03-29 11:36:10 [auto1.be] INFO: Found listing with ID: KG19380
2026-03-29 11:36:10 [auto1.be] INFO: Found listing with ID: HH24769
2026-03-29 11:36:10 [auto1.be] INFO: Found listing with ID: CA55783
2026-03-29 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA55783%27 HTTP/1.1" 200 None
2026-03-29 11:36:10 [auto1.be] INFO: Scrape type for CA55783: 0
2026-03-29 11:36:10 [auto1.be] INFO: Found listing with ID: EP14144
2026-03-29 11:36:10 [auto1.be] INFO: Found listing with ID: HP74170
2026-03-29 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP74170%27 HTTP/1.1" 200 None
2026-03-29 11:36:10 [auto1.be] INFO: Scrape type for HP74170: 0
2026-03-29 11:36:10 [auto1.be] INFO: Found listing with ID: EG14798
2026-03-29 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG14798%27 HTTP/1.1" 200 None
2026-03-29 11:36:10 [auto1.be] INFO: Scrape type for EG14798: 2
2026-03-29 11:36:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e822f5b3-2786-56fc-90e7-1311ff739363 with identifier: EG14798
2026-03-29 11:36:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e822f5b3-2786-56fc-90e7-1311ff739363 with scrape type 2
2026-03-29 11:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e822f5b3-2786-56fc-90e7-1311ff739363 with scrape type 2
2026-03-29 11:36:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e822f5b3-2786-56fc-90e7-1311ff739363, identifier: EG14798
2026-03-29 11:36:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e822f5b3-2786-56fc-90e7-1311ff739363 with identifier: EG14798
2026-03-29 11:36:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e822f5b3-2786-56fc-90e7-1311ff739363 with identifier: EG14798
2026-03-29 11:36:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e822f5b3-2786-56fc-90e7-1311ff739363 with identifier: EG14798 to the API
2026-03-29 11:36:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:36:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:19:35Z',
 'fuel_type': 'petrol',
 'id': 'e822f5b3-2786-56fc-90e7-1311ff739363',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG14798',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 137200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-04',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2019}
2026-03-29 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG14798%27 HTTP/1.1" 200 None
2026-03-29 11:36:10 [auto1.be] INFO: Saving data for EG14798: {'auction_closing_time': 1774883975.0, 'created_time': 1773909356.78368, 'last_price_update_time': 1774784170.500714}
2026-03-29 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EG14798') HTTP/1.1" 204 0
2026-03-29 11:36:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:36:10 [auto1.be] INFO: Found listing with ID: YN26679
2026-03-29 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN26679%27 HTTP/1.1" 200 None
2026-03-29 11:36:10 [auto1.be] INFO: Scrape type for YN26679: 0
2026-03-29 11:36:10 [auto1.be] INFO: Found listing with ID: HX42019
2026-03-29 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX42019%27 HTTP/1.1" 200 None
2026-03-29 11:36:10 [auto1.be] INFO: Scrape type for HX42019: 0
2026-03-29 11:36:10 [auto1.be] INFO: Found listing with ID: JW58136
2026-03-29 11:36:10 [auto1.be] INFO: Found listing with ID: RM51088
2026-03-29 11:36:10 [auto1.be] INFO: Found listing with ID: KW38150
2026-03-29 11:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:36:11 [auto1.be] INFO: Channel: 24h | Page: 13 | totalHits: 1256 | hits on page: 40
2026-03-29 11:36:11 [auto1.be] INFO: Found listing with ID: SV05686
2026-03-29 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV05686%27 HTTP/1.1" 200 None
2026-03-29 11:36:11 [auto1.be] INFO: Scrape type for SV05686: 0
2026-03-29 11:36:11 [auto1.be] INFO: Found listing with ID: JC96921
2026-03-29 11:36:11 [auto1.be] INFO: Found listing with ID: CS46874
2026-03-29 11:36:11 [auto1.be] INFO: Found listing with ID: GG55355
2026-03-29 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG55355%27 HTTP/1.1" 200 None
2026-03-29 11:36:11 [auto1.be] INFO: Scrape type for GG55355: 0
2026-03-29 11:36:11 [auto1.be] INFO: Found listing with ID: TK63545
2026-03-29 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK63545%27 HTTP/1.1" 200 None
2026-03-29 11:36:11 [auto1.be] INFO: Scrape type for TK63545: 0
2026-03-29 11:36:11 [auto1.be] INFO: Found listing with ID: MP28046
2026-03-29 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MP28046%27 HTTP/1.1" 200 None
2026-03-29 11:36:11 [auto1.be] INFO: Scrape type for MP28046: 0
2026-03-29 11:36:11 [auto1.be] INFO: Found listing with ID: HG61894
2026-03-29 11:36:11 [auto1.be] INFO: Found listing with ID: RB98158
2026-03-29 11:36:11 [auto1.be] INFO: Found listing with ID: WA78577
2026-03-29 11:36:11 [auto1.be] INFO: Found listing with ID: NP75657
2026-03-29 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP75657%27 HTTP/1.1" 200 None
2026-03-29 11:36:11 [auto1.be] INFO: Scrape type for NP75657: 2
2026-03-29 11:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 285d0ff0-8be5-5929-9cce-b8c00c37ef2a with identifier: NP75657
2026-03-29 11:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 285d0ff0-8be5-5929-9cce-b8c00c37ef2a with scrape type 2
2026-03-29 11:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 285d0ff0-8be5-5929-9cce-b8c00c37ef2a with scrape type 2
2026-03-29 11:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 285d0ff0-8be5-5929-9cce-b8c00c37ef2a, identifier: NP75657
2026-03-29 11:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 285d0ff0-8be5-5929-9cce-b8c00c37ef2a with identifier: NP75657
2026-03-29 11:36:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 11:36:11 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-29 11:36:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 11:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 285d0ff0-8be5-5929-9cce-b8c00c37ef2a with identifier: NP75657
2026-03-29 11:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 285d0ff0-8be5-5929-9cce-b8c00c37ef2a with identifier: NP75657 to the API
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:50:58Z',
 'fuel_type': 'petrol',
 'id': '285d0ff0-8be5-5929-9cce-b8c00c37ef2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP75657',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 149094,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-25',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Visia',
 'transmission': 'manual',
 'trim': 'Visia',
 'year': 2011}
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP75657%27 HTTP/1.1" 200 None
2026-03-29 11:36:12 [auto1.be] INFO: Saving data for NP75657: {'auction_closing_time': 1774885858.0, 'created_time': 1774600543.772611, 'last_price_update_time': 1774784172.312273}
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NP75657') HTTP/1.1" 204 0
2026-03-29 11:36:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:36:12 [auto1.be] INFO: Found listing with ID: BC49055
2026-03-29 11:36:12 [auto1.be] INFO: Found listing with ID: JJ27182
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ27182%27 HTTP/1.1" 200 None
2026-03-29 11:36:12 [auto1.be] INFO: Scrape type for JJ27182: 0
2026-03-29 11:36:12 [auto1.be] INFO: Found listing with ID: EG19315
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG19315%27 HTTP/1.1" 200 None
2026-03-29 11:36:12 [auto1.be] INFO: Scrape type for EG19315: 0
2026-03-29 11:36:12 [auto1.be] INFO: Found listing with ID: CD53749
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD53749%27 HTTP/1.1" 200 None
2026-03-29 11:36:12 [auto1.be] INFO: Scrape type for CD53749: 0
2026-03-29 11:36:12 [auto1.be] INFO: Found listing with ID: KN88676
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KN88676%27 HTTP/1.1" 200 None
2026-03-29 11:36:12 [auto1.be] INFO: Scrape type for KN88676: 0
2026-03-29 11:36:12 [auto1.be] INFO: Found listing with ID: RX75304
2026-03-29 11:36:12 [auto1.be] INFO: Found listing with ID: DG02903
2026-03-29 11:36:12 [auto1.be] INFO: Found listing with ID: WU67286
2026-03-29 11:36:12 [auto1.be] INFO: Found listing with ID: LL08256
2026-03-29 11:36:12 [auto1.be] INFO: Found listing with ID: CG84069
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG84069%27 HTTP/1.1" 200 None
2026-03-29 11:36:12 [auto1.be] INFO: Scrape type for CG84069: 0
2026-03-29 11:36:12 [auto1.be] INFO: Found listing with ID: AV28567
2026-03-29 11:36:12 [auto1.be] INFO: Found listing with ID: WB95668
2026-03-29 11:36:12 [auto1.be] INFO: Found listing with ID: FS62191
2026-03-29 11:36:12 [auto1.be] INFO: Found listing with ID: WU43595
2026-03-29 11:36:12 [auto1.be] INFO: Found listing with ID: HK81119
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK81119%27 HTTP/1.1" 200 None
2026-03-29 11:36:12 [auto1.be] INFO: Scrape type for HK81119: 0
2026-03-29 11:36:12 [auto1.be] INFO: Found listing with ID: ZJ33794
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ33794%27 HTTP/1.1" 200 None
2026-03-29 11:36:12 [auto1.be] INFO: Scrape type for ZJ33794: 0
2026-03-29 11:36:12 [auto1.be] INFO: Found listing with ID: VF88831
2026-03-29 11:36:12 [auto1.be] INFO: Found listing with ID: VK66376
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK66376%27 HTTP/1.1" 200 None
2026-03-29 11:36:12 [auto1.be] INFO: Scrape type for VK66376: 0
2026-03-29 11:36:12 [auto1.be] INFO: Found listing with ID: RA11008
2026-03-29 11:36:12 [auto1.be] INFO: Found listing with ID: KV01738
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV01738%27 HTTP/1.1" 200 None
2026-03-29 11:36:12 [auto1.be] INFO: Scrape type for KV01738: 0
2026-03-29 11:36:12 [auto1.be] INFO: Found listing with ID: EE45657
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EE45657%27 HTTP/1.1" 200 None
2026-03-29 11:36:12 [auto1.be] INFO: Scrape type for EE45657: 0
2026-03-29 11:36:12 [auto1.be] INFO: Found listing with ID: PS61885
2026-03-29 11:36:12 [auto1.be] INFO: Found listing with ID: UW52037
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW52037%27 HTTP/1.1" 200 None
2026-03-29 11:36:12 [auto1.be] INFO: Scrape type for UW52037: 0
2026-03-29 11:36:12 [auto1.be] INFO: Found listing with ID: YW15851
2026-03-29 11:36:12 [auto1.be] INFO: Found listing with ID: NS97708
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS97708%27 HTTP/1.1" 200 None
2026-03-29 11:36:12 [auto1.be] INFO: Scrape type for NS97708: 2
2026-03-29 11:36:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 817f1743-ff77-5064-a9cd-4dc974ab4f4b with identifier: NS97708
2026-03-29 11:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 817f1743-ff77-5064-a9cd-4dc974ab4f4b with scrape type 2
2026-03-29 11:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 817f1743-ff77-5064-a9cd-4dc974ab4f4b with scrape type 2
2026-03-29 11:36:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 817f1743-ff77-5064-a9cd-4dc974ab4f4b, identifier: NS97708
2026-03-29 11:36:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 817f1743-ff77-5064-a9cd-4dc974ab4f4b with identifier: NS97708
2026-03-29 11:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 817f1743-ff77-5064-a9cd-4dc974ab4f4b with identifier: NS97708
2026-03-29 11:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 817f1743-ff77-5064-a9cd-4dc974ab4f4b with identifier: NS97708 to the API
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:35:03Z',
 'fuel_type': 'petrol',
 'id': '817f1743-ff77-5064-a9cd-4dc974ab4f4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS97708',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 121226,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-26',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Night and Day',
 'transmission': 'manual',
 'trim': 'Night and Day',
 'year': 2010}
2026-03-29 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS97708%27 HTTP/1.1" 200 None
2026-03-29 11:36:13 [auto1.be] INFO: Saving data for NS97708: {'auction_closing_time': 1774884903.0, 'created_time': 1774514158.29556, 'last_price_update_time': 1774784173.056994}
2026-03-29 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NS97708') HTTP/1.1" 204 0
2026-03-29 11:36:13 [auto1.be] INFO: Found listing with ID: MB15455
2026-03-29 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB15455%27 HTTP/1.1" 200 None
2026-03-29 11:36:13 [auto1.be] INFO: Scrape type for MB15455: 0
2026-03-29 11:36:13 [auto1.be] INFO: Found listing with ID: RY14212
2026-03-29 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY14212%27 HTTP/1.1" 200 None
2026-03-29 11:36:13 [auto1.be] INFO: Scrape type for RY14212: 0
2026-03-29 11:36:13 [auto1.be] INFO: Found listing with ID: PB96026
2026-03-29 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB96026%27 HTTP/1.1" 200 None
2026-03-29 11:36:13 [auto1.be] INFO: Scrape type for PB96026: 0
2026-03-29 11:36:13 [auto1.be] INFO: Found listing with ID: EL33380
2026-03-29 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL33380%27 HTTP/1.1" 200 None
2026-03-29 11:36:13 [auto1.be] INFO: Scrape type for EL33380: 0
2026-03-29 11:36:13 [auto1.be] INFO: Found listing with ID: UH14890
2026-03-29 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UH14890%27 HTTP/1.1" 200 None
2026-03-29 11:36:13 [auto1.be] INFO: Scrape type for UH14890: 0
2026-03-29 11:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:36:14 [auto1.be] INFO: Channel: 24h | Page: 14 | totalHits: 1256 | hits on page: 40
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: YK73361
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK73361%27 HTTP/1.1" 200 None
2026-03-29 11:36:14 [auto1.be] INFO: Scrape type for YK73361: 0
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: FF99790
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF99790%27 HTTP/1.1" 200 None
2026-03-29 11:36:14 [auto1.be] INFO: Scrape type for FF99790: 0
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: DP88518
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP88518%27 HTTP/1.1" 200 None
2026-03-29 11:36:14 [auto1.be] INFO: Scrape type for DP88518: 0
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: XL26167
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: YJ00240
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: NB09051
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB09051%27 HTTP/1.1" 200 None
2026-03-29 11:36:14 [auto1.be] INFO: Scrape type for NB09051: 0
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: GF65026
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: HS49836
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: CU87114
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU87114%27 HTTP/1.1" 200 None
2026-03-29 11:36:14 [auto1.be] INFO: Scrape type for CU87114: 0
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: BV41613
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV41613%27 HTTP/1.1" 200 None
2026-03-29 11:36:14 [auto1.be] INFO: Scrape type for BV41613: 0
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: UX15937
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: RU19747
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: ZS27075
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZS27075%27 HTTP/1.1" 200 None
2026-03-29 11:36:14 [auto1.be] INFO: Scrape type for ZS27075: 0
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: UA67521
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA67521%27 HTTP/1.1" 200 None
2026-03-29 11:36:14 [auto1.be] INFO: Scrape type for UA67521: 0
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: CS20047
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: MK30308
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: FA61625
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: YA85838
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA85838%27 HTTP/1.1" 200 None
2026-03-29 11:36:14 [auto1.be] INFO: Scrape type for YA85838: 0
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: RL24593
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: PJ20685
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ20685%27 HTTP/1.1" 200 None
2026-03-29 11:36:14 [auto1.be] INFO: Scrape type for PJ20685: 0
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: XV14848
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: DY20434
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: CH15764
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: HY35953
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY35953%27 HTTP/1.1" 200 None
2026-03-29 11:36:14 [auto1.be] INFO: Scrape type for HY35953: 0
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: AX58227
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: GG92230
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: HM69306
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM69306%27 HTTP/1.1" 200 None
2026-03-29 11:36:14 [auto1.be] INFO: Scrape type for HM69306: 0
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: XC97675
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: LE04651
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE04651%27 HTTP/1.1" 200 None
2026-03-29 11:36:14 [auto1.be] INFO: Scrape type for LE04651: 0
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: XZ27909
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: CV26650
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV26650%27 HTTP/1.1" 200 None
2026-03-29 11:36:14 [auto1.be] INFO: Scrape type for CV26650: 0
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: XH41981
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: SV23823
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: HW65369
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW65369%27 HTTP/1.1" 200 None
2026-03-29 11:36:14 [auto1.be] INFO: Scrape type for HW65369: 0
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: YC48670
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: MK11042
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: SZ23077
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ23077%27 HTTP/1.1" 200 None
2026-03-29 11:36:14 [auto1.be] INFO: Scrape type for SZ23077: 0
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: TS47815
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS47815%27 HTTP/1.1" 200 None
2026-03-29 11:36:14 [auto1.be] INFO: Scrape type for TS47815: 0
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: RU10603
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU10603%27 HTTP/1.1" 200 None
2026-03-29 11:36:14 [auto1.be] INFO: Scrape type for RU10603: 0
2026-03-29 11:36:14 [auto1.be] INFO: Found listing with ID: SX30605
2026-03-29 11:36:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:36:15 [auto1.be] INFO: Channel: 24h | Page: 15 | totalHits: 1256 | hits on page: 40
2026-03-29 11:36:15 [auto1.be] INFO: Found listing with ID: AX51995
2026-03-29 11:36:15 [auto1.be] INFO: Found listing with ID: KW80684
2026-03-29 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW80684%27 HTTP/1.1" 200 None
2026-03-29 11:36:15 [auto1.be] INFO: Scrape type for KW80684: 0
2026-03-29 11:36:15 [auto1.be] INFO: Found listing with ID: LF90651
2026-03-29 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF90651%27 HTTP/1.1" 200 None
2026-03-29 11:36:15 [auto1.be] INFO: Scrape type for LF90651: 0
2026-03-29 11:36:15 [auto1.be] INFO: Found listing with ID: TH79553
2026-03-29 11:36:15 [auto1.be] INFO: Found listing with ID: ZJ26609
2026-03-29 11:36:15 [auto1.be] INFO: Found listing with ID: EK41744
2026-03-29 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK41744%27 HTTP/1.1" 200 None
2026-03-29 11:36:15 [auto1.be] INFO: Scrape type for EK41744: 0
2026-03-29 11:36:15 [auto1.be] INFO: Found listing with ID: BV36868
2026-03-29 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV36868%27 HTTP/1.1" 200 None
2026-03-29 11:36:15 [auto1.be] INFO: Scrape type for BV36868: 0
2026-03-29 11:36:15 [auto1.be] INFO: Found listing with ID: JB98140
2026-03-29 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB98140%27 HTTP/1.1" 200 None
2026-03-29 11:36:15 [auto1.be] INFO: Scrape type for JB98140: 2
2026-03-29 11:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd04258e-0d92-5c3d-8721-e65c6bd9d3bb with identifier: JB98140
2026-03-29 11:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd04258e-0d92-5c3d-8721-e65c6bd9d3bb with scrape type 2
2026-03-29 11:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd04258e-0d92-5c3d-8721-e65c6bd9d3bb with scrape type 2
2026-03-29 11:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fd04258e-0d92-5c3d-8721-e65c6bd9d3bb, identifier: JB98140
2026-03-29 11:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fd04258e-0d92-5c3d-8721-e65c6bd9d3bb with identifier: JB98140
2026-03-29 11:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fd04258e-0d92-5c3d-8721-e65c6bd9d3bb with identifier: JB98140
2026-03-29 11:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fd04258e-0d92-5c3d-8721-e65c6bd9d3bb with identifier: JB98140 to the API
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:45:35Z',
 'fuel_type': 'diesel',
 'id': 'fd04258e-0d92-5c3d-8721-e65c6bd9d3bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB98140',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 318252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-23',
 'seller_name': None,
 'title': 'Opel Zafira 1.7 CDTI Family Plus',
 'transmission': 'manual',
 'trim': 'Family Plus',
 'year': 2013}
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB98140%27 HTTP/1.1" 200 None
2026-03-29 11:36:16 [auto1.be] INFO: Saving data for JB98140: {'auction_closing_time': 1774885535.0, 'created_time': 1774600539.62481, 'last_price_update_time': 1774784176.419393}
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JB98140') HTTP/1.1" 204 0
2026-03-29 11:36:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:36:16 [auto1.be] INFO: Found listing with ID: ED70069
2026-03-29 11:36:16 [auto1.be] INFO: Found listing with ID: RM32931
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM32931%27 HTTP/1.1" 200 None
2026-03-29 11:36:16 [auto1.be] INFO: Scrape type for RM32931: 0
2026-03-29 11:36:16 [auto1.be] INFO: Found listing with ID: SK81997
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK81997%27 HTTP/1.1" 200 None
2026-03-29 11:36:16 [auto1.be] INFO: Scrape type for SK81997: 0
2026-03-29 11:36:16 [auto1.be] INFO: Found listing with ID: XE15288
2026-03-29 11:36:16 [auto1.be] INFO: Found listing with ID: PJ31589
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ31589%27 HTTP/1.1" 200 None
2026-03-29 11:36:16 [auto1.be] INFO: Scrape type for PJ31589: 0
2026-03-29 11:36:16 [auto1.be] INFO: Found listing with ID: MN41841
2026-03-29 11:36:16 [auto1.be] INFO: Found listing with ID: TV22564
2026-03-29 11:36:16 [auto1.be] INFO: Found listing with ID: UF59925
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF59925%27 HTTP/1.1" 200 None
2026-03-29 11:36:16 [auto1.be] INFO: Scrape type for UF59925: 0
2026-03-29 11:36:16 [auto1.be] INFO: Found listing with ID: UA82763
2026-03-29 11:36:16 [auto1.be] INFO: Found listing with ID: YX48939
2026-03-29 11:36:16 [auto1.be] INFO: Found listing with ID: RA81540
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA81540%27 HTTP/1.1" 200 None
2026-03-29 11:36:16 [auto1.be] INFO: Scrape type for RA81540: 0
2026-03-29 11:36:16 [auto1.be] INFO: Found listing with ID: RW15578
2026-03-29 11:36:16 [auto1.be] INFO: Found listing with ID: LW38679
2026-03-29 11:36:16 [auto1.be] INFO: Found listing with ID: WG20951
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG20951%27 HTTP/1.1" 200 None
2026-03-29 11:36:16 [auto1.be] INFO: Scrape type for WG20951: 0
2026-03-29 11:36:16 [auto1.be] INFO: Found listing with ID: UW21644
2026-03-29 11:36:16 [auto1.be] INFO: Found listing with ID: AG87445
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG87445%27 HTTP/1.1" 200 None
2026-03-29 11:36:16 [auto1.be] INFO: Scrape type for AG87445: 0
2026-03-29 11:36:16 [auto1.be] INFO: Found listing with ID: LX45606
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LX45606%27 HTTP/1.1" 200 None
2026-03-29 11:36:16 [auto1.be] INFO: Scrape type for LX45606: 0
2026-03-29 11:36:16 [auto1.be] INFO: Found listing with ID: DE21401
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE21401%27 HTTP/1.1" 200 None
2026-03-29 11:36:16 [auto1.be] INFO: Scrape type for DE21401: 0
2026-03-29 11:36:16 [auto1.be] INFO: Found listing with ID: MJ77172
2026-03-29 11:36:16 [auto1.be] INFO: Found listing with ID: RK68346
2026-03-29 11:36:16 [auto1.be] INFO: Found listing with ID: VE52917
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE52917%27 HTTP/1.1" 200 None
2026-03-29 11:36:16 [auto1.be] INFO: Scrape type for VE52917: 0
2026-03-29 11:36:16 [auto1.be] INFO: Found listing with ID: GC03502
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC03502%27 HTTP/1.1" 200 None
2026-03-29 11:36:16 [auto1.be] INFO: Scrape type for GC03502: 0
2026-03-29 11:36:16 [auto1.be] INFO: Found listing with ID: JX04101
2026-03-29 11:36:16 [auto1.be] INFO: Found listing with ID: YA14339
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA14339%27 HTTP/1.1" 200 None
2026-03-29 11:36:16 [auto1.be] INFO: Scrape type for YA14339: 0
2026-03-29 11:36:16 [auto1.be] INFO: Found listing with ID: SD15124
2026-03-29 11:36:16 [auto1.be] INFO: Found listing with ID: RR03336
2026-03-29 11:36:16 [auto1.be] INFO: Found listing with ID: JZ92177
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ92177%27 HTTP/1.1" 200 None
2026-03-29 11:36:16 [auto1.be] INFO: Scrape type for JZ92177: 0
2026-03-29 11:36:16 [auto1.be] INFO: Found listing with ID: PF95077
2026-03-29 11:36:16 [auto1.be] INFO: Found listing with ID: WE56106
2026-03-29 11:36:16 [auto1.be] INFO: Found listing with ID: BC32945
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC32945%27 HTTP/1.1" 200 None
2026-03-29 11:36:16 [auto1.be] INFO: Scrape type for BC32945: 0
2026-03-29 11:36:16 [auto1.be] INFO: Found listing with ID: NB71425
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB71425%27 HTTP/1.1" 200 None
2026-03-29 11:36:16 [auto1.be] INFO: Scrape type for NB71425: 0
2026-03-29 11:36:16 [auto1.be] INFO: Found listing with ID: HJ67440
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ67440%27 HTTP/1.1" 200 None
2026-03-29 11:36:16 [auto1.be] INFO: Scrape type for HJ67440: 0
2026-03-29 11:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:36:17 [auto1.be] INFO: Channel: 24h | Page: 16 | totalHits: 1256 | hits on page: 40
2026-03-29 11:36:17 [auto1.be] INFO: Found listing with ID: SF89359
2026-03-29 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF89359%27 HTTP/1.1" 200 None
2026-03-29 11:36:17 [auto1.be] INFO: Scrape type for SF89359: 2
2026-03-29 11:36:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90467edd-a787-5155-96c7-48be11c31ff2 with identifier: SF89359
2026-03-29 11:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90467edd-a787-5155-96c7-48be11c31ff2 with scrape type 2
2026-03-29 11:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90467edd-a787-5155-96c7-48be11c31ff2 with scrape type 2
2026-03-29 11:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 90467edd-a787-5155-96c7-48be11c31ff2, identifier: SF89359
2026-03-29 11:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 90467edd-a787-5155-96c7-48be11c31ff2 with identifier: SF89359
2026-03-29 11:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 90467edd-a787-5155-96c7-48be11c31ff2 with identifier: SF89359
2026-03-29 11:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 90467edd-a787-5155-96c7-48be11c31ff2 with identifier: SF89359 to the API
2026-03-29 11:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:07:07Z',
 'fuel_type': 'petrol',
 'id': '90467edd-a787-5155-96c7-48be11c31ff2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF89359',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 80555,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-08',
 'seller_name': None,
 'title': 'Renault Captur 0.9 Energy Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2017}
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF89359%27 HTTP/1.1" 200 None
2026-03-29 11:36:18 [auto1.be] INFO: Saving data for SF89359: {'auction_closing_time': 1774883227.0, 'created_time': 1774600538.33691, 'last_price_update_time': 1774784178.147474}
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SF89359') HTTP/1.1" 204 0
2026-03-29 11:36:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:36:18 [auto1.be] INFO: Found listing with ID: PN62826
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN62826%27 HTTP/1.1" 200 None
2026-03-29 11:36:18 [auto1.be] INFO: Scrape type for PN62826: 0
2026-03-29 11:36:18 [auto1.be] INFO: Found listing with ID: ZP07177
2026-03-29 11:36:18 [auto1.be] INFO: Found listing with ID: EF70909
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EF70909%27 HTTP/1.1" 200 None
2026-03-29 11:36:18 [auto1.be] INFO: Scrape type for EF70909: 0
2026-03-29 11:36:18 [auto1.be] INFO: Found listing with ID: FC28046
2026-03-29 11:36:18 [auto1.be] INFO: Found listing with ID: FP68376
2026-03-29 11:36:18 [auto1.be] INFO: Found listing with ID: VL69873
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL69873%27 HTTP/1.1" 200 None
2026-03-29 11:36:18 [auto1.be] INFO: Scrape type for VL69873: 0
2026-03-29 11:36:18 [auto1.be] INFO: Found listing with ID: AF71611
2026-03-29 11:36:18 [auto1.be] INFO: Found listing with ID: FR21473
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR21473%27 HTTP/1.1" 200 None
2026-03-29 11:36:18 [auto1.be] INFO: Scrape type for FR21473: 0
2026-03-29 11:36:18 [auto1.be] INFO: Found listing with ID: FK29667
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK29667%27 HTTP/1.1" 200 None
2026-03-29 11:36:18 [auto1.be] INFO: Scrape type for FK29667: 0
2026-03-29 11:36:18 [auto1.be] INFO: Found listing with ID: FG88533
2026-03-29 11:36:18 [auto1.be] INFO: Found listing with ID: AV34296
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV34296%27 HTTP/1.1" 200 None
2026-03-29 11:36:18 [auto1.be] INFO: Scrape type for AV34296: 0
2026-03-29 11:36:18 [auto1.be] INFO: Found listing with ID: ET09366
2026-03-29 11:36:18 [auto1.be] INFO: Found listing with ID: SB45161
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB45161%27 HTTP/1.1" 200 None
2026-03-29 11:36:18 [auto1.be] INFO: Scrape type for SB45161: 0
2026-03-29 11:36:18 [auto1.be] INFO: Found listing with ID: YF28674
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF28674%27 HTTP/1.1" 200 None
2026-03-29 11:36:18 [auto1.be] INFO: Scrape type for YF28674: 0
2026-03-29 11:36:18 [auto1.be] INFO: Found listing with ID: SR34780
2026-03-29 11:36:18 [auto1.be] INFO: Found listing with ID: NK56969
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK56969%27 HTTP/1.1" 200 None
2026-03-29 11:36:18 [auto1.be] INFO: Scrape type for NK56969: 0
2026-03-29 11:36:18 [auto1.be] INFO: Found listing with ID: MT09894
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MT09894%27 HTTP/1.1" 200 None
2026-03-29 11:36:18 [auto1.be] INFO: Scrape type for MT09894: 0
2026-03-29 11:36:18 [auto1.be] INFO: Found listing with ID: WB76864
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB76864%27 HTTP/1.1" 200 None
2026-03-29 11:36:18 [auto1.be] INFO: Scrape type for WB76864: 0
2026-03-29 11:36:18 [auto1.be] INFO: Found listing with ID: JZ88652
2026-03-29 11:36:18 [auto1.be] INFO: Found listing with ID: ZF81780
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF81780%27 HTTP/1.1" 200 None
2026-03-29 11:36:18 [auto1.be] INFO: Scrape type for ZF81780: 0
2026-03-29 11:36:18 [auto1.be] INFO: Found listing with ID: UV91092
2026-03-29 11:36:18 [auto1.be] INFO: Found listing with ID: JX62848
2026-03-29 11:36:18 [auto1.be] INFO: Found listing with ID: BS55977
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS55977%27 HTTP/1.1" 200 None
2026-03-29 11:36:18 [auto1.be] INFO: Scrape type for BS55977: 0
2026-03-29 11:36:18 [auto1.be] INFO: Found listing with ID: ET18736
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET18736%27 HTTP/1.1" 200 None
2026-03-29 11:36:18 [auto1.be] INFO: Scrape type for ET18736: 0
2026-03-29 11:36:18 [auto1.be] INFO: Found listing with ID: MA69424
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA69424%27 HTTP/1.1" 200 None
2026-03-29 11:36:18 [auto1.be] INFO: Scrape type for MA69424: 2
2026-03-29 11:36:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55dc8aba-cf4d-5ca8-a65e-fa42572d3812 with identifier: MA69424
2026-03-29 11:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55dc8aba-cf4d-5ca8-a65e-fa42572d3812 with scrape type 2
2026-03-29 11:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55dc8aba-cf4d-5ca8-a65e-fa42572d3812 with scrape type 2
2026-03-29 11:36:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 55dc8aba-cf4d-5ca8-a65e-fa42572d3812, identifier: MA69424
2026-03-29 11:36:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 55dc8aba-cf4d-5ca8-a65e-fa42572d3812 with identifier: MA69424
2026-03-29 11:36:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 55dc8aba-cf4d-5ca8-a65e-fa42572d3812 with identifier: MA69424
2026-03-29 11:36:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 55dc8aba-cf4d-5ca8-a65e-fa42572d3812 with identifier: MA69424 to the API
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:31:09Z',
 'fuel_type': 'diesel',
 'id': '55dc8aba-cf4d-5ca8-a65e-fa42572d3812',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA69424',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 144248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-03',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 d Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2015}
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA69424%27 HTTP/1.1" 200 None
2026-03-29 11:36:18 [auto1.be] INFO: Saving data for MA69424: {'auction_closing_time': 1774884669.0, 'created_time': 1773132633.832627, 'last_price_update_time': 1774784178.958631}
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MA69424') HTTP/1.1" 204 0
2026-03-29 11:36:19 [auto1.be] INFO: Found listing with ID: ZR45530
2026-03-29 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR45530%27 HTTP/1.1" 200 None
2026-03-29 11:36:19 [auto1.be] INFO: Scrape type for ZR45530: 0
2026-03-29 11:36:19 [auto1.be] INFO: Found listing with ID: VW08902
2026-03-29 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW08902%27 HTTP/1.1" 200 None
2026-03-29 11:36:19 [auto1.be] INFO: Scrape type for VW08902: 0
2026-03-29 11:36:19 [auto1.be] INFO: Found listing with ID: FS38787
2026-03-29 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS38787%27 HTTP/1.1" 200 None
2026-03-29 11:36:19 [auto1.be] INFO: Scrape type for FS38787: 0
2026-03-29 11:36:19 [auto1.be] INFO: Found listing with ID: HT09098
2026-03-29 11:36:19 [auto1.be] INFO: Found listing with ID: KP16038
2026-03-29 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP16038%27 HTTP/1.1" 200 None
2026-03-29 11:36:19 [auto1.be] INFO: Scrape type for KP16038: 0
2026-03-29 11:36:19 [auto1.be] INFO: Found listing with ID: KC19835
2026-03-29 11:36:19 [auto1.be] INFO: Found listing with ID: VU16052
2026-03-29 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU16052%27 HTTP/1.1" 200 None
2026-03-29 11:36:19 [auto1.be] INFO: Scrape type for VU16052: 0
2026-03-29 11:36:19 [auto1.be] INFO: Found listing with ID: HM47736
2026-03-29 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM47736%27 HTTP/1.1" 200 None
2026-03-29 11:36:19 [auto1.be] INFO: Scrape type for HM47736: 0
2026-03-29 11:36:19 [auto1.be] INFO: Found listing with ID: GF03232
2026-03-29 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF03232%27 HTTP/1.1" 200 None
2026-03-29 11:36:19 [auto1.be] INFO: Scrape type for GF03232: 0
2026-03-29 11:36:19 [auto1.be] INFO: Found listing with ID: UC56570
2026-03-29 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC56570%27 HTTP/1.1" 200 None
2026-03-29 11:36:19 [auto1.be] INFO: Scrape type for UC56570: 0
2026-03-29 11:36:19 [auto1.be] INFO: Found listing with ID: NN67810
2026-03-29 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN67810%27 HTTP/1.1" 200 None
2026-03-29 11:36:19 [auto1.be] INFO: Scrape type for NN67810: 0
2026-03-29 11:36:19 [auto1.be] INFO: Found listing with ID: FE88671
2026-03-29 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE88671%27 HTTP/1.1" 200 None
2026-03-29 11:36:19 [auto1.be] INFO: Scrape type for FE88671: 0
2026-03-29 11:36:19 [auto1.be] INFO: Found listing with ID: ZM54686
2026-03-29 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM54686%27 HTTP/1.1" 200 None
2026-03-29 11:36:19 [auto1.be] INFO: Scrape type for ZM54686: 0
2026-03-29 11:36:19 [auto1.be] INFO: Found listing with ID: GR78986
2026-03-29 11:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:36:20 [auto1.be] INFO: Channel: 24h | Page: 17 | totalHits: 1256 | hits on page: 40
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: CP42003
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP42003%27 HTTP/1.1" 200 None
2026-03-29 11:36:20 [auto1.be] INFO: Scrape type for CP42003: 0
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: RN56335
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: RF80171
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: ZF78419
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF78419%27 HTTP/1.1" 200 None
2026-03-29 11:36:20 [auto1.be] INFO: Scrape type for ZF78419: 0
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: DT24627
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: YM99739
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM99739%27 HTTP/1.1" 200 None
2026-03-29 11:36:20 [auto1.be] INFO: Scrape type for YM99739: 0
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: CH83928
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: YT15018
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YT15018%27 HTTP/1.1" 200 None
2026-03-29 11:36:20 [auto1.be] INFO: Scrape type for YT15018: 0
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: BC69430
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: BU90061
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU90061%27 HTTP/1.1" 200 None
2026-03-29 11:36:20 [auto1.be] INFO: Scrape type for BU90061: 0
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: EV01420
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV01420%27 HTTP/1.1" 200 None
2026-03-29 11:36:20 [auto1.be] INFO: Scrape type for EV01420: 0
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: PS72966
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS72966%27 HTTP/1.1" 200 None
2026-03-29 11:36:20 [auto1.be] INFO: Scrape type for PS72966: 0
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: CR22525
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: HF54985
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HF54985%27 HTTP/1.1" 200 None
2026-03-29 11:36:20 [auto1.be] INFO: Scrape type for HF54985: 0
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: GH94733
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH94733%27 HTTP/1.1" 200 None
2026-03-29 11:36:20 [auto1.be] INFO: Scrape type for GH94733: 0
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: CP91123
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: FA30680
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA30680%27 HTTP/1.1" 200 None
2026-03-29 11:36:20 [auto1.be] INFO: Scrape type for FA30680: 0
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: WL65720
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL65720%27 HTTP/1.1" 200 None
2026-03-29 11:36:20 [auto1.be] INFO: Scrape type for WL65720: 0
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: KM67426
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM67426%27 HTTP/1.1" 200 None
2026-03-29 11:36:20 [auto1.be] INFO: Scrape type for KM67426: 0
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: DM52841
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM52841%27 HTTP/1.1" 200 None
2026-03-29 11:36:20 [auto1.be] INFO: Scrape type for DM52841: 0
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: YH09444
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH09444%27 HTTP/1.1" 200 None
2026-03-29 11:36:20 [auto1.be] INFO: Scrape type for YH09444: 0
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: JP67733
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JP67733%27 HTTP/1.1" 200 None
2026-03-29 11:36:20 [auto1.be] INFO: Scrape type for JP67733: 0
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: RB53949
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: XD36076
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: RK05604
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: WA39171
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: AL21659
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: DC47068
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC47068%27 HTTP/1.1" 200 None
2026-03-29 11:36:20 [auto1.be] INFO: Scrape type for DC47068: 0
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: ES19550
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES19550%27 HTTP/1.1" 200 None
2026-03-29 11:36:20 [auto1.be] INFO: Scrape type for ES19550: 0
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: ZH14429
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: VV25356
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VV25356%27 HTTP/1.1" 200 None
2026-03-29 11:36:20 [auto1.be] INFO: Scrape type for VV25356: 0
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: GS99704
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS99704%27 HTTP/1.1" 200 None
2026-03-29 11:36:20 [auto1.be] INFO: Scrape type for GS99704: 0
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: YJ44532
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ44532%27 HTTP/1.1" 200 None
2026-03-29 11:36:20 [auto1.be] INFO: Scrape type for YJ44532: 0
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: UD97693
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: VM79296
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: YF30387
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: NU98421
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU98421%27 HTTP/1.1" 200 None
2026-03-29 11:36:20 [auto1.be] INFO: Scrape type for NU98421: 0
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: DY95002
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: HL95749
2026-03-29 11:36:20 [auto1.be] INFO: Found listing with ID: SA79242
2026-03-29 11:36:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:36:21 [auto1.be] INFO: Channel: 24h | Page: 18 | totalHits: 1256 | hits on page: 40
2026-03-29 11:36:21 [auto1.be] INFO: Found listing with ID: KF81819
2026-03-29 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF81819%27 HTTP/1.1" 200 None
2026-03-29 11:36:21 [auto1.be] INFO: Scrape type for KF81819: 0
2026-03-29 11:36:21 [auto1.be] INFO: Found listing with ID: WC10504
2026-03-29 11:36:21 [auto1.be] INFO: Found listing with ID: KU12802
2026-03-29 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU12802%27 HTTP/1.1" 200 None
2026-03-29 11:36:21 [auto1.be] INFO: Scrape type for KU12802: 0
2026-03-29 11:36:21 [auto1.be] INFO: Found listing with ID: CE58685
2026-03-29 11:36:21 [auto1.be] INFO: Found listing with ID: YH98972
2026-03-29 11:36:21 [auto1.be] INFO: Found listing with ID: BJ55526
2026-03-29 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ55526%27 HTTP/1.1" 200 None
2026-03-29 11:36:21 [auto1.be] INFO: Scrape type for BJ55526: 2
2026-03-29 11:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4412c6c3-53c2-56cf-9d30-c3800dda54e9 with identifier: BJ55526
2026-03-29 11:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4412c6c3-53c2-56cf-9d30-c3800dda54e9 with scrape type 2
2026-03-29 11:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4412c6c3-53c2-56cf-9d30-c3800dda54e9 with scrape type 2
2026-03-29 11:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4412c6c3-53c2-56cf-9d30-c3800dda54e9, identifier: BJ55526
2026-03-29 11:36:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4412c6c3-53c2-56cf-9d30-c3800dda54e9 with identifier: BJ55526
2026-03-29 11:36:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4412c6c3-53c2-56cf-9d30-c3800dda54e9 with identifier: BJ55526
2026-03-29 11:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4412c6c3-53c2-56cf-9d30-c3800dda54e9 with identifier: BJ55526 to the API
2026-03-29 11:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:57:29Z',
 'fuel_type': 'petrol',
 'id': '4412c6c3-53c2-56cf-9d30-c3800dda54e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ55526',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Spark',
 'odometer': 176548,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-25',
 'seller_name': None,
 'title': 'Chevrolet Spark 1.0 Basis +',
 'transmission': 'manual',
 'trim': 'Basis +',
 'year': 2012}
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ55526%27 HTTP/1.1" 200 None
2026-03-29 11:36:22 [auto1.be] INFO: Saving data for BJ55526: {'auction_closing_time': 1774886249.0, 'created_time': 1774600525.857736, 'last_price_update_time': 1774784182.097421}
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BJ55526') HTTP/1.1" 204 0
2026-03-29 11:36:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: GP50240
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP50240%27 HTTP/1.1" 200 None
2026-03-29 11:36:22 [auto1.be] INFO: Scrape type for GP50240: 0
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: SR93497
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR93497%27 HTTP/1.1" 200 None
2026-03-29 11:36:22 [auto1.be] INFO: Scrape type for SR93497: 0
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: GN45273
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: TW22956
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW22956%27 HTTP/1.1" 200 None
2026-03-29 11:36:22 [auto1.be] INFO: Scrape type for TW22956: 0
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: AE23838
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: MF96479
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: WD60187
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: KF59500
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: ZT52703
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: ZR52684
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: GP69185
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: DF09339
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF09339%27 HTTP/1.1" 200 None
2026-03-29 11:36:22 [auto1.be] INFO: Scrape type for DF09339: 0
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: LY80968
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY80968%27 HTTP/1.1" 200 None
2026-03-29 11:36:22 [auto1.be] INFO: Scrape type for LY80968: 0
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: CN47453
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: BX96549
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX96549%27 HTTP/1.1" 200 None
2026-03-29 11:36:22 [auto1.be] INFO: Scrape type for BX96549: 0
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: LM94739
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM94739%27 HTTP/1.1" 200 None
2026-03-29 11:36:22 [auto1.be] INFO: Scrape type for LM94739: 0
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: UT35373
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: KW15988
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: ZR23499
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: YR29884
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YR29884%27 HTTP/1.1" 200 None
2026-03-29 11:36:22 [auto1.be] INFO: Scrape type for YR29884: 0
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: NK28391
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK28391%27 HTTP/1.1" 200 None
2026-03-29 11:36:22 [auto1.be] INFO: Scrape type for NK28391: 0
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: KF50538
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF50538%27 HTTP/1.1" 200 None
2026-03-29 11:36:22 [auto1.be] INFO: Scrape type for KF50538: 0
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: ZR56949
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: MA06269
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: VZ78935
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ78935%27 HTTP/1.1" 200 None
2026-03-29 11:36:22 [auto1.be] INFO: Scrape type for VZ78935: 0
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: YU72813
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: CB53563
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB53563%27 HTTP/1.1" 200 None
2026-03-29 11:36:22 [auto1.be] INFO: Scrape type for CB53563: 0
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: NR94896
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR94896%27 HTTP/1.1" 200 None
2026-03-29 11:36:22 [auto1.be] INFO: Scrape type for NR94896: 2
2026-03-29 11:36:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 446467ba-2c5c-5540-92d6-0f9df88e4d8f with identifier: NR94896
2026-03-29 11:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 446467ba-2c5c-5540-92d6-0f9df88e4d8f with scrape type 2
2026-03-29 11:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 446467ba-2c5c-5540-92d6-0f9df88e4d8f with scrape type 2
2026-03-29 11:36:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 446467ba-2c5c-5540-92d6-0f9df88e4d8f, identifier: NR94896
2026-03-29 11:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 446467ba-2c5c-5540-92d6-0f9df88e4d8f with identifier: NR94896
2026-03-29 11:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 446467ba-2c5c-5540-92d6-0f9df88e4d8f with identifier: NR94896
2026-03-29 11:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 446467ba-2c5c-5540-92d6-0f9df88e4d8f with identifier: NR94896 to the API
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:40:37Z',
 'fuel_type': 'diesel',
 'id': '446467ba-2c5c-5540-92d6-0f9df88e4d8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR94896',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Edge',
 'odometer': 136162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-14',
 'seller_name': None,
 'title': 'Ford Edge 2.0 TDCi EcoBlue 4x2 Titanium',
 'transmission': 'automatic',
 'trim': '4x2 Titanium',
 'year': 2020}
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR94896%27 HTTP/1.1" 200 None
2026-03-29 11:36:22 [auto1.be] INFO: Saving data for NR94896: {'auction_closing_time': 1774885237.0, 'created_time': 1774600544.249187, 'last_price_update_time': 1774784182.796762}
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NR94896') HTTP/1.1" 204 0
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: GW69223
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW69223%27 HTTP/1.1" 200 None
2026-03-29 11:36:22 [auto1.be] INFO: Scrape type for GW69223: 0
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: BV56621
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV56621%27 HTTP/1.1" 200 None
2026-03-29 11:36:22 [auto1.be] INFO: Scrape type for BV56621: 0
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: CM40127
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: UB84592
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: HT96077
2026-03-29 11:36:22 [auto1.be] INFO: Found listing with ID: LE55631
2026-03-29 11:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:36:24 [auto1.be] INFO: Channel: 24h | Page: 19 | totalHits: 1256 | hits on page: 40
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: AK84541
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK84541%27 HTTP/1.1" 200 None
2026-03-29 11:36:24 [auto1.be] INFO: Scrape type for AK84541: 0
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: PM96543
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM96543%27 HTTP/1.1" 200 None
2026-03-29 11:36:24 [auto1.be] INFO: Scrape type for PM96543: 0
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: KF52558
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: NM84060
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: TW64249
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: XE64009
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE64009%27 HTTP/1.1" 200 None
2026-03-29 11:36:24 [auto1.be] INFO: Scrape type for XE64009: 0
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: KU26204
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU26204%27 HTTP/1.1" 200 None
2026-03-29 11:36:24 [auto1.be] INFO: Scrape type for KU26204: 0
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: ZN66630
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN66630%27 HTTP/1.1" 200 None
2026-03-29 11:36:24 [auto1.be] INFO: Scrape type for ZN66630: 0
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: PY81659
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: ZG50395
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG50395%27 HTTP/1.1" 200 None
2026-03-29 11:36:24 [auto1.be] INFO: Scrape type for ZG50395: 0
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: TM97404
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM97404%27 HTTP/1.1" 200 None
2026-03-29 11:36:24 [auto1.be] INFO: Scrape type for TM97404: 0
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: UV50609
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: ZZ47044
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ47044%27 HTTP/1.1" 200 None
2026-03-29 11:36:24 [auto1.be] INFO: Scrape type for ZZ47044: 0
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: UT04463
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT04463%27 HTTP/1.1" 200 None
2026-03-29 11:36:24 [auto1.be] INFO: Scrape type for UT04463: 0
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: WK14396
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: WE53696
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE53696%27 HTTP/1.1" 200 None
2026-03-29 11:36:24 [auto1.be] INFO: Scrape type for WE53696: 0
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: RW49064
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: NP69529
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP69529%27 HTTP/1.1" 200 None
2026-03-29 11:36:24 [auto1.be] INFO: Scrape type for NP69529: 0
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: WU38196
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU38196%27 HTTP/1.1" 200 None
2026-03-29 11:36:24 [auto1.be] INFO: Scrape type for WU38196: 0
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: ZL81412
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: FC74189
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC74189%27 HTTP/1.1" 200 None
2026-03-29 11:36:24 [auto1.be] INFO: Scrape type for FC74189: 0
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: CS98471
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: KC69840
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: ZR84759
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: WG89987
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: FE56390
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE56390%27 HTTP/1.1" 200 None
2026-03-29 11:36:24 [auto1.be] INFO: Scrape type for FE56390: 0
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: BR84638
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR84638%27 HTTP/1.1" 200 None
2026-03-29 11:36:24 [auto1.be] INFO: Scrape type for BR84638: 0
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: WC98842
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: VM06685
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: TS87931
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: UL72077
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL72077%27 HTTP/1.1" 200 None
2026-03-29 11:36:24 [auto1.be] INFO: Scrape type for UL72077: 0
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: VZ08217
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ08217%27 HTTP/1.1" 200 None
2026-03-29 11:36:24 [auto1.be] INFO: Scrape type for VZ08217: 0
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: UJ89543
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: SZ60181
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: JZ97752
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: YL00049
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL00049%27 HTTP/1.1" 200 None
2026-03-29 11:36:24 [auto1.be] INFO: Scrape type for YL00049: 0
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: SF38570
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: CG91643
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: CP13942
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP13942%27 HTTP/1.1" 200 None
2026-03-29 11:36:24 [auto1.be] INFO: Scrape type for CP13942: 0
2026-03-29 11:36:24 [auto1.be] INFO: Found listing with ID: RE48196
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE48196%27 HTTP/1.1" 200 None
2026-03-29 11:36:24 [auto1.be] INFO: Scrape type for RE48196: 0
2026-03-29 11:36:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:36:25 [auto1.be] INFO: Channel: 24h | Page: 20 | totalHits: 1256 | hits on page: 40
2026-03-29 11:36:25 [auto1.be] INFO: Found listing with ID: MS23670
2026-03-29 11:36:25 [auto1.be] INFO: Found listing with ID: CU40853
2026-03-29 11:36:25 [auto1.be] INFO: Found listing with ID: VA59143
2026-03-29 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA59143%27 HTTP/1.1" 200 None
2026-03-29 11:36:25 [auto1.be] INFO: Scrape type for VA59143: 2
2026-03-29 11:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54f2d533-e0ae-5885-9736-b45258329035 with identifier: VA59143
2026-03-29 11:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54f2d533-e0ae-5885-9736-b45258329035 with scrape type 2
2026-03-29 11:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54f2d533-e0ae-5885-9736-b45258329035 with scrape type 2
2026-03-29 11:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 54f2d533-e0ae-5885-9736-b45258329035, identifier: VA59143
2026-03-29 11:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 54f2d533-e0ae-5885-9736-b45258329035 with identifier: VA59143
2026-03-29 11:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 54f2d533-e0ae-5885-9736-b45258329035 with identifier: VA59143
2026-03-29 11:36:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 54f2d533-e0ae-5885-9736-b45258329035 with identifier: VA59143 to the API
2026-03-29 11:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:36:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:42:38Z',
 'fuel_type': 'diesel',
 'id': '54f2d533-e0ae-5885-9736-b45258329035',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA59143',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai+2',
 'odometer': 206974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-17',
 'seller_name': None,
 'title': 'Nissan Qashqai+2 1.6 dCi Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2013}
2026-03-29 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA59143%27 HTTP/1.1" 200 None
2026-03-29 11:36:25 [auto1.be] INFO: Saving data for VA59143: {'auction_closing_time': 1774885358.0, 'created_time': 1773780033.301243, 'last_price_update_time': 1774784185.833307}
2026-03-29 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VA59143') HTTP/1.1" 204 0
2026-03-29 11:36:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:36:25 [auto1.be] INFO: Found listing with ID: PR31064
2026-03-29 11:36:25 [auto1.be] INFO: Found listing with ID: KC33551
2026-03-29 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC33551%27 HTTP/1.1" 200 None
2026-03-29 11:36:25 [auto1.be] INFO: Scrape type for KC33551: 0
2026-03-29 11:36:25 [auto1.be] INFO: Found listing with ID: CE65833
2026-03-29 11:36:25 [auto1.be] INFO: Found listing with ID: VA87646
2026-03-29 11:36:25 [auto1.be] INFO: Found listing with ID: RA65802
2026-03-29 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA65802%27 HTTP/1.1" 200 None
2026-03-29 11:36:25 [auto1.be] INFO: Scrape type for RA65802: 0
2026-03-29 11:36:25 [auto1.be] INFO: Found listing with ID: MJ08102
2026-03-29 11:36:25 [auto1.be] INFO: Found listing with ID: CF04837
2026-03-29 11:36:25 [auto1.be] INFO: Found listing with ID: TS87416
2026-03-29 11:36:25 [auto1.be] INFO: Found listing with ID: YB94076
2026-03-29 11:36:25 [auto1.be] INFO: Found listing with ID: JM27578
2026-03-29 11:36:25 [auto1.be] INFO: Found listing with ID: ZA01438
2026-03-29 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZA01438%27 HTTP/1.1" 200 None
2026-03-29 11:36:25 [auto1.be] INFO: Scrape type for ZA01438: 0
2026-03-29 11:36:25 [auto1.be] INFO: Found listing with ID: VJ27978
2026-03-29 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VJ27978%27 HTTP/1.1" 200 None
2026-03-29 11:36:26 [auto1.be] INFO: Scrape type for VJ27978: 0
2026-03-29 11:36:26 [auto1.be] INFO: Found listing with ID: DF96327
2026-03-29 11:36:26 [auto1.be] INFO: Found listing with ID: MC94265
2026-03-29 11:36:26 [auto1.be] INFO: Found listing with ID: VP90118
2026-03-29 11:36:26 [auto1.be] INFO: Found listing with ID: PY58607
2026-03-29 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY58607%27 HTTP/1.1" 200 None
2026-03-29 11:36:26 [auto1.be] INFO: Scrape type for PY58607: 0
2026-03-29 11:36:26 [auto1.be] INFO: Found listing with ID: PK93774
2026-03-29 11:36:26 [auto1.be] INFO: Found listing with ID: BT72678
2026-03-29 11:36:26 [auto1.be] INFO: Found listing with ID: TK06008
2026-03-29 11:36:26 [auto1.be] INFO: Found listing with ID: VP91071
2026-03-29 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP91071%27 HTTP/1.1" 200 None
2026-03-29 11:36:26 [auto1.be] INFO: Scrape type for VP91071: 0
2026-03-29 11:36:26 [auto1.be] INFO: Found listing with ID: NM63028
2026-03-29 11:36:26 [auto1.be] INFO: Found listing with ID: JY53618
2026-03-29 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY53618%27 HTTP/1.1" 200 None
2026-03-29 11:36:26 [auto1.be] INFO: Scrape type for JY53618: 0
2026-03-29 11:36:26 [auto1.be] INFO: Found listing with ID: VB55746
2026-03-29 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB55746%27 HTTP/1.1" 200 None
2026-03-29 11:36:26 [auto1.be] INFO: Scrape type for VB55746: 0
2026-03-29 11:36:26 [auto1.be] INFO: Found listing with ID: GS48835
2026-03-29 11:36:26 [auto1.be] INFO: Found listing with ID: FA63464
2026-03-29 11:36:26 [auto1.be] INFO: Found listing with ID: XA29570
2026-03-29 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XA29570%27 HTTP/1.1" 200 None
2026-03-29 11:36:26 [auto1.be] INFO: Scrape type for XA29570: 0
2026-03-29 11:36:26 [auto1.be] INFO: Found listing with ID: MG12074
2026-03-29 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG12074%27 HTTP/1.1" 200 None
2026-03-29 11:36:26 [auto1.be] INFO: Scrape type for MG12074: 0
2026-03-29 11:36:26 [auto1.be] INFO: Found listing with ID: YD21406
2026-03-29 11:36:26 [auto1.be] INFO: Found listing with ID: XJ95743
2026-03-29 11:36:26 [auto1.be] INFO: Found listing with ID: DB02418
2026-03-29 11:36:26 [auto1.be] INFO: Found listing with ID: XT36171
2026-03-29 11:36:26 [auto1.be] INFO: Found listing with ID: MC66522
2026-03-29 11:36:26 [auto1.be] INFO: Found listing with ID: ZK00678
2026-03-29 11:36:26 [auto1.be] INFO: Found listing with ID: DE33834
2026-03-29 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE33834%27 HTTP/1.1" 200 None
2026-03-29 11:36:26 [auto1.be] INFO: Scrape type for DE33834: 0
2026-03-29 11:36:26 [auto1.be] INFO: Found listing with ID: HH62001
2026-03-29 11:36:26 [auto1.be] INFO: Found listing with ID: WF76478
2026-03-29 11:36:26 [auto1.be] INFO: Found listing with ID: SC59712
2026-03-29 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC59712%27 HTTP/1.1" 200 None
2026-03-29 11:36:26 [auto1.be] INFO: Scrape type for SC59712: 0
2026-03-29 11:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:36:27 [auto1.be] INFO: Channel: 24h | Page: 21 | totalHits: 1256 | hits on page: 40
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: XH49609
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH49609%27 HTTP/1.1" 200 None
2026-03-29 11:36:27 [auto1.be] INFO: Scrape type for XH49609: 0
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: SU72836
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: ME81448
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: GV27154
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV27154%27 HTTP/1.1" 200 None
2026-03-29 11:36:27 [auto1.be] INFO: Scrape type for GV27154: 0
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: XC10139
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: JS25395
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: RL32581
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: GA09150
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: CR21244
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CR21244%27 HTTP/1.1" 200 None
2026-03-29 11:36:27 [auto1.be] INFO: Scrape type for CR21244: 0
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: FY43318
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: FR80699
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: NM33768
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM33768%27 HTTP/1.1" 200 None
2026-03-29 11:36:27 [auto1.be] INFO: Scrape type for NM33768: 0
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: ZX33086
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX33086%27 HTTP/1.1" 200 None
2026-03-29 11:36:27 [auto1.be] INFO: Scrape type for ZX33086: 0
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: BP38818
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP38818%27 HTTP/1.1" 200 None
2026-03-29 11:36:27 [auto1.be] INFO: Scrape type for BP38818: 0
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: XT87195
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: KP16725
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: GS68920
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS68920%27 HTTP/1.1" 200 None
2026-03-29 11:36:27 [auto1.be] INFO: Scrape type for GS68920: 0
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: WP21428
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: XC64567
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: AU41446
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU41446%27 HTTP/1.1" 200 None
2026-03-29 11:36:27 [auto1.be] INFO: Scrape type for AU41446: 0
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: NJ59863
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ59863%27 HTTP/1.1" 200 None
2026-03-29 11:36:27 [auto1.be] INFO: Scrape type for NJ59863: 0
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: EX63844
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: XB11874
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB11874%27 HTTP/1.1" 200 None
2026-03-29 11:36:27 [auto1.be] INFO: Scrape type for XB11874: 0
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: VA07887
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: FJ79675
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: XT90325
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: CS46585
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: CG39340
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: MX90898
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX90898%27 HTTP/1.1" 200 None
2026-03-29 11:36:27 [auto1.be] INFO: Scrape type for MX90898: 0
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: LP39108
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: NZ84501
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ84501%27 HTTP/1.1" 200 None
2026-03-29 11:36:27 [auto1.be] INFO: Scrape type for NZ84501: 2
2026-03-29 11:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53177884-ab4c-50a6-853e-6e5964d8bc27 with identifier: NZ84501
2026-03-29 11:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53177884-ab4c-50a6-853e-6e5964d8bc27 with scrape type 2
2026-03-29 11:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53177884-ab4c-50a6-853e-6e5964d8bc27 with scrape type 2
2026-03-29 11:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 53177884-ab4c-50a6-853e-6e5964d8bc27, identifier: NZ84501
2026-03-29 11:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 53177884-ab4c-50a6-853e-6e5964d8bc27 with identifier: NZ84501
2026-03-29 11:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 53177884-ab4c-50a6-853e-6e5964d8bc27 with identifier: NZ84501
2026-03-29 11:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 53177884-ab4c-50a6-853e-6e5964d8bc27 with identifier: NZ84501 to the API
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:04:36Z',
 'fuel_type': 'petrol',
 'id': '53177884-ab4c-50a6-853e-6e5964d8bc27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ84501',
 'listing': 'auction',
 'make': 'Abarth',
 'model': '595',
 'odometer': 107943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-29',
 'seller_name': None,
 'title': 'Abarth 595 1.4 Turbo Custom',
 'transmission': 'automatic',
 'trim': 'Custom',
 'year': 2016}
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ84501%27 HTTP/1.1" 200 None
2026-03-29 11:36:27 [auto1.be] INFO: Saving data for NZ84501: {'auction_closing_time': 1774883076.0, 'created_time': 1774600542.14891, 'last_price_update_time': 1774784187.851672}
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NZ84501') HTTP/1.1" 204 0
2026-03-29 11:36:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: LM00165
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: LF23330
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF23330%27 HTTP/1.1" 200 None
2026-03-29 11:36:27 [auto1.be] INFO: Scrape type for LF23330: 0
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: GH45635
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH45635%27 HTTP/1.1" 200 None
2026-03-29 11:36:27 [auto1.be] INFO: Scrape type for GH45635: 0
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: SC36479
2026-03-29 11:36:27 [auto1.be] INFO: Found listing with ID: AB25804
2026-03-29 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB25804%27 HTTP/1.1" 200 None
2026-03-29 11:36:28 [auto1.be] INFO: Scrape type for AB25804: 0
2026-03-29 11:36:28 [auto1.be] INFO: Found listing with ID: TX85632
2026-03-29 11:36:28 [auto1.be] INFO: Found listing with ID: AD33980
2026-03-29 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD33980%27 HTTP/1.1" 200 None
2026-03-29 11:36:28 [auto1.be] INFO: Scrape type for AD33980: 0
2026-03-29 11:36:28 [auto1.be] INFO: Found listing with ID: CH34151
2026-03-29 11:36:28 [auto1.be] INFO: Found listing with ID: VP78411
2026-03-29 11:36:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:36:29 [auto1.be] INFO: Channel: 24h | Page: 22 | totalHits: 1256 | hits on page: 40
2026-03-29 11:36:29 [auto1.be] INFO: Found listing with ID: DM43787
2026-03-29 11:36:29 [auto1.be] INFO: Found listing with ID: SA37733
2026-03-29 11:36:29 [auto1.be] INFO: Found listing with ID: ED59297
2026-03-29 11:36:29 [auto1.be] INFO: Found listing with ID: SL51907
2026-03-29 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL51907%27 HTTP/1.1" 200 None
2026-03-29 11:36:29 [auto1.be] INFO: Scrape type for SL51907: 0
2026-03-29 11:36:29 [auto1.be] INFO: Found listing with ID: DU38710
2026-03-29 11:36:29 [auto1.be] INFO: Found listing with ID: JC93215
2026-03-29 11:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC93215%27 HTTP/1.1" 200 None
2026-03-29 11:36:30 [auto1.be] INFO: Scrape type for JC93215: 0
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: TD70367
2026-03-29 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD70367%27 HTTP/1.1" 200 None
2026-03-29 11:36:30 [auto1.be] INFO: Scrape type for TD70367: 0
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: YK80434
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: VZ63754
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: TU11660
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: JW78855
2026-03-29 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW78855%27 HTTP/1.1" 200 None
2026-03-29 11:36:30 [auto1.be] INFO: Scrape type for JW78855: 0
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: LP97900
2026-03-29 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP97900%27 HTTP/1.1" 200 None
2026-03-29 11:36:30 [auto1.be] INFO: Scrape type for LP97900: 0
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: LP07116
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: RX86056
2026-03-29 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX86056%27 HTTP/1.1" 200 None
2026-03-29 11:36:30 [auto1.be] INFO: Scrape type for RX86056: 0
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: AW74184
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: BK01349
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: BA37972
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: XL43279
2026-03-29 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL43279%27 HTTP/1.1" 200 None
2026-03-29 11:36:30 [auto1.be] INFO: Scrape type for XL43279: 0
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: SC85120
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: TW09601
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: TZ99758
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: RH32729
2026-03-29 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH32729%27 HTTP/1.1" 200 None
2026-03-29 11:36:30 [auto1.be] INFO: Scrape type for RH32729: 0
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: UU12218
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: LT47332
2026-03-29 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT47332%27 HTTP/1.1" 200 None
2026-03-29 11:36:30 [auto1.be] INFO: Scrape type for LT47332: 0
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: DY28234
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: WS04459
2026-03-29 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WS04459%27 HTTP/1.1" 200 None
2026-03-29 11:36:30 [auto1.be] INFO: Scrape type for WS04459: 0
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: KS43499
2026-03-29 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS43499%27 HTTP/1.1" 200 None
2026-03-29 11:36:30 [auto1.be] INFO: Scrape type for KS43499: 0
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: PB25162
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: UA44051
2026-03-29 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA44051%27 HTTP/1.1" 200 None
2026-03-29 11:36:30 [auto1.be] INFO: Scrape type for UA44051: 0
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: PY12122
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: BZ65544
2026-03-29 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ65544%27 HTTP/1.1" 200 None
2026-03-29 11:36:30 [auto1.be] INFO: Scrape type for BZ65544: 0
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: HZ19238
2026-03-29 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ19238%27 HTTP/1.1" 200 None
2026-03-29 11:36:30 [auto1.be] INFO: Scrape type for HZ19238: 0
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: KU11213
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: DC17534
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: AT20959
2026-03-29 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AT20959%27 HTTP/1.1" 200 None
2026-03-29 11:36:30 [auto1.be] INFO: Scrape type for AT20959: 0
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: JM34078
2026-03-29 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM34078%27 HTTP/1.1" 200 None
2026-03-29 11:36:30 [auto1.be] INFO: Scrape type for JM34078: 0
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: WP69561
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: YS56392
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: VB04696
2026-03-29 11:36:30 [auto1.be] INFO: Found listing with ID: RR89556
2026-03-29 11:36:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:36:31 [auto1.be] INFO: Channel: 24h | Page: 23 | totalHits: 1256 | hits on page: 40
2026-03-29 11:36:31 [auto1.be] INFO: Found listing with ID: XM10489
2026-03-29 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM10489%27 HTTP/1.1" 200 None
2026-03-29 11:36:31 [auto1.be] INFO: Scrape type for XM10489: 0
2026-03-29 11:36:31 [auto1.be] INFO: Found listing with ID: RS45224
2026-03-29 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS45224%27 HTTP/1.1" 200 None
2026-03-29 11:36:31 [auto1.be] INFO: Scrape type for RS45224: 0
2026-03-29 11:36:31 [auto1.be] INFO: Found listing with ID: UW48678
2026-03-29 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW48678%27 HTTP/1.1" 200 None
2026-03-29 11:36:31 [auto1.be] INFO: Scrape type for UW48678: 0
2026-03-29 11:36:31 [auto1.be] INFO: Found listing with ID: FH97290
2026-03-29 11:36:31 [auto1.be] INFO: Found listing with ID: SZ65946
2026-03-29 11:36:31 [auto1.be] INFO: Found listing with ID: XJ24324
2026-03-29 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ24324%27 HTTP/1.1" 200 None
2026-03-29 11:36:31 [auto1.be] INFO: Scrape type for XJ24324: 0
2026-03-29 11:36:31 [auto1.be] INFO: Found listing with ID: MV82025
2026-03-29 11:36:31 [auto1.be] INFO: Found listing with ID: MZ51776
2026-03-29 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ51776%27 HTTP/1.1" 200 None
2026-03-29 11:36:31 [auto1.be] INFO: Scrape type for MZ51776: 0
2026-03-29 11:36:31 [auto1.be] INFO: Found listing with ID: WH33984
2026-03-29 11:36:31 [auto1.be] INFO: Found listing with ID: HU58936
2026-03-29 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU58936%27 HTTP/1.1" 200 None
2026-03-29 11:36:31 [auto1.be] INFO: Scrape type for HU58936: 0
2026-03-29 11:36:31 [auto1.be] INFO: Found listing with ID: ET79377
2026-03-29 11:36:31 [auto1.be] INFO: Found listing with ID: UR44884
2026-03-29 11:36:31 [auto1.be] INFO: Found listing with ID: LC46636
2026-03-29 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LC46636%27 HTTP/1.1" 200 None
2026-03-29 11:36:31 [auto1.be] INFO: Scrape type for LC46636: 0
2026-03-29 11:36:31 [auto1.be] INFO: Found listing with ID: HM84114
2026-03-29 11:36:31 [auto1.be] INFO: Found listing with ID: FN16517
2026-03-29 11:36:31 [auto1.be] INFO: Found listing with ID: UF35860
2026-03-29 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF35860%27 HTTP/1.1" 200 None
2026-03-29 11:36:31 [auto1.be] INFO: Scrape type for UF35860: 0
2026-03-29 11:36:31 [auto1.be] INFO: Found listing with ID: SC73086
2026-03-29 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC73086%27 HTTP/1.1" 200 None
2026-03-29 11:36:31 [auto1.be] INFO: Scrape type for SC73086: 0
2026-03-29 11:36:31 [auto1.be] INFO: Found listing with ID: PR84870
2026-03-29 11:36:31 [auto1.be] INFO: Found listing with ID: NN69701
2026-03-29 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN69701%27 HTTP/1.1" 200 None
2026-03-29 11:36:31 [auto1.be] INFO: Scrape type for NN69701: 0
2026-03-29 11:36:31 [auto1.be] INFO: Found listing with ID: KG53590
2026-03-29 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG53590%27 HTTP/1.1" 200 None
2026-03-29 11:36:31 [auto1.be] INFO: Scrape type for KG53590: 0
2026-03-29 11:36:31 [auto1.be] INFO: Found listing with ID: ZX32272
2026-03-29 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX32272%27 HTTP/1.1" 200 None
2026-03-29 11:36:31 [auto1.be] INFO: Scrape type for ZX32272: 0
2026-03-29 11:36:31 [auto1.be] INFO: Found listing with ID: WK50026
2026-03-29 11:36:31 [auto1.be] INFO: Found listing with ID: MK20825
2026-03-29 11:36:31 [auto1.be] INFO: Found listing with ID: YS48127
2026-03-29 11:36:31 [auto1.be] INFO: Found listing with ID: RF74485
2026-03-29 11:36:31 [auto1.be] INFO: Found listing with ID: NC57966
2026-03-29 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC57966%27 HTTP/1.1" 200 None
2026-03-29 11:36:31 [auto1.be] INFO: Scrape type for NC57966: 0
2026-03-29 11:36:31 [auto1.be] INFO: Found listing with ID: FU04844
2026-03-29 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FU04844%27 HTTP/1.1" 200 None
2026-03-29 11:36:32 [auto1.be] INFO: Scrape type for FU04844: 0
2026-03-29 11:36:32 [auto1.be] INFO: Found listing with ID: FC28385
2026-03-29 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC28385%27 HTTP/1.1" 200 None
2026-03-29 11:36:32 [auto1.be] INFO: Scrape type for FC28385: 0
2026-03-29 11:36:32 [auto1.be] INFO: Found listing with ID: MU18005
2026-03-29 11:36:32 [auto1.be] INFO: Found listing with ID: UM95648
2026-03-29 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM95648%27 HTTP/1.1" 200 None
2026-03-29 11:36:32 [auto1.be] INFO: Scrape type for UM95648: 0
2026-03-29 11:36:32 [auto1.be] INFO: Found listing with ID: VA32651
2026-03-29 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA32651%27 HTTP/1.1" 200 None
2026-03-29 11:36:32 [auto1.be] INFO: Scrape type for VA32651: 0
2026-03-29 11:36:32 [auto1.be] INFO: Found listing with ID: KV94769
2026-03-29 11:36:32 [auto1.be] INFO: Found listing with ID: LG02466
2026-03-29 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG02466%27 HTTP/1.1" 200 None
2026-03-29 11:36:32 [auto1.be] INFO: Scrape type for LG02466: 0
2026-03-29 11:36:32 [auto1.be] INFO: Found listing with ID: ZC67013
2026-03-29 11:36:32 [auto1.be] INFO: Found listing with ID: MZ96160
2026-03-29 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ96160%27 HTTP/1.1" 200 None
2026-03-29 11:36:32 [auto1.be] INFO: Scrape type for MZ96160: 0
2026-03-29 11:36:32 [auto1.be] INFO: Found listing with ID: DD08232
2026-03-29 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD08232%27 HTTP/1.1" 200 None
2026-03-29 11:36:32 [auto1.be] INFO: Scrape type for DD08232: 0
2026-03-29 11:36:32 [auto1.be] INFO: Found listing with ID: ZK51287
2026-03-29 11:36:32 [auto1.be] INFO: Found listing with ID: JX00156
2026-03-29 11:36:32 [auto1.be] INFO: Found listing with ID: UN77217
2026-03-29 11:36:32 [auto1.be] INFO: Found listing with ID: VA33507
2026-03-29 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA33507%27 HTTP/1.1" 200 None
2026-03-29 11:36:32 [auto1.be] INFO: Scrape type for VA33507: 0
2026-03-29 11:36:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:36:33 [auto1.be] INFO: Channel: 24h | Page: 24 | totalHits: 1256 | hits on page: 40
2026-03-29 11:36:33 [auto1.be] INFO: Found listing with ID: FM00077
2026-03-29 11:36:33 [auto1.be] INFO: Found listing with ID: NS73936
2026-03-29 11:36:33 [auto1.be] INFO: Found listing with ID: LY58233
2026-03-29 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY58233%27 HTTP/1.1" 200 None
2026-03-29 11:36:33 [auto1.be] INFO: Scrape type for LY58233: 0
2026-03-29 11:36:33 [auto1.be] INFO: Found listing with ID: XH30316
2026-03-29 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH30316%27 HTTP/1.1" 200 None
2026-03-29 11:36:33 [auto1.be] INFO: Scrape type for XH30316: 0
2026-03-29 11:36:33 [auto1.be] INFO: Found listing with ID: RK82839
2026-03-29 11:36:33 [auto1.be] INFO: Found listing with ID: LE69229
2026-03-29 11:36:33 [auto1.be] INFO: Found listing with ID: CN29269
2026-03-29 11:36:33 [auto1.be] INFO: Found listing with ID: HE95946
2026-03-29 11:36:33 [auto1.be] INFO: Found listing with ID: ZN76480
2026-03-29 11:36:33 [auto1.be] INFO: Found listing with ID: BY25509
2026-03-29 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY25509%27 HTTP/1.1" 200 None
2026-03-29 11:36:33 [auto1.be] INFO: Scrape type for BY25509: 0
2026-03-29 11:36:33 [auto1.be] INFO: Found listing with ID: TR87241
2026-03-29 11:36:33 [auto1.be] INFO: Found listing with ID: PU90284
2026-03-29 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU90284%27 HTTP/1.1" 200 None
2026-03-29 11:36:33 [auto1.be] INFO: Scrape type for PU90284: 0
2026-03-29 11:36:33 [auto1.be] INFO: Found listing with ID: VC92856
2026-03-29 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VC92856%27 HTTP/1.1" 200 None
2026-03-29 11:36:33 [auto1.be] INFO: Scrape type for VC92856: 0
2026-03-29 11:36:33 [auto1.be] INFO: Found listing with ID: DJ08738
2026-03-29 11:36:33 [auto1.be] INFO: Found listing with ID: FN69818
2026-03-29 11:36:33 [auto1.be] INFO: Found listing with ID: XB17770
2026-03-29 11:36:33 [auto1.be] INFO: Found listing with ID: SN22557
2026-03-29 11:36:33 [auto1.be] INFO: Found listing with ID: MV28568
2026-03-29 11:36:33 [auto1.be] INFO: Found listing with ID: FW88759
2026-03-29 11:36:33 [auto1.be] INFO: Found listing with ID: FZ81347
2026-03-29 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FZ81347%27 HTTP/1.1" 200 None
2026-03-29 11:36:33 [auto1.be] INFO: Scrape type for FZ81347: 0
2026-03-29 11:36:33 [auto1.be] INFO: Found listing with ID: CX83686
2026-03-29 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX83686%27 HTTP/1.1" 200 None
2026-03-29 11:36:33 [auto1.be] INFO: Scrape type for CX83686: 2
2026-03-29 11:36:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bb3ceb2-6234-5922-a477-19e3436c2264 with identifier: CX83686
2026-03-29 11:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bb3ceb2-6234-5922-a477-19e3436c2264 with scrape type 2
2026-03-29 11:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bb3ceb2-6234-5922-a477-19e3436c2264 with scrape type 2
2026-03-29 11:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1bb3ceb2-6234-5922-a477-19e3436c2264, identifier: CX83686
2026-03-29 11:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1bb3ceb2-6234-5922-a477-19e3436c2264 with identifier: CX83686
2026-03-29 11:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 11:36:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-29 11:36:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 11:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1bb3ceb2-6234-5922-a477-19e3436c2264 with identifier: CX83686
2026-03-29 11:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1bb3ceb2-6234-5922-a477-19e3436c2264 with identifier: CX83686 to the API
2026-03-29 11:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:38:59Z',
 'fuel_type': 'hybrid',
 'id': '1bb3ceb2-6234-5922-a477-19e3436c2264',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX83686',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 75365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-14',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-29 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX83686%27 HTTP/1.1" 200 None
2026-03-29 11:36:34 [auto1.be] INFO: Saving data for CX83686: {'auction_closing_time': 1774885139.0, 'created_time': 1773866727.396592, 'last_price_update_time': 1774784194.556369}
2026-03-29 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CX83686') HTTP/1.1" 204 0
2026-03-29 11:36:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:36:34 [auto1.be] INFO: Found listing with ID: FR50529
2026-03-29 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR50529%27 HTTP/1.1" 200 None
2026-03-29 11:36:34 [auto1.be] INFO: Scrape type for FR50529: 0
2026-03-29 11:36:34 [auto1.be] INFO: Found listing with ID: PS82481
2026-03-29 11:36:34 [auto1.be] INFO: Found listing with ID: UU07035
2026-03-29 11:36:34 [auto1.be] INFO: Found listing with ID: WL68728
2026-03-29 11:36:34 [auto1.be] INFO: Found listing with ID: MR51068
2026-03-29 11:36:34 [auto1.be] INFO: Found listing with ID: PY41942
2026-03-29 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY41942%27 HTTP/1.1" 200 None
2026-03-29 11:36:34 [auto1.be] INFO: Scrape type for PY41942: 0
2026-03-29 11:36:34 [auto1.be] INFO: Found listing with ID: TP16646
2026-03-29 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP16646%27 HTTP/1.1" 200 None
2026-03-29 11:36:34 [auto1.be] INFO: Scrape type for TP16646: 0
2026-03-29 11:36:34 [auto1.be] INFO: Found listing with ID: AZ39903
2026-03-29 11:36:34 [auto1.be] INFO: Found listing with ID: HB98543
2026-03-29 11:36:34 [auto1.be] INFO: Found listing with ID: RU48742
2026-03-29 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU48742%27 HTTP/1.1" 200 None
2026-03-29 11:36:34 [auto1.be] INFO: Scrape type for RU48742: 0
2026-03-29 11:36:34 [auto1.be] INFO: Found listing with ID: DK63787
2026-03-29 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK63787%27 HTTP/1.1" 200 None
2026-03-29 11:36:34 [auto1.be] INFO: Scrape type for DK63787: 0
2026-03-29 11:36:34 [auto1.be] INFO: Found listing with ID: KG87325
2026-03-29 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG87325%27 HTTP/1.1" 200 None
2026-03-29 11:36:34 [auto1.be] INFO: Scrape type for KG87325: 0
2026-03-29 11:36:34 [auto1.be] INFO: Found listing with ID: HU17820
2026-03-29 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU17820%27 HTTP/1.1" 200 None
2026-03-29 11:36:34 [auto1.be] INFO: Scrape type for HU17820: 0
2026-03-29 11:36:34 [auto1.be] INFO: Found listing with ID: NL83155
2026-03-29 11:36:34 [auto1.be] INFO: Found listing with ID: NV75936
2026-03-29 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV75936%27 HTTP/1.1" 200 None
2026-03-29 11:36:34 [auto1.be] INFO: Scrape type for NV75936: 0
2026-03-29 11:36:34 [auto1.be] INFO: Found listing with ID: AW25378
2026-03-29 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AW25378%27 HTTP/1.1" 200 None
2026-03-29 11:36:34 [auto1.be] INFO: Scrape type for AW25378: 0
2026-03-29 11:36:34 [auto1.be] INFO: Found listing with ID: PF94112
2026-03-29 11:36:34 [auto1.be] INFO: Found listing with ID: XT95399
2026-03-29 11:36:34 [auto1.be] INFO: Found listing with ID: NT98676
2026-03-29 11:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:36:35 [auto1.be] INFO: Channel: 24h | Page: 25 | totalHits: 1256 | hits on page: 40
2026-03-29 11:36:35 [auto1.be] INFO: Found listing with ID: ZA12378
2026-03-29 11:36:35 [auto1.be] INFO: Found listing with ID: LS82290
2026-03-29 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LS82290%27 HTTP/1.1" 200 None
2026-03-29 11:36:35 [auto1.be] INFO: Scrape type for LS82290: 0
2026-03-29 11:36:35 [auto1.be] INFO: Found listing with ID: FJ54867
2026-03-29 11:36:35 [auto1.be] INFO: Found listing with ID: CM51817
2026-03-29 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM51817%27 HTTP/1.1" 200 None
2026-03-29 11:36:35 [auto1.be] INFO: Scrape type for CM51817: 0
2026-03-29 11:36:35 [auto1.be] INFO: Found listing with ID: FA04427
2026-03-29 11:36:35 [auto1.be] INFO: Found listing with ID: KD88013
2026-03-29 11:36:35 [auto1.be] INFO: Found listing with ID: YY44687
2026-03-29 11:36:35 [auto1.be] INFO: Found listing with ID: BX66623
2026-03-29 11:36:35 [auto1.be] INFO: Found listing with ID: NJ37001
2026-03-29 11:36:35 [auto1.be] INFO: Found listing with ID: DM24490
2026-03-29 11:36:35 [auto1.be] INFO: Found listing with ID: PM87207
2026-03-29 11:36:35 [auto1.be] INFO: Found listing with ID: RD23593
2026-03-29 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD23593%27 HTTP/1.1" 200 None
2026-03-29 11:36:35 [auto1.be] INFO: Scrape type for RD23593: 0
2026-03-29 11:36:35 [auto1.be] INFO: Found listing with ID: XW30503
2026-03-29 11:36:35 [auto1.be] INFO: Found listing with ID: GD95033
2026-03-29 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GD95033%27 HTTP/1.1" 200 None
2026-03-29 11:36:35 [auto1.be] INFO: Scrape type for GD95033: 0
2026-03-29 11:36:35 [auto1.be] INFO: Found listing with ID: UE36464
2026-03-29 11:36:35 [auto1.be] INFO: Found listing with ID: ER02883
2026-03-29 11:36:35 [auto1.be] INFO: Found listing with ID: LG99308
2026-03-29 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG99308%27 HTTP/1.1" 200 None
2026-03-29 11:36:35 [auto1.be] INFO: Scrape type for LG99308: 0
2026-03-29 11:36:35 [auto1.be] INFO: Found listing with ID: KW17867
2026-03-29 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW17867%27 HTTP/1.1" 200 None
2026-03-29 11:36:35 [auto1.be] INFO: Scrape type for KW17867: 0
2026-03-29 11:36:35 [auto1.be] INFO: Found listing with ID: HT18059
2026-03-29 11:36:35 [auto1.be] INFO: Found listing with ID: PE64709
2026-03-29 11:36:35 [auto1.be] INFO: Found listing with ID: HS15781
2026-03-29 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS15781%27 HTTP/1.1" 200 None
2026-03-29 11:36:35 [auto1.be] INFO: Scrape type for HS15781: 0
2026-03-29 11:36:35 [auto1.be] INFO: Found listing with ID: HT80629
2026-03-29 11:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT80629%27 HTTP/1.1" 200 None
2026-03-29 11:36:36 [auto1.be] INFO: Scrape type for HT80629: 0
2026-03-29 11:36:36 [auto1.be] INFO: Found listing with ID: FT23017
2026-03-29 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT23017%27 HTTP/1.1" 200 None
2026-03-29 11:36:36 [auto1.be] INFO: Scrape type for FT23017: 0
2026-03-29 11:36:36 [auto1.be] INFO: Found listing with ID: ZM05640
2026-03-29 11:36:36 [auto1.be] INFO: Found listing with ID: KT01454
2026-03-29 11:36:36 [auto1.be] INFO: Found listing with ID: AC59433
2026-03-29 11:36:36 [auto1.be] INFO: Found listing with ID: MY75694
2026-03-29 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MY75694%27 HTTP/1.1" 200 None
2026-03-29 11:36:36 [auto1.be] INFO: Scrape type for MY75694: 0
2026-03-29 11:36:36 [auto1.be] INFO: Found listing with ID: LH19076
2026-03-29 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH19076%27 HTTP/1.1" 200 None
2026-03-29 11:36:36 [auto1.be] INFO: Scrape type for LH19076: 0
2026-03-29 11:36:36 [auto1.be] INFO: Found listing with ID: GM68229
2026-03-29 11:36:36 [auto1.be] INFO: Found listing with ID: LK30146
2026-03-29 11:36:36 [auto1.be] INFO: Found listing with ID: FT86060
2026-03-29 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT86060%27 HTTP/1.1" 200 None
2026-03-29 11:36:36 [auto1.be] INFO: Scrape type for FT86060: 0
2026-03-29 11:36:36 [auto1.be] INFO: Found listing with ID: TF49476
2026-03-29 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF49476%27 HTTP/1.1" 200 None
2026-03-29 11:36:36 [auto1.be] INFO: Scrape type for TF49476: 0
2026-03-29 11:36:36 [auto1.be] INFO: Found listing with ID: JT63704
2026-03-29 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT63704%27 HTTP/1.1" 200 None
2026-03-29 11:36:36 [auto1.be] INFO: Scrape type for JT63704: 0
2026-03-29 11:36:36 [auto1.be] INFO: Found listing with ID: UA37218
2026-03-29 11:36:36 [auto1.be] INFO: Found listing with ID: SX16585
2026-03-29 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX16585%27 HTTP/1.1" 200 None
2026-03-29 11:36:36 [auto1.be] INFO: Scrape type for SX16585: 0
2026-03-29 11:36:36 [auto1.be] INFO: Found listing with ID: TF43790
2026-03-29 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF43790%27 HTTP/1.1" 200 None
2026-03-29 11:36:36 [auto1.be] INFO: Scrape type for TF43790: 0
2026-03-29 11:36:36 [auto1.be] INFO: Found listing with ID: NZ75648
2026-03-29 11:36:36 [auto1.be] INFO: Found listing with ID: ER91021
2026-03-29 11:36:36 [auto1.be] INFO: Found listing with ID: LF44164
2026-03-29 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF44164%27 HTTP/1.1" 200 None
2026-03-29 11:36:36 [auto1.be] INFO: Scrape type for LF44164: 0
2026-03-29 11:36:36 [auto1.be] INFO: Found listing with ID: SV00163
2026-03-29 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV00163%27 HTTP/1.1" 200 None
2026-03-29 11:36:36 [auto1.be] INFO: Scrape type for SV00163: 0
2026-03-29 11:36:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:36:43 [auto1.be] INFO: Channel: 24h | Page: 26 | totalHits: 1256 | hits on page: 40
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: EM88075
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: VM07385
2026-03-29 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM07385%27 HTTP/1.1" 200 None
2026-03-29 11:36:43 [auto1.be] INFO: Scrape type for VM07385: 0
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: WC19794
2026-03-29 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC19794%27 HTTP/1.1" 200 None
2026-03-29 11:36:43 [auto1.be] INFO: Scrape type for WC19794: 0
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: UV16393
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: AY92488
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: SB51494
2026-03-29 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB51494%27 HTTP/1.1" 200 None
2026-03-29 11:36:43 [auto1.be] INFO: Scrape type for SB51494: 0
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: KM81672
2026-03-29 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM81672%27 HTTP/1.1" 200 None
2026-03-29 11:36:43 [auto1.be] INFO: Scrape type for KM81672: 0
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: JC37428
2026-03-29 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC37428%27 HTTP/1.1" 200 None
2026-03-29 11:36:43 [auto1.be] INFO: Scrape type for JC37428: 0
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: RL22884
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: WH35268
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: DZ29736
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: BT48733
2026-03-29 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT48733%27 HTTP/1.1" 200 None
2026-03-29 11:36:43 [auto1.be] INFO: Scrape type for BT48733: 0
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: JM52918
2026-03-29 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM52918%27 HTTP/1.1" 200 None
2026-03-29 11:36:43 [auto1.be] INFO: Scrape type for JM52918: 0
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: PJ47204
2026-03-29 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ47204%27 HTTP/1.1" 200 None
2026-03-29 11:36:43 [auto1.be] INFO: Scrape type for PJ47204: 0
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: WV93881
2026-03-29 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV93881%27 HTTP/1.1" 200 None
2026-03-29 11:36:43 [auto1.be] INFO: Scrape type for WV93881: 0
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: ZN30582
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: DW89604
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: WV93759
2026-03-29 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV93759%27 HTTP/1.1" 200 None
2026-03-29 11:36:43 [auto1.be] INFO: Scrape type for WV93759: 0
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: JB30712
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: XK23104
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: SG83875
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: UM29446
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: XS20349
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: TA24587
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: MM51411
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: EM05161
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: HZ76034
2026-03-29 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ76034%27 HTTP/1.1" 200 None
2026-03-29 11:36:43 [auto1.be] INFO: Scrape type for HZ76034: 0
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: US61524
2026-03-29 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27US61524%27 HTTP/1.1" 200 None
2026-03-29 11:36:43 [auto1.be] INFO: Scrape type for US61524: 0
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: DP44577
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: KU92863
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: XU79591
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: LM11563
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: VZ26705
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: GW19918
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: UY14877
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: WJ93890
2026-03-29 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ93890%27 HTTP/1.1" 200 None
2026-03-29 11:36:43 [auto1.be] INFO: Scrape type for WJ93890: 0
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: DN00999
2026-03-29 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DN00999%27 HTTP/1.1" 200 None
2026-03-29 11:36:43 [auto1.be] INFO: Scrape type for DN00999: 0
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: GN49517
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: BE30988
2026-03-29 11:36:43 [auto1.be] INFO: Found listing with ID: ZW40078
2026-03-29 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZW40078%27 HTTP/1.1" 200 None
2026-03-29 11:36:43 [auto1.be] INFO: Scrape type for ZW40078: 0
2026-03-29 11:36:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:36:44 [auto1.be] INFO: Channel: 24h | Page: 27 | totalHits: 1256 | hits on page: 40
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: YW96446
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW96446%27 HTTP/1.1" 200 None
2026-03-29 11:36:44 [auto1.be] INFO: Scrape type for YW96446: 0
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: LA99224
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: UE64828
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE64828%27 HTTP/1.1" 200 None
2026-03-29 11:36:44 [auto1.be] INFO: Scrape type for UE64828: 0
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: GJ36560
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: KF94293
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF94293%27 HTTP/1.1" 200 None
2026-03-29 11:36:44 [auto1.be] INFO: Scrape type for KF94293: 0
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: ER36240
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: SD86163
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: LM13926
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM13926%27 HTTP/1.1" 200 None
2026-03-29 11:36:44 [auto1.be] INFO: Scrape type for LM13926: 0
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: AE63964
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE63964%27 HTTP/1.1" 200 None
2026-03-29 11:36:44 [auto1.be] INFO: Scrape type for AE63964: 0
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: SL57288
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL57288%27 HTTP/1.1" 200 None
2026-03-29 11:36:44 [auto1.be] INFO: Scrape type for SL57288: 0
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: BT92464
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: RK43455
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK43455%27 HTTP/1.1" 200 None
2026-03-29 11:36:44 [auto1.be] INFO: Scrape type for RK43455: 0
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: KG93945
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: FB93927
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FB93927%27 HTTP/1.1" 200 None
2026-03-29 11:36:44 [auto1.be] INFO: Scrape type for FB93927: 0
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: SV46049
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV46049%27 HTTP/1.1" 200 None
2026-03-29 11:36:44 [auto1.be] INFO: Scrape type for SV46049: 0
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: WV65314
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV65314%27 HTTP/1.1" 200 None
2026-03-29 11:36:44 [auto1.be] INFO: Scrape type for WV65314: 0
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: FM81572
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM81572%27 HTTP/1.1" 200 None
2026-03-29 11:36:44 [auto1.be] INFO: Scrape type for FM81572: 0
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: HJ19751
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: MW50956
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW50956%27 HTTP/1.1" 200 None
2026-03-29 11:36:44 [auto1.be] INFO: Scrape type for MW50956: 0
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: JJ70860
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: DN28044
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DN28044%27 HTTP/1.1" 200 None
2026-03-29 11:36:44 [auto1.be] INFO: Scrape type for DN28044: 0
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: WG38275
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG38275%27 HTTP/1.1" 200 None
2026-03-29 11:36:44 [auto1.be] INFO: Scrape type for WG38275: 0
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: NC08569
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC08569%27 HTTP/1.1" 200 None
2026-03-29 11:36:44 [auto1.be] INFO: Scrape type for NC08569: 0
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: JR09444
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: CF30779
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF30779%27 HTTP/1.1" 200 None
2026-03-29 11:36:44 [auto1.be] INFO: Scrape type for CF30779: 0
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: WT53046
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT53046%27 HTTP/1.1" 200 None
2026-03-29 11:36:44 [auto1.be] INFO: Scrape type for WT53046: 0
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: DR48094
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DR48094%27 HTTP/1.1" 200 None
2026-03-29 11:36:44 [auto1.be] INFO: Scrape type for DR48094: 0
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: JZ34939
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ34939%27 HTTP/1.1" 200 None
2026-03-29 11:36:44 [auto1.be] INFO: Scrape type for JZ34939: 0
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: TX04561
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX04561%27 HTTP/1.1" 200 None
2026-03-29 11:36:44 [auto1.be] INFO: Scrape type for TX04561: 0
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: ET82729
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: BC33060
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC33060%27 HTTP/1.1" 200 None
2026-03-29 11:36:44 [auto1.be] INFO: Scrape type for BC33060: 0
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: HL00392
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: EP00364
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP00364%27 HTTP/1.1" 200 None
2026-03-29 11:36:44 [auto1.be] INFO: Scrape type for EP00364: 0
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: AU29077
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: FL05782
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: HB59214
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB59214%27 HTTP/1.1" 200 None
2026-03-29 11:36:44 [auto1.be] INFO: Scrape type for HB59214: 0
2026-03-29 11:36:44 [auto1.be] INFO: Found listing with ID: SX95001
2026-03-29 11:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX95001%27 HTTP/1.1" 200 None
2026-03-29 11:36:45 [auto1.be] INFO: Scrape type for SX95001: 0
2026-03-29 11:36:45 [auto1.be] INFO: Found listing with ID: UY27001
2026-03-29 11:36:45 [auto1.be] INFO: Found listing with ID: UR33188
2026-03-29 11:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR33188%27 HTTP/1.1" 200 None
2026-03-29 11:36:45 [auto1.be] INFO: Scrape type for UR33188: 0
2026-03-29 11:36:45 [auto1.be] INFO: Found listing with ID: CM21252
2026-03-29 11:36:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:36:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:36:56 [auto1.be] INFO: Channel: 24h | Page: 28 | totalHits: 1256 | hits on page: 40
2026-03-29 11:36:56 [auto1.be] INFO: Found listing with ID: SU85893
2026-03-29 11:36:56 [auto1.be] INFO: Found listing with ID: DT20121
2026-03-29 11:36:56 [auto1.be] INFO: Found listing with ID: VM76060
2026-03-29 11:36:56 [auto1.be] INFO: Found listing with ID: FJ57746
2026-03-29 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ57746%27 HTTP/1.1" 200 None
2026-03-29 11:36:56 [auto1.be] INFO: Scrape type for FJ57746: 0
2026-03-29 11:36:56 [auto1.be] INFO: Found listing with ID: KZ05274
2026-03-29 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ05274%27 HTTP/1.1" 200 None
2026-03-29 11:36:56 [auto1.be] INFO: Scrape type for KZ05274: 0
2026-03-29 11:36:56 [auto1.be] INFO: Found listing with ID: TJ00131
2026-03-29 11:36:56 [auto1.be] INFO: Found listing with ID: VY36246
2026-03-29 11:36:56 [auto1.be] INFO: Found listing with ID: MJ04907
2026-03-29 11:36:56 [auto1.be] INFO: Found listing with ID: YG03175
2026-03-29 11:36:56 [auto1.be] INFO: Found listing with ID: HK87235
2026-03-29 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK87235%27 HTTP/1.1" 200 None
2026-03-29 11:36:56 [auto1.be] INFO: Scrape type for HK87235: 0
2026-03-29 11:36:56 [auto1.be] INFO: Found listing with ID: UG65181
2026-03-29 11:36:56 [auto1.be] INFO: Found listing with ID: KT35610
2026-03-29 11:36:56 [auto1.be] INFO: Found listing with ID: CD22470
2026-03-29 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD22470%27 HTTP/1.1" 200 None
2026-03-29 11:36:56 [auto1.be] INFO: Scrape type for CD22470: 0
2026-03-29 11:36:56 [auto1.be] INFO: Found listing with ID: SJ05954
2026-03-29 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ05954%27 HTTP/1.1" 200 None
2026-03-29 11:36:56 [auto1.be] INFO: Scrape type for SJ05954: 0
2026-03-29 11:36:56 [auto1.be] INFO: Found listing with ID: GH80996
2026-03-29 11:36:56 [auto1.be] INFO: Found listing with ID: ZY24236
2026-03-29 11:36:56 [auto1.be] INFO: Found listing with ID: FV90992
2026-03-29 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV90992%27 HTTP/1.1" 200 None
2026-03-29 11:36:56 [auto1.be] INFO: Scrape type for FV90992: 0
2026-03-29 11:36:56 [auto1.be] INFO: Found listing with ID: PG48700
2026-03-29 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PG48700%27 HTTP/1.1" 200 None
2026-03-29 11:36:56 [auto1.be] INFO: Scrape type for PG48700: 0
2026-03-29 11:36:56 [auto1.be] INFO: Found listing with ID: ZZ74713
2026-03-29 11:36:56 [auto1.be] INFO: Found listing with ID: XD67660
2026-03-29 11:36:56 [auto1.be] INFO: Found listing with ID: DT55223
2026-03-29 11:36:56 [auto1.be] INFO: Found listing with ID: EL95031
2026-03-29 11:36:56 [auto1.be] INFO: Found listing with ID: DC62563
2026-03-29 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC62563%27 HTTP/1.1" 200 None
2026-03-29 11:36:56 [auto1.be] INFO: Scrape type for DC62563: 0
2026-03-29 11:36:56 [auto1.be] INFO: Found listing with ID: UX01518
2026-03-29 11:36:56 [auto1.be] INFO: Found listing with ID: ZP95092
2026-03-29 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP95092%27 HTTP/1.1" 200 None
2026-03-29 11:36:56 [auto1.be] INFO: Scrape type for ZP95092: 2
2026-03-29 11:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29a35d51-4951-5c9f-8818-3370273c76ff with identifier: ZP95092
2026-03-29 11:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29a35d51-4951-5c9f-8818-3370273c76ff with scrape type 2
2026-03-29 11:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29a35d51-4951-5c9f-8818-3370273c76ff with scrape type 2
2026-03-29 11:36:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 29a35d51-4951-5c9f-8818-3370273c76ff, identifier: ZP95092
2026-03-29 11:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 29a35d51-4951-5c9f-8818-3370273c76ff with identifier: ZP95092
2026-03-29 11:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 29a35d51-4951-5c9f-8818-3370273c76ff with identifier: ZP95092
2026-03-29 11:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 29a35d51-4951-5c9f-8818-3370273c76ff with identifier: ZP95092 to the API
2026-03-29 11:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:36:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:16:36Z',
 'fuel_type': 'diesel',
 'id': '29a35d51-4951-5c9f-8818-3370273c76ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP95092',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 155775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-20',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2006}
2026-03-29 11:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP95092%27 HTTP/1.1" 200 None
2026-03-29 11:36:57 [auto1.be] INFO: Saving data for ZP95092: {'auction_closing_time': 1774883796.0, 'created_time': 1774697793.64774, 'last_price_update_time': 1774784217.873188}
2026-03-29 11:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZP95092') HTTP/1.1" 204 0
2026-03-29 11:36:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:36:57 [auto1.be] INFO: Found listing with ID: ZR35447
2026-03-29 11:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR35447%27 HTTP/1.1" 200 None
2026-03-29 11:36:58 [auto1.be] INFO: Scrape type for ZR35447: 2
2026-03-29 11:36:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6db941a1-8645-5c6f-bbf7-fe200134479b with identifier: ZR35447
2026-03-29 11:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6db941a1-8645-5c6f-bbf7-fe200134479b with scrape type 2
2026-03-29 11:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6db941a1-8645-5c6f-bbf7-fe200134479b with scrape type 2
2026-03-29 11:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6db941a1-8645-5c6f-bbf7-fe200134479b, identifier: ZR35447
2026-03-29 11:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6db941a1-8645-5c6f-bbf7-fe200134479b with identifier: ZR35447
2026-03-29 11:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6db941a1-8645-5c6f-bbf7-fe200134479b with identifier: ZR35447
2026-03-29 11:36:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6db941a1-8645-5c6f-bbf7-fe200134479b with identifier: ZR35447 to the API
2026-03-29 11:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:10:19Z',
 'fuel_type': 'petrol',
 'id': '6db941a1-8645-5c6f-bbf7-fe200134479b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR35447',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 75287,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-20',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-03-29 11:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR35447%27 HTTP/1.1" 200 None
2026-03-29 11:36:59 [auto1.be] INFO: Saving data for ZR35447: {'auction_closing_time': 1774883419.0, 'created_time': 1774697762.611259, 'last_price_update_time': 1774784219.353427}
2026-03-29 11:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZR35447') HTTP/1.1" 204 0
2026-03-29 11:36:59 [auto1.be] INFO: Found listing with ID: EK14732
2026-03-29 11:36:59 [auto1.be] INFO: Found listing with ID: CA54828
2026-03-29 11:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA54828%27 HTTP/1.1" 200 None
2026-03-29 11:36:59 [auto1.be] INFO: Scrape type for CA54828: 2
2026-03-29 11:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9659d86c-725d-5eda-90c3-5d685b1b8f6f with identifier: CA54828
2026-03-29 11:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9659d86c-725d-5eda-90c3-5d685b1b8f6f with scrape type 2
2026-03-29 11:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9659d86c-725d-5eda-90c3-5d685b1b8f6f with scrape type 2
2026-03-29 11:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9659d86c-725d-5eda-90c3-5d685b1b8f6f, identifier: CA54828
2026-03-29 11:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9659d86c-725d-5eda-90c3-5d685b1b8f6f with identifier: CA54828
2026-03-29 11:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9659d86c-725d-5eda-90c3-5d685b1b8f6f with identifier: CA54828
2026-03-29 11:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9659d86c-725d-5eda-90c3-5d685b1b8f6f with identifier: CA54828 to the API
2026-03-29 11:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:24:26Z',
 'fuel_type': 'petrol',
 'id': '9659d86c-725d-5eda-90c3-5d685b1b8f6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA54828',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 78578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-06',
 'seller_name': None,
 'title': 'MINI Clubman Cooper',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-29 11:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA54828%27 HTTP/1.1" 200 None
2026-03-29 11:36:59 [auto1.be] INFO: Saving data for CA54828: {'auction_closing_time': 1774884266.0, 'created_time': 1774697722.446956, 'last_price_update_time': 1774784219.746207}
2026-03-29 11:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CA54828') HTTP/1.1" 204 0
2026-03-29 11:36:59 [auto1.be] INFO: Found listing with ID: UR02836
2026-03-29 11:36:59 [auto1.be] INFO: Found listing with ID: XK01311
2026-03-29 11:36:59 [auto1.be] INFO: Found listing with ID: FW70524
2026-03-29 11:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW70524%27 HTTP/1.1" 200 None
2026-03-29 11:36:59 [auto1.be] INFO: Scrape type for FW70524: 2
2026-03-29 11:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e352c4e-7a8e-506f-8bfb-ccdde942a5e9 with identifier: FW70524
2026-03-29 11:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e352c4e-7a8e-506f-8bfb-ccdde942a5e9 with scrape type 2
2026-03-29 11:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e352c4e-7a8e-506f-8bfb-ccdde942a5e9 with scrape type 2
2026-03-29 11:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2e352c4e-7a8e-506f-8bfb-ccdde942a5e9, identifier: FW70524
2026-03-29 11:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2e352c4e-7a8e-506f-8bfb-ccdde942a5e9 with identifier: FW70524
2026-03-29 11:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2e352c4e-7a8e-506f-8bfb-ccdde942a5e9 with identifier: FW70524
2026-03-29 11:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2e352c4e-7a8e-506f-8bfb-ccdde942a5e9 with identifier: FW70524 to the API
2026-03-29 11:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:47:34Z',
 'fuel_type': 'diesel',
 'id': '2e352c4e-7a8e-506f-8bfb-ccdde942a5e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW70524',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 282602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-22',
 'seller_name': None,
 'title': 'BMW X1 xDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-29 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW70524%27 HTTP/1.1" 200 None
2026-03-29 11:37:00 [auto1.be] INFO: Saving data for FW70524: {'auction_closing_time': 1774885654.0, 'created_time': 1774697754.743089, 'last_price_update_time': 1774784220.163699}
2026-03-29 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FW70524') HTTP/1.1" 204 0
2026-03-29 11:37:00 [auto1.be] INFO: Found listing with ID: ED41371
2026-03-29 11:37:00 [auto1.be] INFO: Found listing with ID: VX51166
2026-03-29 11:37:00 [auto1.be] INFO: Found listing with ID: BD29807
2026-03-29 11:37:00 [auto1.be] INFO: Found listing with ID: NZ74768
2026-03-29 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ74768%27 HTTP/1.1" 200 None
2026-03-29 11:37:00 [auto1.be] INFO: Scrape type for NZ74768: 2
2026-03-29 11:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f82a8942-6e07-5172-a324-f6c919315007 with identifier: NZ74768
2026-03-29 11:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f82a8942-6e07-5172-a324-f6c919315007 with scrape type 2
2026-03-29 11:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f82a8942-6e07-5172-a324-f6c919315007 with scrape type 2
2026-03-29 11:37:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f82a8942-6e07-5172-a324-f6c919315007, identifier: NZ74768
2026-03-29 11:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f82a8942-6e07-5172-a324-f6c919315007 with identifier: NZ74768
2026-03-29 11:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f82a8942-6e07-5172-a324-f6c919315007 with identifier: NZ74768
2026-03-29 11:37:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f82a8942-6e07-5172-a324-f6c919315007 with identifier: NZ74768 to the API
2026-03-29 11:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:22:48Z',
 'fuel_type': 'diesel',
 'id': 'f82a8942-6e07-5172-a324-f6c919315007',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ74768',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Navara NP-300',
 'odometer': 63531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-11',
 'seller_name': None,
 'title': 'Nissan Navara NP-300 2.3 dCi N-Guard Double Cab 4x4',
 'transmission': 'automatic',
 'trim': 'N-Guard Double Cab 4x4',
 'year': 2021}
2026-03-29 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ74768%27 HTTP/1.1" 200 None
2026-03-29 11:37:00 [auto1.be] INFO: Saving data for NZ74768: {'auction_closing_time': 1774884168.0, 'created_time': 1774697723.542976, 'last_price_update_time': 1774784220.566018}
2026-03-29 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NZ74768') HTTP/1.1" 204 0
2026-03-29 11:37:00 [auto1.be] INFO: Found listing with ID: AC55620
2026-03-29 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AC55620%27 HTTP/1.1" 200 None
2026-03-29 11:37:00 [auto1.be] INFO: Scrape type for AC55620: 2
2026-03-29 11:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3505842-9219-5595-bcdf-7e483fd8cc77 with identifier: AC55620
2026-03-29 11:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3505842-9219-5595-bcdf-7e483fd8cc77 with scrape type 2
2026-03-29 11:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3505842-9219-5595-bcdf-7e483fd8cc77 with scrape type 2
2026-03-29 11:37:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d3505842-9219-5595-bcdf-7e483fd8cc77, identifier: AC55620
2026-03-29 11:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d3505842-9219-5595-bcdf-7e483fd8cc77 with identifier: AC55620
2026-03-29 11:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 11:37:00 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-29 11:37:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 11:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 11:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d3505842-9219-5595-bcdf-7e483fd8cc77 with identifier: AC55620
2026-03-29 11:37:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d3505842-9219-5595-bcdf-7e483fd8cc77 with identifier: AC55620 to the API
2026-03-29 11:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:17:32Z',
 'fuel_type': 'diesel',
 'id': 'd3505842-9219-5595-bcdf-7e483fd8cc77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC55620',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 161588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-10',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2015}
2026-03-29 11:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AC55620%27 HTTP/1.1" 200 None
2026-03-29 11:37:01 [auto1.be] INFO: Saving data for AC55620: {'auction_closing_time': 1774883852.0, 'created_time': 1774697759.100817, 'last_price_update_time': 1774784221.080988}
2026-03-29 11:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AC55620') HTTP/1.1" 204 0
2026-03-29 11:37:01 [auto1.be] INFO: Found listing with ID: ZJ26009
2026-03-29 11:37:01 [auto1.be] INFO: Found listing with ID: LR36013
2026-03-29 11:37:01 [auto1.be] INFO: Found listing with ID: YZ92764
2026-03-29 11:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YZ92764%27 HTTP/1.1" 200 None
2026-03-29 11:37:01 [auto1.be] INFO: Scrape type for YZ92764: 2
2026-03-29 11:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa75fb00-33d1-5d0b-89b1-6d1bb5575d73 with identifier: YZ92764
2026-03-29 11:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa75fb00-33d1-5d0b-89b1-6d1bb5575d73 with scrape type 2
2026-03-29 11:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa75fb00-33d1-5d0b-89b1-6d1bb5575d73 with scrape type 2
2026-03-29 11:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fa75fb00-33d1-5d0b-89b1-6d1bb5575d73, identifier: YZ92764
2026-03-29 11:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fa75fb00-33d1-5d0b-89b1-6d1bb5575d73 with identifier: YZ92764
2026-03-29 11:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 11:37:01 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-29 11:37:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 11:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 11:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fa75fb00-33d1-5d0b-89b1-6d1bb5575d73 with identifier: YZ92764
2026-03-29 11:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fa75fb00-33d1-5d0b-89b1-6d1bb5575d73 with identifier: YZ92764 to the API
2026-03-29 11:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:44:08Z',
 'fuel_type': 'diesel',
 'id': 'fa75fb00-33d1-5d0b-89b1-6d1bb5575d73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ92764',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'iQ',
 'odometer': 214536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-01',
 'seller_name': None,
 'title': 'Toyota iQ 1.4 D-4D',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-29 11:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YZ92764%27 HTTP/1.1" 200 None
2026-03-29 11:37:01 [auto1.be] INFO: Saving data for YZ92764: {'auction_closing_time': 1774885448.0, 'created_time': 1774697756.107384, 'last_price_update_time': 1774784221.665263}
2026-03-29 11:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YZ92764') HTTP/1.1" 204 0
2026-03-29 11:37:01 [auto1.be] INFO: Found listing with ID: ZZ63767
2026-03-29 11:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ63767%27 HTTP/1.1" 200 None
2026-03-29 11:37:01 [auto1.be] INFO: Scrape type for ZZ63767: 2
2026-03-29 11:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94004ea2-ab18-5923-acab-dee180fd7603 with identifier: ZZ63767
2026-03-29 11:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94004ea2-ab18-5923-acab-dee180fd7603 with scrape type 2
2026-03-29 11:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94004ea2-ab18-5923-acab-dee180fd7603 with scrape type 2
2026-03-29 11:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 94004ea2-ab18-5923-acab-dee180fd7603, identifier: ZZ63767
2026-03-29 11:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 94004ea2-ab18-5923-acab-dee180fd7603 with identifier: ZZ63767
2026-03-29 11:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 11:37:01 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-29 11:37:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 11:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 11:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 94004ea2-ab18-5923-acab-dee180fd7603 with identifier: ZZ63767
2026-03-29 11:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 94004ea2-ab18-5923-acab-dee180fd7603 with identifier: ZZ63767 to the API
2026-03-29 11:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:16:26Z',
 'fuel_type': 'diesel',
 'id': '94004ea2-ab18-5923-acab-dee180fd7603',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ63767',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Space Star',
 'odometer': 210839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-07-28',
 'seller_name': None,
 'title': 'Mitsubishi Space Star 1.9 DI-D Family 1900',
 'transmission': 'manual',
 'trim': 'Family 1900',
 'year': 2004}
2026-03-29 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ63767%27 HTTP/1.1" 200 None
2026-03-29 11:37:02 [auto1.be] INFO: Saving data for ZZ63767: {'auction_closing_time': 1774883786.0, 'created_time': 1774697723.967728, 'last_price_update_time': 1774784222.187173}
2026-03-29 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZZ63767') HTTP/1.1" 204 0
2026-03-29 11:37:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:37:02 [auto1.be] INFO: Channel: 24h | Page: 29 | totalHits: 1256 | hits on page: 40
2026-03-29 11:37:02 [auto1.be] INFO: Found listing with ID: VW23905
2026-03-29 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW23905%27 HTTP/1.1" 200 None
2026-03-29 11:37:02 [auto1.be] INFO: Scrape type for VW23905: 2
2026-03-29 11:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f76f7f9d-b84f-598c-952c-b8892a754a78 with identifier: VW23905
2026-03-29 11:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f76f7f9d-b84f-598c-952c-b8892a754a78 with scrape type 2
2026-03-29 11:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f76f7f9d-b84f-598c-952c-b8892a754a78 with scrape type 2
2026-03-29 11:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f76f7f9d-b84f-598c-952c-b8892a754a78, identifier: VW23905
2026-03-29 11:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f76f7f9d-b84f-598c-952c-b8892a754a78 with identifier: VW23905
2026-03-29 11:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f76f7f9d-b84f-598c-952c-b8892a754a78 with identifier: VW23905
2026-03-29 11:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f76f7f9d-b84f-598c-952c-b8892a754a78 with identifier: VW23905 to the API
2026-03-29 11:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:51:57Z',
 'fuel_type': 'diesel',
 'id': 'f76f7f9d-b84f-598c-952c-b8892a754a78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW23905',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 88076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-20',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 dCi N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2017}
2026-03-29 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW23905%27 HTTP/1.1" 200 None
2026-03-29 11:37:03 [auto1.be] INFO: Saving data for VW23905: {'auction_closing_time': 1774885917.0, 'created_time': 1774697794.950548, 'last_price_update_time': 1774784223.852601}
2026-03-29 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VW23905') HTTP/1.1" 204 0
2026-03-29 11:37:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:37:03 [auto1.be] INFO: Found listing with ID: BZ70123
2026-03-29 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ70123%27 HTTP/1.1" 200 None
2026-03-29 11:37:03 [auto1.be] INFO: Scrape type for BZ70123: 2
2026-03-29 11:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e86c8e1-36cc-5df4-8c16-d258792dff96 with identifier: BZ70123
2026-03-29 11:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e86c8e1-36cc-5df4-8c16-d258792dff96 with scrape type 2
2026-03-29 11:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e86c8e1-36cc-5df4-8c16-d258792dff96 with scrape type 2
2026-03-29 11:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4e86c8e1-36cc-5df4-8c16-d258792dff96, identifier: BZ70123
2026-03-29 11:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4e86c8e1-36cc-5df4-8c16-d258792dff96 with identifier: BZ70123
2026-03-29 11:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4e86c8e1-36cc-5df4-8c16-d258792dff96 with identifier: BZ70123
2026-03-29 11:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4e86c8e1-36cc-5df4-8c16-d258792dff96 with identifier: BZ70123 to the API
2026-03-29 11:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:20:38Z',
 'fuel_type': 'diesel',
 'id': '4e86c8e1-36cc-5df4-8c16-d258792dff96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ70123',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 150432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-15',
 'seller_name': None,
 'title': 'Opel Corsa 1.3 CDTI Edition ecoFlex',
 'transmission': 'manual',
 'trim': 'Edition ecoFlex',
 'year': 2015}
2026-03-29 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ70123%27 HTTP/1.1" 200 None
2026-03-29 11:37:04 [auto1.be] INFO: Saving data for BZ70123: {'auction_closing_time': 1774884038.0, 'created_time': 1773384489.030312, 'last_price_update_time': 1774784224.218388}
2026-03-29 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BZ70123') HTTP/1.1" 204 0
2026-03-29 11:37:04 [auto1.be] INFO: Found listing with ID: TX50404
2026-03-29 11:37:04 [auto1.be] INFO: Found listing with ID: XC95069
2026-03-29 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC95069%27 HTTP/1.1" 200 None
2026-03-29 11:37:04 [auto1.be] INFO: Scrape type for XC95069: 2
2026-03-29 11:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb2d479b-7554-5303-94e6-76865bc86c59 with identifier: XC95069
2026-03-29 11:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb2d479b-7554-5303-94e6-76865bc86c59 with scrape type 2
2026-03-29 11:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb2d479b-7554-5303-94e6-76865bc86c59 with scrape type 2
2026-03-29 11:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bb2d479b-7554-5303-94e6-76865bc86c59, identifier: XC95069
2026-03-29 11:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bb2d479b-7554-5303-94e6-76865bc86c59 with identifier: XC95069
2026-03-29 11:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bb2d479b-7554-5303-94e6-76865bc86c59 with identifier: XC95069
2026-03-29 11:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bb2d479b-7554-5303-94e6-76865bc86c59 with identifier: XC95069 to the API
2026-03-29 11:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:45:50Z',
 'fuel_type': 'petrol',
 'id': 'bb2d479b-7554-5303-94e6-76865bc86c59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC95069',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 109962,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-21',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2016}
2026-03-29 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC95069%27 HTTP/1.1" 200 None
2026-03-29 11:37:04 [auto1.be] INFO: Saving data for XC95069: {'auction_closing_time': 1774885550.0, 'created_time': 1774697752.335925, 'last_price_update_time': 1774784224.639711}
2026-03-29 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XC95069') HTTP/1.1" 204 0
2026-03-29 11:37:04 [auto1.be] INFO: Found listing with ID: BS70441
2026-03-29 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS70441%27 HTTP/1.1" 200 None
2026-03-29 11:37:04 [auto1.be] INFO: Scrape type for BS70441: 2
2026-03-29 11:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e433a844-a689-5367-8714-653fee095003 with identifier: BS70441
2026-03-29 11:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e433a844-a689-5367-8714-653fee095003 with scrape type 2
2026-03-29 11:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e433a844-a689-5367-8714-653fee095003 with scrape type 2
2026-03-29 11:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e433a844-a689-5367-8714-653fee095003, identifier: BS70441
2026-03-29 11:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e433a844-a689-5367-8714-653fee095003 with identifier: BS70441
2026-03-29 11:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e433a844-a689-5367-8714-653fee095003 with identifier: BS70441
2026-03-29 11:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e433a844-a689-5367-8714-653fee095003 with identifier: BS70441 to the API
2026-03-29 11:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:35:56Z',
 'fuel_type': 'petrol',
 'id': 'e433a844-a689-5367-8714-653fee095003',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS70441',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 123064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-04-22',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 140 L Classic',
 'transmission': 'automatic',
 'trim': 'L Classic',
 'year': 2004}
2026-03-29 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS70441%27 HTTP/1.1" 200 None
2026-03-29 11:37:05 [auto1.be] INFO: Saving data for BS70441: {'auction_closing_time': 1774884956.0, 'created_time': 1774697755.103194, 'last_price_update_time': 1774784225.03099}
2026-03-29 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BS70441') HTTP/1.1" 204 0
2026-03-29 11:37:05 [auto1.be] INFO: Found listing with ID: GM14941
2026-03-29 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM14941%27 HTTP/1.1" 200 None
2026-03-29 11:37:05 [auto1.be] INFO: Scrape type for GM14941: 2
2026-03-29 11:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e7864f8-93d6-521c-8d1b-1354badf6d8a with identifier: GM14941
2026-03-29 11:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e7864f8-93d6-521c-8d1b-1354badf6d8a with scrape type 2
2026-03-29 11:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e7864f8-93d6-521c-8d1b-1354badf6d8a with scrape type 2
2026-03-29 11:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6e7864f8-93d6-521c-8d1b-1354badf6d8a, identifier: GM14941
2026-03-29 11:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6e7864f8-93d6-521c-8d1b-1354badf6d8a with identifier: GM14941
2026-03-29 11:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6e7864f8-93d6-521c-8d1b-1354badf6d8a with identifier: GM14941
2026-03-29 11:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6e7864f8-93d6-521c-8d1b-1354badf6d8a with identifier: GM14941 to the API
2026-03-29 11:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:31:03Z',
 'fuel_type': 'petrol',
 'id': '6e7864f8-93d6-521c-8d1b-1354badf6d8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM14941',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 16541,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-29',
 'seller_name': None,
 'title': 'Renault Twingo 0.9 TCe Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2019}
2026-03-29 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM14941%27 HTTP/1.1" 200 None
2026-03-29 11:37:05 [auto1.be] INFO: Saving data for GM14941: {'auction_closing_time': 1774884663.0, 'created_time': 1774697751.947689, 'last_price_update_time': 1774784225.407583}
2026-03-29 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GM14941') HTTP/1.1" 204 0
2026-03-29 11:37:05 [auto1.be] INFO: Found listing with ID: SY87797
2026-03-29 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY87797%27 HTTP/1.1" 200 None
2026-03-29 11:37:05 [auto1.be] INFO: Scrape type for SY87797: 2
2026-03-29 11:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e46d3f0-0807-5b96-8849-00972b4d6143 with identifier: SY87797
2026-03-29 11:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e46d3f0-0807-5b96-8849-00972b4d6143 with scrape type 2
2026-03-29 11:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e46d3f0-0807-5b96-8849-00972b4d6143 with scrape type 2
2026-03-29 11:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6e46d3f0-0807-5b96-8849-00972b4d6143, identifier: SY87797
2026-03-29 11:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6e46d3f0-0807-5b96-8849-00972b4d6143 with identifier: SY87797
2026-03-29 11:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6e46d3f0-0807-5b96-8849-00972b4d6143 with identifier: SY87797
2026-03-29 11:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6e46d3f0-0807-5b96-8849-00972b4d6143 with identifier: SY87797 to the API
2026-03-29 11:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:42:48Z',
 'fuel_type': 'petrol',
 'id': '6e46d3f0-0807-5b96-8849-00972b4d6143',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY87797',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 165349,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-25',
 'seller_name': None,
 'title': 'Dacia Sandero 1.2 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2010}
2026-03-29 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY87797%27 HTTP/1.1" 200 None
2026-03-29 11:37:06 [auto1.be] INFO: Saving data for SY87797: {'auction_closing_time': 1774885368.0, 'created_time': 1774697749.821526, 'last_price_update_time': 1774784226.360072}
2026-03-29 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SY87797') HTTP/1.1" 204 0
2026-03-29 11:37:06 [auto1.be] INFO: Found listing with ID: WV78161
2026-03-29 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV78161%27 HTTP/1.1" 200 None
2026-03-29 11:37:06 [auto1.be] INFO: Scrape type for WV78161: 2
2026-03-29 11:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c86d0a7d-14b3-5db9-af01-0c5152bd3d7c with identifier: WV78161
2026-03-29 11:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c86d0a7d-14b3-5db9-af01-0c5152bd3d7c with scrape type 2
2026-03-29 11:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c86d0a7d-14b3-5db9-af01-0c5152bd3d7c with scrape type 2
2026-03-29 11:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c86d0a7d-14b3-5db9-af01-0c5152bd3d7c, identifier: WV78161
2026-03-29 11:37:06 [scrapy.extensions.logstats] INFO: Crawled 33 pages (at 19 pages/min), scraped 33 items (at 27 items/min)
2026-03-29 11:37:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 158MiB
2026-03-29 11:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c86d0a7d-14b3-5db9-af01-0c5152bd3d7c with identifier: WV78161
2026-03-29 11:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c86d0a7d-14b3-5db9-af01-0c5152bd3d7c with identifier: WV78161
2026-03-29 11:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c86d0a7d-14b3-5db9-af01-0c5152bd3d7c with identifier: WV78161 to the API
2026-03-29 11:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:18:35Z',
 'fuel_type': 'diesel',
 'id': 'c86d0a7d-14b3-5db9-af01-0c5152bd3d7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV78161',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 41439,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-12',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 BLUE dCi Rapid Maxi Extra',
 'transmission': 'manual',
 'trim': 'Rapid Maxi Extra',
 'year': 2020}
2026-03-29 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV78161%27 HTTP/1.1" 200 None
2026-03-29 11:37:06 [auto1.be] INFO: Saving data for WV78161: {'auction_closing_time': 1774883915.0, 'created_time': 1773384681.527128, 'last_price_update_time': 1774784226.823341}
2026-03-29 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WV78161') HTTP/1.1" 204 0
2026-03-29 11:37:06 [auto1.be] INFO: Found listing with ID: ZV95387
2026-03-29 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZV95387%27 HTTP/1.1" 200 None
2026-03-29 11:37:06 [auto1.be] INFO: Scrape type for ZV95387: 2
2026-03-29 11:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b0881ec-6709-5d81-81b2-5054e324342b with identifier: ZV95387
2026-03-29 11:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b0881ec-6709-5d81-81b2-5054e324342b with scrape type 2
2026-03-29 11:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b0881ec-6709-5d81-81b2-5054e324342b with scrape type 2
2026-03-29 11:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3b0881ec-6709-5d81-81b2-5054e324342b, identifier: ZV95387
2026-03-29 11:37:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3b0881ec-6709-5d81-81b2-5054e324342b with identifier: ZV95387
2026-03-29 11:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3b0881ec-6709-5d81-81b2-5054e324342b with identifier: ZV95387
2026-03-29 11:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3b0881ec-6709-5d81-81b2-5054e324342b with identifier: ZV95387 to the API
2026-03-29 11:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:42:59Z',
 'fuel_type': 'petrol',
 'id': '3b0881ec-6709-5d81-81b2-5054e324342b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV95387',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 84058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-01',
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-29 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZV95387%27 HTTP/1.1" 200 None
2026-03-29 11:37:07 [auto1.be] INFO: Saving data for ZV95387: {'auction_closing_time': 1774885379.0, 'created_time': 1774697801.794006, 'last_price_update_time': 1774784227.206471}
2026-03-29 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZV95387') HTTP/1.1" 204 0
2026-03-29 11:37:07 [auto1.be] INFO: Found listing with ID: HR69689
2026-03-29 11:37:07 [auto1.be] INFO: Found listing with ID: KB40459
2026-03-29 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KB40459%27 HTTP/1.1" 200 None
2026-03-29 11:37:07 [auto1.be] INFO: Scrape type for KB40459: 2
2026-03-29 11:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d42316a-0279-56f7-9b8e-5699d25c82b6 with identifier: KB40459
2026-03-29 11:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d42316a-0279-56f7-9b8e-5699d25c82b6 with scrape type 2
2026-03-29 11:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d42316a-0279-56f7-9b8e-5699d25c82b6 with scrape type 2
2026-03-29 11:37:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6d42316a-0279-56f7-9b8e-5699d25c82b6, identifier: KB40459
2026-03-29 11:37:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6d42316a-0279-56f7-9b8e-5699d25c82b6 with identifier: KB40459
2026-03-29 11:37:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6d42316a-0279-56f7-9b8e-5699d25c82b6 with identifier: KB40459
2026-03-29 11:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6d42316a-0279-56f7-9b8e-5699d25c82b6 with identifier: KB40459 to the API
2026-03-29 11:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:51:44Z',
 'fuel_type': 'petrol',
 'id': '6d42316a-0279-56f7-9b8e-5699d25c82b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB40459',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 129413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-14',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.6 SIDI Turbo Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2014}
2026-03-29 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KB40459%27 HTTP/1.1" 200 None
2026-03-29 11:37:07 [auto1.be] INFO: Saving data for KB40459: {'auction_closing_time': 1774885904.0, 'created_time': 1774697748.969292, 'last_price_update_time': 1774784227.598198}
2026-03-29 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KB40459') HTTP/1.1" 204 0
2026-03-29 11:37:07 [auto1.be] INFO: Found listing with ID: FC15884
2026-03-29 11:37:07 [auto1.be] INFO: Found listing with ID: KX73156
2026-03-29 11:37:07 [auto1.be] INFO: Found listing with ID: ZZ39097
2026-03-29 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ39097%27 HTTP/1.1" 200 None
2026-03-29 11:37:07 [auto1.be] INFO: Scrape type for ZZ39097: 2
2026-03-29 11:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1eee54d-5421-5ab8-8769-bd0fe8b84449 with identifier: ZZ39097
2026-03-29 11:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1eee54d-5421-5ab8-8769-bd0fe8b84449 with scrape type 2
2026-03-29 11:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1eee54d-5421-5ab8-8769-bd0fe8b84449 with scrape type 2
2026-03-29 11:37:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a1eee54d-5421-5ab8-8769-bd0fe8b84449, identifier: ZZ39097
2026-03-29 11:37:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a1eee54d-5421-5ab8-8769-bd0fe8b84449 with identifier: ZZ39097
2026-03-29 11:37:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a1eee54d-5421-5ab8-8769-bd0fe8b84449 with identifier: ZZ39097
2026-03-29 11:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a1eee54d-5421-5ab8-8769-bd0fe8b84449 with identifier: ZZ39097 to the API
2026-03-29 11:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:44:10Z',
 'fuel_type': 'diesel',
 'id': 'a1eee54d-5421-5ab8-8769-bd0fe8b84449',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ39097',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Pulsar',
 'odometer': 126244,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-21',
 'seller_name': None,
 'title': 'Nissan Pulsar 1.5 Turbodiesel N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2016}
2026-03-29 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ39097%27 HTTP/1.1" 200 None
2026-03-29 11:37:07 [auto1.be] INFO: Saving data for ZZ39097: {'auction_closing_time': 1774885450.0, 'created_time': 1774697803.877391, 'last_price_update_time': 1774784227.988654}
2026-03-29 11:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZZ39097') HTTP/1.1" 204 0
2026-03-29 11:37:08 [auto1.be] INFO: Channel: 24h | Page: 30 | totalHits: 1256 | hits on page: 40
2026-03-29 11:37:08 [auto1.be] INFO: Found listing with ID: SZ00073
2026-03-29 11:37:08 [auto1.be] INFO: Found listing with ID: SC10935
2026-03-29 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC10935%27 HTTP/1.1" 200 None
2026-03-29 11:37:08 [auto1.be] INFO: Scrape type for SC10935: 2
2026-03-29 11:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42a11eda-652d-5f8e-80e7-402930d101e3 with identifier: SC10935
2026-03-29 11:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42a11eda-652d-5f8e-80e7-402930d101e3 with scrape type 2
2026-03-29 11:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42a11eda-652d-5f8e-80e7-402930d101e3 with scrape type 2
2026-03-29 11:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 42a11eda-652d-5f8e-80e7-402930d101e3, identifier: SC10935
2026-03-29 11:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 42a11eda-652d-5f8e-80e7-402930d101e3 with identifier: SC10935
2026-03-29 11:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 42a11eda-652d-5f8e-80e7-402930d101e3 with identifier: SC10935
2026-03-29 11:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 42a11eda-652d-5f8e-80e7-402930d101e3 with identifier: SC10935 to the API
2026-03-29 11:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:06:58Z',
 'fuel_type': 'diesel',
 'id': '42a11eda-652d-5f8e-80e7-402930d101e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC10935',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 225479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-30',
 'seller_name': None,
 'title': 'Opel Meriva 1.6 CDTI DPF Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2015}
2026-03-29 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC10935%27 HTTP/1.1" 200 None
2026-03-29 11:37:08 [auto1.be] INFO: Saving data for SC10935: {'auction_closing_time': 1774883218.0, 'created_time': 1774697802.498061, 'last_price_update_time': 1774784228.361805}
2026-03-29 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SC10935') HTTP/1.1" 204 0
2026-03-29 11:37:08 [auto1.be] INFO: Found listing with ID: PU93740
2026-03-29 11:37:08 [auto1.be] INFO: Found listing with ID: LY17098
2026-03-29 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY17098%27 HTTP/1.1" 200 None
2026-03-29 11:37:08 [auto1.be] INFO: Scrape type for LY17098: 2
2026-03-29 11:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5 with identifier: LY17098
2026-03-29 11:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5 with scrape type 2
2026-03-29 11:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5 with scrape type 2
2026-03-29 11:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5, identifier: LY17098
2026-03-29 11:37:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:37:08 [auto1.be] INFO: Found listing with ID: BU18930
2026-03-29 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU18930%27 HTTP/1.1" 200 None
2026-03-29 11:37:08 [auto1.be] INFO: Scrape type for BU18930: 2
2026-03-29 11:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41becf54-0430-5c07-8557-5a3865934ccf with identifier: BU18930
2026-03-29 11:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41becf54-0430-5c07-8557-5a3865934ccf with scrape type 2
2026-03-29 11:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41becf54-0430-5c07-8557-5a3865934ccf with scrape type 2
2026-03-29 11:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 41becf54-0430-5c07-8557-5a3865934ccf, identifier: BU18930
2026-03-29 11:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5 with identifier: LY17098
2026-03-29 11:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5 with identifier: LY17098
2026-03-29 11:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5 with identifier: LY17098 to the API
2026-03-29 11:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-30T15:34:08Z',
 'fuel_type': 'petrol',
 'id': '3e4e2dc3-0b3e-59cc-bb21-1f02b46409a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY17098',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Carens',
 'odometer': 194581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-02',
 'seller_name': None,
 'title': 'Kia Carens 1.6 Attract',
 'transmission': 'manual',
 'trim': 'Attract',
 'year': 2009}
2026-03-29 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY17098%27 HTTP/1.1" 200 None
2026-03-29 11:37:08 [auto1.be] INFO: Saving data for LY17098: {'auction_closing_time': 1774884848.0, 'created_time': 1774697738.073627, 'last_price_update_time': 1774784228.861197}
2026-03-29 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LY17098') HTTP/1.1" 204 0
2026-03-29 11:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 41becf54-0430-5c07-8557-5a3865934ccf with identifier: BU18930
2026-03-29 11:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 41becf54-0430-5c07-8557-5a3865934ccf with identifier: BU18930
2026-03-29 11:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 41becf54-0430-5c07-8557-5a3865934ccf with identifier: BU18930 to the API
2026-03-29 11:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:19:01Z',
 'fuel_type': 'diesel',
 'id': '41becf54-0430-5c07-8557-5a3865934ccf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU18930',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 275170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-22',
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 HDi Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2010}
2026-03-29 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU18930%27 HTTP/1.1" 200 None
2026-03-29 11:37:09 [auto1.be] INFO: Saving data for BU18930: {'auction_closing_time': 1774883941.0, 'created_time': 1774697753.745961, 'last_price_update_time': 1774784229.21285}
2026-03-29 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BU18930') HTTP/1.1" 204 0
2026-03-29 11:37:09 [auto1.be] INFO: Found listing with ID: FC78029
2026-03-29 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC78029%27 HTTP/1.1" 200 None
2026-03-29 11:37:09 [auto1.be] INFO: Scrape type for FC78029: 2
2026-03-29 11:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78c0a291-758d-505c-bbb5-f0981838f388 with identifier: FC78029
2026-03-29 11:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78c0a291-758d-505c-bbb5-f0981838f388 with scrape type 2
2026-03-29 11:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78c0a291-758d-505c-bbb5-f0981838f388 with scrape type 2
2026-03-29 11:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 78c0a291-758d-505c-bbb5-f0981838f388, identifier: FC78029
2026-03-29 11:37:09 [auto1.be] INFO: Found listing with ID: CA73486
2026-03-29 11:37:09 [auto1.be] INFO: Found listing with ID: NU74968
2026-03-29 11:37:09 [auto1.be] INFO: Found listing with ID: WX14373
2026-03-29 11:37:09 [auto1.be] INFO: Found listing with ID: YK61845
2026-03-29 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK61845%27 HTTP/1.1" 200 None
2026-03-29 11:37:09 [auto1.be] INFO: Scrape type for YK61845: 0
2026-03-29 11:37:09 [auto1.be] INFO: Found listing with ID: CN37182
2026-03-29 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN37182%27 HTTP/1.1" 200 None
2026-03-29 11:37:09 [auto1.be] INFO: Scrape type for CN37182: 2
2026-03-29 11:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ee7d568-2372-53d1-9a2a-801a755fb75c with identifier: CN37182
2026-03-29 11:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ee7d568-2372-53d1-9a2a-801a755fb75c with scrape type 2
2026-03-29 11:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ee7d568-2372-53d1-9a2a-801a755fb75c with scrape type 2
2026-03-29 11:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7ee7d568-2372-53d1-9a2a-801a755fb75c, identifier: CN37182
2026-03-29 11:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 78c0a291-758d-505c-bbb5-f0981838f388 with identifier: FC78029
2026-03-29 11:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 78c0a291-758d-505c-bbb5-f0981838f388 with identifier: FC78029
2026-03-29 11:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 78c0a291-758d-505c-bbb5-f0981838f388 with identifier: FC78029 to the API
2026-03-29 11:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:34:46Z',
 'fuel_type': 'petrol',
 'id': '78c0a291-758d-505c-bbb5-f0981838f388',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC78029',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 132105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-02',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 AMG Line',
 'transmission': 'manual',
 'trim': 'AMG Line',
 'year': 2014}
2026-03-29 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC78029%27 HTTP/1.1" 200 None
2026-03-29 11:37:09 [auto1.be] INFO: Saving data for FC78029: {'auction_closing_time': 1774884886.0, 'created_time': 1774697737.764261, 'last_price_update_time': 1774784229.722617}
2026-03-29 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FC78029') HTTP/1.1" 204 0
2026-03-29 11:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7ee7d568-2372-53d1-9a2a-801a755fb75c with identifier: CN37182
2026-03-29 11:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7ee7d568-2372-53d1-9a2a-801a755fb75c with identifier: CN37182
2026-03-29 11:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7ee7d568-2372-53d1-9a2a-801a755fb75c with identifier: CN37182 to the API
2026-03-29 11:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:32:54Z',
 'fuel_type': 'diesel',
 'id': '7ee7d568-2372-53d1-9a2a-801a755fb75c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN37182',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 60189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-27',
 'seller_name': None,
 'title': 'Renault Trafic 1.6 dCi Energy L2H1 2,9t Formula Edition',
 'transmission': 'manual',
 'trim': 'L2H1 2,9t Formula Edition',
 'year': 2017}
2026-03-29 11:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN37182%27 HTTP/1.1" 200 None
2026-03-29 11:37:10 [auto1.be] INFO: Saving data for CN37182: {'auction_closing_time': 1774884774.0, 'created_time': 1774697732.981308, 'last_price_update_time': 1774784230.051195}
2026-03-29 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CN37182') HTTP/1.1" 204 0
2026-03-29 11:37:10 [auto1.be] INFO: Found listing with ID: EH00335
2026-03-29 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EH00335%27 HTTP/1.1" 200 None
2026-03-29 11:37:10 [auto1.be] INFO: Scrape type for EH00335: 2
2026-03-29 11:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdbfe6a6-a285-5ee5-bd85-8a3050595475 with identifier: EH00335
2026-03-29 11:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdbfe6a6-a285-5ee5-bd85-8a3050595475 with scrape type 2
2026-03-29 11:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdbfe6a6-a285-5ee5-bd85-8a3050595475 with scrape type 2
2026-03-29 11:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cdbfe6a6-a285-5ee5-bd85-8a3050595475, identifier: EH00335
2026-03-29 11:37:10 [auto1.be] INFO: Found listing with ID: EK79460
2026-03-29 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK79460%27 HTTP/1.1" 200 None
2026-03-29 11:37:10 [auto1.be] INFO: Scrape type for EK79460: 2
2026-03-29 11:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9c69946-e6f2-5427-8592-657055574d32 with identifier: EK79460
2026-03-29 11:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9c69946-e6f2-5427-8592-657055574d32 with scrape type 2
2026-03-29 11:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9c69946-e6f2-5427-8592-657055574d32 with scrape type 2
2026-03-29 11:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f9c69946-e6f2-5427-8592-657055574d32, identifier: EK79460
2026-03-29 11:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cdbfe6a6-a285-5ee5-bd85-8a3050595475 with identifier: EH00335
2026-03-29 11:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cdbfe6a6-a285-5ee5-bd85-8a3050595475 with identifier: EH00335
2026-03-29 11:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cdbfe6a6-a285-5ee5-bd85-8a3050595475 with identifier: EH00335 to the API
2026-03-29 11:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:24:39Z',
 'fuel_type': 'diesel',
 'id': 'cdbfe6a6-a285-5ee5-bd85-8a3050595475',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH00335',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 197427,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-19',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.5 dCi Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2011}
2026-03-29 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EH00335%27 HTTP/1.1" 200 None
2026-03-29 11:37:10 [auto1.be] INFO: Saving data for EH00335: {'auction_closing_time': 1774884279.0, 'created_time': 1774697744.108818, 'last_price_update_time': 1774784230.540389}
2026-03-29 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EH00335') HTTP/1.1" 204 0
2026-03-29 11:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f9c69946-e6f2-5427-8592-657055574d32 with identifier: EK79460
2026-03-29 11:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f9c69946-e6f2-5427-8592-657055574d32 with identifier: EK79460
2026-03-29 11:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f9c69946-e6f2-5427-8592-657055574d32 with identifier: EK79460 to the API
2026-03-29 11:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:22:02Z',
 'fuel_type': 'diesel',
 'id': 'f9c69946-e6f2-5427-8592-657055574d32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK79460',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 122467,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-21',
 'seller_name': None,
 'title': 'Skoda Fabia 1.6 TDI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2010}
2026-03-29 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK79460%27 HTTP/1.1" 200 None
2026-03-29 11:37:10 [auto1.be] INFO: Saving data for EK79460: {'auction_closing_time': 1774884122.0, 'created_time': 1773909357.314713, 'last_price_update_time': 1774784230.822024}
2026-03-29 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EK79460') HTTP/1.1" 204 0
2026-03-29 11:37:10 [auto1.be] INFO: Found listing with ID: WH49963
2026-03-29 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH49963%27 HTTP/1.1" 200 None
2026-03-29 11:37:10 [auto1.be] INFO: Scrape type for WH49963: 2
2026-03-29 11:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3366934-d91c-5156-a369-650665629474 with identifier: WH49963
2026-03-29 11:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3366934-d91c-5156-a369-650665629474 with scrape type 2
2026-03-29 11:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3366934-d91c-5156-a369-650665629474 with scrape type 2
2026-03-29 11:37:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a3366934-d91c-5156-a369-650665629474, identifier: WH49963
2026-03-29 11:37:11 [auto1.be] INFO: Found listing with ID: SW60531
2026-03-29 11:37:11 [auto1.be] INFO: Found listing with ID: KE51169
2026-03-29 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE51169%27 HTTP/1.1" 200 None
2026-03-29 11:37:11 [auto1.be] INFO: Scrape type for KE51169: 2
2026-03-29 11:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6952caac-088e-5006-9a46-9b48f1abe497 with identifier: KE51169
2026-03-29 11:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6952caac-088e-5006-9a46-9b48f1abe497 with scrape type 2
2026-03-29 11:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6952caac-088e-5006-9a46-9b48f1abe497 with scrape type 2
2026-03-29 11:37:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6952caac-088e-5006-9a46-9b48f1abe497, identifier: KE51169
2026-03-29 11:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a3366934-d91c-5156-a369-650665629474 with identifier: WH49963
2026-03-29 11:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a3366934-d91c-5156-a369-650665629474 with identifier: WH49963
2026-03-29 11:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a3366934-d91c-5156-a369-650665629474 with identifier: WH49963 to the API
2026-03-29 11:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 394,
 'expiration_date': '2026-03-30T15:00:35Z',
 'fuel_type': 'hybrid',
 'id': 'a3366934-d91c-5156-a369-650665629474',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH49963',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 76700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-22',
 'seller_name': None,
 'title': 'BMW X5 xDrive 45e xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2019}
2026-03-29 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH49963%27 HTTP/1.1" 200 None
2026-03-29 11:37:11 [auto1.be] INFO: Saving data for WH49963: {'auction_closing_time': 1774882835.0, 'created_time': 1774697745.557079, 'last_price_update_time': 1774784231.383724}
2026-03-29 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WH49963') HTTP/1.1" 204 0
2026-03-29 11:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6952caac-088e-5006-9a46-9b48f1abe497 with identifier: KE51169
2026-03-29 11:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 11:37:11 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-29 11:37:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 11:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6952caac-088e-5006-9a46-9b48f1abe497 with identifier: KE51169
2026-03-29 11:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6952caac-088e-5006-9a46-9b48f1abe497 with identifier: KE51169 to the API
2026-03-29 11:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:44:07Z',
 'fuel_type': 'diesel',
 'id': '6952caac-088e-5006-9a46-9b48f1abe497',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE51169',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 130823,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-16',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 HDi Platinum',
 'transmission': 'manual',
 'trim': 'Platinum',
 'year': 2010}
2026-03-29 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE51169%27 HTTP/1.1" 200 None
2026-03-29 11:37:11 [auto1.be] INFO: Saving data for KE51169: {'auction_closing_time': 1774885447.0, 'created_time': 1774697795.32819, 'last_price_update_time': 1774784231.916029}
2026-03-29 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KE51169') HTTP/1.1" 204 0
2026-03-29 11:37:11 [auto1.be] INFO: Found listing with ID: XG70738
2026-03-29 11:37:11 [auto1.be] INFO: Found listing with ID: KL53758
2026-03-29 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KL53758%27 HTTP/1.1" 200 None
2026-03-29 11:37:11 [auto1.be] INFO: Scrape type for KL53758: 2
2026-03-29 11:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb2cc3eb-4d6f-5034-bb20-95c2a2a10868 with identifier: KL53758
2026-03-29 11:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb2cc3eb-4d6f-5034-bb20-95c2a2a10868 with scrape type 2
2026-03-29 11:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb2cc3eb-4d6f-5034-bb20-95c2a2a10868 with scrape type 2
2026-03-29 11:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cb2cc3eb-4d6f-5034-bb20-95c2a2a10868, identifier: KL53758
2026-03-29 11:37:12 [auto1.be] INFO: Found listing with ID: JJ51820
2026-03-29 11:37:12 [auto1.be] INFO: Found listing with ID: KH65741
2026-03-29 11:37:12 [auto1.be] INFO: Found listing with ID: CV58665
2026-03-29 11:37:12 [auto1.be] INFO: Found listing with ID: NE94103
2026-03-29 11:37:12 [auto1.be] INFO: Found listing with ID: RC51689
2026-03-29 11:37:12 [auto1.be] INFO: Found listing with ID: XS76018
2026-03-29 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS76018%27 HTTP/1.1" 200 None
2026-03-29 11:37:12 [auto1.be] INFO: Scrape type for XS76018: 2
2026-03-29 11:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a00c4bcf-7f42-5950-b0cd-015cfad5186e with identifier: XS76018
2026-03-29 11:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a00c4bcf-7f42-5950-b0cd-015cfad5186e with scrape type 2
2026-03-29 11:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a00c4bcf-7f42-5950-b0cd-015cfad5186e with scrape type 2
2026-03-29 11:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a00c4bcf-7f42-5950-b0cd-015cfad5186e, identifier: XS76018
2026-03-29 11:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cb2cc3eb-4d6f-5034-bb20-95c2a2a10868 with identifier: KL53758
2026-03-29 11:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cb2cc3eb-4d6f-5034-bb20-95c2a2a10868 with identifier: KL53758
2026-03-29 11:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cb2cc3eb-4d6f-5034-bb20-95c2a2a10868 with identifier: KL53758 to the API
2026-03-29 11:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:52:41Z',
 'fuel_type': 'diesel',
 'id': 'cb2cc3eb-4d6f-5034-bb20-95c2a2a10868',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL53758',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 153835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-05',
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 Blue-HDi Allure Business',
 'transmission': 'manual',
 'trim': 'Allure Business',
 'year': 2016}
2026-03-29 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KL53758%27 HTTP/1.1" 200 None
2026-03-29 11:37:12 [auto1.be] INFO: Saving data for KL53758: {'auction_closing_time': 1774885961.0, 'created_time': 1774697743.73254, 'last_price_update_time': 1774784232.401335}
2026-03-29 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KL53758') HTTP/1.1" 204 0
2026-03-29 11:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a00c4bcf-7f42-5950-b0cd-015cfad5186e with identifier: XS76018
2026-03-29 11:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a00c4bcf-7f42-5950-b0cd-015cfad5186e with identifier: XS76018
2026-03-29 11:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a00c4bcf-7f42-5950-b0cd-015cfad5186e with identifier: XS76018 to the API
2026-03-29 11:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:29:22Z',
 'fuel_type': 'petrol',
 'id': 'a00c4bcf-7f42-5950-b0cd-015cfad5186e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS76018',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 38521,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-06',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2022}
2026-03-29 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS76018%27 HTTP/1.1" 200 None
2026-03-29 11:37:12 [auto1.be] INFO: Saving data for XS76018: {'auction_closing_time': 1774884562.0, 'created_time': 1774697730.689196, 'last_price_update_time': 1774784232.670788}
2026-03-29 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XS76018') HTTP/1.1" 204 0
2026-03-29 11:37:12 [auto1.be] INFO: Found listing with ID: GV92885
2026-03-29 11:37:12 [auto1.be] INFO: Found listing with ID: RA73981
2026-03-29 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA73981%27 HTTP/1.1" 200 None
2026-03-29 11:37:12 [auto1.be] INFO: Scrape type for RA73981: 2
2026-03-29 11:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c9c6e8a-198e-5a44-af19-4d58da22fa0c with identifier: RA73981
2026-03-29 11:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c9c6e8a-198e-5a44-af19-4d58da22fa0c with scrape type 2
2026-03-29 11:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c9c6e8a-198e-5a44-af19-4d58da22fa0c with scrape type 2
2026-03-29 11:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4c9c6e8a-198e-5a44-af19-4d58da22fa0c, identifier: RA73981
2026-03-29 11:37:12 [auto1.be] INFO: Found listing with ID: UY92003
2026-03-29 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY92003%27 HTTP/1.1" 200 None
2026-03-29 11:37:12 [auto1.be] INFO: Scrape type for UY92003: 2
2026-03-29 11:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0371ffca-6417-5000-9cfe-c3e1707bd28b with identifier: UY92003
2026-03-29 11:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0371ffca-6417-5000-9cfe-c3e1707bd28b with scrape type 2
2026-03-29 11:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0371ffca-6417-5000-9cfe-c3e1707bd28b with scrape type 2
2026-03-29 11:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0371ffca-6417-5000-9cfe-c3e1707bd28b, identifier: UY92003
2026-03-29 11:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4c9c6e8a-198e-5a44-af19-4d58da22fa0c with identifier: RA73981
2026-03-29 11:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4c9c6e8a-198e-5a44-af19-4d58da22fa0c with identifier: RA73981
2026-03-29 11:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4c9c6e8a-198e-5a44-af19-4d58da22fa0c with identifier: RA73981 to the API
2026-03-29 11:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:09:45Z',
 'fuel_type': 'diesel',
 'id': '4c9c6e8a-198e-5a44-af19-4d58da22fa0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA73981',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 282378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-16',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 HDi First',
 'transmission': 'manual',
 'trim': 'First',
 'year': 2008}
2026-03-29 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA73981%27 HTTP/1.1" 200 None
2026-03-29 11:37:13 [auto1.be] INFO: Saving data for RA73981: {'auction_closing_time': 1774883385.0, 'created_time': 1774697734.637786, 'last_price_update_time': 1774784233.173733}
2026-03-29 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RA73981') HTTP/1.1" 204 0
2026-03-29 11:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0371ffca-6417-5000-9cfe-c3e1707bd28b with identifier: UY92003
2026-03-29 11:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0371ffca-6417-5000-9cfe-c3e1707bd28b with identifier: UY92003
2026-03-29 11:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0371ffca-6417-5000-9cfe-c3e1707bd28b with identifier: UY92003 to the API
2026-03-29 11:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:58:32Z',
 'fuel_type': 'petrol',
 'id': '0371ffca-6417-5000-9cfe-c3e1707bd28b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY92003',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris Verso',
 'odometer': 106735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-01-31',
 'seller_name': None,
 'title': 'Toyota Yaris Verso 1.3 VVT-i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2000}
2026-03-29 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY92003%27 HTTP/1.1" 200 None
2026-03-29 11:37:13 [auto1.be] INFO: Saving data for UY92003: {'auction_closing_time': 1774886312.0, 'created_time': 1774697791.974794, 'last_price_update_time': 1774784233.531679}
2026-03-29 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UY92003') HTTP/1.1" 204 0
2026-03-29 11:37:13 [auto1.be] INFO: Found listing with ID: EJ96142
2026-03-29 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ96142%27 HTTP/1.1" 200 None
2026-03-29 11:37:13 [auto1.be] INFO: Scrape type for EJ96142: 2
2026-03-29 11:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb779073-baaf-5e6e-a125-614e69685435 with identifier: EJ96142
2026-03-29 11:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb779073-baaf-5e6e-a125-614e69685435 with scrape type 2
2026-03-29 11:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb779073-baaf-5e6e-a125-614e69685435 with scrape type 2
2026-03-29 11:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bb779073-baaf-5e6e-a125-614e69685435, identifier: EJ96142
2026-03-29 11:37:13 [auto1.be] INFO: Found listing with ID: NV64774
2026-03-29 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV64774%27 HTTP/1.1" 200 None
2026-03-29 11:37:13 [auto1.be] INFO: Scrape type for NV64774: 2
2026-03-29 11:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb386063-39c7-587d-ad9a-ff6800bae828 with identifier: NV64774
2026-03-29 11:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb386063-39c7-587d-ad9a-ff6800bae828 with scrape type 2
2026-03-29 11:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb386063-39c7-587d-ad9a-ff6800bae828 with scrape type 2
2026-03-29 11:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cb386063-39c7-587d-ad9a-ff6800bae828, identifier: NV64774
2026-03-29 11:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bb779073-baaf-5e6e-a125-614e69685435 with identifier: EJ96142
2026-03-29 11:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bb779073-baaf-5e6e-a125-614e69685435 with identifier: EJ96142
2026-03-29 11:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bb779073-baaf-5e6e-a125-614e69685435 with identifier: EJ96142 to the API
2026-03-29 11:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:04:12Z',
 'fuel_type': 'diesel',
 'id': 'bb779073-baaf-5e6e-a125-614e69685435',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ96142',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 96641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-11',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 HDi Outdoor',
 'transmission': 'manual',
 'trim': 'Outdoor',
 'year': 2012}
2026-03-29 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ96142%27 HTTP/1.1" 200 None
2026-03-29 11:37:14 [auto1.be] INFO: Saving data for EJ96142: {'auction_closing_time': 1774883052.0, 'created_time': 1774697748.264964, 'last_price_update_time': 1774784234.017118}
2026-03-29 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EJ96142') HTTP/1.1" 204 0
2026-03-29 11:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cb386063-39c7-587d-ad9a-ff6800bae828 with identifier: NV64774
2026-03-29 11:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cb386063-39c7-587d-ad9a-ff6800bae828 with identifier: NV64774
2026-03-29 11:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cb386063-39c7-587d-ad9a-ff6800bae828 with identifier: NV64774 to the API
2026-03-29 11:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:35:10Z',
 'fuel_type': 'petrol',
 'id': 'cb386063-39c7-587d-ad9a-ff6800bae828',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV64774',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 236390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-20',
 'seller_name': None,
 'title': 'Hyundai i10 1.2 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2012}
2026-03-29 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV64774%27 HTTP/1.1" 200 None
2026-03-29 11:37:14 [auto1.be] INFO: Saving data for NV64774: {'auction_closing_time': 1774884910.0, 'created_time': 1774697793.043121, 'last_price_update_time': 1774784234.376757}
2026-03-29 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NV64774') HTTP/1.1" 204 0
2026-03-29 11:37:14 [auto1.be] INFO: Found listing with ID: HE39793
2026-03-29 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE39793%27 HTTP/1.1" 200 None
2026-03-29 11:37:14 [auto1.be] INFO: Scrape type for HE39793: 2
2026-03-29 11:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 504aed41-bf6e-5884-9e2f-adf46851589d with identifier: HE39793
2026-03-29 11:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 504aed41-bf6e-5884-9e2f-adf46851589d with scrape type 2
2026-03-29 11:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 504aed41-bf6e-5884-9e2f-adf46851589d with scrape type 2
2026-03-29 11:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 504aed41-bf6e-5884-9e2f-adf46851589d, identifier: HE39793
2026-03-29 11:37:14 [auto1.be] INFO: Found listing with ID: KB41449
2026-03-29 11:37:14 [auto1.be] INFO: Found listing with ID: ET88330
2026-03-29 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET88330%27 HTTP/1.1" 200 None
2026-03-29 11:37:14 [auto1.be] INFO: Scrape type for ET88330: 2
2026-03-29 11:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3911d70-a36f-595b-859c-a5e9fd60ea09 with identifier: ET88330
2026-03-29 11:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3911d70-a36f-595b-859c-a5e9fd60ea09 with scrape type 2
2026-03-29 11:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3911d70-a36f-595b-859c-a5e9fd60ea09 with scrape type 2
2026-03-29 11:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e3911d70-a36f-595b-859c-a5e9fd60ea09, identifier: ET88330
2026-03-29 11:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 504aed41-bf6e-5884-9e2f-adf46851589d with identifier: HE39793
2026-03-29 11:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 504aed41-bf6e-5884-9e2f-adf46851589d with identifier: HE39793
2026-03-29 11:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 504aed41-bf6e-5884-9e2f-adf46851589d with identifier: HE39793 to the API
2026-03-29 11:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:34:25Z',
 'fuel_type': 'petrol',
 'id': '504aed41-bf6e-5884-9e2f-adf46851589d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE39793',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 81585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-26',
 'seller_name': None,
 'title': 'Fiat Punto 1.2 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2017}
2026-03-29 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE39793%27 HTTP/1.1" 200 None
2026-03-29 11:37:14 [auto1.be] INFO: Saving data for HE39793: {'auction_closing_time': 1774884865.0, 'created_time': 1774697751.583659, 'last_price_update_time': 1774784234.898426}
2026-03-29 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HE39793') HTTP/1.1" 204 0
2026-03-29 11:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e3911d70-a36f-595b-859c-a5e9fd60ea09 with identifier: ET88330
2026-03-29 11:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 11:37:14 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-29 11:37:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 11:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e3911d70-a36f-595b-859c-a5e9fd60ea09 with identifier: ET88330
2026-03-29 11:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e3911d70-a36f-595b-859c-a5e9fd60ea09 with identifier: ET88330 to the API
2026-03-29 11:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:17:49Z',
 'fuel_type': 'petrol',
 'id': 'e3911d70-a36f-595b-859c-a5e9fd60ea09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET88330',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 25368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-23',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Innovation "110 Jahre"',
 'transmission': 'manual',
 'trim': 'Innovation "110 Jahre"',
 'year': 2010}
2026-03-29 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET88330%27 HTTP/1.1" 200 None
2026-03-29 11:37:15 [auto1.be] INFO: Saving data for ET88330: {'auction_closing_time': 1774883869.0, 'created_time': 1774697735.307143, 'last_price_update_time': 1774784235.260838}
2026-03-29 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ET88330') HTTP/1.1" 204 0
2026-03-29 11:37:15 [auto1.be] INFO: Found listing with ID: DD83263
2026-03-29 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD83263%27 HTTP/1.1" 200 None
2026-03-29 11:37:15 [auto1.be] INFO: Scrape type for DD83263: 2
2026-03-29 11:37:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c32743c6-2b98-5c6e-87ba-bcd434b3cace with identifier: DD83263
2026-03-29 11:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c32743c6-2b98-5c6e-87ba-bcd434b3cace with scrape type 2
2026-03-29 11:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c32743c6-2b98-5c6e-87ba-bcd434b3cace with scrape type 2
2026-03-29 11:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c32743c6-2b98-5c6e-87ba-bcd434b3cace, identifier: DD83263
2026-03-29 11:37:15 [auto1.be] INFO: Found listing with ID: KT00341
2026-03-29 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT00341%27 HTTP/1.1" 200 None
2026-03-29 11:37:15 [auto1.be] INFO: Scrape type for KT00341: 2
2026-03-29 11:37:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b176a8a-6962-5823-864c-71ed348166ca with identifier: KT00341
2026-03-29 11:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b176a8a-6962-5823-864c-71ed348166ca with scrape type 2
2026-03-29 11:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b176a8a-6962-5823-864c-71ed348166ca with scrape type 2
2026-03-29 11:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8b176a8a-6962-5823-864c-71ed348166ca, identifier: KT00341
2026-03-29 11:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c32743c6-2b98-5c6e-87ba-bcd434b3cace with identifier: DD83263
2026-03-29 11:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c32743c6-2b98-5c6e-87ba-bcd434b3cace with identifier: DD83263
2026-03-29 11:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c32743c6-2b98-5c6e-87ba-bcd434b3cace with identifier: DD83263 to the API
2026-03-29 11:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:21:48Z',
 'fuel_type': 'diesel',
 'id': 'c32743c6-2b98-5c6e-87ba-bcd434b3cace',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD83263',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 135430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-19',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Style',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Style',
 'year': 2018}
2026-03-29 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD83263%27 HTTP/1.1" 200 None
2026-03-29 11:37:15 [auto1.be] INFO: Saving data for DD83263: {'auction_closing_time': 1774884108.0, 'created_time': 1774697746.642094, 'last_price_update_time': 1774784235.75181}
2026-03-29 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DD83263') HTTP/1.1" 204 0
2026-03-29 11:37:15 [auto1.be] INFO: Channel: 24h | Page: 31 | totalHits: 1256 | hits on page: 40
2026-03-29 11:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8b176a8a-6962-5823-864c-71ed348166ca with identifier: KT00341
2026-03-29 11:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8b176a8a-6962-5823-864c-71ed348166ca with identifier: KT00341
2026-03-29 11:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8b176a8a-6962-5823-864c-71ed348166ca with identifier: KT00341 to the API
2026-03-29 11:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:57:44Z',
 'fuel_type': 'diesel',
 'id': '8b176a8a-6962-5823-864c-71ed348166ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT00341',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 265642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-23',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Maxi Comfortline',
 'transmission': 'manual',
 'trim': 'Maxi Comfortline',
 'year': 2011}
2026-03-29 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT00341%27 HTTP/1.1" 200 None
2026-03-29 11:37:16 [auto1.be] INFO: Saving data for KT00341: {'auction_closing_time': 1774886264.0, 'created_time': 1774039053.491047, 'last_price_update_time': 1774784236.039657}
2026-03-29 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KT00341') HTTP/1.1" 204 0
2026-03-29 11:37:16 [auto1.be] INFO: Found listing with ID: DV83163
2026-03-29 11:37:16 [auto1.be] INFO: Found listing with ID: SW21472
2026-03-29 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW21472%27 HTTP/1.1" 200 None
2026-03-29 11:37:16 [auto1.be] INFO: Scrape type for SW21472: 2
2026-03-29 11:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e819c02d-4bb2-55db-8d4e-fce41dacd5cf with identifier: SW21472
2026-03-29 11:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e819c02d-4bb2-55db-8d4e-fce41dacd5cf with scrape type 2
2026-03-29 11:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e819c02d-4bb2-55db-8d4e-fce41dacd5cf with scrape type 2
2026-03-29 11:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e819c02d-4bb2-55db-8d4e-fce41dacd5cf, identifier: SW21472
2026-03-29 11:37:16 [auto1.be] INFO: Found listing with ID: YH90615
2026-03-29 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH90615%27 HTTP/1.1" 200 None
2026-03-29 11:37:16 [auto1.be] INFO: Scrape type for YH90615: 2
2026-03-29 11:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c351e18-f3a9-5a23-85d4-dcfc5693610c with identifier: YH90615
2026-03-29 11:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c351e18-f3a9-5a23-85d4-dcfc5693610c with scrape type 2
2026-03-29 11:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c351e18-f3a9-5a23-85d4-dcfc5693610c with scrape type 2
2026-03-29 11:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0c351e18-f3a9-5a23-85d4-dcfc5693610c, identifier: YH90615
2026-03-29 11:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e819c02d-4bb2-55db-8d4e-fce41dacd5cf with identifier: SW21472
2026-03-29 11:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e819c02d-4bb2-55db-8d4e-fce41dacd5cf with identifier: SW21472
2026-03-29 11:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e819c02d-4bb2-55db-8d4e-fce41dacd5cf with identifier: SW21472 to the API
2026-03-29 11:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:21:26Z',
 'fuel_type': 'petrol',
 'id': 'e819c02d-4bb2-55db-8d4e-fce41dacd5cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW21472',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 222777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-16',
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 THP Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2015}
2026-03-29 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW21472%27 HTTP/1.1" 200 None
2026-03-29 11:37:16 [auto1.be] INFO: Saving data for SW21472: {'auction_closing_time': 1774884086.0, 'created_time': 1774697736.187641, 'last_price_update_time': 1774784236.558606}
2026-03-29 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SW21472') HTTP/1.1" 204 0
2026-03-29 11:37:16 [auto1.be] INFO: Found listing with ID: ST29091
2026-03-29 11:37:16 [auto1.be] INFO: Found listing with ID: TV57254
2026-03-29 11:37:16 [auto1.be] INFO: Found listing with ID: TC61218
2026-03-29 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC61218%27 HTTP/1.1" 200 None
2026-03-29 11:37:16 [auto1.be] INFO: Scrape type for TC61218: 2
2026-03-29 11:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c70514e2-cfa6-53b4-966f-1ba51a7b9e60 with identifier: TC61218
2026-03-29 11:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c70514e2-cfa6-53b4-966f-1ba51a7b9e60 with scrape type 2
2026-03-29 11:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c70514e2-cfa6-53b4-966f-1ba51a7b9e60 with scrape type 2
2026-03-29 11:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c70514e2-cfa6-53b4-966f-1ba51a7b9e60, identifier: TC61218
2026-03-29 11:37:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0c351e18-f3a9-5a23-85d4-dcfc5693610c with identifier: YH90615
2026-03-29 11:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0c351e18-f3a9-5a23-85d4-dcfc5693610c with identifier: YH90615
2026-03-29 11:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0c351e18-f3a9-5a23-85d4-dcfc5693610c with identifier: YH90615 to the API
2026-03-29 11:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:38:34Z',
 'fuel_type': 'petrol',
 'id': '0c351e18-f3a9-5a23-85d4-dcfc5693610c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH90615',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 113628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-11',
 'seller_name': None,
 'title': 'Peugeot 207 1.6 Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2010}
2026-03-29 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH90615%27 HTTP/1.1" 200 None
2026-03-29 11:37:16 [auto1.be] INFO: Saving data for YH90615: {'auction_closing_time': 1774885114.0, 'created_time': 1774039062.988824, 'last_price_update_time': 1774784236.953629}
2026-03-29 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YH90615') HTTP/1.1" 204 0
2026-03-29 11:37:17 [auto1.be] INFO: Found listing with ID: AF15006
2026-03-29 11:37:17 [auto1.be] INFO: Found listing with ID: JY19882
2026-03-29 11:37:17 [auto1.be] INFO: Found listing with ID: EY57880
2026-03-29 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EY57880%27 HTTP/1.1" 200 None
2026-03-29 11:37:17 [auto1.be] INFO: Scrape type for EY57880: 2
2026-03-29 11:37:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c with identifier: EY57880
2026-03-29 11:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c with scrape type 2
2026-03-29 11:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c with scrape type 2
2026-03-29 11:37:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c, identifier: EY57880
2026-03-29 11:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c70514e2-cfa6-53b4-966f-1ba51a7b9e60 with identifier: TC61218
2026-03-29 11:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c70514e2-cfa6-53b4-966f-1ba51a7b9e60 with identifier: TC61218
2026-03-29 11:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c70514e2-cfa6-53b4-966f-1ba51a7b9e60 with identifier: TC61218 to the API
2026-03-29 11:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:24:29Z',
 'fuel_type': 'petrol',
 'id': 'c70514e2-cfa6-53b4-966f-1ba51a7b9e60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC61218',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Tigra',
 'odometer': 78437,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-04-29',
 'seller_name': None,
 'title': "Opel Tigra 1.4 Color Line 'Chequers'",
 'transmission': 'manual',
 'trim': "Color Line 'Chequers'",
 'year': 1999}
2026-03-29 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC61218%27 HTTP/1.1" 200 None
2026-03-29 11:37:17 [auto1.be] INFO: Saving data for TC61218: {'auction_closing_time': 1774884269.0, 'created_time': 1774697792.341597, 'last_price_update_time': 1774784237.410135}
2026-03-29 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TC61218') HTTP/1.1" 204 0
2026-03-29 11:37:17 [auto1.be] INFO: Found listing with ID: CU35051
2026-03-29 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU35051%27 HTTP/1.1" 200 None
2026-03-29 11:37:17 [auto1.be] INFO: Scrape type for CU35051: 2
2026-03-29 11:37:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf76b278-56a0-5646-a2a7-de1723011ba0 with identifier: CU35051
2026-03-29 11:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf76b278-56a0-5646-a2a7-de1723011ba0 with scrape type 2
2026-03-29 11:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf76b278-56a0-5646-a2a7-de1723011ba0 with scrape type 2
2026-03-29 11:37:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cf76b278-56a0-5646-a2a7-de1723011ba0, identifier: CU35051
2026-03-29 11:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c with identifier: EY57880
2026-03-29 11:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c with identifier: EY57880
2026-03-29 11:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c with identifier: EY57880 to the API
2026-03-29 11:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:52:48Z',
 'fuel_type': 'petrol',
 'id': '70fd023c-9b5a-5ea9-b7b1-cf57b782fd5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY57880',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 95241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-13',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.0 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2022}
2026-03-29 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EY57880%27 HTTP/1.1" 200 None
2026-03-29 11:37:17 [auto1.be] INFO: Saving data for EY57880: {'auction_closing_time': 1774885968.0, 'created_time': 1774697747.628706, 'last_price_update_time': 1774784237.822709}
2026-03-29 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EY57880') HTTP/1.1" 204 0
2026-03-29 11:37:17 [auto1.be] INFO: Found listing with ID: PP72448
2026-03-29 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PP72448%27 HTTP/1.1" 200 None
2026-03-29 11:37:17 [auto1.be] INFO: Scrape type for PP72448: 2
2026-03-29 11:37:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c with identifier: PP72448
2026-03-29 11:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c with scrape type 2
2026-03-29 11:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c with scrape type 2
2026-03-29 11:37:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c, identifier: PP72448
2026-03-29 11:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cf76b278-56a0-5646-a2a7-de1723011ba0 with identifier: CU35051
2026-03-29 11:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cf76b278-56a0-5646-a2a7-de1723011ba0 with identifier: CU35051
2026-03-29 11:37:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cf76b278-56a0-5646-a2a7-de1723011ba0 with identifier: CU35051 to the API
2026-03-29 11:37:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:55:22Z',
 'fuel_type': 'diesel',
 'id': 'cf76b278-56a0-5646-a2a7-de1723011ba0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU35051',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 206651,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-01',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2013}
2026-03-29 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU35051%27 HTTP/1.1" 200 None
2026-03-29 11:37:18 [auto1.be] INFO: Saving data for CU35051: {'auction_closing_time': 1774886122.0, 'created_time': 1774697759.542206, 'last_price_update_time': 1774784238.18993}
2026-03-29 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CU35051') HTTP/1.1" 204 0
2026-03-29 11:37:18 [auto1.be] INFO: Found listing with ID: JZ80953
2026-03-29 11:37:18 [auto1.be] INFO: Found listing with ID: TL44110
2026-03-29 11:37:18 [auto1.be] INFO: Found listing with ID: ZN56944
2026-03-29 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN56944%27 HTTP/1.1" 200 None
2026-03-29 11:37:18 [auto1.be] INFO: Scrape type for ZN56944: 2
2026-03-29 11:37:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36cdb666-0057-5970-95f1-d0c19635898b with identifier: ZN56944
2026-03-29 11:37:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36cdb666-0057-5970-95f1-d0c19635898b with scrape type 2
2026-03-29 11:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36cdb666-0057-5970-95f1-d0c19635898b with scrape type 2
2026-03-29 11:37:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 36cdb666-0057-5970-95f1-d0c19635898b, identifier: ZN56944
2026-03-29 11:37:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c with identifier: PP72448
2026-03-29 11:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c with identifier: PP72448
2026-03-29 11:37:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c with identifier: PP72448 to the API
2026-03-29 11:37:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:35:20Z',
 'fuel_type': 'diesel',
 'id': 'a221f3b3-a3f5-5cb2-8a7e-79dd0f74ee1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP72448',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 79106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-01',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi EcoBlue Titanium AWD',
 'transmission': 'automatic',
 'trim': 'Titanium AWD',
 'year': 2019}
2026-03-29 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PP72448%27 HTTP/1.1" 200 None
2026-03-29 11:37:18 [auto1.be] INFO: Saving data for PP72448: {'auction_closing_time': 1774884920.0, 'created_time': 1774697787.941228, 'last_price_update_time': 1774784238.576343}
2026-03-29 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PP72448') HTTP/1.1" 204 0
2026-03-29 11:37:18 [auto1.be] INFO: Found listing with ID: JU94491
2026-03-29 11:37:18 [auto1.be] INFO: Found listing with ID: PK02246
2026-03-29 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK02246%27 HTTP/1.1" 200 None
2026-03-29 11:37:18 [auto1.be] INFO: Scrape type for PK02246: 2
2026-03-29 11:37:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03849ee2-b597-56b3-a949-37d7f86bb163 with identifier: PK02246
2026-03-29 11:37:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03849ee2-b597-56b3-a949-37d7f86bb163 with scrape type 2
2026-03-29 11:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03849ee2-b597-56b3-a949-37d7f86bb163 with scrape type 2
2026-03-29 11:37:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 03849ee2-b597-56b3-a949-37d7f86bb163, identifier: PK02246
2026-03-29 11:37:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 36cdb666-0057-5970-95f1-d0c19635898b with identifier: ZN56944
2026-03-29 11:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 36cdb666-0057-5970-95f1-d0c19635898b with identifier: ZN56944
2026-03-29 11:37:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 36cdb666-0057-5970-95f1-d0c19635898b with identifier: ZN56944 to the API
2026-03-29 11:37:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:07:11Z',
 'fuel_type': 'diesel',
 'id': '36cdb666-0057-5970-95f1-d0c19635898b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN56944',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 148676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2019}
2026-03-29 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN56944%27 HTTP/1.1" 200 None
2026-03-29 11:37:18 [auto1.be] INFO: Saving data for ZN56944: {'auction_closing_time': 1774883231.0, 'created_time': 1774697783.876837, 'last_price_update_time': 1774784238.992856}
2026-03-29 11:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZN56944') HTTP/1.1" 204 0
2026-03-29 11:37:19 [auto1.be] INFO: Found listing with ID: EV21741
2026-03-29 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV21741%27 HTTP/1.1" 200 None
2026-03-29 11:37:19 [auto1.be] INFO: Scrape type for EV21741: 2
2026-03-29 11:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b990d3ba-1fec-55d2-b815-9ecfdbfdbee4 with identifier: EV21741
2026-03-29 11:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b990d3ba-1fec-55d2-b815-9ecfdbfdbee4 with scrape type 2
2026-03-29 11:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b990d3ba-1fec-55d2-b815-9ecfdbfdbee4 with scrape type 2
2026-03-29 11:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b990d3ba-1fec-55d2-b815-9ecfdbfdbee4, identifier: EV21741
2026-03-29 11:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 03849ee2-b597-56b3-a949-37d7f86bb163 with identifier: PK02246
2026-03-29 11:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 03849ee2-b597-56b3-a949-37d7f86bb163 with identifier: PK02246
2026-03-29 11:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 03849ee2-b597-56b3-a949-37d7f86bb163 with identifier: PK02246 to the API
2026-03-29 11:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:09:42Z',
 'fuel_type': 'petrol',
 'id': '03849ee2-b597-56b3-a949-37d7f86bb163',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK02246',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 130656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-21',
 'seller_name': None,
 'title': 'Renault Clio 1.2 TCe Energy Limited',
 'transmission': 'automatic',
 'trim': 'Limited',
 'year': 2016}
2026-03-29 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK02246%27 HTTP/1.1" 200 None
2026-03-29 11:37:19 [auto1.be] INFO: Saving data for PK02246: {'auction_closing_time': 1774883382.0, 'created_time': 1774697746.98808, 'last_price_update_time': 1774784239.38189}
2026-03-29 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PK02246') HTTP/1.1" 204 0
2026-03-29 11:37:19 [auto1.be] INFO: Found listing with ID: FC31614
2026-03-29 11:37:19 [auto1.be] INFO: Found listing with ID: HX50025
2026-03-29 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX50025%27 HTTP/1.1" 200 None
2026-03-29 11:37:19 [auto1.be] INFO: Scrape type for HX50025: 2
2026-03-29 11:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e6c0b59-8a39-5bbd-b079-1bea41edcf14 with identifier: HX50025
2026-03-29 11:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e6c0b59-8a39-5bbd-b079-1bea41edcf14 with scrape type 2
2026-03-29 11:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e6c0b59-8a39-5bbd-b079-1bea41edcf14 with scrape type 2
2026-03-29 11:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2e6c0b59-8a39-5bbd-b079-1bea41edcf14, identifier: HX50025
2026-03-29 11:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b990d3ba-1fec-55d2-b815-9ecfdbfdbee4 with identifier: EV21741
2026-03-29 11:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b990d3ba-1fec-55d2-b815-9ecfdbfdbee4 with identifier: EV21741
2026-03-29 11:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b990d3ba-1fec-55d2-b815-9ecfdbfdbee4 with identifier: EV21741 to the API
2026-03-29 11:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:13:16Z',
 'fuel_type': 'petrol',
 'id': 'b990d3ba-1fec-55d2-b815-9ecfdbfdbee4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV21741',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 181063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-11',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2009}
2026-03-29 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV21741%27 HTTP/1.1" 200 None
2026-03-29 11:37:19 [auto1.be] INFO: Saving data for EV21741: {'auction_closing_time': 1774883596.0, 'created_time': 1774697796.088869, 'last_price_update_time': 1774784239.866246}
2026-03-29 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EV21741') HTTP/1.1" 204 0
2026-03-29 11:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2e6c0b59-8a39-5bbd-b079-1bea41edcf14 with identifier: HX50025
2026-03-29 11:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2e6c0b59-8a39-5bbd-b079-1bea41edcf14 with identifier: HX50025
2026-03-29 11:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2e6c0b59-8a39-5bbd-b079-1bea41edcf14 with identifier: HX50025 to the API
2026-03-29 11:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:17:27Z',
 'fuel_type': 'diesel',
 'id': '2e6c0b59-8a39-5bbd-b079-1bea41edcf14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX50025',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 144487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-19',
 'seller_name': None,
 'title': 'Toyota Auris 1.4 Turbodiesel Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2010}
2026-03-29 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX50025%27 HTTP/1.1" 200 None
2026-03-29 11:37:20 [auto1.be] INFO: Saving data for HX50025: {'auction_closing_time': 1774883847.0, 'created_time': 1774697787.47083, 'last_price_update_time': 1774784240.136669}
2026-03-29 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HX50025') HTTP/1.1" 204 0
2026-03-29 11:37:20 [auto1.be] INFO: Found listing with ID: RF01360
2026-03-29 11:37:20 [auto1.be] INFO: Found listing with ID: UU14069
2026-03-29 11:37:20 [auto1.be] INFO: Found listing with ID: BZ95673
2026-03-29 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ95673%27 HTTP/1.1" 200 None
2026-03-29 11:37:20 [auto1.be] INFO: Scrape type for BZ95673: 2
2026-03-29 11:37:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 010df3b2-67e1-515a-9167-f86a53c05da9 with identifier: BZ95673
2026-03-29 11:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 010df3b2-67e1-515a-9167-f86a53c05da9 with scrape type 2
2026-03-29 11:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 010df3b2-67e1-515a-9167-f86a53c05da9 with scrape type 2
2026-03-29 11:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 010df3b2-67e1-515a-9167-f86a53c05da9, identifier: BZ95673
2026-03-29 11:37:20 [auto1.be] INFO: Found listing with ID: DH53723
2026-03-29 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH53723%27 HTTP/1.1" 200 None
2026-03-29 11:37:20 [auto1.be] INFO: Scrape type for DH53723: 2
2026-03-29 11:37:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b20f0804-3982-5a38-b306-11f616ad2e80 with identifier: DH53723
2026-03-29 11:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b20f0804-3982-5a38-b306-11f616ad2e80 with scrape type 2
2026-03-29 11:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b20f0804-3982-5a38-b306-11f616ad2e80 with scrape type 2
2026-03-29 11:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b20f0804-3982-5a38-b306-11f616ad2e80, identifier: DH53723
2026-03-29 11:37:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 010df3b2-67e1-515a-9167-f86a53c05da9 with identifier: BZ95673
2026-03-29 11:37:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 010df3b2-67e1-515a-9167-f86a53c05da9 with identifier: BZ95673
2026-03-29 11:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 010df3b2-67e1-515a-9167-f86a53c05da9 with identifier: BZ95673 to the API
2026-03-29 11:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:47:47Z',
 'fuel_type': 'diesel',
 'id': '010df3b2-67e1-515a-9167-f86a53c05da9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ95673',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 168075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-22',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-29 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ95673%27 HTTP/1.1" 200 None
2026-03-29 11:37:20 [auto1.be] INFO: Saving data for BZ95673: {'auction_closing_time': 1774885667.0, 'created_time': 1774697797.474401, 'last_price_update_time': 1774784240.982825}
2026-03-29 11:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BZ95673') HTTP/1.1" 204 0
2026-03-29 11:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b20f0804-3982-5a38-b306-11f616ad2e80 with identifier: DH53723
2026-03-29 11:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b20f0804-3982-5a38-b306-11f616ad2e80 with identifier: DH53723
2026-03-29 11:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b20f0804-3982-5a38-b306-11f616ad2e80 with identifier: DH53723 to the API
2026-03-29 11:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:08:30Z',
 'fuel_type': 'diesel',
 'id': 'b20f0804-3982-5a38-b306-11f616ad2e80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH53723',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 129982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-19',
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Allure L1',
 'transmission': 'manual',
 'trim': 'Allure L1',
 'year': 2019}
2026-03-29 11:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH53723%27 HTTP/1.1" 200 None
2026-03-29 11:37:21 [auto1.be] INFO: Saving data for DH53723: {'auction_closing_time': 1774883310.0, 'created_time': 1774697776.373988, 'last_price_update_time': 1774784241.253139}
2026-03-29 11:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DH53723') HTTP/1.1" 204 0
2026-03-29 11:37:21 [auto1.be] INFO: Found listing with ID: AG16412
2026-03-29 11:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG16412%27 HTTP/1.1" 200 None
2026-03-29 11:37:21 [auto1.be] INFO: Scrape type for AG16412: 2
2026-03-29 11:37:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cc086b2-0d65-5036-b3a0-c7e36427d08b with identifier: AG16412
2026-03-29 11:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cc086b2-0d65-5036-b3a0-c7e36427d08b with scrape type 2
2026-03-29 11:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2cc086b2-0d65-5036-b3a0-c7e36427d08b with scrape type 2
2026-03-29 11:37:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2cc086b2-0d65-5036-b3a0-c7e36427d08b, identifier: AG16412
2026-03-29 11:37:21 [auto1.be] INFO: Found listing with ID: CU06988
2026-03-29 11:37:21 [auto1.be] INFO: Found listing with ID: RD62823
2026-03-29 11:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD62823%27 HTTP/1.1" 200 None
2026-03-29 11:37:21 [auto1.be] INFO: Scrape type for RD62823: 2
2026-03-29 11:37:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d409237-307b-5e19-8cb0-ecf6fed7aa3b with identifier: RD62823
2026-03-29 11:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d409237-307b-5e19-8cb0-ecf6fed7aa3b with scrape type 2
2026-03-29 11:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d409237-307b-5e19-8cb0-ecf6fed7aa3b with scrape type 2
2026-03-29 11:37:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0d409237-307b-5e19-8cb0-ecf6fed7aa3b, identifier: RD62823
2026-03-29 11:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2cc086b2-0d65-5036-b3a0-c7e36427d08b with identifier: AG16412
2026-03-29 11:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2cc086b2-0d65-5036-b3a0-c7e36427d08b with identifier: AG16412
2026-03-29 11:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2cc086b2-0d65-5036-b3a0-c7e36427d08b with identifier: AG16412 to the API
2026-03-29 11:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:27:02Z',
 'fuel_type': 'petrol',
 'id': '2cc086b2-0d65-5036-b3a0-c7e36427d08b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG16412',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 118041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-30',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI ACT Ambiente ultra',
 'transmission': 'automatic',
 'trim': 'Ambiente ultra',
 'year': 2014}
2026-03-29 11:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG16412%27 HTTP/1.1" 200 None
2026-03-29 11:37:21 [auto1.be] INFO: Saving data for AG16412: {'auction_closing_time': 1774884422.0, 'created_time': 1774697802.152202, 'last_price_update_time': 1774784241.730958}
2026-03-29 11:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AG16412') HTTP/1.1" 204 0
2026-03-29 11:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0d409237-307b-5e19-8cb0-ecf6fed7aa3b with identifier: RD62823
2026-03-29 11:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0d409237-307b-5e19-8cb0-ecf6fed7aa3b with identifier: RD62823
2026-03-29 11:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0d409237-307b-5e19-8cb0-ecf6fed7aa3b with identifier: RD62823 to the API
2026-03-29 11:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:28:11Z',
 'fuel_type': 'petrol',
 'id': '0d409237-307b-5e19-8cb0-ecf6fed7aa3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD62823',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 137580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-20',
 'seller_name': None,
 'title': 'Renault Scenic 1.6 Latitude',
 'transmission': 'manual',
 'trim': 'Latitude',
 'year': 2008}
2026-03-29 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD62823%27 HTTP/1.1" 200 None
2026-03-29 11:37:22 [auto1.be] INFO: Saving data for RD62823: {'auction_closing_time': 1774884491.0, 'created_time': 1773384047.537483, 'last_price_update_time': 1774784242.021}
2026-03-29 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RD62823') HTTP/1.1" 204 0
2026-03-29 11:37:22 [auto1.be] INFO: Found listing with ID: TM16327
2026-03-29 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM16327%27 HTTP/1.1" 200 None
2026-03-29 11:37:22 [auto1.be] INFO: Scrape type for TM16327: 2
2026-03-29 11:37:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3049ee2d-7293-504a-9175-7f72795d5e40 with identifier: TM16327
2026-03-29 11:37:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3049ee2d-7293-504a-9175-7f72795d5e40 with scrape type 2
2026-03-29 11:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3049ee2d-7293-504a-9175-7f72795d5e40 with scrape type 2
2026-03-29 11:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3049ee2d-7293-504a-9175-7f72795d5e40, identifier: TM16327
2026-03-29 11:37:22 [auto1.be] INFO: Found listing with ID: KH04328
2026-03-29 11:37:22 [auto1.be] INFO: Found listing with ID: GN32494
2026-03-29 11:37:22 [auto1.be] INFO: Found listing with ID: ZG72967
2026-03-29 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG72967%27 HTTP/1.1" 200 None
2026-03-29 11:37:22 [auto1.be] INFO: Scrape type for ZG72967: 2
2026-03-29 11:37:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6255b3bf-184a-5247-9765-2476d5bb33fc with identifier: ZG72967
2026-03-29 11:37:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6255b3bf-184a-5247-9765-2476d5bb33fc with scrape type 2
2026-03-29 11:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6255b3bf-184a-5247-9765-2476d5bb33fc with scrape type 2
2026-03-29 11:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6255b3bf-184a-5247-9765-2476d5bb33fc, identifier: ZG72967
2026-03-29 11:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3049ee2d-7293-504a-9175-7f72795d5e40 with identifier: TM16327
2026-03-29 11:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3049ee2d-7293-504a-9175-7f72795d5e40 with identifier: TM16327
2026-03-29 11:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3049ee2d-7293-504a-9175-7f72795d5e40 with identifier: TM16327 to the API
2026-03-29 11:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:26:05Z',
 'fuel_type': 'diesel',
 'id': '3049ee2d-7293-504a-9175-7f72795d5e40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM16327',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 224368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-06',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-03-29 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM16327%27 HTTP/1.1" 200 None
2026-03-29 11:37:22 [auto1.be] INFO: Saving data for TM16327: {'auction_closing_time': 1774884365.0, 'created_time': 1774697770.682946, 'last_price_update_time': 1774784242.516198}
2026-03-29 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TM16327') HTTP/1.1" 204 0
2026-03-29 11:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6255b3bf-184a-5247-9765-2476d5bb33fc with identifier: ZG72967
2026-03-29 11:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 11:37:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-29 11:37:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 11:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 11:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6255b3bf-184a-5247-9765-2476d5bb33fc with identifier: ZG72967
2026-03-29 11:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6255b3bf-184a-5247-9765-2476d5bb33fc with identifier: ZG72967 to the API
2026-03-29 11:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:05:07Z',
 'fuel_type': 'petrol',
 'id': '6255b3bf-184a-5247-9765-2476d5bb33fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG72967',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Fiorino',
 'odometer': 69929,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-06',
 'seller_name': None,
 'title': 'Fiat Fiorino 1.4 SX Kasten',
 'transmission': 'manual',
 'trim': 'SX Kasten',
 'year': 2010}
2026-03-29 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG72967%27 HTTP/1.1" 200 None
2026-03-29 11:37:23 [auto1.be] INFO: Saving data for ZG72967: {'auction_closing_time': 1774883107.0, 'created_time': 1774697798.380371, 'last_price_update_time': 1774784243.055691}
2026-03-29 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZG72967') HTTP/1.1" 204 0
2026-03-29 11:37:23 [auto1.be] INFO: Found listing with ID: UC18604
2026-03-29 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC18604%27 HTTP/1.1" 200 None
2026-03-29 11:37:23 [auto1.be] INFO: Scrape type for UC18604: 2
2026-03-29 11:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b173c489-7538-5260-a6f8-21e29901460c with identifier: UC18604
2026-03-29 11:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b173c489-7538-5260-a6f8-21e29901460c with scrape type 2
2026-03-29 11:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b173c489-7538-5260-a6f8-21e29901460c with scrape type 2
2026-03-29 11:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b173c489-7538-5260-a6f8-21e29901460c, identifier: UC18604
2026-03-29 11:37:23 [auto1.be] INFO: Found listing with ID: LA84805
2026-03-29 11:37:23 [auto1.be] INFO: Found listing with ID: UH00217
2026-03-29 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UH00217%27 HTTP/1.1" 200 None
2026-03-29 11:37:23 [auto1.be] INFO: Scrape type for UH00217: 2
2026-03-29 11:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad0aba6a-691f-5c26-962e-c15486b0fbab with identifier: UH00217
2026-03-29 11:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad0aba6a-691f-5c26-962e-c15486b0fbab with scrape type 2
2026-03-29 11:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad0aba6a-691f-5c26-962e-c15486b0fbab with scrape type 2
2026-03-29 11:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ad0aba6a-691f-5c26-962e-c15486b0fbab, identifier: UH00217
2026-03-29 11:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b173c489-7538-5260-a6f8-21e29901460c with identifier: UC18604
2026-03-29 11:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b173c489-7538-5260-a6f8-21e29901460c with identifier: UC18604
2026-03-29 11:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b173c489-7538-5260-a6f8-21e29901460c with identifier: UC18604 to the API
2026-03-29 11:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 128,
 'expiration_date': '2026-03-30T15:11:24Z',
 'fuel_type': 'diesel',
 'id': 'b173c489-7538-5260-a6f8-21e29901460c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC18604',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 108276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-15',
 'seller_name': None,
 'title': 'Citroen Jumpy 2.0 HDi L2H1 29 Kasten',
 'transmission': 'manual',
 'trim': 'L2H1 29 Kasten',
 'year': 2014}
2026-03-29 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC18604%27 HTTP/1.1" 200 None
2026-03-29 11:37:23 [auto1.be] INFO: Saving data for UC18604: {'auction_closing_time': 1774883484.0, 'created_time': 1774697788.703516, 'last_price_update_time': 1774784243.57982}
2026-03-29 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UC18604') HTTP/1.1" 204 0
2026-03-29 11:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ad0aba6a-691f-5c26-962e-c15486b0fbab with identifier: UH00217
2026-03-29 11:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ad0aba6a-691f-5c26-962e-c15486b0fbab with identifier: UH00217
2026-03-29 11:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ad0aba6a-691f-5c26-962e-c15486b0fbab with identifier: UH00217 to the API
2026-03-29 11:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:38:02Z',
 'fuel_type': 'diesel',
 'id': 'ad0aba6a-691f-5c26-962e-c15486b0fbab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH00217',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Lancer',
 'odometer': 263712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-07',
 'seller_name': None,
 'title': 'Mitsubishi Lancer 1.8 DI-D ClearTec EDITION',
 'transmission': 'manual',
 'trim': 'ClearTec EDITION',
 'year': 2012}
2026-03-29 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UH00217%27 HTTP/1.1" 200 None
2026-03-29 11:37:23 [auto1.be] INFO: Saving data for UH00217: {'auction_closing_time': 1774885082.0, 'created_time': 1774697800.667137, 'last_price_update_time': 1774784243.85556}
2026-03-29 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UH00217') HTTP/1.1" 204 0
2026-03-29 11:37:23 [auto1.be] INFO: Found listing with ID: TF70513
2026-03-29 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF70513%27 HTTP/1.1" 200 None
2026-03-29 11:37:23 [auto1.be] INFO: Scrape type for TF70513: 0
2026-03-29 11:37:23 [auto1.be] INFO: Found listing with ID: ZD95004
2026-03-29 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZD95004%27 HTTP/1.1" 200 None
2026-03-29 11:37:23 [auto1.be] INFO: Scrape type for ZD95004: 0
2026-03-29 11:37:23 [auto1.be] INFO: Found listing with ID: ES25967
2026-03-29 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES25967%27 HTTP/1.1" 200 None
2026-03-29 11:37:23 [auto1.be] INFO: Scrape type for ES25967: 0
2026-03-29 11:37:23 [auto1.be] INFO: Found listing with ID: PC01829
2026-03-29 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC01829%27 HTTP/1.1" 200 None
2026-03-29 11:37:23 [auto1.be] INFO: Scrape type for PC01829: 0
2026-03-29 11:37:23 [auto1.be] INFO: Found listing with ID: RW32127
2026-03-29 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW32127%27 HTTP/1.1" 200 None
2026-03-29 11:37:23 [auto1.be] INFO: Scrape type for RW32127: 0
2026-03-29 11:37:23 [auto1.be] INFO: Found listing with ID: CE27208
2026-03-29 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE27208%27 HTTP/1.1" 200 None
2026-03-29 11:37:23 [auto1.be] INFO: Scrape type for CE27208: 0
2026-03-29 11:37:23 [auto1.be] INFO: Found listing with ID: XG78459
2026-03-29 11:37:23 [auto1.be] INFO: Found listing with ID: CG81228
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG81228%27 HTTP/1.1" 200 None
2026-03-29 11:37:24 [auto1.be] INFO: Scrape type for CG81228: 0
2026-03-29 11:37:24 [auto1.be] INFO: Found listing with ID: RC25321
2026-03-29 11:37:24 [auto1.be] INFO: Found listing with ID: YZ86935
2026-03-29 11:37:24 [auto1.be] INFO: Found listing with ID: XB72565
2026-03-29 11:37:24 [auto1.be] INFO: Found listing with ID: WN54122
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN54122%27 HTTP/1.1" 200 None
2026-03-29 11:37:24 [auto1.be] INFO: Scrape type for WN54122: 0
2026-03-29 11:37:24 [auto1.be] INFO: Found listing with ID: WM28184
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM28184%27 HTTP/1.1" 200 None
2026-03-29 11:37:24 [auto1.be] INFO: Scrape type for WM28184: 0
2026-03-29 11:37:24 [auto1.be] INFO: Found listing with ID: UA48921
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA48921%27 HTTP/1.1" 200 None
2026-03-29 11:37:24 [auto1.be] INFO: Scrape type for UA48921: 0
2026-03-29 11:37:24 [auto1.be] INFO: Found listing with ID: PV46198
2026-03-29 11:37:24 [auto1.be] INFO: Found listing with ID: LE69336
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE69336%27 HTTP/1.1" 200 None
2026-03-29 11:37:24 [auto1.be] INFO: Scrape type for LE69336: 0
2026-03-29 11:37:24 [auto1.be] INFO: Found listing with ID: RY49845
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY49845%27 HTTP/1.1" 200 None
2026-03-29 11:37:24 [auto1.be] INFO: Scrape type for RY49845: 0
2026-03-29 11:37:24 [auto1.be] INFO: Found listing with ID: ZT87936
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZT87936%27 HTTP/1.1" 200 None
2026-03-29 11:37:24 [auto1.be] INFO: Scrape type for ZT87936: 0
2026-03-29 11:37:24 [auto1.be] INFO: Found listing with ID: VZ26828
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ26828%27 HTTP/1.1" 200 None
2026-03-29 11:37:24 [auto1.be] INFO: Scrape type for VZ26828: 0
2026-03-29 11:37:24 [auto1.be] INFO: Found listing with ID: RU30240
2026-03-29 11:37:24 [auto1.be] INFO: Found listing with ID: KR16689
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KR16689%27 HTTP/1.1" 200 None
2026-03-29 11:37:24 [auto1.be] INFO: Scrape type for KR16689: 0
2026-03-29 11:37:24 [auto1.be] INFO: Found listing with ID: YV20290
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV20290%27 HTTP/1.1" 200 None
2026-03-29 11:37:24 [auto1.be] INFO: Scrape type for YV20290: 0
2026-03-29 11:37:24 [auto1.be] INFO: Found listing with ID: XX22473
2026-03-29 11:37:24 [auto1.be] INFO: Found listing with ID: LK52725
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK52725%27 HTTP/1.1" 200 None
2026-03-29 11:37:24 [auto1.be] INFO: Scrape type for LK52725: 0
2026-03-29 11:37:24 [auto1.be] INFO: Found listing with ID: TS84713
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS84713%27 HTTP/1.1" 200 None
2026-03-29 11:37:24 [auto1.be] INFO: Scrape type for TS84713: 0
2026-03-29 11:37:24 [auto1.be] INFO: Found listing with ID: HY97997
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY97997%27 HTTP/1.1" 200 None
2026-03-29 11:37:24 [auto1.be] INFO: Scrape type for HY97997: 0
2026-03-29 11:37:24 [auto1.be] INFO: Found listing with ID: YA99172
2026-03-29 11:37:24 [auto1.be] INFO: Found listing with ID: PD03709
2026-03-29 11:37:24 [auto1.be] INFO: Found listing with ID: ZU52155
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU52155%27 HTTP/1.1" 200 None
2026-03-29 11:37:24 [auto1.be] INFO: Scrape type for ZU52155: 0
2026-03-29 11:37:24 [auto1.be] INFO: Found listing with ID: RX31058
2026-03-29 11:37:24 [auto1.be] INFO: Found listing with ID: BB55914
2026-03-29 11:37:24 [auto1.be] INFO: Found listing with ID: JY01361
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY01361%27 HTTP/1.1" 200 None
2026-03-29 11:37:24 [auto1.be] INFO: Scrape type for JY01361: 2
2026-03-29 11:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8275dd1c-4360-5681-bf44-7a58ec55484a with identifier: JY01361
2026-03-29 11:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8275dd1c-4360-5681-bf44-7a58ec55484a with scrape type 2
2026-03-29 11:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8275dd1c-4360-5681-bf44-7a58ec55484a with scrape type 2
2026-03-29 11:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8275dd1c-4360-5681-bf44-7a58ec55484a, identifier: JY01361
2026-03-29 11:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8275dd1c-4360-5681-bf44-7a58ec55484a with identifier: JY01361
2026-03-29 11:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8275dd1c-4360-5681-bf44-7a58ec55484a with identifier: JY01361
2026-03-29 11:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8275dd1c-4360-5681-bf44-7a58ec55484a with identifier: JY01361 to the API
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:07:32Z',
 'fuel_type': 'diesel',
 'id': '8275dd1c-4360-5681-bf44-7a58ec55484a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY01361',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 136779,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-17',
 'seller_name': None,
 'title': 'MINI Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY01361%27 HTTP/1.1" 200 None
2026-03-29 11:37:24 [auto1.be] INFO: Saving data for JY01361: {'auction_closing_time': 1774883252.0, 'created_time': 1774697781.569314, 'last_price_update_time': 1774784244.681848}
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JY01361') HTTP/1.1" 204 0
2026-03-29 11:37:24 [auto1.be] INFO: Found listing with ID: EU75132
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EU75132%27 HTTP/1.1" 200 None
2026-03-29 11:37:24 [auto1.be] INFO: Scrape type for EU75132: 2
2026-03-29 11:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 866a5601-cd8e-5d41-9c03-ee135e528231 with identifier: EU75132
2026-03-29 11:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 866a5601-cd8e-5d41-9c03-ee135e528231 with scrape type 2
2026-03-29 11:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 866a5601-cd8e-5d41-9c03-ee135e528231 with scrape type 2
2026-03-29 11:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 866a5601-cd8e-5d41-9c03-ee135e528231, identifier: EU75132
2026-03-29 11:37:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 866a5601-cd8e-5d41-9c03-ee135e528231 with identifier: EU75132
2026-03-29 11:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 866a5601-cd8e-5d41-9c03-ee135e528231 with identifier: EU75132
2026-03-29 11:37:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 866a5601-cd8e-5d41-9c03-ee135e528231 with identifier: EU75132 to the API
2026-03-29 11:37:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:40:06Z',
 'fuel_type': 'diesel',
 'id': '866a5601-cd8e-5d41-9c03-ee135e528231',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU75132',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 199855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-01',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2015}
2026-03-29 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EU75132%27 HTTP/1.1" 200 None
2026-03-29 11:37:25 [auto1.be] INFO: Saving data for EU75132: {'auction_closing_time': 1774885206.0, 'created_time': 1774697773.307018, 'last_price_update_time': 1774784245.192885}
2026-03-29 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EU75132') HTTP/1.1" 204 0
2026-03-29 11:37:25 [auto1.be] INFO: Found listing with ID: KC67497
2026-03-29 11:37:25 [auto1.be] INFO: Found listing with ID: FK09845
2026-03-29 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK09845%27 HTTP/1.1" 200 None
2026-03-29 11:37:25 [auto1.be] INFO: Scrape type for FK09845: 2
2026-03-29 11:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c70a5763-970e-5a4e-bb73-d1ba5c51d2d6 with identifier: FK09845
2026-03-29 11:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c70a5763-970e-5a4e-bb73-d1ba5c51d2d6 with scrape type 2
2026-03-29 11:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c70a5763-970e-5a4e-bb73-d1ba5c51d2d6 with scrape type 2
2026-03-29 11:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c70a5763-970e-5a4e-bb73-d1ba5c51d2d6, identifier: FK09845
2026-03-29 11:37:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c70a5763-970e-5a4e-bb73-d1ba5c51d2d6 with identifier: FK09845
2026-03-29 11:37:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c70a5763-970e-5a4e-bb73-d1ba5c51d2d6 with identifier: FK09845
2026-03-29 11:37:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c70a5763-970e-5a4e-bb73-d1ba5c51d2d6 with identifier: FK09845 to the API
2026-03-29 11:37:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:35:45Z',
 'fuel_type': 'petrol',
 'id': 'c70a5763-970e-5a4e-bb73-d1ba5c51d2d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK09845',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 135564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-08',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2014}
2026-03-29 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK09845%27 HTTP/1.1" 200 None
2026-03-29 11:37:25 [auto1.be] INFO: Saving data for FK09845: {'auction_closing_time': 1774884945.0, 'created_time': 1774697781.210376, 'last_price_update_time': 1774784245.597474}
2026-03-29 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FK09845') HTTP/1.1" 204 0
2026-03-29 11:37:25 [auto1.be] INFO: Found listing with ID: EB31921
2026-03-29 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB31921%27 HTTP/1.1" 200 None
2026-03-29 11:37:25 [auto1.be] INFO: Scrape type for EB31921: 2
2026-03-29 11:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b70a8686-eefe-5e47-99ce-6b9a88db00f5 with identifier: EB31921
2026-03-29 11:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b70a8686-eefe-5e47-99ce-6b9a88db00f5 with scrape type 2
2026-03-29 11:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b70a8686-eefe-5e47-99ce-6b9a88db00f5 with scrape type 2
2026-03-29 11:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b70a8686-eefe-5e47-99ce-6b9a88db00f5, identifier: EB31921
2026-03-29 11:37:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b70a8686-eefe-5e47-99ce-6b9a88db00f5 with identifier: EB31921
2026-03-29 11:37:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b70a8686-eefe-5e47-99ce-6b9a88db00f5 with identifier: EB31921
2026-03-29 11:37:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b70a8686-eefe-5e47-99ce-6b9a88db00f5 with identifier: EB31921 to the API
2026-03-29 11:37:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:13:52Z',
 'fuel_type': 'diesel',
 'id': 'b70a8686-eefe-5e47-99ce-6b9a88db00f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB31921',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 224762,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-25',
 'seller_name': None,
 'title': 'Hyundai i20 1.4 CRDi Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2012}
2026-03-29 11:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB31921%27 HTTP/1.1" 200 None
2026-03-29 11:37:26 [auto1.be] INFO: Saving data for EB31921: {'auction_closing_time': 1774883632.0, 'created_time': 1774697782.226079, 'last_price_update_time': 1774784246.030859}
2026-03-29 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EB31921') HTTP/1.1" 204 0
2026-03-29 11:37:26 [auto1.be] INFO: Channel: 24h | Page: 32 | totalHits: 1256 | hits on page: 16
2026-03-29 11:37:26 [auto1.be] INFO: Found listing with ID: DJ63605
2026-03-29 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ63605%27 HTTP/1.1" 200 None
2026-03-29 11:37:26 [auto1.be] INFO: Scrape type for DJ63605: 2
2026-03-29 11:37:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c91f71ac-999d-54f8-b90c-1b6fcb4c8f40 with identifier: DJ63605
2026-03-29 11:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c91f71ac-999d-54f8-b90c-1b6fcb4c8f40 with scrape type 2
2026-03-29 11:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c91f71ac-999d-54f8-b90c-1b6fcb4c8f40 with scrape type 2
2026-03-29 11:37:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c91f71ac-999d-54f8-b90c-1b6fcb4c8f40, identifier: DJ63605
2026-03-29 11:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c91f71ac-999d-54f8-b90c-1b6fcb4c8f40 with identifier: DJ63605
2026-03-29 11:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c91f71ac-999d-54f8-b90c-1b6fcb4c8f40 with identifier: DJ63605
2026-03-29 11:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c91f71ac-999d-54f8-b90c-1b6fcb4c8f40 with identifier: DJ63605 to the API
2026-03-29 11:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:08:01Z',
 'fuel_type': 'petrol',
 'id': 'c91f71ac-999d-54f8-b90c-1b6fcb4c8f40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ63605',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 107256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-11',
 'seller_name': None,
 'title': 'Fiat Tipo 1.4 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2017}
2026-03-29 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ63605%27 HTTP/1.1" 200 None
2026-03-29 11:37:26 [auto1.be] INFO: Saving data for DJ63605: {'auction_closing_time': 1774883281.0, 'created_time': 1774697787.104539, 'last_price_update_time': 1774784246.409026}
2026-03-29 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DJ63605') HTTP/1.1" 204 0
2026-03-29 11:37:26 [auto1.be] INFO: Found listing with ID: HJ47401
2026-03-29 11:37:26 [auto1.be] INFO: Found listing with ID: FY94559
2026-03-29 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY94559%27 HTTP/1.1" 200 None
2026-03-29 11:37:26 [auto1.be] INFO: Scrape type for FY94559: 0
2026-03-29 11:37:26 [auto1.be] INFO: Found listing with ID: WY04920
2026-03-29 11:37:26 [auto1.be] INFO: Found listing with ID: PG64643
2026-03-29 11:37:26 [auto1.be] INFO: Found listing with ID: GF35922
2026-03-29 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF35922%27 HTTP/1.1" 200 None
2026-03-29 11:37:26 [auto1.be] INFO: Scrape type for GF35922: 2
2026-03-29 11:37:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cba50ece-3db1-5e5e-bc62-65ab11f30ab1 with identifier: GF35922
2026-03-29 11:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cba50ece-3db1-5e5e-bc62-65ab11f30ab1 with scrape type 2
2026-03-29 11:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cba50ece-3db1-5e5e-bc62-65ab11f30ab1 with scrape type 2
2026-03-29 11:37:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cba50ece-3db1-5e5e-bc62-65ab11f30ab1, identifier: GF35922
2026-03-29 11:37:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 11:37:26 [auto1.be] INFO: Found listing with ID: US61346
2026-03-29 11:37:26 [auto1.be] INFO: Found listing with ID: SY12350
2026-03-29 11:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cba50ece-3db1-5e5e-bc62-65ab11f30ab1 with identifier: GF35922
2026-03-29 11:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cba50ece-3db1-5e5e-bc62-65ab11f30ab1 with identifier: GF35922
2026-03-29 11:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cba50ece-3db1-5e5e-bc62-65ab11f30ab1 with identifier: GF35922 to the API
2026-03-29 11:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 11:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 11:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:15:00Z',
 'fuel_type': 'diesel',
 'id': 'cba50ece-3db1-5e5e-bc62-65ab11f30ab1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF35922',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 124830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'BE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-19',
 'seller_name': None,
 'title': 'Ford Mondeo 1.5 TDCi Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2017}
2026-03-29 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF35922%27 HTTP/1.1" 200 None
2026-03-29 11:37:26 [auto1.be] INFO: Saving data for GF35922: {'auction_closing_time': 1774883700.0, 'created_time': 1774006547.455712, 'last_price_update_time': 1774784246.85365}
2026-03-29 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GF35922') HTTP/1.1" 204 0
2026-03-29 11:37:26 [auto1.be] INFO: Found listing with ID: BR73229
2026-03-29 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR73229%27 HTTP/1.1" 200 None
2026-03-29 11:37:26 [auto1.be] INFO: Scrape type for BR73229: 0
2026-03-29 11:37:26 [auto1.be] INFO: Found listing with ID: PV20794
2026-03-29 11:37:26 [auto1.be] INFO: Found listing with ID: BB63081
2026-03-29 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB63081%27 HTTP/1.1" 200 None
2026-03-29 11:37:26 [auto1.be] INFO: Scrape type for BB63081: 0
2026-03-29 11:37:26 [auto1.be] INFO: Found listing with ID: SD89253
2026-03-29 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD89253%27 HTTP/1.1" 200 None
2026-03-29 11:37:27 [auto1.be] INFO: Scrape type for SD89253: 0
2026-03-29 11:37:27 [auto1.be] INFO: Found listing with ID: SJ57770
2026-03-29 11:37:27 [auto1.be] INFO: Found listing with ID: XR93319
2026-03-29 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR93319%27 HTTP/1.1" 200 None
2026-03-29 11:37:27 [auto1.be] INFO: Scrape type for XR93319: 0
2026-03-29 11:37:27 [auto1.be] INFO: Found listing with ID: AB98915
2026-03-29 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB98915%27 HTTP/1.1" 200 None
2026-03-29 11:37:27 [auto1.be] INFO: Scrape type for AB98915: 0
2026-03-29 11:37:27 [auto1.be] INFO: Found listing with ID: AB83336
2026-03-29 11:37:27 [auto1.be] INFO: Found listing with ID: MR34349
2026-03-29 11:37:27 [auto1.be] INFO: Found listing with ID: XL09418
2026-03-29 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 11:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL09418%27 HTTP/1.1" 200 None
2026-03-29 11:37:27 [auto1.be] INFO: Scrape type for XL09418: 0
2026-03-29 11:37:27 [auto1.be] INFO: Found listing with ID: UW48636
2026-03-29 11:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 11:37:28 [auto1.be] INFO: Channel: 24h | Page: 33 | totalHits: 1256 | hits on page: 0
2026-03-29 11:37:28 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-29 11:37:28 [auto1.be] INFO: auto1.be Batch config: batch 2/2
2026-03-29 11:37:28 [auto1.be] INFO: auto1.be Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 6, <ScrapeType.BATCH_SKIPPED: 5>: 5}
2026-03-29 11:37:28 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (80 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.be/task_26_2026-03-29T11_35_00.jl
2026-03-29 11:37:28 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 102297,
 'downloader/request_count': 37,
 'downloader/request_method_count/GET': 2,
 'downloader/request_method_count/POST': 35,
 'downloader/response_bytes': 5917688,
 'downloader/response_count': 37,
 'downloader/response_status_count/200': 37,
 'elapsed_time_seconds': 141.653807,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 29, 11, 37, 28, 204120, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 80,
 'log_count/DEBUG': 1961,
 'log_count/INFO': 2668,
 'memusage/max': 166080512,
 'memusage/startup': 150183936,
 'request_depth_max': 36,
 'response_received_count': 37,
 'scheduler/dequeued': 37,
 'scheduler/dequeued/memory': 37,
 'scheduler/enqueued': 37,
 'scheduler/enqueued/memory': 37,
 'scrape_type/batch_skipped': 659,
 'scrape_type/price_update': 80,
 'scrape_type/skipped': 557,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 37,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 2.7659240429465837,
 'scrapy-zyte-api/mean_response_seconds': 2.8983023931096126,
 'scrapy-zyte-api/processed': 37,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 37,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 36,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 37,
 'scrapy-zyte-api/request_args/httpRequestBody': 35,
 'scrapy-zyte-api/request_args/httpRequestMethod': 35,
 'scrapy-zyte-api/request_args/httpResponseBody': 37,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 37,
 'scrapy-zyte-api/request_args/sessionContext': 37,
 'scrapy-zyte-api/request_args/url': 37,
 'scrapy-zyte-api/status_codes/200': 37,
 'scrapy-zyte-api/success': 37,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 1296,
 'source/total_available': 1256,
 'start_time': datetime.datetime(2026, 3, 29, 11, 35, 6, 550313, tzinfo=datetime.timezone.utc)}
2026-03-29 11:37:28 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-29 11:37:28 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f37afa136d0>
2026-03-29 11:37:28 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f37af89e190>