2026-03-30 08:35:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 08:35:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 08:35:06 [auto1.be] INFO: Batch mode enabled: batch 2/2
2026-03-30 08:35:06 [auto1.be] INFO: Starting spider auto1.be
2026-03-30 08:35:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 08:35:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 08:35:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 08:35:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 08:35:06 [scrapy.extensions.telnet] INFO: Telnet Password: f167ab4caa4eedf8
2026-03-30 08:35:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-30 08:35:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.be/task_26_2026-03-30T08_35_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-30 08:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 08:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 08:35:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 08:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-30 08:35:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 08:35:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-30 08:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 08:35:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2106
2026-03-30 08:35:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 08:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 08:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-30 08:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-30 08:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-30 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-30 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-30 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-30 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-30 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-30 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-30 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-30 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-30 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-30 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-30 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-30 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-30 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-30 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-30 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-30 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-30 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-30 08:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-30 08:35:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-30 08:35:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-30 08:35:06 [scrapy.core.engine] INFO: Spider opened
2026-03-30 08:35:07 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 08:35:07 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-30 08:35:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 143MiB
2026-03-30 08:35:07 [scrapy-playwright] INFO: Starting download handler
2026-03-30 08:35:07 [scrapy-playwright] INFO: Starting download handler
2026-03-30 08:35:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): publicsuffix.org:443
2026-03-30 08:35:13 [urllib3.connectionpool] DEBUG: https://publicsuffix.org:443 "GET /list/public_suffix_list.dat HTTP/1.1" 200 87421
2026-03-30 08:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-30 08:35:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-30 08:35:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-30 08:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-30 08:35:27 [auto1.be] INFO: Channel: 24h | Page: 0 | totalHits: 1499 | hits on page: 40
2026-03-30 08:35:27 [auto1.be] INFO: Found listing with ID: YK50481
2026-03-30 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK50481%27 HTTP/1.1" 200 None
2026-03-30 08:35:27 [auto1.be] INFO: Scrape type for YK50481: 2
2026-03-30 08:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0efb10b-87fa-564d-8e69-25b9726a0808 with identifier: YK50481
2026-03-30 08:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0efb10b-87fa-564d-8e69-25b9726a0808 with scrape type 2
2026-03-30 08:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0efb10b-87fa-564d-8e69-25b9726a0808 with scrape type 2
2026-03-30 08:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d0efb10b-87fa-564d-8e69-25b9726a0808, identifier: YK50481
2026-03-30 08:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d0efb10b-87fa-564d-8e69-25b9726a0808 with identifier: YK50481
2026-03-30 08:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:35:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-30 08:35:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:35:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-30 08:35:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d0efb10b-87fa-564d-8e69-25b9726a0808 with identifier: YK50481
2026-03-30 08:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d0efb10b-87fa-564d-8e69-25b9726a0808 with identifier: YK50481 to the API
2026-03-30 08:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:15:35Z',
'fuel_type': 'petrol',
'id': 'd0efb10b-87fa-564d-8e69-25b9726a0808',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK50481',
'listing': 'auction',
'make': 'Renault',
'model': 'Kangoo',
'odometer': 109671,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-18',
'seller_name': None,
'title': 'Renault Kangoo 1.2 TCe Energy Limited',
'transmission': 'manual',
'trim': 'Limited',
'year': 2017}
2026-03-30 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK50481%27 HTTP/1.1" 200 None
2026-03-30 08:35:28 [auto1.be] INFO: Saving data for YK50481: {'auction_closing_time': 1774970135.0, 'created_time': 1774125513.432255, 'last_price_update_time': 1774859728.158704}
2026-03-30 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YK50481') HTTP/1.1" 204 0
2026-03-30 08:35:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:28 [auto1.be] INFO: Found listing with ID: TX71438
2026-03-30 08:35:28 [auto1.be] INFO: Found listing with ID: TG38013
2026-03-30 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TG38013%27 HTTP/1.1" 200 None
2026-03-30 08:35:28 [auto1.be] INFO: Scrape type for TG38013: 2
2026-03-30 08:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 647ee421-a5f0-5c7f-a72b-c2cf31b567a9 with identifier: TG38013
2026-03-30 08:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 647ee421-a5f0-5c7f-a72b-c2cf31b567a9 with scrape type 2
2026-03-30 08:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 647ee421-a5f0-5c7f-a72b-c2cf31b567a9 with scrape type 2
2026-03-30 08:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 647ee421-a5f0-5c7f-a72b-c2cf31b567a9, identifier: TG38013
2026-03-30 08:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 647ee421-a5f0-5c7f-a72b-c2cf31b567a9 with identifier: TG38013
2026-03-30 08:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:35:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-30 08:35:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:35:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-30 08:35:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 647ee421-a5f0-5c7f-a72b-c2cf31b567a9 with identifier: TG38013
2026-03-30 08:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 647ee421-a5f0-5c7f-a72b-c2cf31b567a9 with identifier: TG38013 to the API
2026-03-30 08:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-31T15:46:59Z',
'fuel_type': 'diesel',
'id': '647ee421-a5f0-5c7f-a72b-c2cf31b567a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG38013',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 101640,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-17',
'seller_name': None,
'title': 'BMW X3 xDrive 20d',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-03-30 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TG38013%27 HTTP/1.1" 200 None
2026-03-30 08:35:29 [auto1.be] INFO: Saving data for TG38013: {'auction_closing_time': 1774972019.0, 'created_time': 1773134273.882044, 'last_price_update_time': 1774859729.052379}
2026-03-30 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TG38013') HTTP/1.1" 204 0
2026-03-30 08:35:29 [auto1.be] INFO: Found listing with ID: VV61440
2026-03-30 08:35:29 [auto1.be] INFO: Found listing with ID: SX17712
2026-03-30 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX17712%27 HTTP/1.1" 200 None
2026-03-30 08:35:29 [auto1.be] INFO: Scrape type for SX17712: 1
2026-03-30 08:35:29 [auto1.be] INFO: Found listing with ID: CK64923
2026-03-30 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK64923%27 HTTP/1.1" 200 None
2026-03-30 08:35:29 [auto1.be] INFO: Scrape type for CK64923: 2
2026-03-30 08:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01bbcac9-be80-5f93-8a33-7618fc30eab6 with identifier: CK64923
2026-03-30 08:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01bbcac9-be80-5f93-8a33-7618fc30eab6 with scrape type 2
2026-03-30 08:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01bbcac9-be80-5f93-8a33-7618fc30eab6 with scrape type 2
2026-03-30 08:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 01bbcac9-be80-5f93-8a33-7618fc30eab6, identifier: CK64923
2026-03-30 08:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 01bbcac9-be80-5f93-8a33-7618fc30eab6 with identifier: CK64923
2026-03-30 08:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:35:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-30 08:35:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 01bbcac9-be80-5f93-8a33-7618fc30eab6 with identifier: CK64923
2026-03-30 08:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 01bbcac9-be80-5f93-8a33-7618fc30eab6 with identifier: CK64923 to the API
2026-03-30 08:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 218,
'expiration_date': '2026-03-31T15:46:24Z',
'fuel_type': 'diesel',
'id': '01bbcac9-be80-5f93-8a33-7618fc30eab6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK64923',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 165919,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-12',
'seller_name': None,
'title': 'BMW 3er 325d',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-30 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK64923%27 HTTP/1.1" 200 None
2026-03-30 08:35:30 [auto1.be] INFO: Saving data for CK64923: {'auction_closing_time': 1774971984.0, 'created_time': 1774643902.349671, 'last_price_update_time': 1774859730.070312}
2026-03-30 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CK64923') HTTP/1.1" 204 0
2026-03-30 08:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:30 [auto1.be] INFO: Found listing with ID: DD41126
2026-03-30 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD41126%27 HTTP/1.1" 200 None
2026-03-30 08:35:30 [auto1.be] INFO: Scrape type for DD41126: 1
2026-03-30 08:35:30 [auto1.be] INFO: Found listing with ID: HL85042
2026-03-30 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL85042%27 HTTP/1.1" 200 None
2026-03-30 08:35:30 [auto1.be] INFO: Scrape type for HL85042: 2
2026-03-30 08:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af18c718-684e-5a91-983e-8d7d25dd14e9 with identifier: HL85042
2026-03-30 08:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af18c718-684e-5a91-983e-8d7d25dd14e9 with scrape type 2
2026-03-30 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af18c718-684e-5a91-983e-8d7d25dd14e9 with scrape type 2
2026-03-30 08:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: af18c718-684e-5a91-983e-8d7d25dd14e9, identifier: HL85042
2026-03-30 08:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: af18c718-684e-5a91-983e-8d7d25dd14e9 with identifier: HL85042
2026-03-30 08:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:35:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-30 08:35:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: af18c718-684e-5a91-983e-8d7d25dd14e9 with identifier: HL85042
2026-03-30 08:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: af18c718-684e-5a91-983e-8d7d25dd14e9 with identifier: HL85042 to the API
2026-03-30 08:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:20:22Z',
'fuel_type': 'petrol',
'id': 'af18c718-684e-5a91-983e-8d7d25dd14e9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL85042',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3 Sportback',
'odometer': 41814,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-19',
'seller_name': None,
'title': 'Audi Q3 Sportback 35 TFSI Mild-Hybrid ACT',
'transmission': 'automatic',
'trim': 'ACT',
'year': 2021}
2026-03-30 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL85042%27 HTTP/1.1" 200 None
2026-03-30 08:35:30 [auto1.be] INFO: Saving data for HL85042: {'auction_closing_time': 1774970422.0, 'created_time': 1774471259.9767, 'last_price_update_time': 1774859730.640137}
2026-03-30 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HL85042') HTTP/1.1" 204 0
2026-03-30 08:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:30 [auto1.be] INFO: Found listing with ID: WR16749
2026-03-30 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WR16749%27 HTTP/1.1" 200 None
2026-03-30 08:35:30 [auto1.be] INFO: Scrape type for WR16749: 1
2026-03-30 08:35:30 [auto1.be] INFO: Found listing with ID: DJ32328
2026-03-30 08:35:30 [auto1.be] INFO: Found listing with ID: NS39608
2026-03-30 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS39608%27 HTTP/1.1" 200 None
2026-03-30 08:35:30 [auto1.be] INFO: Scrape type for NS39608: 1
2026-03-30 08:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:30 [auto1.be] INFO: Found listing with ID: FE21102
2026-03-30 08:35:30 [auto1.be] INFO: Found listing with ID: JM82997
2026-03-30 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM82997%27 HTTP/1.1" 200 None
2026-03-30 08:35:30 [auto1.be] INFO: Scrape type for JM82997: 1
2026-03-30 08:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:30 [auto1.be] INFO: Found listing with ID: KP84190
2026-03-30 08:35:30 [auto1.be] INFO: Found listing with ID: EH30324
2026-03-30 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EH30324%27 HTTP/1.1" 200 None
2026-03-30 08:35:30 [auto1.be] INFO: Scrape type for EH30324: 1
2026-03-30 08:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:30 [auto1.be] INFO: Found listing with ID: ME19194
2026-03-30 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ME19194%27 HTTP/1.1" 200 None
2026-03-30 08:35:30 [auto1.be] INFO: Scrape type for ME19194: 1
2026-03-30 08:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:30 [auto1.be] INFO: Found listing with ID: CW36552
2026-03-30 08:35:30 [auto1.be] INFO: Found listing with ID: XM81929
2026-03-30 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM81929%27 HTTP/1.1" 200 None
2026-03-30 08:35:30 [auto1.be] INFO: Scrape type for XM81929: 2
2026-03-30 08:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 320b1a52-bad0-5428-a126-f5b99eb2752f with identifier: XM81929
2026-03-30 08:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 320b1a52-bad0-5428-a126-f5b99eb2752f with scrape type 2
2026-03-30 08:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 320b1a52-bad0-5428-a126-f5b99eb2752f with scrape type 2
2026-03-30 08:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 320b1a52-bad0-5428-a126-f5b99eb2752f, identifier: XM81929
2026-03-30 08:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 320b1a52-bad0-5428-a126-f5b99eb2752f with identifier: XM81929
2026-03-30 08:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 320b1a52-bad0-5428-a126-f5b99eb2752f with identifier: XM81929
2026-03-30 08:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 320b1a52-bad0-5428-a126-f5b99eb2752f with identifier: XM81929 to the API
2026-03-30 08:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-31T15:41:41Z',
'fuel_type': 'petrol',
'id': '320b1a52-bad0-5428-a126-f5b99eb2752f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM81929',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 129353,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-04-09',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 180 Shooting Brake Progressive',
'transmission': 'manual',
'trim': 'Progressive',
'year': 2020}
2026-03-30 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM81929%27 HTTP/1.1" 200 None
2026-03-30 08:35:31 [auto1.be] INFO: Saving data for XM81929: {'auction_closing_time': 1774971701.0, 'created_time': 1773134017.893839, 'last_price_update_time': 1774859731.918801}
2026-03-30 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XM81929') HTTP/1.1" 204 0
2026-03-30 08:35:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:32 [auto1.be] INFO: Found listing with ID: RL35333
2026-03-30 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL35333%27 HTTP/1.1" 200 None
2026-03-30 08:35:32 [auto1.be] INFO: Scrape type for RL35333: 1
2026-03-30 08:35:32 [auto1.be] INFO: Found listing with ID: WD23717
2026-03-30 08:35:32 [auto1.be] INFO: Found listing with ID: XH74025
2026-03-30 08:35:32 [auto1.be] INFO: Found listing with ID: DZ54195
2026-03-30 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ54195%27 HTTP/1.1" 200 None
2026-03-30 08:35:32 [auto1.be] INFO: Scrape type for DZ54195: 2
2026-03-30 08:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36c350ee-07e6-5d7a-a08c-c51ecf5f5473 with identifier: DZ54195
2026-03-30 08:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36c350ee-07e6-5d7a-a08c-c51ecf5f5473 with scrape type 2
2026-03-30 08:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36c350ee-07e6-5d7a-a08c-c51ecf5f5473 with scrape type 2
2026-03-30 08:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 36c350ee-07e6-5d7a-a08c-c51ecf5f5473, identifier: DZ54195
2026-03-30 08:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 36c350ee-07e6-5d7a-a08c-c51ecf5f5473 with identifier: DZ54195
2026-03-30 08:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:35:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-30 08:35:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 36c350ee-07e6-5d7a-a08c-c51ecf5f5473 with identifier: DZ54195
2026-03-30 08:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 36c350ee-07e6-5d7a-a08c-c51ecf5f5473 with identifier: DZ54195 to the API
2026-03-30 08:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 309,
'expiration_date': '2026-03-31T15:12:42Z',
'fuel_type': 'hybrid',
'id': '36c350ee-07e6-5d7a-a08c-c51ecf5f5473',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ54195',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 33691,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-02',
'seller_name': None,
'title': 'Land Rover Evoque P300e Hybrid SE',
'transmission': 'automatic',
'trim': 'SE',
'year': 2021}
2026-03-30 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ54195%27 HTTP/1.1" 200 None
2026-03-30 08:35:33 [auto1.be] INFO: Saving data for DZ54195: {'auction_closing_time': 1774969962.0, 'created_time': 1773228946.162087, 'last_price_update_time': 1774859733.391733}
2026-03-30 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DZ54195') HTTP/1.1" 204 0
2026-03-30 08:35:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:33 [auto1.be] INFO: Found listing with ID: PB88221
2026-03-30 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB88221%27 HTTP/1.1" 200 None
2026-03-30 08:35:33 [auto1.be] INFO: Scrape type for PB88221: 2
2026-03-30 08:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5499533-a0b4-5f1c-8422-50e3069c4bf3 with identifier: PB88221
2026-03-30 08:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5499533-a0b4-5f1c-8422-50e3069c4bf3 with scrape type 2
2026-03-30 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5499533-a0b4-5f1c-8422-50e3069c4bf3 with scrape type 2
2026-03-30 08:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e5499533-a0b4-5f1c-8422-50e3069c4bf3, identifier: PB88221
2026-03-30 08:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e5499533-a0b4-5f1c-8422-50e3069c4bf3 with identifier: PB88221
2026-03-30 08:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e5499533-a0b4-5f1c-8422-50e3069c4bf3 with identifier: PB88221
2026-03-30 08:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e5499533-a0b4-5f1c-8422-50e3069c4bf3 with identifier: PB88221 to the API
2026-03-30 08:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:57:55Z',
'fuel_type': 'diesel',
'id': 'e5499533-a0b4-5f1c-8422-50e3069c4bf3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB88221',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 148931,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-30',
'seller_name': None,
'title': 'Volkswagen Passat 1.6 TDI Comfortline BlueMotion',
'transmission': 'automatic',
'trim': 'Comfortline BlueMotion',
'year': 2019}
2026-03-30 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB88221%27 HTTP/1.1" 200 None
2026-03-30 08:35:33 [auto1.be] INFO: Saving data for PB88221: {'auction_closing_time': 1774972675.0, 'created_time': 1773136626.050788, 'last_price_update_time': 1774859733.862554}
2026-03-30 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PB88221') HTTP/1.1" 204 0
2026-03-30 08:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SX17712/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:35:33 [auto1.be] INFO: Found listing with ID: HJ68089
2026-03-30 08:35:33 [auto1.be] INFO: Found listing with ID: VP17023
2026-03-30 08:35:33 [auto1.be] INFO: Found listing with ID: CF49225
2026-03-30 08:35:33 [auto1.be] INFO: Found listing with ID: ST59109
2026-03-30 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST59109%27 HTTP/1.1" 200 None
2026-03-30 08:35:33 [auto1.be] INFO: Scrape type for ST59109: 1
2026-03-30 08:35:33 [auto1.be] INFO: Channel: 24h | Page: 1 | totalHits: 1499 | hits on page: 40
2026-03-30 08:35:33 [auto1.be] INFO: Found listing with ID: XF11904
2026-03-30 08:35:33 [auto1.be] INFO: Found listing with ID: HA15365
2026-03-30 08:35:33 [auto1.be] INFO: Found listing with ID: NN50309
2026-03-30 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN50309%27 HTTP/1.1" 200 None
2026-03-30 08:35:33 [auto1.be] INFO: Scrape type for NN50309: 2
2026-03-30 08:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e99b1d2-257a-506f-80b0-0420102f965c with identifier: NN50309
2026-03-30 08:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e99b1d2-257a-506f-80b0-0420102f965c with scrape type 2
2026-03-30 08:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e99b1d2-257a-506f-80b0-0420102f965c with scrape type 2
2026-03-30 08:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2e99b1d2-257a-506f-80b0-0420102f965c, identifier: NN50309
2026-03-30 08:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2e99b1d2-257a-506f-80b0-0420102f965c with identifier: NN50309
2026-03-30 08:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2e99b1d2-257a-506f-80b0-0420102f965c with identifier: NN50309
2026-03-30 08:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2e99b1d2-257a-506f-80b0-0420102f965c with identifier: NN50309 to the API
2026-03-30 08:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:01:56Z',
'fuel_type': 'diesel',
'id': '2e99b1d2-257a-506f-80b0-0420102f965c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN50309',
'listing': 'auction',
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 102237,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-29',
'seller_name': None,
'title': 'Skoda Kodiaq 2.0 TDI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2021}
2026-03-30 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN50309%27 HTTP/1.1" 200 None
2026-03-30 08:35:34 [auto1.be] INFO: Saving data for NN50309: {'auction_closing_time': 1774969316.0, 'created_time': 1774298365.237496, 'last_price_update_time': 1774859734.38536}
2026-03-30 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NN50309') HTTP/1.1" 204 0
2026-03-30 08:35:34 [auto1.be] INFO: Found listing with ID: YK50481
2026-03-30 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK50481%27 HTTP/1.1" 200 None
2026-03-30 08:35:34 [auto1.be] INFO: Scrape type for YK50481: 0
2026-03-30 08:35:34 [auto1.be] INFO: Found listing with ID: TX71438
2026-03-30 08:35:34 [auto1.be] INFO: Found listing with ID: TG38013
2026-03-30 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TG38013%27 HTTP/1.1" 200 None
2026-03-30 08:35:34 [auto1.be] INFO: Scrape type for TG38013: 0
2026-03-30 08:35:34 [auto1.be] INFO: Found listing with ID: VV61440
2026-03-30 08:35:34 [auto1.be] INFO: Found listing with ID: SX17712
2026-03-30 08:35:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:34 [auto1.be] INFO: Found listing with ID: RD52510
2026-03-30 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD52510%27 HTTP/1.1" 200 None
2026-03-30 08:35:34 [auto1.be] INFO: Scrape type for RD52510: 2
2026-03-30 08:35:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a3ca651-9264-5d62-9804-bcdc6289fe89 with identifier: RD52510
2026-03-30 08:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a3ca651-9264-5d62-9804-bcdc6289fe89 with scrape type 2
2026-03-30 08:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a3ca651-9264-5d62-9804-bcdc6289fe89 with scrape type 2
2026-03-30 08:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1a3ca651-9264-5d62-9804-bcdc6289fe89, identifier: RD52510
2026-03-30 08:35:34 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/SX17712/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-30 08:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1a3ca651-9264-5d62-9804-bcdc6289fe89 with identifier: RD52510
2026-03-30 08:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1a3ca651-9264-5d62-9804-bcdc6289fe89 with identifier: RD52510
2026-03-30 08:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1a3ca651-9264-5d62-9804-bcdc6289fe89 with identifier: RD52510 to the API
2026-03-30 08:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 205,
'expiration_date': '2026-03-31T15:44:04Z',
'fuel_type': 'diesel',
'id': '1a3ca651-9264-5d62-9804-bcdc6289fe89',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD52510',
'listing': 'auction',
'make': 'Audi',
'model': 'Q7',
'odometer': 234503,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-08',
'seller_name': None,
'title': 'Audi Q7 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2015}
2026-03-30 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD52510%27 HTTP/1.1" 200 None
2026-03-30 08:35:35 [auto1.be] INFO: Saving data for RD52510: {'auction_closing_time': 1774971844.0, 'created_time': 1774298361.316085, 'last_price_update_time': 1774859735.941011}
2026-03-30 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RD52510') HTTP/1.1" 204 0
2026-03-30 08:35:35 [auto1.be] INFO: Found listing with ID: CK64923
2026-03-30 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK64923%27 HTTP/1.1" 200 None
2026-03-30 08:35:35 [auto1.be] INFO: Scrape type for CK64923: 0
2026-03-30 08:35:35 [auto1.be] INFO: Found listing with ID: DD41126
2026-03-30 08:35:35 [auto1.be] INFO: Found listing with ID: XT14784
2026-03-30 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT14784%27 HTTP/1.1" 200 None
2026-03-30 08:35:36 [auto1.be] INFO: Scrape type for XT14784: 2
2026-03-30 08:35:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9eda80a1-9a78-5977-a264-561930e8f9d0 with identifier: XT14784
2026-03-30 08:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9eda80a1-9a78-5977-a264-561930e8f9d0 with scrape type 2
2026-03-30 08:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9eda80a1-9a78-5977-a264-561930e8f9d0 with scrape type 2
2026-03-30 08:35:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9eda80a1-9a78-5977-a264-561930e8f9d0, identifier: XT14784
2026-03-30 08:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WR16749/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DD41126/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:35:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9eda80a1-9a78-5977-a264-561930e8f9d0 with identifier: XT14784
2026-03-30 08:35:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9eda80a1-9a78-5977-a264-561930e8f9d0 with identifier: XT14784
2026-03-30 08:35:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9eda80a1-9a78-5977-a264-561930e8f9d0 with identifier: XT14784 to the API
2026-03-30 08:35:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 245,
'expiration_date': '2026-03-31T15:09:18Z',
'fuel_type': 'diesel',
'id': '9eda80a1-9a78-5977-a264-561930e8f9d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT14784',
'listing': 'auction',
'make': 'Audi',
'model': 'Q7',
'odometer': 165936,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-19',
'seller_name': None,
'title': 'Audi Q7 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2014}
2026-03-30 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT14784%27 HTTP/1.1" 200 None
2026-03-30 08:35:36 [auto1.be] INFO: Saving data for XT14784: {'auction_closing_time': 1774969758.0, 'created_time': 1773384578.337419, 'last_price_update_time': 1774859736.431195}
2026-03-30 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XT14784') HTTP/1.1" 204 0
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: HL85042
2026-03-30 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL85042%27 HTTP/1.1" 200 None
2026-03-30 08:35:36 [auto1.be] INFO: Scrape type for HL85042: 0
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: WR16749
2026-03-30 08:35:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: AV31741
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: RJ26699
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: FL94389
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: MJ87524
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: MX59641
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: EW88607
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: NA83535
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: BV48703
2026-03-30 08:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NS39608/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JM82997/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: DJ32328
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: NS39608
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: FE21102
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: JM82997
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: KP84190
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: EH30324
2026-03-30 08:35:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: ME19194
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: CW36552
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: XM81929
2026-03-30 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM81929%27 HTTP/1.1" 200 None
2026-03-30 08:35:36 [auto1.be] INFO: Scrape type for XM81929: 0
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: RL35333
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: WD23717
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: XH74025
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: DZ54195
2026-03-30 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ54195%27 HTTP/1.1" 200 None
2026-03-30 08:35:36 [auto1.be] INFO: Scrape type for DZ54195: 0
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: PB88221
2026-03-30 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB88221%27 HTTP/1.1" 200 None
2026-03-30 08:35:36 [auto1.be] INFO: Scrape type for PB88221: 0
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: HJ68089
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: VP17023
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: CF49225
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: ST59109
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: XF11904
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: HA15365
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: NN50309
2026-03-30 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN50309%27 HTTP/1.1" 200 None
2026-03-30 08:35:36 [auto1.be] INFO: Scrape type for NN50309: 0
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: RD52510
2026-03-30 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD52510%27 HTTP/1.1" 200 None
2026-03-30 08:35:36 [auto1.be] INFO: Scrape type for RD52510: 0
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: XT14784
2026-03-30 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XT14784%27 HTTP/1.1" 200 None
2026-03-30 08:35:36 [auto1.be] INFO: Scrape type for XT14784: 0
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: AV31741
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: RJ26699
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: FL94389
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: MJ87524
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: MX59641
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: EW88607
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: NA83535
2026-03-30 08:35:36 [auto1.be] INFO: Found listing with ID: BV48703
2026-03-30 08:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SX17712> (referer: https://www.auto1.com/v1/car-details-view/SX17712/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:35:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RL35333/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:35:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 365633c6-eb05-5b1b-af9c-cbb16a7c6c3c with identifier: SX17712
2026-03-30 08:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 365633c6-eb05-5b1b-af9c-cbb16a7c6c3c with scrape type 1
2026-03-30 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 365633c6-eb05-5b1b-af9c-cbb16a7c6c3c
2026-03-30 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Ff9%252F89f9367310a742b18ea8f8df4884b747%252Fpa%252FSX17712_20b913e0fe0919887ff25e1e03225621.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f9/89f9367310a742b18ea8f8df4884b747/pa/SX17712_20b913e0fe0919887ff25e1e03225621.jpg already downloaded
2026-03-30 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Ff9%252F89f9367310a742b18ea8f8df4884b747%252Fpa%252FSX17712_4ab9e6686a009c1a9cbc658307ec8a63.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f9/89f9367310a742b18ea8f8df4884b747/pa/SX17712_4ab9e6686a009c1a9cbc658307ec8a63.jpg already downloaded
2026-03-30 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Ff9%252F89f9367310a742b18ea8f8df4884b747%252Fpa%252FSX17712_71f5167ce186ea344db0a2afc9a9f50e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f9/89f9367310a742b18ea8f8df4884b747/pa/SX17712_71f5167ce186ea344db0a2afc9a9f50e.jpg already downloaded
2026-03-30 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Ff9%252F89f9367310a742b18ea8f8df4884b747%252Fpa%252FSX17712_809c67d5b90e6de2cdf60db838ab85ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f9/89f9367310a742b18ea8f8df4884b747/pa/SX17712_809c67d5b90e6de2cdf60db838ab85ec.jpg already downloaded
2026-03-30 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Ff9%252F89f9367310a742b18ea8f8df4884b747%252Fpa%252FSX17712_24353779c430b31de5d6e618f288650d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f9/89f9367310a742b18ea8f8df4884b747/pa/SX17712_24353779c430b31de5d6e618f288650d.jpg already downloaded
2026-03-30 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Ff9%252F89f9367310a742b18ea8f8df4884b747%252Fpa%252FSX17712_cbc55691d62871a1dd7a4f4a2539972d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f9/89f9367310a742b18ea8f8df4884b747/pa/SX17712_cbc55691d62871a1dd7a4f4a2539972d.jpg already downloaded
2026-03-30 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Ff9%252F89f9367310a742b18ea8f8df4884b747%252Fpa%252FSX17712_1c088515b3447469dc252d2286f3f056.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f9/89f9367310a742b18ea8f8df4884b747/pa/SX17712_1c088515b3447469dc252d2286f3f056.jpg already downloaded
2026-03-30 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Ff9%252F89f9367310a742b18ea8f8df4884b747%252Fpa%252FSX17712_545a29c8ccf60ff2feacc98ff607535b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f9/89f9367310a742b18ea8f8df4884b747/pa/SX17712_545a29c8ccf60ff2feacc98ff607535b.jpg already downloaded
2026-03-30 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Ff9%252F89f9367310a742b18ea8f8df4884b747%252Fpa%252FSX17712_db5ea6aa9ab30a399c0fc43c8986c38d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f9/89f9367310a742b18ea8f8df4884b747/pa/SX17712_db5ea6aa9ab30a399c0fc43c8986c38d.jpg already downloaded
2026-03-30 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Ff9%252F89f9367310a742b18ea8f8df4884b747%252Fpa%252FSX17712_a77254066ce9b1cc462454d0a576bdf2.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f9/89f9367310a742b18ea8f8df4884b747/pa/SX17712_a77254066ce9b1cc462454d0a576bdf2.jpg already downloaded
2026-03-30 08:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 365633c6-eb05-5b1b-af9c-cbb16a7c6c3c, identifier: SX17712
2026-03-30 08:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 365633c6-eb05-5b1b-af9c-cbb16a7c6c3c with identifier: SX17712
2026-03-30 08:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 365633c6-eb05-5b1b-af9c-cbb16a7c6c3c with identifier: SX17712
2026-03-30 08:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 365633c6-eb05-5b1b-af9c-cbb16a7c6c3c with identifier: SX17712 to the API
2026-03-30 08:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SX17712>
{'auction_title': '',
'c_o_2_emission_value': 121,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:08:11Z',
'fuel_type': 'petrol',
'id': '365633c6-eb05-5b1b-af9c-cbb16a7c6c3c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX17712',
'listing': 'auction',
'location': 'BE',
'make': 'BMW',
'model': 'X1',
'odometer': 165341,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 22,
'photo_urls': ['https://img-pa.auto1.com/img89/f9/89f9367310a742b18ea8f8df4884b747/pa/SX17712_20b913e0fe0919887ff25e1e03225621.jpg',
'https://img-pa.auto1.com/img89/f9/89f9367310a742b18ea8f8df4884b747/pa/SX17712_4ab9e6686a009c1a9cbc658307ec8a63.jpg',
'https://img-pa.auto1.com/img89/f9/89f9367310a742b18ea8f8df4884b747/pa/SX17712_71f5167ce186ea344db0a2afc9a9f50e.jpg',
'https://img-pa.auto1.com/img89/f9/89f9367310a742b18ea8f8df4884b747/pa/SX17712_809c67d5b90e6de2cdf60db838ab85ec.jpg',
'https://img-pa.auto1.com/img89/f9/89f9367310a742b18ea8f8df4884b747/pa/SX17712_24353779c430b31de5d6e618f288650d.jpg',
'https://img-pa.auto1.com/img89/f9/89f9367310a742b18ea8f8df4884b747/pa/SX17712_cbc55691d62871a1dd7a4f4a2539972d.jpg',
'https://img-pa.auto1.com/img89/f9/89f9367310a742b18ea8f8df4884b747/pa/SX17712_1c088515b3447469dc252d2286f3f056.jpg',
'https://img-pa.auto1.com/img89/f9/89f9367310a742b18ea8f8df4884b747/pa/SX17712_545a29c8ccf60ff2feacc98ff607535b.jpg',
'https://img-pa.auto1.com/img89/f9/89f9367310a742b18ea8f8df4884b747/pa/SX17712_db5ea6aa9ab30a399c0fc43c8986c38d.jpg',
'https://img-pa.auto1.com/img89/f9/89f9367310a742b18ea8f8df4884b747/pa/SX17712_a77254066ce9b1cc462454d0a576bdf2.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_365633c6-eb05-5b1b-af9c-cbb16a7c6c3c/365633c6-eb05-5b1b-af9c-cbb16a7c6c3c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 123047,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/f9/89f9367310a742b18ea8f8df4884b747/pa/SX17712_20b913e0fe0919887ff25e1e03225621.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_365633c6-eb05-5b1b-af9c-cbb16a7c6c3c/365633c6-eb05-5b1b-af9c-cbb16a7c6c3c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122412,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/f9/89f9367310a742b18ea8f8df4884b747/pa/SX17712_4ab9e6686a009c1a9cbc658307ec8a63.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_365633c6-eb05-5b1b-af9c-cbb16a7c6c3c/365633c6-eb05-5b1b-af9c-cbb16a7c6c3c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116353,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/f9/89f9367310a742b18ea8f8df4884b747/pa/SX17712_71f5167ce186ea344db0a2afc9a9f50e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_365633c6-eb05-5b1b-af9c-cbb16a7c6c3c/365633c6-eb05-5b1b-af9c-cbb16a7c6c3c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 124831,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/f9/89f9367310a742b18ea8f8df4884b747/pa/SX17712_809c67d5b90e6de2cdf60db838ab85ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_365633c6-eb05-5b1b-af9c-cbb16a7c6c3c/365633c6-eb05-5b1b-af9c-cbb16a7c6c3c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118682,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/f9/89f9367310a742b18ea8f8df4884b747/pa/SX17712_24353779c430b31de5d6e618f288650d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_365633c6-eb05-5b1b-af9c-cbb16a7c6c3c/365633c6-eb05-5b1b-af9c-cbb16a7c6c3c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114255,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/f9/89f9367310a742b18ea8f8df4884b747/pa/SX17712_cbc55691d62871a1dd7a4f4a2539972d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_365633c6-eb05-5b1b-af9c-cbb16a7c6c3c/365633c6-eb05-5b1b-af9c-cbb16a7c6c3c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119744,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/f9/89f9367310a742b18ea8f8df4884b747/pa/SX17712_1c088515b3447469dc252d2286f3f056.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_365633c6-eb05-5b1b-af9c-cbb16a7c6c3c/365633c6-eb05-5b1b-af9c-cbb16a7c6c3c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98662,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/f9/89f9367310a742b18ea8f8df4884b747/pa/SX17712_545a29c8ccf60ff2feacc98ff607535b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_365633c6-eb05-5b1b-af9c-cbb16a7c6c3c/365633c6-eb05-5b1b-af9c-cbb16a7c6c3c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71466,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/f9/89f9367310a742b18ea8f8df4884b747/pa/SX17712_db5ea6aa9ab30a399c0fc43c8986c38d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_365633c6-eb05-5b1b-af9c-cbb16a7c6c3c/365633c6-eb05-5b1b-af9c-cbb16a7c6c3c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61070,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/f9/89f9367310a742b18ea8f8df4884b747/pa/SX17712_a77254066ce9b1cc462454d0a576bdf2.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-01-03',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 sDrive 18i Advantage',
'transmission': 'manual',
'trim': 'Advantage',
'year': 2018}
2026-03-30 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX17712%27 HTTP/1.1" 200 None
2026-03-30 08:35:38 [auto1.be] INFO: Saving data for SX17712: {'created_time': 1774859738.944638, 'last_price_update_time': 1774859738.944651, 'auction_closing_time': 1774969691.0}
2026-03-30 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SX17712') HTTP/1.1" 204 0
2026-03-30 08:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ST59109/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DD41126> (referer: https://www.auto1.com/v1/car-details-view/DD41126/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:35:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59225e59-4741-5e9f-84c8-33bb49cbb1c7 with identifier: DD41126
2026-03-30 08:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59225e59-4741-5e9f-84c8-33bb49cbb1c7 with scrape type 1
2026-03-30 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 59225e59-4741-5e9f-84c8-33bb49cbb1c7
2026-03-30 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fab%252F50ab04c2fd4fc098603898f04ba4d6d3%252Fpa%252FDD41126_20844610eb65a8fc0c1855cf7fb36d75.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/ab/50ab04c2fd4fc098603898f04ba4d6d3/pa/DD41126_20844610eb65a8fc0c1855cf7fb36d75.jpg not downloaded yet
2026-03-30 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fab%252F50ab04c2fd4fc098603898f04ba4d6d3%252Fpa%252FDD41126_4f15dff2e356b666f9d94bbef1ff4cff.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/ab/50ab04c2fd4fc098603898f04ba4d6d3/pa/DD41126_4f15dff2e356b666f9d94bbef1ff4cff.jpg not downloaded yet
2026-03-30 08:35:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fab%252F50ab04c2fd4fc098603898f04ba4d6d3%252Fpa%252FDD41126_d65601ff0aec0da6394cf43c7a817e4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/ab/50ab04c2fd4fc098603898f04ba4d6d3/pa/DD41126_d65601ff0aec0da6394cf43c7a817e4f.jpg not downloaded yet
2026-03-30 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fab%252F50ab04c2fd4fc098603898f04ba4d6d3%252Fpa%252FDD41126_b82ad9d379bacdba1522e512c6416df6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/ab/50ab04c2fd4fc098603898f04ba4d6d3/pa/DD41126_b82ad9d379bacdba1522e512c6416df6.jpg not downloaded yet
2026-03-30 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fab%252F50ab04c2fd4fc098603898f04ba4d6d3%252Fpa%252FDD41126_cee53b060cc95fd22c61205b37c89b54.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/ab/50ab04c2fd4fc098603898f04ba4d6d3/pa/DD41126_cee53b060cc95fd22c61205b37c89b54.jpg not downloaded yet
2026-03-30 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fab%252F50ab04c2fd4fc098603898f04ba4d6d3%252Fpa%252FDD41126_1f29929844965cd3a7cd60790a5d6aea.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/ab/50ab04c2fd4fc098603898f04ba4d6d3/pa/DD41126_1f29929844965cd3a7cd60790a5d6aea.jpg not downloaded yet
2026-03-30 08:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/ab/50ab04c2fd4fc098603898f04ba4d6d3/pa/DD41126_cee53b060cc95fd22c61205b37c89b54.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/ab/50ab04c2fd4fc098603898f04ba4d6d3/pa/DD41126_20844610eb65a8fc0c1855cf7fb36d75.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/ab/50ab04c2fd4fc098603898f04ba4d6d3/pa/DD41126_d65601ff0aec0da6394cf43c7a817e4f.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/ab/50ab04c2fd4fc098603898f04ba4d6d3/pa/DD41126_b82ad9d379bacdba1522e512c6416df6.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:35:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-30 08:35:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-30 08:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8ee4750>
2026-03-30 08:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 08:35:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-30 08:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-30 08:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59225e59-4741-5e9f-84c8-33bb49cbb1c7/59225e59-4741-5e9f-84c8-33bb49cbb1c7_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fab%252F50ab04c2fd4fc098603898f04ba4d6d3%252Fpa%252FDD41126_cee53b060cc95fd22c61205b37c89b54.jpg') HTTP/1.1" 204 0
2026-03-30 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/ab/50ab04c2fd4fc098603898f04ba4d6d3/pa/DD41126_cee53b060cc95fd22c61205b37c89b54.jpg saved to cache
2026-03-30 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 59225e59-4741-5e9f-84c8-33bb49cbb1c7
2026-03-30 08:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/ab/50ab04c2fd4fc098603898f04ba4d6d3/pa/DD41126_1f29929844965cd3a7cd60790a5d6aea.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/ab/50ab04c2fd4fc098603898f04ba4d6d3/pa/DD41126_4f15dff2e356b666f9d94bbef1ff4cff.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd9d84ad0>
2026-03-30 08:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59225e59-4741-5e9f-84c8-33bb49cbb1c7/59225e59-4741-5e9f-84c8-33bb49cbb1c7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fab%252F50ab04c2fd4fc098603898f04ba4d6d3%252Fpa%252FDD41126_20844610eb65a8fc0c1855cf7fb36d75.jpg') HTTP/1.1" 204 0
2026-03-30 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/ab/50ab04c2fd4fc098603898f04ba4d6d3/pa/DD41126_20844610eb65a8fc0c1855cf7fb36d75.jpg saved to cache
2026-03-30 08:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 59225e59-4741-5e9f-84c8-33bb49cbb1c7
2026-03-30 08:35:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:35:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8e93b50>
2026-03-30 08:35:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:35:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:35:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59225e59-4741-5e9f-84c8-33bb49cbb1c7/59225e59-4741-5e9f-84c8-33bb49cbb1c7_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fab%252F50ab04c2fd4fc098603898f04ba4d6d3%252Fpa%252FDD41126_d65601ff0aec0da6394cf43c7a817e4f.jpg') HTTP/1.1" 204 0
2026-03-30 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/ab/50ab04c2fd4fc098603898f04ba4d6d3/pa/DD41126_d65601ff0aec0da6394cf43c7a817e4f.jpg saved to cache
2026-03-30 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 59225e59-4741-5e9f-84c8-33bb49cbb1c7
2026-03-30 08:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8eb6e50>
2026-03-30 08:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59225e59-4741-5e9f-84c8-33bb49cbb1c7/59225e59-4741-5e9f-84c8-33bb49cbb1c7_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fab%252F50ab04c2fd4fc098603898f04ba4d6d3%252Fpa%252FDD41126_b82ad9d379bacdba1522e512c6416df6.jpg') HTTP/1.1" 204 0
2026-03-30 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/ab/50ab04c2fd4fc098603898f04ba4d6d3/pa/DD41126_b82ad9d379bacdba1522e512c6416df6.jpg saved to cache
2026-03-30 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 59225e59-4741-5e9f-84c8-33bb49cbb1c7
2026-03-30 08:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NS39608> (referer: https://www.auto1.com/v1/car-details-view/NS39608/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JM82997> (referer: https://www.auto1.com/v1/car-details-view/JM82997/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd900bf50>
2026-03-30 08:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59225e59-4741-5e9f-84c8-33bb49cbb1c7/59225e59-4741-5e9f-84c8-33bb49cbb1c7_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fab%252F50ab04c2fd4fc098603898f04ba4d6d3%252Fpa%252FDD41126_1f29929844965cd3a7cd60790a5d6aea.jpg') HTTP/1.1" 204 0
2026-03-30 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/ab/50ab04c2fd4fc098603898f04ba4d6d3/pa/DD41126_1f29929844965cd3a7cd60790a5d6aea.jpg saved to cache
2026-03-30 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 59225e59-4741-5e9f-84c8-33bb49cbb1c7
2026-03-30 08:35:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:35:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd9163e10>
2026-03-30 08:35:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:35:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_59225e59-4741-5e9f-84c8-33bb49cbb1c7/59225e59-4741-5e9f-84c8-33bb49cbb1c7_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fab%252F50ab04c2fd4fc098603898f04ba4d6d3%252Fpa%252FDD41126_4f15dff2e356b666f9d94bbef1ff4cff.jpg') HTTP/1.1" 204 0
2026-03-30 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/ab/50ab04c2fd4fc098603898f04ba4d6d3/pa/DD41126_4f15dff2e356b666f9d94bbef1ff4cff.jpg saved to cache
2026-03-30 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 59225e59-4741-5e9f-84c8-33bb49cbb1c7
2026-03-30 08:35:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 59225e59-4741-5e9f-84c8-33bb49cbb1c7, skipping ID generation
2026-03-30 08:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59225e59-4741-5e9f-84c8-33bb49cbb1c7 with scrape type 1
2026-03-30 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 59225e59-4741-5e9f-84c8-33bb49cbb1c7 sending to next pipeline
2026-03-30 08:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 59225e59-4741-5e9f-84c8-33bb49cbb1c7, identifier: DD41126
2026-03-30 08:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 59225e59-4741-5e9f-84c8-33bb49cbb1c7 with identifier: DD41126
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-30 08:35:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 59225e59-4741-5e9f-84c8-33bb49cbb1c7 with identifier: DD41126
2026-03-30 08:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 59225e59-4741-5e9f-84c8-33bb49cbb1c7 with identifier: DD41126 to the API
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img50/ab/50ab04c2fd4fc098603898f04ba4d6d3/pa/DD41126_4f15dff2e356b666f9d94bbef1ff4cff.jpg>
{'auction_title': '',
'c_o_2_emission_value': 137,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.1L',
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:20:57Z',
'fuel_type': 'petrol',
'id': '59225e59-4741-5e9f-84c8-33bb49cbb1c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD41126',
'listing': 'auction',
'location': 'BE, Kortrijk',
'make': 'Dacia',
'model': 'Sandero',
'odometer': 140145,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59225e59-4741-5e9f-84c8-33bb49cbb1c7/59225e59-4741-5e9f-84c8-33bb49cbb1c7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82445,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/ab/50ab04c2fd4fc098603898f04ba4d6d3/pa/DD41126_20844610eb65a8fc0c1855cf7fb36d75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59225e59-4741-5e9f-84c8-33bb49cbb1c7/59225e59-4741-5e9f-84c8-33bb49cbb1c7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81910,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/ab/50ab04c2fd4fc098603898f04ba4d6d3/pa/DD41126_4f15dff2e356b666f9d94bbef1ff4cff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59225e59-4741-5e9f-84c8-33bb49cbb1c7/59225e59-4741-5e9f-84c8-33bb49cbb1c7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81314,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/ab/50ab04c2fd4fc098603898f04ba4d6d3/pa/DD41126_d65601ff0aec0da6394cf43c7a817e4f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59225e59-4741-5e9f-84c8-33bb49cbb1c7/59225e59-4741-5e9f-84c8-33bb49cbb1c7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60320,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/ab/50ab04c2fd4fc098603898f04ba4d6d3/pa/DD41126_b82ad9d379bacdba1522e512c6416df6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59225e59-4741-5e9f-84c8-33bb49cbb1c7/59225e59-4741-5e9f-84c8-33bb49cbb1c7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116080,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/ab/50ab04c2fd4fc098603898f04ba4d6d3/pa/DD41126_cee53b060cc95fd22c61205b37c89b54.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_59225e59-4741-5e9f-84c8-33bb49cbb1c7/59225e59-4741-5e9f-84c8-33bb49cbb1c7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57646,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img50/ab/50ab04c2fd4fc098603898f04ba4d6d3/pa/DD41126_1f29929844965cd3a7cd60790a5d6aea.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-12-06',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Sandero 1.2 Ambiance',
'transmission': 'manual',
'trim': 'Ambiance',
'year': 2012}
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD41126%27 HTTP/1.1" 200 None
2026-03-30 08:35:40 [auto1.be] INFO: Saving data for DD41126: {'created_time': 1774859740.729025, 'last_price_update_time': 1774859740.729037, 'auction_closing_time': 1774970457.0}
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DD41126') HTTP/1.1" 204 0
2026-03-30 08:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ME19194/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ST59109> (referer: https://www.auto1.com/v1/car-details-view/ST59109/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:35:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RL35333> (referer: https://www.auto1.com/v1/car-details-view/RL35333/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e12d71f9-7f99-5e6a-9814-e0a705b24adb with identifier: NS39608
2026-03-30 08:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e12d71f9-7f99-5e6a-9814-e0a705b24adb with scrape type 1
2026-03-30 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e12d71f9-7f99-5e6a-9814-e0a705b24adb
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F53%252F5c53a1fdfca6df5b4f64fbb75782f32d%252Fpa%252FNS39608_a7cf8ab2360c889c477352473daa498b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/53/5c53a1fdfca6df5b4f64fbb75782f32d/pa/NS39608_a7cf8ab2360c889c477352473daa498b.jpg already downloaded
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F53%252F5c53a1fdfca6df5b4f64fbb75782f32d%252Fpa%252FNS39608_61a1036a1eb0de05376307b04f411d80.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/53/5c53a1fdfca6df5b4f64fbb75782f32d/pa/NS39608_61a1036a1eb0de05376307b04f411d80.jpg already downloaded
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F53%252F5c53a1fdfca6df5b4f64fbb75782f32d%252Fpa%252FNS39608_ec5b586ab00174bfb0ce0fb3e3b40651.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/53/5c53a1fdfca6df5b4f64fbb75782f32d/pa/NS39608_ec5b586ab00174bfb0ce0fb3e3b40651.jpg already downloaded
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F53%252F5c53a1fdfca6df5b4f64fbb75782f32d%252Fpa%252FNS39608_3ea08fa543d2585bc07039f0b92183af.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/53/5c53a1fdfca6df5b4f64fbb75782f32d/pa/NS39608_3ea08fa543d2585bc07039f0b92183af.jpg already downloaded
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F53%252F5c53a1fdfca6df5b4f64fbb75782f32d%252Fpa%252FNS39608_0f972807185a77c3310ff490f64e4dfd.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/53/5c53a1fdfca6df5b4f64fbb75782f32d/pa/NS39608_0f972807185a77c3310ff490f64e4dfd.jpg already downloaded
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F53%252F5c53a1fdfca6df5b4f64fbb75782f32d%252Fpa%252FNS39608_edb7a1abb92746c3f41138b1602843dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/53/5c53a1fdfca6df5b4f64fbb75782f32d/pa/NS39608_edb7a1abb92746c3f41138b1602843dd.jpg already downloaded
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F53%252F5c53a1fdfca6df5b4f64fbb75782f32d%252Fpa%252FNS39608_c8f40427e2c35735c8a7b53247a9fe2e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/53/5c53a1fdfca6df5b4f64fbb75782f32d/pa/NS39608_c8f40427e2c35735c8a7b53247a9fe2e.jpg already downloaded
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F53%252F5c53a1fdfca6df5b4f64fbb75782f32d%252Fpa%252FNS39608_836b6167860ef50e7892af9d2028d669.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/53/5c53a1fdfca6df5b4f64fbb75782f32d/pa/NS39608_836b6167860ef50e7892af9d2028d669.jpg already downloaded
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F53%252F5c53a1fdfca6df5b4f64fbb75782f32d%252Fpa%252FNS39608_d1bcaefa41a31e24867ded2ad2233120.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/53/5c53a1fdfca6df5b4f64fbb75782f32d/pa/NS39608_d1bcaefa41a31e24867ded2ad2233120.jpg already downloaded
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F53%252F5c53a1fdfca6df5b4f64fbb75782f32d%252Fpa%252FNS39608_5e2a9a98c5ee6d75d4bdbd3d725bee6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/53/5c53a1fdfca6df5b4f64fbb75782f32d/pa/NS39608_5e2a9a98c5ee6d75d4bdbd3d725bee6c.jpg already downloaded
2026-03-30 08:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e12d71f9-7f99-5e6a-9814-e0a705b24adb, identifier: NS39608
2026-03-30 08:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ca5867c-9f1a-56b7-ba1c-f08c43c18ee5 with identifier: JM82997
2026-03-30 08:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ca5867c-9f1a-56b7-ba1c-f08c43c18ee5 with scrape type 1
2026-03-30 08:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5ca5867c-9f1a-56b7-ba1c-f08c43c18ee5
2026-03-30 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F27%252Fe927f4f3c66abf9b18a3c9dce9b41e97%252Fpa%252FJM82997_70fa2a66f21107c941db6a5795869a8a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/27/e927f4f3c66abf9b18a3c9dce9b41e97/pa/JM82997_70fa2a66f21107c941db6a5795869a8a.jpg already downloaded
2026-03-30 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F27%252Fe927f4f3c66abf9b18a3c9dce9b41e97%252Fpa%252FJM82997_b1238a872eee32f0df423c701391a083.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/27/e927f4f3c66abf9b18a3c9dce9b41e97/pa/JM82997_b1238a872eee32f0df423c701391a083.jpg already downloaded
2026-03-30 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F27%252Fe927f4f3c66abf9b18a3c9dce9b41e97%252Fpa%252FJM82997_f9f9ae9f349c4b536d3c50a276a2f58f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/27/e927f4f3c66abf9b18a3c9dce9b41e97/pa/JM82997_f9f9ae9f349c4b536d3c50a276a2f58f.jpg already downloaded
2026-03-30 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F27%252Fe927f4f3c66abf9b18a3c9dce9b41e97%252Fpa%252FJM82997_809eba962d1fcf0b3f90e1886bc5f8be.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/27/e927f4f3c66abf9b18a3c9dce9b41e97/pa/JM82997_809eba962d1fcf0b3f90e1886bc5f8be.jpg already downloaded
2026-03-30 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F27%252Fe927f4f3c66abf9b18a3c9dce9b41e97%252Fpa%252FJM82997_f23adf4639758a32ff7f43b666693f48.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/27/e927f4f3c66abf9b18a3c9dce9b41e97/pa/JM82997_f23adf4639758a32ff7f43b666693f48.jpg already downloaded
2026-03-30 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F27%252Fe927f4f3c66abf9b18a3c9dce9b41e97%252Fpa%252FJM82997_ae328785b325c33f8dd8da628b5cb7c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/27/e927f4f3c66abf9b18a3c9dce9b41e97/pa/JM82997_ae328785b325c33f8dd8da628b5cb7c5.jpg already downloaded
2026-03-30 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F27%252Fe927f4f3c66abf9b18a3c9dce9b41e97%252Fpa%252FJM82997_461a543722b23a88cf40d6694a29623e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/27/e927f4f3c66abf9b18a3c9dce9b41e97/pa/JM82997_461a543722b23a88cf40d6694a29623e.jpg already downloaded
2026-03-30 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F27%252Fe927f4f3c66abf9b18a3c9dce9b41e97%252Fpa%252FJM82997_7e2f842e5326d00c94e381d2b35d8848.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/27/e927f4f3c66abf9b18a3c9dce9b41e97/pa/JM82997_7e2f842e5326d00c94e381d2b35d8848.jpg already downloaded
2026-03-30 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F27%252Fe927f4f3c66abf9b18a3c9dce9b41e97%252Fpa%252FJM82997_b47e944086560f9cd94f6c04ef333ba1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/27/e927f4f3c66abf9b18a3c9dce9b41e97/pa/JM82997_b47e944086560f9cd94f6c04ef333ba1.jpg already downloaded
2026-03-30 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F27%252Fe927f4f3c66abf9b18a3c9dce9b41e97%252Fpa%252FJM82997_c11b250663b39a86b3673122c0f1222d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/27/e927f4f3c66abf9b18a3c9dce9b41e97/pa/JM82997_c11b250663b39a86b3673122c0f1222d.jpg already downloaded
2026-03-30 08:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5ca5867c-9f1a-56b7-ba1c-f08c43c18ee5, identifier: JM82997
2026-03-30 08:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e12d71f9-7f99-5e6a-9814-e0a705b24adb with identifier: NS39608
2026-03-30 08:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e12d71f9-7f99-5e6a-9814-e0a705b24adb with identifier: NS39608
2026-03-30 08:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e12d71f9-7f99-5e6a-9814-e0a705b24adb with identifier: NS39608 to the API
2026-03-30 08:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NS39608>
{'auction_title': '',
'c_o_2_emission_value': 101,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 5',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:27:16Z',
'fuel_type': 'diesel',
'id': 'e12d71f9-7f99-5e6a-9814-e0a705b24adb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS39608',
'listing': 'auction',
'location': 'BE, Pelt',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 164616,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img5c/53/5c53a1fdfca6df5b4f64fbb75782f32d/pa/NS39608_a7cf8ab2360c889c477352473daa498b.jpg',
'https://img-pa.auto1.com/img5c/53/5c53a1fdfca6df5b4f64fbb75782f32d/pa/NS39608_61a1036a1eb0de05376307b04f411d80.jpg',
'https://img-pa.auto1.com/img5c/53/5c53a1fdfca6df5b4f64fbb75782f32d/pa/NS39608_ec5b586ab00174bfb0ce0fb3e3b40651.jpg',
'https://img-pa.auto1.com/img5c/53/5c53a1fdfca6df5b4f64fbb75782f32d/pa/NS39608_3ea08fa543d2585bc07039f0b92183af.jpg',
'https://img-pa.auto1.com/img5c/53/5c53a1fdfca6df5b4f64fbb75782f32d/pa/NS39608_0f972807185a77c3310ff490f64e4dfd.jpg',
'https://img-pa.auto1.com/img5c/53/5c53a1fdfca6df5b4f64fbb75782f32d/pa/NS39608_edb7a1abb92746c3f41138b1602843dd.jpg',
'https://img-pa.auto1.com/img5c/53/5c53a1fdfca6df5b4f64fbb75782f32d/pa/NS39608_c8f40427e2c35735c8a7b53247a9fe2e.jpg',
'https://img-pa.auto1.com/img5c/53/5c53a1fdfca6df5b4f64fbb75782f32d/pa/NS39608_836b6167860ef50e7892af9d2028d669.jpg',
'https://img-pa.auto1.com/img5c/53/5c53a1fdfca6df5b4f64fbb75782f32d/pa/NS39608_d1bcaefa41a31e24867ded2ad2233120.jpg',
'https://img-pa.auto1.com/img5c/53/5c53a1fdfca6df5b4f64fbb75782f32d/pa/NS39608_5e2a9a98c5ee6d75d4bdbd3d725bee6c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12d71f9-7f99-5e6a-9814-e0a705b24adb/e12d71f9-7f99-5e6a-9814-e0a705b24adb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76532,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/53/5c53a1fdfca6df5b4f64fbb75782f32d/pa/NS39608_a7cf8ab2360c889c477352473daa498b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12d71f9-7f99-5e6a-9814-e0a705b24adb/e12d71f9-7f99-5e6a-9814-e0a705b24adb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68569,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/53/5c53a1fdfca6df5b4f64fbb75782f32d/pa/NS39608_61a1036a1eb0de05376307b04f411d80.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12d71f9-7f99-5e6a-9814-e0a705b24adb/e12d71f9-7f99-5e6a-9814-e0a705b24adb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55208,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/53/5c53a1fdfca6df5b4f64fbb75782f32d/pa/NS39608_ec5b586ab00174bfb0ce0fb3e3b40651.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12d71f9-7f99-5e6a-9814-e0a705b24adb/e12d71f9-7f99-5e6a-9814-e0a705b24adb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60824,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/53/5c53a1fdfca6df5b4f64fbb75782f32d/pa/NS39608_3ea08fa543d2585bc07039f0b92183af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12d71f9-7f99-5e6a-9814-e0a705b24adb/e12d71f9-7f99-5e6a-9814-e0a705b24adb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58662,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/53/5c53a1fdfca6df5b4f64fbb75782f32d/pa/NS39608_0f972807185a77c3310ff490f64e4dfd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12d71f9-7f99-5e6a-9814-e0a705b24adb/e12d71f9-7f99-5e6a-9814-e0a705b24adb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57609,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/53/5c53a1fdfca6df5b4f64fbb75782f32d/pa/NS39608_edb7a1abb92746c3f41138b1602843dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12d71f9-7f99-5e6a-9814-e0a705b24adb/e12d71f9-7f99-5e6a-9814-e0a705b24adb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63704,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/53/5c53a1fdfca6df5b4f64fbb75782f32d/pa/NS39608_c8f40427e2c35735c8a7b53247a9fe2e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12d71f9-7f99-5e6a-9814-e0a705b24adb/e12d71f9-7f99-5e6a-9814-e0a705b24adb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63425,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/53/5c53a1fdfca6df5b4f64fbb75782f32d/pa/NS39608_836b6167860ef50e7892af9d2028d669.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12d71f9-7f99-5e6a-9814-e0a705b24adb/e12d71f9-7f99-5e6a-9814-e0a705b24adb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76241,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/53/5c53a1fdfca6df5b4f64fbb75782f32d/pa/NS39608_d1bcaefa41a31e24867ded2ad2233120.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e12d71f9-7f99-5e6a-9814-e0a705b24adb/e12d71f9-7f99-5e6a-9814-e0a705b24adb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65718,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/53/5c53a1fdfca6df5b4f64fbb75782f32d/pa/NS39608_5e2a9a98c5ee6d75d4bdbd3d725bee6c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-02-01',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 180 d',
'transmission': 'manual',
'trim': '',
'year': 2015}
2026-03-30 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS39608%27 HTTP/1.1" 200 None
2026-03-30 08:35:41 [auto1.be] INFO: Saving data for NS39608: {'created_time': 1774859741.717786, 'last_price_update_time': 1774859741.717797, 'auction_closing_time': 1774970836.0}
2026-03-30 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NS39608') HTTP/1.1" 204 0
2026-03-30 08:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5ca5867c-9f1a-56b7-ba1c-f08c43c18ee5 with identifier: JM82997
2026-03-30 08:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:35:41 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-30 08:35:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5ca5867c-9f1a-56b7-ba1c-f08c43c18ee5 with identifier: JM82997
2026-03-30 08:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5ca5867c-9f1a-56b7-ba1c-f08c43c18ee5 with identifier: JM82997 to the API
2026-03-30 08:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JM82997>
{'auction_title': '',
'c_o_2_emission_value': 169,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:16:10Z',
'fuel_type': 'petrol',
'id': '5ca5867c-9f1a-56b7-ba1c-f08c43c18ee5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM82997',
'listing': 'auction',
'location': 'BE, Pelt',
'make': 'Renault',
'model': 'Megane',
'odometer': 113295,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imge9/27/e927f4f3c66abf9b18a3c9dce9b41e97/pa/JM82997_70fa2a66f21107c941db6a5795869a8a.jpg',
'https://img-pa.auto1.com/imge9/27/e927f4f3c66abf9b18a3c9dce9b41e97/pa/JM82997_b1238a872eee32f0df423c701391a083.jpg',
'https://img-pa.auto1.com/imge9/27/e927f4f3c66abf9b18a3c9dce9b41e97/pa/JM82997_f9f9ae9f349c4b536d3c50a276a2f58f.jpg',
'https://img-pa.auto1.com/imge9/27/e927f4f3c66abf9b18a3c9dce9b41e97/pa/JM82997_809eba962d1fcf0b3f90e1886bc5f8be.jpg',
'https://img-pa.auto1.com/imge9/27/e927f4f3c66abf9b18a3c9dce9b41e97/pa/JM82997_f23adf4639758a32ff7f43b666693f48.jpg',
'https://img-pa.auto1.com/imge9/27/e927f4f3c66abf9b18a3c9dce9b41e97/pa/JM82997_ae328785b325c33f8dd8da628b5cb7c5.jpg',
'https://img-pa.auto1.com/imge9/27/e927f4f3c66abf9b18a3c9dce9b41e97/pa/JM82997_461a543722b23a88cf40d6694a29623e.jpg',
'https://img-pa.auto1.com/imge9/27/e927f4f3c66abf9b18a3c9dce9b41e97/pa/JM82997_7e2f842e5326d00c94e381d2b35d8848.jpg',
'https://img-pa.auto1.com/imge9/27/e927f4f3c66abf9b18a3c9dce9b41e97/pa/JM82997_b47e944086560f9cd94f6c04ef333ba1.jpg',
'https://img-pa.auto1.com/imge9/27/e927f4f3c66abf9b18a3c9dce9b41e97/pa/JM82997_c11b250663b39a86b3673122c0f1222d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca5867c-9f1a-56b7-ba1c-f08c43c18ee5/5ca5867c-9f1a-56b7-ba1c-f08c43c18ee5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95979,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/27/e927f4f3c66abf9b18a3c9dce9b41e97/pa/JM82997_70fa2a66f21107c941db6a5795869a8a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca5867c-9f1a-56b7-ba1c-f08c43c18ee5/5ca5867c-9f1a-56b7-ba1c-f08c43c18ee5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90294,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/27/e927f4f3c66abf9b18a3c9dce9b41e97/pa/JM82997_b1238a872eee32f0df423c701391a083.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca5867c-9f1a-56b7-ba1c-f08c43c18ee5/5ca5867c-9f1a-56b7-ba1c-f08c43c18ee5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118104,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/27/e927f4f3c66abf9b18a3c9dce9b41e97/pa/JM82997_f9f9ae9f349c4b536d3c50a276a2f58f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca5867c-9f1a-56b7-ba1c-f08c43c18ee5/5ca5867c-9f1a-56b7-ba1c-f08c43c18ee5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85829,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/27/e927f4f3c66abf9b18a3c9dce9b41e97/pa/JM82997_809eba962d1fcf0b3f90e1886bc5f8be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca5867c-9f1a-56b7-ba1c-f08c43c18ee5/5ca5867c-9f1a-56b7-ba1c-f08c43c18ee5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116200,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/27/e927f4f3c66abf9b18a3c9dce9b41e97/pa/JM82997_f23adf4639758a32ff7f43b666693f48.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca5867c-9f1a-56b7-ba1c-f08c43c18ee5/5ca5867c-9f1a-56b7-ba1c-f08c43c18ee5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118893,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/27/e927f4f3c66abf9b18a3c9dce9b41e97/pa/JM82997_ae328785b325c33f8dd8da628b5cb7c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca5867c-9f1a-56b7-ba1c-f08c43c18ee5/5ca5867c-9f1a-56b7-ba1c-f08c43c18ee5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3146124,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imge9/27/e927f4f3c66abf9b18a3c9dce9b41e97/pa/JM82997_461a543722b23a88cf40d6694a29623e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca5867c-9f1a-56b7-ba1c-f08c43c18ee5/5ca5867c-9f1a-56b7-ba1c-f08c43c18ee5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104362,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/27/e927f4f3c66abf9b18a3c9dce9b41e97/pa/JM82997_7e2f842e5326d00c94e381d2b35d8848.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca5867c-9f1a-56b7-ba1c-f08c43c18ee5/5ca5867c-9f1a-56b7-ba1c-f08c43c18ee5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91235,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/27/e927f4f3c66abf9b18a3c9dce9b41e97/pa/JM82997_b47e944086560f9cd94f6c04ef333ba1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca5867c-9f1a-56b7-ba1c-f08c43c18ee5/5ca5867c-9f1a-56b7-ba1c-f08c43c18ee5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108969,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/27/e927f4f3c66abf9b18a3c9dce9b41e97/pa/JM82997_c11b250663b39a86b3673122c0f1222d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-06-03',
'seats_number': 4,
'seller_name': None,
'title': 'Renault Megane 1.4 TCe Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2012}
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM82997%27 HTTP/1.1" 200 None
2026-03-30 08:35:42 [auto1.be] INFO: Saving data for JM82997: {'created_time': 1774859742.200132, 'last_price_update_time': 1774859742.200149, 'auction_closing_time': 1774970170.0}
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JM82997') HTTP/1.1" 204 0
2026-03-30 08:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 530fad52-8386-59ef-bb43-134c1f84041f with identifier: ST59109
2026-03-30 08:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 530fad52-8386-59ef-bb43-134c1f84041f with scrape type 1
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 530fad52-8386-59ef-bb43-134c1f84041f
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F71%252F0c71e2b189b903b0985856140f170f59%252Fpa%252FST59109_bd3a61873beeb10096ea8b3ad1f80104.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_bd3a61873beeb10096ea8b3ad1f80104.jpg not downloaded yet
2026-03-30 08:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 908f9b0e-bf55-5c8f-898a-fa94e0aad560 with identifier: RL35333
2026-03-30 08:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 908f9b0e-bf55-5c8f-898a-fa94e0aad560 with scrape type 1
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 908f9b0e-bf55-5c8f-898a-fa94e0aad560
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fa2%252Fdea25a5ddf17bd005237a7e899aad379%252Fpa%252FRL35333_ae15255d32b2201be9321fb3bf832263.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_ae15255d32b2201be9321fb3bf832263.jpg not downloaded yet
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F71%252F0c71e2b189b903b0985856140f170f59%252Fpa%252FST59109_68fa8755cf0f6689de57af3ba50c5dc9.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_68fa8755cf0f6689de57af3ba50c5dc9.jpg not downloaded yet
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fa2%252Fdea25a5ddf17bd005237a7e899aad379%252Fpa%252FRL35333_9085be23c7f807cd271d375d39e32328.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_9085be23c7f807cd271d375d39e32328.jpg not downloaded yet
2026-03-30 08:35:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F71%252F0c71e2b189b903b0985856140f170f59%252Fpa%252FST59109_36d61943ecf172910651dcd46e0b557d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_36d61943ecf172910651dcd46e0b557d.jpg not downloaded yet
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fa2%252Fdea25a5ddf17bd005237a7e899aad379%252Fpa%252FRL35333_2f6ed456ca550c153bbd30800c341fd0.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_2f6ed456ca550c153bbd30800c341fd0.jpg not downloaded yet
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F71%252F0c71e2b189b903b0985856140f170f59%252Fpa%252FST59109_16d6e2cf8a3aca14c702f2a5013eff9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_16d6e2cf8a3aca14c702f2a5013eff9d.jpg not downloaded yet
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fa2%252Fdea25a5ddf17bd005237a7e899aad379%252Fpa%252FRL35333_cba68ad5cfd7c55b0c09a4a19bbbe194.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_cba68ad5cfd7c55b0c09a4a19bbbe194.jpg not downloaded yet
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F71%252F0c71e2b189b903b0985856140f170f59%252Fpa%252FST59109_e8423c8954ed5a5ce8c5e4db448be5b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_e8423c8954ed5a5ce8c5e4db448be5b8.jpg not downloaded yet
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fa2%252Fdea25a5ddf17bd005237a7e899aad379%252Fpa%252FRL35333_886a16ac1426fb048b4b9a5489598136.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_886a16ac1426fb048b4b9a5489598136.jpg not downloaded yet
2026-03-30 08:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_ae15255d32b2201be9321fb3bf832263.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F71%252F0c71e2b189b903b0985856140f170f59%252Fpa%252FST59109_e610d6e1708fb2fc2b89aadea50c8f95.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_e610d6e1708fb2fc2b89aadea50c8f95.jpg not downloaded yet
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fa2%252Fdea25a5ddf17bd005237a7e899aad379%252Fpa%252FRL35333_51038cdc506943a581c384b30a7a9a6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_51038cdc506943a581c384b30a7a9a6c.jpg not downloaded yet
2026-03-30 08:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_bd3a61873beeb10096ea8b3ad1f80104.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F71%252F0c71e2b189b903b0985856140f170f59%252Fpa%252FST59109_9dfba871fbcdfeb4267c3357b3d815c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_9dfba871fbcdfeb4267c3357b3d815c3.jpg not downloaded yet
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fa2%252Fdea25a5ddf17bd005237a7e899aad379%252Fpa%252FRL35333_bf2c602f084994b2bbdaa8436374984f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_bf2c602f084994b2bbdaa8436374984f.jpg not downloaded yet
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F71%252F0c71e2b189b903b0985856140f170f59%252Fpa%252FST59109_07aaeec75fc0e9f2708b436b1bc86d83.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_07aaeec75fc0e9f2708b436b1bc86d83.jpg not downloaded yet
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fa2%252Fdea25a5ddf17bd005237a7e899aad379%252Fpa%252FRL35333_7d57b5f9bb42c7de2707f771263af583.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_7d57b5f9bb42c7de2707f771263af583.jpg not downloaded yet
2026-03-30 08:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_36d61943ecf172910651dcd46e0b557d.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_9085be23c7f807cd271d375d39e32328.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F71%252F0c71e2b189b903b0985856140f170f59%252Fpa%252FST59109_9ddc320cbd2afc40a924ee47ad61e53e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_9ddc320cbd2afc40a924ee47ad61e53e.jpg not downloaded yet
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fa2%252Fdea25a5ddf17bd005237a7e899aad379%252Fpa%252FRL35333_1731319bd3a9465ff12f3a9c5ca3f57b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_1731319bd3a9465ff12f3a9c5ca3f57b.jpg not downloaded yet
2026-03-30 08:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_886a16ac1426fb048b4b9a5489598136.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8f14310>
2026-03-30 08:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_908f9b0e-bf55-5c8f-898a-fa94e0aad560/908f9b0e-bf55-5c8f-898a-fa94e0aad560_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fa2%252Fdea25a5ddf17bd005237a7e899aad379%252Fpa%252FRL35333_ae15255d32b2201be9321fb3bf832263.jpg') HTTP/1.1" 204 0
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_ae15255d32b2201be9321fb3bf832263.jpg saved to cache
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 908f9b0e-bf55-5c8f-898a-fa94e0aad560
2026-03-30 08:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_68fa8755cf0f6689de57af3ba50c5dc9.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F71%252F0c71e2b189b903b0985856140f170f59%252Fpa%252FST59109_612fc4e92b73dd5185906a9ad2af1070.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_612fc4e92b73dd5185906a9ad2af1070.jpg not downloaded yet
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fa2%252Fdea25a5ddf17bd005237a7e899aad379%252Fpa%252FRL35333_37ce416961cc1a7a48dece1bd080a024.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_37ce416961cc1a7a48dece1bd080a024.jpg not downloaded yet
2026-03-30 08:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_51038cdc506943a581c384b30a7a9a6c.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8f59950>
2026-03-30 08:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_530fad52-8386-59ef-bb43-134c1f84041f/530fad52-8386-59ef-bb43-134c1f84041f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F71%252F0c71e2b189b903b0985856140f170f59%252Fpa%252FST59109_bd3a61873beeb10096ea8b3ad1f80104.jpg') HTTP/1.1" 204 0
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_bd3a61873beeb10096ea8b3ad1f80104.jpg saved to cache
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 530fad52-8386-59ef-bb43-134c1f84041f
2026-03-30 08:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_bf2c602f084994b2bbdaa8436374984f.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_2f6ed456ca550c153bbd30800c341fd0.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_e8423c8954ed5a5ce8c5e4db448be5b8.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8f3a490>
2026-03-30 08:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_530fad52-8386-59ef-bb43-134c1f84041f/530fad52-8386-59ef-bb43-134c1f84041f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F71%252F0c71e2b189b903b0985856140f170f59%252Fpa%252FST59109_36d61943ecf172910651dcd46e0b557d.jpg') HTTP/1.1" 204 0
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_36d61943ecf172910651dcd46e0b557d.jpg saved to cache
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 530fad52-8386-59ef-bb43-134c1f84041f
2026-03-30 08:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8efa0d0>
2026-03-30 08:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_908f9b0e-bf55-5c8f-898a-fa94e0aad560/908f9b0e-bf55-5c8f-898a-fa94e0aad560_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fa2%252Fdea25a5ddf17bd005237a7e899aad379%252Fpa%252FRL35333_9085be23c7f807cd271d375d39e32328.jpg') HTTP/1.1" 204 0
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_9085be23c7f807cd271d375d39e32328.jpg saved to cache
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 908f9b0e-bf55-5c8f-898a-fa94e0aad560
2026-03-30 08:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8ff3d10>
2026-03-30 08:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_908f9b0e-bf55-5c8f-898a-fa94e0aad560/908f9b0e-bf55-5c8f-898a-fa94e0aad560_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fa2%252Fdea25a5ddf17bd005237a7e899aad379%252Fpa%252FRL35333_886a16ac1426fb048b4b9a5489598136.jpg') HTTP/1.1" 204 0
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_886a16ac1426fb048b4b9a5489598136.jpg saved to cache
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 908f9b0e-bf55-5c8f-898a-fa94e0aad560
2026-03-30 08:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_cba68ad5cfd7c55b0c09a4a19bbbe194.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_7d57b5f9bb42c7de2707f771263af583.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_e610d6e1708fb2fc2b89aadea50c8f95.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8fad110>
2026-03-30 08:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_530fad52-8386-59ef-bb43-134c1f84041f/530fad52-8386-59ef-bb43-134c1f84041f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F71%252F0c71e2b189b903b0985856140f170f59%252Fpa%252FST59109_68fa8755cf0f6689de57af3ba50c5dc9.jpg') HTTP/1.1" 204 0
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_68fa8755cf0f6689de57af3ba50c5dc9.jpg saved to cache
2026-03-30 08:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 530fad52-8386-59ef-bb43-134c1f84041f
2026-03-30 08:35:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:35:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8febad0>
2026-03-30 08:35:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:35:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:35:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_908f9b0e-bf55-5c8f-898a-fa94e0aad560/908f9b0e-bf55-5c8f-898a-fa94e0aad560_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fa2%252Fdea25a5ddf17bd005237a7e899aad379%252Fpa%252FRL35333_51038cdc506943a581c384b30a7a9a6c.jpg') HTTP/1.1" 204 0
2026-03-30 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_51038cdc506943a581c384b30a7a9a6c.jpg saved to cache
2026-03-30 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 908f9b0e-bf55-5c8f-898a-fa94e0aad560
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8e9f150>
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_908f9b0e-bf55-5c8f-898a-fa94e0aad560/908f9b0e-bf55-5c8f-898a-fa94e0aad560_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fa2%252Fdea25a5ddf17bd005237a7e899aad379%252Fpa%252FRL35333_bf2c602f084994b2bbdaa8436374984f.jpg') HTTP/1.1" 204 0
2026-03-30 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_bf2c602f084994b2bbdaa8436374984f.jpg saved to cache
2026-03-30 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 908f9b0e-bf55-5c8f-898a-fa94e0aad560
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8ea7bd0>
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_908f9b0e-bf55-5c8f-898a-fa94e0aad560/908f9b0e-bf55-5c8f-898a-fa94e0aad560_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fa2%252Fdea25a5ddf17bd005237a7e899aad379%252Fpa%252FRL35333_2f6ed456ca550c153bbd30800c341fd0.jpg') HTTP/1.1" 204 0
2026-03-30 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_2f6ed456ca550c153bbd30800c341fd0.jpg saved to cache
2026-03-30 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 908f9b0e-bf55-5c8f-898a-fa94e0aad560
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8ead1d0>
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_530fad52-8386-59ef-bb43-134c1f84041f/530fad52-8386-59ef-bb43-134c1f84041f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F71%252F0c71e2b189b903b0985856140f170f59%252Fpa%252FST59109_e8423c8954ed5a5ce8c5e4db448be5b8.jpg') HTTP/1.1" 204 0
2026-03-30 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_e8423c8954ed5a5ce8c5e4db448be5b8.jpg saved to cache
2026-03-30 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 530fad52-8386-59ef-bb43-134c1f84041f
2026-03-30 08:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_9dfba871fbcdfeb4267c3357b3d815c3.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_1731319bd3a9465ff12f3a9c5ca3f57b.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_16d6e2cf8a3aca14c702f2a5013eff9d.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_07aaeec75fc0e9f2708b436b1bc86d83.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_9ddc320cbd2afc40a924ee47ad61e53e.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8ee5250>
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_908f9b0e-bf55-5c8f-898a-fa94e0aad560/908f9b0e-bf55-5c8f-898a-fa94e0aad560_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fa2%252Fdea25a5ddf17bd005237a7e899aad379%252Fpa%252FRL35333_cba68ad5cfd7c55b0c09a4a19bbbe194.jpg') HTTP/1.1" 204 0
2026-03-30 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_cba68ad5cfd7c55b0c09a4a19bbbe194.jpg saved to cache
2026-03-30 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 908f9b0e-bf55-5c8f-898a-fa94e0aad560
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd85ed850>
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_908f9b0e-bf55-5c8f-898a-fa94e0aad560/908f9b0e-bf55-5c8f-898a-fa94e0aad560_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fa2%252Fdea25a5ddf17bd005237a7e899aad379%252Fpa%252FRL35333_7d57b5f9bb42c7de2707f771263af583.jpg') HTTP/1.1" 204 0
2026-03-30 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_7d57b5f9bb42c7de2707f771263af583.jpg saved to cache
2026-03-30 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 908f9b0e-bf55-5c8f-898a-fa94e0aad560
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8f03390>
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_530fad52-8386-59ef-bb43-134c1f84041f/530fad52-8386-59ef-bb43-134c1f84041f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F71%252F0c71e2b189b903b0985856140f170f59%252Fpa%252FST59109_e610d6e1708fb2fc2b89aadea50c8f95.jpg') HTTP/1.1" 204 0
2026-03-30 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_e610d6e1708fb2fc2b89aadea50c8f95.jpg saved to cache
2026-03-30 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 530fad52-8386-59ef-bb43-134c1f84041f
2026-03-30 08:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_37ce416961cc1a7a48dece1bd080a024.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd85ecc10>
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_530fad52-8386-59ef-bb43-134c1f84041f/530fad52-8386-59ef-bb43-134c1f84041f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F71%252F0c71e2b189b903b0985856140f170f59%252Fpa%252FST59109_9dfba871fbcdfeb4267c3357b3d815c3.jpg') HTTP/1.1" 204 0
2026-03-30 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_9dfba871fbcdfeb4267c3357b3d815c3.jpg saved to cache
2026-03-30 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 530fad52-8386-59ef-bb43-134c1f84041f
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8ef9010>
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_908f9b0e-bf55-5c8f-898a-fa94e0aad560/908f9b0e-bf55-5c8f-898a-fa94e0aad560_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fa2%252Fdea25a5ddf17bd005237a7e899aad379%252Fpa%252FRL35333_1731319bd3a9465ff12f3a9c5ca3f57b.jpg') HTTP/1.1" 204 0
2026-03-30 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_1731319bd3a9465ff12f3a9c5ca3f57b.jpg saved to cache
2026-03-30 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 908f9b0e-bf55-5c8f-898a-fa94e0aad560
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8e92ad0>
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_530fad52-8386-59ef-bb43-134c1f84041f/530fad52-8386-59ef-bb43-134c1f84041f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F71%252F0c71e2b189b903b0985856140f170f59%252Fpa%252FST59109_16d6e2cf8a3aca14c702f2a5013eff9d.jpg') HTTP/1.1" 204 0
2026-03-30 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_16d6e2cf8a3aca14c702f2a5013eff9d.jpg saved to cache
2026-03-30 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 530fad52-8386-59ef-bb43-134c1f84041f
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8ef8a50>
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_530fad52-8386-59ef-bb43-134c1f84041f/530fad52-8386-59ef-bb43-134c1f84041f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F71%252F0c71e2b189b903b0985856140f170f59%252Fpa%252FST59109_07aaeec75fc0e9f2708b436b1bc86d83.jpg') HTTP/1.1" 204 0
2026-03-30 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_07aaeec75fc0e9f2708b436b1bc86d83.jpg saved to cache
2026-03-30 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 530fad52-8386-59ef-bb43-134c1f84041f
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8f62fd0>
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_530fad52-8386-59ef-bb43-134c1f84041f/530fad52-8386-59ef-bb43-134c1f84041f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F71%252F0c71e2b189b903b0985856140f170f59%252Fpa%252FST59109_9ddc320cbd2afc40a924ee47ad61e53e.jpg') HTTP/1.1" 204 0
2026-03-30 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_9ddc320cbd2afc40a924ee47ad61e53e.jpg saved to cache
2026-03-30 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 530fad52-8386-59ef-bb43-134c1f84041f
2026-03-30 08:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_612fc4e92b73dd5185906a9ad2af1070.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ME19194> (referer: https://www.auto1.com/v1/car-details-view/ME19194/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febdb1b4390>
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:35:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_908f9b0e-bf55-5c8f-898a-fa94e0aad560/908f9b0e-bf55-5c8f-898a-fa94e0aad560_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fa2%252Fdea25a5ddf17bd005237a7e899aad379%252Fpa%252FRL35333_37ce416961cc1a7a48dece1bd080a024.jpg') HTTP/1.1" 204 0
2026-03-30 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_37ce416961cc1a7a48dece1bd080a024.jpg saved to cache
2026-03-30 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 908f9b0e-bf55-5c8f-898a-fa94e0aad560
2026-03-30 08:35:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 908f9b0e-bf55-5c8f-898a-fa94e0aad560, skipping ID generation
2026-03-30 08:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 908f9b0e-bf55-5c8f-898a-fa94e0aad560 with scrape type 1
2026-03-30 08:35:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 908f9b0e-bf55-5c8f-898a-fa94e0aad560 sending to next pipeline
2026-03-30 08:35:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 908f9b0e-bf55-5c8f-898a-fa94e0aad560, identifier: RL35333
2026-03-30 08:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 908f9b0e-bf55-5c8f-898a-fa94e0aad560 with identifier: RL35333
2026-03-30 08:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 908f9b0e-bf55-5c8f-898a-fa94e0aad560 with identifier: RL35333
2026-03-30 08:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 908f9b0e-bf55-5c8f-898a-fa94e0aad560 with identifier: RL35333 to the API
2026-03-30 08:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_37ce416961cc1a7a48dece1bd080a024.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 160,
'expiration_date': '2026-03-31T15:53:40Z',
'fuel_type': 'petrol',
'id': '908f9b0e-bf55-5c8f-898a-fa94e0aad560',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL35333',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Kia',
'model': "pro_cee'd",
'odometer': 115791,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_908f9b0e-bf55-5c8f-898a-fa94e0aad560/908f9b0e-bf55-5c8f-898a-fa94e0aad560_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70174,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_ae15255d32b2201be9321fb3bf832263.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_908f9b0e-bf55-5c8f-898a-fa94e0aad560/908f9b0e-bf55-5c8f-898a-fa94e0aad560_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71519,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_9085be23c7f807cd271d375d39e32328.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_908f9b0e-bf55-5c8f-898a-fa94e0aad560/908f9b0e-bf55-5c8f-898a-fa94e0aad560_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76506,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_2f6ed456ca550c153bbd30800c341fd0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_908f9b0e-bf55-5c8f-898a-fa94e0aad560/908f9b0e-bf55-5c8f-898a-fa94e0aad560_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55189,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_cba68ad5cfd7c55b0c09a4a19bbbe194.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_908f9b0e-bf55-5c8f-898a-fa94e0aad560/908f9b0e-bf55-5c8f-898a-fa94e0aad560_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68391,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_886a16ac1426fb048b4b9a5489598136.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_908f9b0e-bf55-5c8f-898a-fa94e0aad560/908f9b0e-bf55-5c8f-898a-fa94e0aad560_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75007,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_51038cdc506943a581c384b30a7a9a6c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_908f9b0e-bf55-5c8f-898a-fa94e0aad560/908f9b0e-bf55-5c8f-898a-fa94e0aad560_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57331,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_bf2c602f084994b2bbdaa8436374984f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_908f9b0e-bf55-5c8f-898a-fa94e0aad560/908f9b0e-bf55-5c8f-898a-fa94e0aad560_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72666,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_7d57b5f9bb42c7de2707f771263af583.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_908f9b0e-bf55-5c8f-898a-fa94e0aad560/908f9b0e-bf55-5c8f-898a-fa94e0aad560_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72312,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_1731319bd3a9465ff12f3a9c5ca3f57b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_908f9b0e-bf55-5c8f-898a-fa94e0aad560/908f9b0e-bf55-5c8f-898a-fa94e0aad560_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65550,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/a2/dea25a5ddf17bd005237a7e899aad379/pa/RL35333_37ce416961cc1a7a48dece1bd080a024.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-10-07',
'seats_number': 5,
'seller_name': None,
'title': "Kia pro_cee'd 1.5 TGDI GT Line",
'transmission': 'automatic',
'trim': 'GT Line',
'year': 2021}
2026-03-30 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RL35333%27 HTTP/1.1" 200 None
2026-03-30 08:35:44 [auto1.be] INFO: Saving data for RL35333: {'created_time': 1774859744.265724, 'last_price_update_time': 1774859744.265735, 'auction_closing_time': 1774972420.0}
2026-03-30 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RL35333') HTTP/1.1" 204 0
2026-03-30 08:35:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:35:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd912b250>
2026-03-30 08:35:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:35:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:35:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_530fad52-8386-59ef-bb43-134c1f84041f/530fad52-8386-59ef-bb43-134c1f84041f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F71%252F0c71e2b189b903b0985856140f170f59%252Fpa%252FST59109_612fc4e92b73dd5185906a9ad2af1070.jpg') HTTP/1.1" 204 0
2026-03-30 08:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_612fc4e92b73dd5185906a9ad2af1070.jpg saved to cache
2026-03-30 08:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 530fad52-8386-59ef-bb43-134c1f84041f
2026-03-30 08:35:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 530fad52-8386-59ef-bb43-134c1f84041f, skipping ID generation
2026-03-30 08:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 530fad52-8386-59ef-bb43-134c1f84041f with scrape type 1
2026-03-30 08:35:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 530fad52-8386-59ef-bb43-134c1f84041f sending to next pipeline
2026-03-30 08:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 530fad52-8386-59ef-bb43-134c1f84041f, identifier: ST59109
2026-03-30 08:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a771b2f2-1111-5a2a-b797-ca09a4bcc9cf with identifier: ME19194
2026-03-30 08:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a771b2f2-1111-5a2a-b797-ca09a4bcc9cf with scrape type 1
2026-03-30 08:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item a771b2f2-1111-5a2a-b797-ca09a4bcc9cf
2026-03-30 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F6a%252F416ab3b58b9d99e0d45328e41f4de259%252Fpa%252FME19194_2d67c67173a0c8079c4adb511d94bb8f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/6a/416ab3b58b9d99e0d45328e41f4de259/pa/ME19194_2d67c67173a0c8079c4adb511d94bb8f.jpg not downloaded yet
2026-03-30 08:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 530fad52-8386-59ef-bb43-134c1f84041f with identifier: ST59109
2026-03-30 08:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 530fad52-8386-59ef-bb43-134c1f84041f with identifier: ST59109
2026-03-30 08:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 530fad52-8386-59ef-bb43-134c1f84041f with identifier: ST59109 to the API
2026-03-30 08:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_612fc4e92b73dd5185906a9ad2af1070.jpg>
{'auction_title': '',
'c_o_2_emission_value': 126,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.6L',
'engine_horse_power': 122,
'expiration_date': '2026-03-31T15:36:19Z',
'fuel_type': 'petrol',
'id': '530fad52-8386-59ef-bb43-134c1f84041f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST59109',
'listing': 'auction',
'location': 'BE, Bruxelles-Brussel',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 99654,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_530fad52-8386-59ef-bb43-134c1f84041f/530fad52-8386-59ef-bb43-134c1f84041f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102892,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_bd3a61873beeb10096ea8b3ad1f80104.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_530fad52-8386-59ef-bb43-134c1f84041f/530fad52-8386-59ef-bb43-134c1f84041f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84220,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_68fa8755cf0f6689de57af3ba50c5dc9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_530fad52-8386-59ef-bb43-134c1f84041f/530fad52-8386-59ef-bb43-134c1f84041f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110556,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_36d61943ecf172910651dcd46e0b557d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_530fad52-8386-59ef-bb43-134c1f84041f/530fad52-8386-59ef-bb43-134c1f84041f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78941,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_16d6e2cf8a3aca14c702f2a5013eff9d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_530fad52-8386-59ef-bb43-134c1f84041f/530fad52-8386-59ef-bb43-134c1f84041f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76915,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_e8423c8954ed5a5ce8c5e4db448be5b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_530fad52-8386-59ef-bb43-134c1f84041f/530fad52-8386-59ef-bb43-134c1f84041f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85792,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_e610d6e1708fb2fc2b89aadea50c8f95.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_530fad52-8386-59ef-bb43-134c1f84041f/530fad52-8386-59ef-bb43-134c1f84041f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63626,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_9dfba871fbcdfeb4267c3357b3d815c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_530fad52-8386-59ef-bb43-134c1f84041f/530fad52-8386-59ef-bb43-134c1f84041f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89030,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_07aaeec75fc0e9f2708b436b1bc86d83.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_530fad52-8386-59ef-bb43-134c1f84041f/530fad52-8386-59ef-bb43-134c1f84041f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97597,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_9ddc320cbd2afc40a924ee47ad61e53e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_530fad52-8386-59ef-bb43-134c1f84041f/530fad52-8386-59ef-bb43-134c1f84041f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51652,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0c/71/0c71e2b189b903b0985856140f170f59/pa/ST59109_612fc4e92b73dd5185906a9ad2af1070.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-11-02',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Urban',
'transmission': 'automatic',
'trim': 'BlueEfficiency Urban',
'year': 2015}
2026-03-30 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ST59109%27 HTTP/1.1" 200 None
2026-03-30 08:35:44 [auto1.be] INFO: Saving data for ST59109: {'created_time': 1774859744.918737, 'last_price_update_time': 1774859744.918749, 'auction_closing_time': 1774971379.0}
2026-03-30 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ST59109') HTTP/1.1" 204 0
2026-03-30 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F6a%252F416ab3b58b9d99e0d45328e41f4de259%252Fpa%252FME19194_e44932f7a74bb1c1c2728999a22ff1b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/6a/416ab3b58b9d99e0d45328e41f4de259/pa/ME19194_e44932f7a74bb1c1c2728999a22ff1b0.jpg not downloaded yet
2026-03-30 08:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F6a%252F416ab3b58b9d99e0d45328e41f4de259%252Fpa%252FME19194_58e387073229bc1a18f234a840ce99b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/6a/416ab3b58b9d99e0d45328e41f4de259/pa/ME19194_58e387073229bc1a18f234a840ce99b4.jpg not downloaded yet
2026-03-30 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F6a%252F416ab3b58b9d99e0d45328e41f4de259%252Fpa%252FME19194_fe27a630c1784e8f6b6ee5ae12637e42.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/6a/416ab3b58b9d99e0d45328e41f4de259/pa/ME19194_fe27a630c1784e8f6b6ee5ae12637e42.jpg not downloaded yet
2026-03-30 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F6a%252F416ab3b58b9d99e0d45328e41f4de259%252Fpa%252FME19194_844e2dde04a28dac4d25e0fc1613b45d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/6a/416ab3b58b9d99e0d45328e41f4de259/pa/ME19194_844e2dde04a28dac4d25e0fc1613b45d.jpg not downloaded yet
2026-03-30 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F6a%252F416ab3b58b9d99e0d45328e41f4de259%252Fpa%252FME19194_8c20c6c46c9a44278b553492d6ae1cb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/6a/416ab3b58b9d99e0d45328e41f4de259/pa/ME19194_8c20c6c46c9a44278b553492d6ae1cb6.jpg not downloaded yet
2026-03-30 08:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/6a/416ab3b58b9d99e0d45328e41f4de259/pa/ME19194_2d67c67173a0c8079c4adb511d94bb8f.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:35:45 [auto1.be] INFO: Channel: 24h | Page: 2 | totalHits: 1500 | hits on page: 40
2026-03-30 08:35:45 [auto1.be] INFO: Found listing with ID: BV48703
2026-03-30 08:35:45 [auto1.be] INFO: Found listing with ID: JH90909
2026-03-30 08:35:45 [auto1.be] INFO: Found listing with ID: UT07561
2026-03-30 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT07561%27 HTTP/1.1" 200 None
2026-03-30 08:35:45 [auto1.be] INFO: Scrape type for UT07561: 1
2026-03-30 08:35:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:45 [auto1.be] INFO: Found listing with ID: GN58348
2026-03-30 08:35:45 [auto1.be] INFO: Found listing with ID: XW45158
2026-03-30 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XW45158%27 HTTP/1.1" 200 None
2026-03-30 08:35:45 [auto1.be] INFO: Scrape type for XW45158: 2
2026-03-30 08:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 136163d3-2795-58ca-b733-16750f00b7d8 with identifier: XW45158
2026-03-30 08:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 136163d3-2795-58ca-b733-16750f00b7d8 with scrape type 2
2026-03-30 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 136163d3-2795-58ca-b733-16750f00b7d8 with scrape type 2
2026-03-30 08:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 136163d3-2795-58ca-b733-16750f00b7d8, identifier: XW45158
2026-03-30 08:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 136163d3-2795-58ca-b733-16750f00b7d8 with identifier: XW45158
2026-03-30 08:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 136163d3-2795-58ca-b733-16750f00b7d8 with identifier: XW45158
2026-03-30 08:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 136163d3-2795-58ca-b733-16750f00b7d8 with identifier: XW45158 to the API
2026-03-30 08:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 200,
'expiration_date': '2026-03-31T15:16:14Z',
'fuel_type': 'petrol',
'id': '136163d3-2795-58ca-b733-16750f00b7d8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW45158',
'listing': 'auction',
'make': 'Peugeot',
'model': 'RCZ',
'odometer': 112337,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-12-07',
'seller_name': None,
'title': 'Peugeot RCZ 1.6 THP Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2012}
2026-03-30 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XW45158%27 HTTP/1.1" 200 None
2026-03-30 08:35:45 [auto1.be] INFO: Saving data for XW45158: {'auction_closing_time': 1774970174.0, 'created_time': 1773137030.241935, 'last_price_update_time': 1774859745.619407}
2026-03-30 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XW45158') HTTP/1.1" 204 0
2026-03-30 08:35:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:45 [auto1.be] INFO: Found listing with ID: SE67148
2026-03-30 08:35:45 [auto1.be] INFO: Found listing with ID: KP55338
2026-03-30 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP55338%27 HTTP/1.1" 200 None
2026-03-30 08:35:45 [auto1.be] INFO: Scrape type for KP55338: 1
2026-03-30 08:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/6a/416ab3b58b9d99e0d45328e41f4de259/pa/ME19194_e44932f7a74bb1c1c2728999a22ff1b0.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/6a/416ab3b58b9d99e0d45328e41f4de259/pa/ME19194_fe27a630c1784e8f6b6ee5ae12637e42.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/6a/416ab3b58b9d99e0d45328e41f4de259/pa/ME19194_58e387073229bc1a18f234a840ce99b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/6a/416ab3b58b9d99e0d45328e41f4de259/pa/ME19194_844e2dde04a28dac4d25e0fc1613b45d.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/6a/416ab3b58b9d99e0d45328e41f4de259/pa/ME19194_8c20c6c46c9a44278b553492d6ae1cb6.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:35:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:35:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd85b9310>
2026-03-30 08:35:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:35:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:35:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a771b2f2-1111-5a2a-b797-ca09a4bcc9cf/a771b2f2-1111-5a2a-b797-ca09a4bcc9cf_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F6a%252F416ab3b58b9d99e0d45328e41f4de259%252Fpa%252FME19194_2d67c67173a0c8079c4adb511d94bb8f.jpg') HTTP/1.1" 204 0
2026-03-30 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/6a/416ab3b58b9d99e0d45328e41f4de259/pa/ME19194_2d67c67173a0c8079c4adb511d94bb8f.jpg saved to cache
2026-03-30 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a771b2f2-1111-5a2a-b797-ca09a4bcc9cf
2026-03-30 08:35:45 [auto1.be] INFO: Found listing with ID: ME39543
2026-03-30 08:35:45 [auto1.be] INFO: Found listing with ID: RN25296
2026-03-30 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RN25296%27 HTTP/1.1" 200 None
2026-03-30 08:35:45 [auto1.be] INFO: Scrape type for RN25296: 2
2026-03-30 08:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba9efb64-baf9-5264-b8c3-835185ce9a16 with identifier: RN25296
2026-03-30 08:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba9efb64-baf9-5264-b8c3-835185ce9a16 with scrape type 2
2026-03-30 08:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba9efb64-baf9-5264-b8c3-835185ce9a16 with scrape type 2
2026-03-30 08:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ba9efb64-baf9-5264-b8c3-835185ce9a16, identifier: RN25296
2026-03-30 08:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ba9efb64-baf9-5264-b8c3-835185ce9a16 with identifier: RN25296
2026-03-30 08:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ba9efb64-baf9-5264-b8c3-835185ce9a16 with identifier: RN25296
2026-03-30 08:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ba9efb64-baf9-5264-b8c3-835185ce9a16 with identifier: RN25296 to the API
2026-03-30 08:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 60,
'expiration_date': '2026-03-31T15:26:15Z',
'fuel_type': 'petrol',
'id': 'ba9efb64-baf9-5264-b8c3-835185ce9a16',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN25296',
'listing': 'auction',
'make': 'Peugeot',
'model': '206+',
'odometer': 165767,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-08-08',
'seller_name': None,
'title': 'Peugeot 206+ 1.1 Urban',
'transmission': 'manual',
'trim': 'Urban',
'year': 2011}
2026-03-30 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RN25296%27 HTTP/1.1" 200 None
2026-03-30 08:35:46 [auto1.be] INFO: Saving data for RN25296: {'auction_closing_time': 1774970775.0, 'created_time': 1774298225.269538, 'last_price_update_time': 1774859746.166067}
2026-03-30 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RN25296') HTTP/1.1" 204 0
2026-03-30 08:35:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:46 [auto1.be] INFO: Found listing with ID: CD49334
2026-03-30 08:35:46 [auto1.be] INFO: Found listing with ID: SG70291
2026-03-30 08:35:46 [auto1.be] INFO: Found listing with ID: MB15920
2026-03-30 08:35:46 [auto1.be] INFO: Found listing with ID: EU38310
2026-03-30 08:35:46 [auto1.be] INFO: Found listing with ID: NL96046
2026-03-30 08:35:46 [auto1.be] INFO: Found listing with ID: CW56663
2026-03-30 08:35:46 [auto1.be] INFO: Found listing with ID: GL12776
2026-03-30 08:35:46 [auto1.be] INFO: Found listing with ID: FA29131
2026-03-30 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA29131%27 HTTP/1.1" 200 None
2026-03-30 08:35:46 [auto1.be] INFO: Scrape type for FA29131: 1
2026-03-30 08:35:46 [auto1.be] INFO: Found listing with ID: MA67469
2026-03-30 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA67469%27 HTTP/1.1" 200 None
2026-03-30 08:35:46 [auto1.be] INFO: Scrape type for MA67469: 1
2026-03-30 08:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd90e1e50>
2026-03-30 08:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a771b2f2-1111-5a2a-b797-ca09a4bcc9cf/a771b2f2-1111-5a2a-b797-ca09a4bcc9cf_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F6a%252F416ab3b58b9d99e0d45328e41f4de259%252Fpa%252FME19194_e44932f7a74bb1c1c2728999a22ff1b0.jpg') HTTP/1.1" 204 0
2026-03-30 08:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/6a/416ab3b58b9d99e0d45328e41f4de259/pa/ME19194_e44932f7a74bb1c1c2728999a22ff1b0.jpg saved to cache
2026-03-30 08:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a771b2f2-1111-5a2a-b797-ca09a4bcc9cf
2026-03-30 08:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd85a0750>
2026-03-30 08:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a771b2f2-1111-5a2a-b797-ca09a4bcc9cf/a771b2f2-1111-5a2a-b797-ca09a4bcc9cf_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F6a%252F416ab3b58b9d99e0d45328e41f4de259%252Fpa%252FME19194_fe27a630c1784e8f6b6ee5ae12637e42.jpg') HTTP/1.1" 204 0
2026-03-30 08:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/6a/416ab3b58b9d99e0d45328e41f4de259/pa/ME19194_fe27a630c1784e8f6b6ee5ae12637e42.jpg saved to cache
2026-03-30 08:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a771b2f2-1111-5a2a-b797-ca09a4bcc9cf
2026-03-30 08:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd85d6c10>
2026-03-30 08:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a771b2f2-1111-5a2a-b797-ca09a4bcc9cf/a771b2f2-1111-5a2a-b797-ca09a4bcc9cf_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F6a%252F416ab3b58b9d99e0d45328e41f4de259%252Fpa%252FME19194_58e387073229bc1a18f234a840ce99b4.jpg') HTTP/1.1" 204 0
2026-03-30 08:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/6a/416ab3b58b9d99e0d45328e41f4de259/pa/ME19194_58e387073229bc1a18f234a840ce99b4.jpg saved to cache
2026-03-30 08:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a771b2f2-1111-5a2a-b797-ca09a4bcc9cf
2026-03-30 08:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8601090>
2026-03-30 08:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a771b2f2-1111-5a2a-b797-ca09a4bcc9cf/a771b2f2-1111-5a2a-b797-ca09a4bcc9cf_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F6a%252F416ab3b58b9d99e0d45328e41f4de259%252Fpa%252FME19194_844e2dde04a28dac4d25e0fc1613b45d.jpg') HTTP/1.1" 204 0
2026-03-30 08:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/6a/416ab3b58b9d99e0d45328e41f4de259/pa/ME19194_844e2dde04a28dac4d25e0fc1613b45d.jpg saved to cache
2026-03-30 08:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a771b2f2-1111-5a2a-b797-ca09a4bcc9cf
2026-03-30 08:35:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:35:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8f60810>
2026-03-30 08:35:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:35:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:35:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a771b2f2-1111-5a2a-b797-ca09a4bcc9cf/a771b2f2-1111-5a2a-b797-ca09a4bcc9cf_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F6a%252F416ab3b58b9d99e0d45328e41f4de259%252Fpa%252FME19194_8c20c6c46c9a44278b553492d6ae1cb6.jpg') HTTP/1.1" 204 0
2026-03-30 08:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/6a/416ab3b58b9d99e0d45328e41f4de259/pa/ME19194_8c20c6c46c9a44278b553492d6ae1cb6.jpg saved to cache
2026-03-30 08:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a771b2f2-1111-5a2a-b797-ca09a4bcc9cf
2026-03-30 08:35:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a771b2f2-1111-5a2a-b797-ca09a4bcc9cf, skipping ID generation
2026-03-30 08:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a771b2f2-1111-5a2a-b797-ca09a4bcc9cf with scrape type 1
2026-03-30 08:35:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a771b2f2-1111-5a2a-b797-ca09a4bcc9cf sending to next pipeline
2026-03-30 08:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a771b2f2-1111-5a2a-b797-ca09a4bcc9cf, identifier: ME19194
2026-03-30 08:35:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a771b2f2-1111-5a2a-b797-ca09a4bcc9cf with identifier: ME19194
2026-03-30 08:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a771b2f2-1111-5a2a-b797-ca09a4bcc9cf with identifier: ME19194
2026-03-30 08:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a771b2f2-1111-5a2a-b797-ca09a4bcc9cf with identifier: ME19194 to the API
2026-03-30 08:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img41/6a/416ab3b58b9d99e0d45328e41f4de259/pa/ME19194_8c20c6c46c9a44278b553492d6ae1cb6.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine': '1.4L',
'engine_horse_power': 80,
'expiration_date': '2026-03-31T15:34:17Z',
'fuel_type': 'petrol',
'id': 'a771b2f2-1111-5a2a-b797-ca09a4bcc9cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME19194',
'listing': 'auction',
'location': 'BE, Wauthier-Braine',
'make': 'Ford',
'model': 'Fusion',
'odometer': 118593,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a771b2f2-1111-5a2a-b797-ca09a4bcc9cf/a771b2f2-1111-5a2a-b797-ca09a4bcc9cf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112224,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/6a/416ab3b58b9d99e0d45328e41f4de259/pa/ME19194_2d67c67173a0c8079c4adb511d94bb8f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a771b2f2-1111-5a2a-b797-ca09a4bcc9cf/a771b2f2-1111-5a2a-b797-ca09a4bcc9cf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107342,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/6a/416ab3b58b9d99e0d45328e41f4de259/pa/ME19194_e44932f7a74bb1c1c2728999a22ff1b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a771b2f2-1111-5a2a-b797-ca09a4bcc9cf/a771b2f2-1111-5a2a-b797-ca09a4bcc9cf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88225,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/6a/416ab3b58b9d99e0d45328e41f4de259/pa/ME19194_58e387073229bc1a18f234a840ce99b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a771b2f2-1111-5a2a-b797-ca09a4bcc9cf/a771b2f2-1111-5a2a-b797-ca09a4bcc9cf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83372,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/6a/416ab3b58b9d99e0d45328e41f4de259/pa/ME19194_fe27a630c1784e8f6b6ee5ae12637e42.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a771b2f2-1111-5a2a-b797-ca09a4bcc9cf/a771b2f2-1111-5a2a-b797-ca09a4bcc9cf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122177,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/6a/416ab3b58b9d99e0d45328e41f4de259/pa/ME19194_844e2dde04a28dac4d25e0fc1613b45d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a771b2f2-1111-5a2a-b797-ca09a4bcc9cf/a771b2f2-1111-5a2a-b797-ca09a4bcc9cf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87178,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img41/6a/416ab3b58b9d99e0d45328e41f4de259/pa/ME19194_8c20c6c46c9a44278b553492d6ae1cb6.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2007-05-17',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fusion 1.4 Zetec',
'transmission': 'manual',
'trim': 'Zetec',
'year': 2007}
2026-03-30 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ME19194%27 HTTP/1.1" 200 None
2026-03-30 08:35:47 [auto1.be] INFO: Saving data for ME19194: {'created_time': 1774859747.083577, 'last_price_update_time': 1774859747.083592, 'auction_closing_time': 1774971257.0}
2026-03-30 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ME19194') HTTP/1.1" 204 0
2026-03-30 08:35:47 [auto1.be] INFO: Found listing with ID: FL73906
2026-03-30 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL73906%27 HTTP/1.1" 200 None
2026-03-30 08:35:47 [auto1.be] INFO: Scrape type for FL73906: 2
2026-03-30 08:35:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78baca0d-4cae-5e78-a9ec-853710649ef1 with identifier: FL73906
2026-03-30 08:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78baca0d-4cae-5e78-a9ec-853710649ef1 with scrape type 2
2026-03-30 08:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78baca0d-4cae-5e78-a9ec-853710649ef1 with scrape type 2
2026-03-30 08:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 78baca0d-4cae-5e78-a9ec-853710649ef1, identifier: FL73906
2026-03-30 08:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 78baca0d-4cae-5e78-a9ec-853710649ef1 with identifier: FL73906
2026-03-30 08:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 78baca0d-4cae-5e78-a9ec-853710649ef1 with identifier: FL73906
2026-03-30 08:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 78baca0d-4cae-5e78-a9ec-853710649ef1 with identifier: FL73906 to the API
2026-03-30 08:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:14:26Z',
'fuel_type': 'diesel',
'id': '78baca0d-4cae-5e78-a9ec-853710649ef1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL73906',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 177470,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-31',
'seller_name': None,
'title': 'Ford Focus 1.6 TDCi Concept',
'transmission': 'manual',
'trim': 'Concept',
'year': 2011}
2026-03-30 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FL73906%27 HTTP/1.1" 200 None
2026-03-30 08:35:47 [auto1.be] INFO: Saving data for FL73906: {'auction_closing_time': 1774970066.0, 'created_time': 1773693638.060467, 'last_price_update_time': 1774859747.678349}
2026-03-30 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FL73906') HTTP/1.1" 204 0
2026-03-30 08:35:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:47 [auto1.be] INFO: Found listing with ID: KL19623
2026-03-30 08:35:47 [auto1.be] INFO: Found listing with ID: TR13838
2026-03-30 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR13838%27 HTTP/1.1" 200 None
2026-03-30 08:35:47 [auto1.be] INFO: Scrape type for TR13838: 1
2026-03-30 08:35:47 [auto1.be] INFO: Found listing with ID: LW89201
2026-03-30 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW89201%27 HTTP/1.1" 200 None
2026-03-30 08:35:47 [auto1.be] INFO: Scrape type for LW89201: 1
2026-03-30 08:35:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:47 [auto1.be] INFO: Found listing with ID: ZC05502
2026-03-30 08:35:47 [auto1.be] INFO: Found listing with ID: AG54530
2026-03-30 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG54530%27 HTTP/1.1" 200 None
2026-03-30 08:35:47 [auto1.be] INFO: Scrape type for AG54530: 1
2026-03-30 08:35:47 [auto1.be] INFO: Found listing with ID: UU73016
2026-03-30 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU73016%27 HTTP/1.1" 200 None
2026-03-30 08:35:47 [auto1.be] INFO: Scrape type for UU73016: 1
2026-03-30 08:35:47 [auto1.be] INFO: Found listing with ID: YG75749
2026-03-30 08:35:47 [auto1.be] INFO: Found listing with ID: FU28808
2026-03-30 08:35:47 [auto1.be] INFO: Found listing with ID: MS70949
2026-03-30 08:35:47 [auto1.be] INFO: Found listing with ID: CX41368
2026-03-30 08:35:47 [auto1.be] INFO: Found listing with ID: BT12815
2026-03-30 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT12815%27 HTTP/1.1" 200 None
2026-03-30 08:35:47 [auto1.be] INFO: Scrape type for BT12815: 2
2026-03-30 08:35:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb922cee-ae97-523d-acbf-7348638e9916 with identifier: BT12815
2026-03-30 08:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb922cee-ae97-523d-acbf-7348638e9916 with scrape type 2
2026-03-30 08:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb922cee-ae97-523d-acbf-7348638e9916 with scrape type 2
2026-03-30 08:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cb922cee-ae97-523d-acbf-7348638e9916, identifier: BT12815
2026-03-30 08:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cb922cee-ae97-523d-acbf-7348638e9916 with identifier: BT12815
2026-03-30 08:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cb922cee-ae97-523d-acbf-7348638e9916 with identifier: BT12815
2026-03-30 08:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cb922cee-ae97-523d-acbf-7348638e9916 with identifier: BT12815 to the API
2026-03-30 08:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:16:17Z',
'fuel_type': 'petrol',
'id': 'cb922cee-ae97-523d-acbf-7348638e9916',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT12815',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Partner',
'odometer': 270341,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-09-24',
'seller_name': None,
'title': 'Peugeot Partner 1.4 Confort',
'transmission': 'manual',
'trim': 'Confort',
'year': 2007}
2026-03-30 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT12815%27 HTTP/1.1" 200 None
2026-03-30 08:35:48 [auto1.be] INFO: Saving data for BT12815: {'auction_closing_time': 1774970177.0, 'created_time': 1774298303.60701, 'last_price_update_time': 1774859748.240904}
2026-03-30 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BT12815') HTTP/1.1" 204 0
2026-03-30 08:35:48 [auto1.be] INFO: Found listing with ID: PY47802
2026-03-30 08:35:48 [auto1.be] INFO: Found listing with ID: RD37587
2026-03-30 08:35:48 [auto1.be] INFO: Found listing with ID: RV20515
2026-03-30 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RV20515%27 HTTP/1.1" 200 None
2026-03-30 08:35:48 [auto1.be] INFO: Scrape type for RV20515: 2
2026-03-30 08:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ddedf3d-f0f8-52a2-8e50-38d24aef6e6b with identifier: RV20515
2026-03-30 08:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ddedf3d-f0f8-52a2-8e50-38d24aef6e6b with scrape type 2
2026-03-30 08:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ddedf3d-f0f8-52a2-8e50-38d24aef6e6b with scrape type 2
2026-03-30 08:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7ddedf3d-f0f8-52a2-8e50-38d24aef6e6b, identifier: RV20515
2026-03-30 08:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7ddedf3d-f0f8-52a2-8e50-38d24aef6e6b with identifier: RV20515
2026-03-30 08:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7ddedf3d-f0f8-52a2-8e50-38d24aef6e6b with identifier: RV20515
2026-03-30 08:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7ddedf3d-f0f8-52a2-8e50-38d24aef6e6b with identifier: RV20515 to the API
2026-03-30 08:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 300,
'expiration_date': '2026-03-31T15:35:48Z',
'fuel_type': 'petrol',
'id': '7ddedf3d-f0f8-52a2-8e50-38d24aef6e6b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV20515',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VIII',
'odometer': 38986,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-11',
'seller_name': None,
'title': 'Volkswagen Golf VIII 2.0 TSI GTI Clubsport',
'transmission': 'automatic',
'trim': 'GTI Clubsport',
'year': 2022}
2026-03-30 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RV20515%27 HTTP/1.1" 200 None
2026-03-30 08:35:48 [auto1.be] INFO: Saving data for RV20515: {'auction_closing_time': 1774971348.0, 'created_time': 1774039063.593968, 'last_price_update_time': 1774859748.79926}
2026-03-30 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RV20515') HTTP/1.1" 204 0
2026-03-30 08:35:48 [auto1.be] INFO: Found listing with ID: SG64560
2026-03-30 08:35:48 [auto1.be] INFO: Found listing with ID: XL28387
2026-03-30 08:35:48 [auto1.be] INFO: Found listing with ID: XZ87385
2026-03-30 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ87385%27 HTTP/1.1" 200 None
2026-03-30 08:35:48 [auto1.be] INFO: Scrape type for XZ87385: 2
2026-03-30 08:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ef11587-612a-58ee-8501-ee6cdbd9e0de with identifier: XZ87385
2026-03-30 08:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ef11587-612a-58ee-8501-ee6cdbd9e0de with scrape type 2
2026-03-30 08:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ef11587-612a-58ee-8501-ee6cdbd9e0de with scrape type 2
2026-03-30 08:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9ef11587-612a-58ee-8501-ee6cdbd9e0de, identifier: XZ87385
2026-03-30 08:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9ef11587-612a-58ee-8501-ee6cdbd9e0de with identifier: XZ87385
2026-03-30 08:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9ef11587-612a-58ee-8501-ee6cdbd9e0de with identifier: XZ87385
2026-03-30 08:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9ef11587-612a-58ee-8501-ee6cdbd9e0de with identifier: XZ87385 to the API
2026-03-30 08:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:15:08Z',
'fuel_type': 'diesel',
'id': '9ef11587-612a-58ee-8501-ee6cdbd9e0de',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ87385',
'listing': 'auction',
'make': 'MINI',
'model': 'Clubman',
'odometer': 95841,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-28',
'seller_name': None,
'title': 'MINI Clubman Cooper D',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-30 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ87385%27 HTTP/1.1" 200 None
2026-03-30 08:35:49 [auto1.be] INFO: Saving data for XZ87385: {'auction_closing_time': 1774970108.0, 'created_time': 1773239620.885351, 'last_price_update_time': 1774859749.320946}
2026-03-30 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XZ87385') HTTP/1.1" 204 0
2026-03-30 08:35:49 [auto1.be] INFO: Found listing with ID: WR41774
2026-03-30 08:35:49 [auto1.be] INFO: Found listing with ID: DT02833
2026-03-30 08:35:49 [auto1.be] INFO: Found listing with ID: ZV23610
2026-03-30 08:35:49 [auto1.be] INFO: Found listing with ID: FH19686
2026-03-30 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH19686%27 HTTP/1.1" 200 None
2026-03-30 08:35:49 [auto1.be] INFO: Scrape type for FH19686: 2
2026-03-30 08:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26baca3c-9941-525f-8c4f-e264c11e5f3b with identifier: FH19686
2026-03-30 08:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26baca3c-9941-525f-8c4f-e264c11e5f3b with scrape type 2
2026-03-30 08:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26baca3c-9941-525f-8c4f-e264c11e5f3b with scrape type 2
2026-03-30 08:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 26baca3c-9941-525f-8c4f-e264c11e5f3b, identifier: FH19686
2026-03-30 08:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 26baca3c-9941-525f-8c4f-e264c11e5f3b with identifier: FH19686
2026-03-30 08:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 26baca3c-9941-525f-8c4f-e264c11e5f3b with identifier: FH19686
2026-03-30 08:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 26baca3c-9941-525f-8c4f-e264c11e5f3b with identifier: FH19686 to the API
2026-03-30 08:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 77,
'expiration_date': '2026-03-31T15:34:25Z',
'fuel_type': 'petrol',
'id': '26baca3c-9941-525f-8c4f-e264c11e5f3b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH19686',
'listing': 'auction',
'make': 'Honda',
'model': 'Jazz',
'odometer': 155250,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-03-09',
'seller_name': None,
'title': 'Honda Jazz 1.2 DSi',
'transmission': 'manual',
'trim': '',
'year': 2008}
2026-03-30 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH19686%27 HTTP/1.1" 200 None
2026-03-30 08:35:49 [auto1.be] INFO: Saving data for FH19686: {'auction_closing_time': 1774971265.0, 'created_time': 1773134266.513909, 'last_price_update_time': 1774859749.835586}
2026-03-30 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FH19686') HTTP/1.1" 204 0
2026-03-30 08:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UT07561/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:35:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KP55338/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FA29131/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:35:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:49 [auto1.be] INFO: Channel: 24h | Page: 3 | totalHits: 1500 | hits on page: 40
2026-03-30 08:35:49 [auto1.be] INFO: Found listing with ID: JT53562
2026-03-30 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT53562%27 HTTP/1.1" 200 None
2026-03-30 08:35:49 [auto1.be] INFO: Scrape type for JT53562: 2
2026-03-30 08:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d7351ae-b6ec-57b8-a833-bc2ce9635e31 with identifier: JT53562
2026-03-30 08:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d7351ae-b6ec-57b8-a833-bc2ce9635e31 with scrape type 2
2026-03-30 08:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d7351ae-b6ec-57b8-a833-bc2ce9635e31 with scrape type 2
2026-03-30 08:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5d7351ae-b6ec-57b8-a833-bc2ce9635e31, identifier: JT53562
2026-03-30 08:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5d7351ae-b6ec-57b8-a833-bc2ce9635e31 with identifier: JT53562
2026-03-30 08:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5d7351ae-b6ec-57b8-a833-bc2ce9635e31 with identifier: JT53562
2026-03-30 08:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5d7351ae-b6ec-57b8-a833-bc2ce9635e31 with identifier: JT53562 to the API
2026-03-30 08:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 85,
'expiration_date': '2026-03-31T15:14:16Z',
'fuel_type': 'petrol',
'id': '5d7351ae-b6ec-57b8-a833-bc2ce9635e31',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT53562',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 135731,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-07',
'seller_name': None,
'title': 'Opel Corsa 1.2 Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2012}
2026-03-30 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT53562%27 HTTP/1.1" 200 None
2026-03-30 08:35:50 [auto1.be] INFO: Saving data for JT53562: {'auction_closing_time': 1774970056.0, 'created_time': 1773228008.856981, 'last_price_update_time': 1774859750.375335}
2026-03-30 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JT53562') HTTP/1.1" 204 0
2026-03-30 08:35:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:50 [auto1.be] INFO: Found listing with ID: NH91226
2026-03-30 08:35:50 [auto1.be] INFO: Found listing with ID: RS16623
2026-03-30 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS16623%27 HTTP/1.1" 200 None
2026-03-30 08:35:50 [auto1.be] INFO: Scrape type for RS16623: 2
2026-03-30 08:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15dabd15-1724-5fec-9932-b70f222b7e77 with identifier: RS16623
2026-03-30 08:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15dabd15-1724-5fec-9932-b70f222b7e77 with scrape type 2
2026-03-30 08:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15dabd15-1724-5fec-9932-b70f222b7e77 with scrape type 2
2026-03-30 08:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 15dabd15-1724-5fec-9932-b70f222b7e77, identifier: RS16623
2026-03-30 08:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 15dabd15-1724-5fec-9932-b70f222b7e77 with identifier: RS16623
2026-03-30 08:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 15dabd15-1724-5fec-9932-b70f222b7e77 with identifier: RS16623
2026-03-30 08:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 15dabd15-1724-5fec-9932-b70f222b7e77 with identifier: RS16623 to the API
2026-03-30 08:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:14:22Z',
'fuel_type': 'petrol',
'id': '15dabd15-1724-5fec-9932-b70f222b7e77',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS16623',
'listing': 'auction',
'make': 'Kia',
'model': "cee'd",
'odometer': 141191,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-07',
'seller_name': None,
'title': "Kia cee'd 1.0 TGDI Active",
'transmission': 'manual',
'trim': 'Active',
'year': 2019}
2026-03-30 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS16623%27 HTTP/1.1" 200 None
2026-03-30 08:35:50 [auto1.be] INFO: Saving data for RS16623: {'auction_closing_time': 1774970062.0, 'created_time': 1773135652.636807, 'last_price_update_time': 1774859750.939774}
2026-03-30 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RS16623') HTTP/1.1" 204 0
2026-03-30 08:35:50 [auto1.be] INFO: Found listing with ID: ZY23736
2026-03-30 08:35:50 [auto1.be] INFO: Found listing with ID: CD50328
2026-03-30 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD50328%27 HTTP/1.1" 200 None
2026-03-30 08:35:50 [auto1.be] INFO: Scrape type for CD50328: 2
2026-03-30 08:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27845ad9-51ba-5141-9087-3ad1998081b9 with identifier: CD50328
2026-03-30 08:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27845ad9-51ba-5141-9087-3ad1998081b9 with scrape type 2
2026-03-30 08:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27845ad9-51ba-5141-9087-3ad1998081b9 with scrape type 2
2026-03-30 08:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 27845ad9-51ba-5141-9087-3ad1998081b9, identifier: CD50328
2026-03-30 08:35:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MA67469/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 27845ad9-51ba-5141-9087-3ad1998081b9 with identifier: CD50328
2026-03-30 08:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 27845ad9-51ba-5141-9087-3ad1998081b9 with identifier: CD50328
2026-03-30 08:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 27845ad9-51ba-5141-9087-3ad1998081b9 with identifier: CD50328 to the API
2026-03-30 08:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-31T15:22:24Z',
'fuel_type': 'petrol',
'id': '27845ad9-51ba-5141-9087-3ad1998081b9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD50328',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 190374,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-28',
'seller_name': None,
'title': 'Ford Fiesta 1.25 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2015}
2026-03-30 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD50328%27 HTTP/1.1" 200 None
2026-03-30 08:35:51 [auto1.be] INFO: Saving data for CD50328: {'auction_closing_time': 1774970544.0, 'created_time': 1773693928.615321, 'last_price_update_time': 1774859751.396384}
2026-03-30 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CD50328') HTTP/1.1" 204 0
2026-03-30 08:35:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:51 [auto1.be] INFO: Found listing with ID: LC68044
2026-03-30 08:35:51 [auto1.be] INFO: Found listing with ID: FM77705
2026-03-30 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM77705%27 HTTP/1.1" 200 None
2026-03-30 08:35:51 [auto1.be] INFO: Scrape type for FM77705: 2
2026-03-30 08:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c67623f-9958-5463-a258-d28b781d71f1 with identifier: FM77705
2026-03-30 08:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c67623f-9958-5463-a258-d28b781d71f1 with scrape type 2
2026-03-30 08:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c67623f-9958-5463-a258-d28b781d71f1 with scrape type 2
2026-03-30 08:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6c67623f-9958-5463-a258-d28b781d71f1, identifier: FM77705
2026-03-30 08:35:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TR13838/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6c67623f-9958-5463-a258-d28b781d71f1 with identifier: FM77705
2026-03-30 08:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6c67623f-9958-5463-a258-d28b781d71f1 with identifier: FM77705
2026-03-30 08:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6c67623f-9958-5463-a258-d28b781d71f1 with identifier: FM77705 to the API
2026-03-30 08:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:56:59Z',
'fuel_type': 'diesel',
'id': '6c67623f-9958-5463-a258-d28b781d71f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM77705',
'listing': 'auction',
'make': 'Chevrolet',
'model': 'Orlando',
'odometer': 207547,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-25',
'seller_name': None,
'title': 'Chevrolet Orlando 2.0 Diesel LS',
'transmission': 'manual',
'trim': 'LS',
'year': 2012}
2026-03-30 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM77705%27 HTTP/1.1" 200 None
2026-03-30 08:35:51 [auto1.be] INFO: Saving data for FM77705: {'auction_closing_time': 1774972619.0, 'created_time': 1773137871.201578, 'last_price_update_time': 1774859751.870751}
2026-03-30 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FM77705') HTTP/1.1" 204 0
2026-03-30 08:35:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:51 [auto1.be] INFO: Found listing with ID: ZH14526
2026-03-30 08:35:51 [auto1.be] INFO: Found listing with ID: TY33491
2026-03-30 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY33491%27 HTTP/1.1" 200 None
2026-03-30 08:35:51 [auto1.be] INFO: Scrape type for TY33491: 2
2026-03-30 08:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26549f8a-0cd8-5dd2-bfb8-e83bf5d5d426 with identifier: TY33491
2026-03-30 08:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26549f8a-0cd8-5dd2-bfb8-e83bf5d5d426 with scrape type 2
2026-03-30 08:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26549f8a-0cd8-5dd2-bfb8-e83bf5d5d426 with scrape type 2
2026-03-30 08:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 26549f8a-0cd8-5dd2-bfb8-e83bf5d5d426, identifier: TY33491
2026-03-30 08:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 26549f8a-0cd8-5dd2-bfb8-e83bf5d5d426 with identifier: TY33491
2026-03-30 08:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 26549f8a-0cd8-5dd2-bfb8-e83bf5d5d426 with identifier: TY33491
2026-03-30 08:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 26549f8a-0cd8-5dd2-bfb8-e83bf5d5d426 with identifier: TY33491 to the API
2026-03-30 08:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 145,
'expiration_date': '2026-03-31T15:22:42Z',
'fuel_type': 'diesel',
'id': '26549f8a-0cd8-5dd2-bfb8-e83bf5d5d426',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY33491',
'listing': 'auction',
'make': 'Renault',
'model': 'Master',
'odometer': 199226,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-18',
'seller_name': None,
'title': 'Renault Master 2.3 dCi Energy L3H2 HKa 3,5t',
'transmission': 'manual',
'trim': 'L3H2 HKa 3,5t',
'year': 2018}
2026-03-30 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY33491%27 HTTP/1.1" 200 None
2026-03-30 08:35:52 [auto1.be] INFO: Saving data for TY33491: {'auction_closing_time': 1774970562.0, 'created_time': 1773301886.95503, 'last_price_update_time': 1774859752.347259}
2026-03-30 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TY33491') HTTP/1.1" 204 0
2026-03-30 08:35:52 [auto1.be] INFO: Found listing with ID: HA32985
2026-03-30 08:35:52 [auto1.be] INFO: Found listing with ID: VU67376
2026-03-30 08:35:52 [auto1.be] INFO: Found listing with ID: TS76065
2026-03-30 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS76065%27 HTTP/1.1" 200 None
2026-03-30 08:35:52 [auto1.be] INFO: Scrape type for TS76065: 1
2026-03-30 08:35:52 [auto1.be] INFO: Found listing with ID: TK82832
2026-03-30 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK82832%27 HTTP/1.1" 200 None
2026-03-30 08:35:52 [auto1.be] INFO: Scrape type for TK82832: 2
2026-03-30 08:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a368676f-40c0-5a92-ac63-79fa07c54a71 with identifier: TK82832
2026-03-30 08:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a368676f-40c0-5a92-ac63-79fa07c54a71 with scrape type 2
2026-03-30 08:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a368676f-40c0-5a92-ac63-79fa07c54a71 with scrape type 2
2026-03-30 08:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a368676f-40c0-5a92-ac63-79fa07c54a71, identifier: TK82832
2026-03-30 08:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a368676f-40c0-5a92-ac63-79fa07c54a71 with identifier: TK82832
2026-03-30 08:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a368676f-40c0-5a92-ac63-79fa07c54a71 with identifier: TK82832
2026-03-30 08:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a368676f-40c0-5a92-ac63-79fa07c54a71 with identifier: TK82832 to the API
2026-03-30 08:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:34:34Z',
'fuel_type': 'diesel',
'id': 'a368676f-40c0-5a92-ac63-79fa07c54a71',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK82832',
'listing': 'auction',
'make': 'BMW',
'model': 'X4',
'odometer': 202366,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-01',
'seller_name': None,
'title': 'BMW X4 xDrive 20d Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2018}
2026-03-30 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK82832%27 HTTP/1.1" 200 None
2026-03-30 08:35:52 [auto1.be] INFO: Saving data for TK82832: {'auction_closing_time': 1774971274.0, 'created_time': 1773780008.972512, 'last_price_update_time': 1774859752.82315}
2026-03-30 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TK82832') HTTP/1.1" 204 0
2026-03-30 08:35:52 [auto1.be] INFO: Found listing with ID: DH79590
2026-03-30 08:35:52 [auto1.be] INFO: Found listing with ID: YS75558
2026-03-30 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS75558%27 HTTP/1.1" 200 None
2026-03-30 08:35:52 [auto1.be] INFO: Scrape type for YS75558: 2
2026-03-30 08:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a127bb04-5a98-5f4f-8b7e-025b2874ac21 with identifier: YS75558
2026-03-30 08:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a127bb04-5a98-5f4f-8b7e-025b2874ac21 with scrape type 2
2026-03-30 08:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a127bb04-5a98-5f4f-8b7e-025b2874ac21 with scrape type 2
2026-03-30 08:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a127bb04-5a98-5f4f-8b7e-025b2874ac21, identifier: YS75558
2026-03-30 08:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a127bb04-5a98-5f4f-8b7e-025b2874ac21 with identifier: YS75558
2026-03-30 08:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a127bb04-5a98-5f4f-8b7e-025b2874ac21 with identifier: YS75558
2026-03-30 08:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a127bb04-5a98-5f4f-8b7e-025b2874ac21 with identifier: YS75558 to the API
2026-03-30 08:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:57:01Z',
'fuel_type': 'diesel',
'id': 'a127bb04-5a98-5f4f-8b7e-025b2874ac21',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS75558',
'listing': 'auction',
'make': 'Volvo',
'model': 'V70',
'odometer': 239776,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-13',
'seller_name': None,
'title': 'Volvo V70 2.0 D3 Kinetic',
'transmission': 'manual',
'trim': 'Kinetic',
'year': 2012}
2026-03-30 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YS75558%27 HTTP/1.1" 200 None
2026-03-30 08:35:53 [auto1.be] INFO: Saving data for YS75558: {'auction_closing_time': 1774972621.0, 'created_time': 1773693736.870881, 'last_price_update_time': 1774859753.497265}
2026-03-30 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YS75558') HTTP/1.1" 204 0
2026-03-30 08:35:53 [auto1.be] INFO: Found listing with ID: VP95014
2026-03-30 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP95014%27 HTTP/1.1" 200 None
2026-03-30 08:35:53 [auto1.be] INFO: Scrape type for VP95014: 1
2026-03-30 08:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LW89201/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AG54530/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UU73016/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:35:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:53 [auto1.be] INFO: Found listing with ID: DZ24480
2026-03-30 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ24480%27 HTTP/1.1" 200 None
2026-03-30 08:35:53 [auto1.be] INFO: Scrape type for DZ24480: 2
2026-03-30 08:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dd689a5-da7d-58b2-8a23-dd5a65dcb5a1 with identifier: DZ24480
2026-03-30 08:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dd689a5-da7d-58b2-8a23-dd5a65dcb5a1 with scrape type 2
2026-03-30 08:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0dd689a5-da7d-58b2-8a23-dd5a65dcb5a1 with scrape type 2
2026-03-30 08:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0dd689a5-da7d-58b2-8a23-dd5a65dcb5a1, identifier: DZ24480
2026-03-30 08:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0dd689a5-da7d-58b2-8a23-dd5a65dcb5a1 with identifier: DZ24480
2026-03-30 08:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0dd689a5-da7d-58b2-8a23-dd5a65dcb5a1 with identifier: DZ24480
2026-03-30 08:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0dd689a5-da7d-58b2-8a23-dd5a65dcb5a1 with identifier: DZ24480 to the API
2026-03-30 08:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 129,
'expiration_date': '2026-03-31T15:02:36Z',
'fuel_type': 'petrol',
'id': '0dd689a5-da7d-58b2-8a23-dd5a65dcb5a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ24480',
'listing': 'auction',
'make': 'Suzuki',
'model': 'SX4 S-Cross',
'odometer': 106268,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-27',
'seller_name': None,
'title': 'Suzuki SX4 S-Cross 1.4 BoosterJet Mild-Hybrid Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2020}
2026-03-30 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ24480%27 HTTP/1.1" 200 None
2026-03-30 08:35:53 [auto1.be] INFO: Saving data for DZ24480: {'auction_closing_time': 1774969356.0, 'created_time': 1773693556.320044, 'last_price_update_time': 1774859753.968957}
2026-03-30 08:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DZ24480') HTTP/1.1" 204 0
2026-03-30 08:35:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:54 [auto1.be] INFO: Found listing with ID: GN71373
2026-03-30 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN71373%27 HTTP/1.1" 200 None
2026-03-30 08:35:54 [auto1.be] INFO: Scrape type for GN71373: 2
2026-03-30 08:35:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21a5d323-89a5-50f8-a71d-570999b5d22b with identifier: GN71373
2026-03-30 08:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21a5d323-89a5-50f8-a71d-570999b5d22b with scrape type 2
2026-03-30 08:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21a5d323-89a5-50f8-a71d-570999b5d22b with scrape type 2
2026-03-30 08:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 21a5d323-89a5-50f8-a71d-570999b5d22b, identifier: GN71373
2026-03-30 08:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 21a5d323-89a5-50f8-a71d-570999b5d22b with identifier: GN71373
2026-03-30 08:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 21a5d323-89a5-50f8-a71d-570999b5d22b with identifier: GN71373
2026-03-30 08:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 21a5d323-89a5-50f8-a71d-570999b5d22b with identifier: GN71373 to the API
2026-03-30 08:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:19:47Z',
'fuel_type': 'petrol',
'id': '21a5d323-89a5-50f8-a71d-570999b5d22b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN71373',
'listing': 'auction',
'make': 'MINI',
'model': 'Countryman',
'odometer': 257351,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-11',
'seller_name': None,
'title': 'MINI Countryman Cooper',
'transmission': 'manual',
'trim': '',
'year': 2018}
2026-03-30 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GN71373%27 HTTP/1.1" 200 None
2026-03-30 08:35:54 [auto1.be] INFO: Saving data for GN71373: {'auction_closing_time': 1774970387.0, 'created_time': 1774471175.934794, 'last_price_update_time': 1774859754.57232}
2026-03-30 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GN71373') HTTP/1.1" 204 0
2026-03-30 08:35:54 [auto1.be] INFO: Found listing with ID: MJ01257
2026-03-30 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ01257%27 HTTP/1.1" 200 None
2026-03-30 08:35:54 [auto1.be] INFO: Scrape type for MJ01257: 2
2026-03-30 08:35:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac8c8223-c2d0-5dae-af18-465feeec66c5 with identifier: MJ01257
2026-03-30 08:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac8c8223-c2d0-5dae-af18-465feeec66c5 with scrape type 2
2026-03-30 08:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac8c8223-c2d0-5dae-af18-465feeec66c5 with scrape type 2
2026-03-30 08:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ac8c8223-c2d0-5dae-af18-465feeec66c5, identifier: MJ01257
2026-03-30 08:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ac8c8223-c2d0-5dae-af18-465feeec66c5 with identifier: MJ01257
2026-03-30 08:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ac8c8223-c2d0-5dae-af18-465feeec66c5 with identifier: MJ01257
2026-03-30 08:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ac8c8223-c2d0-5dae-af18-465feeec66c5 with identifier: MJ01257 to the API
2026-03-30 08:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:30:35Z',
'fuel_type': 'petrol',
'id': 'ac8c8223-c2d0-5dae-af18-465feeec66c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ01257',
'listing': 'auction',
'make': 'Nissan',
'model': 'Townstar',
'odometer': 41483,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-06',
'seller_name': None,
'title': 'Nissan Townstar 1.3 DIG-T L1 Acenta',
'transmission': 'manual',
'trim': 'L1 Acenta',
'year': 2023}
2026-03-30 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ01257%27 HTTP/1.1" 200 None
2026-03-30 08:35:55 [auto1.be] INFO: Saving data for MJ01257: {'auction_closing_time': 1774971035.0, 'created_time': 1774514134.616338, 'last_price_update_time': 1774859755.019545}
2026-03-30 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MJ01257') HTTP/1.1" 204 0
2026-03-30 08:35:55 [auto1.be] INFO: Channel: 24h | Page: 4 | totalHits: 1500 | hits on page: 40
2026-03-30 08:35:55 [auto1.be] INFO: Found listing with ID: VL86303
2026-03-30 08:35:55 [auto1.be] INFO: Found listing with ID: AY48728
2026-03-30 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY48728%27 HTTP/1.1" 200 None
2026-03-30 08:35:55 [auto1.be] INFO: Scrape type for AY48728: 2
2026-03-30 08:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d22e983-63db-5272-9092-a0543eb9f6ac with identifier: AY48728
2026-03-30 08:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d22e983-63db-5272-9092-a0543eb9f6ac with scrape type 2
2026-03-30 08:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d22e983-63db-5272-9092-a0543eb9f6ac with scrape type 2
2026-03-30 08:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5d22e983-63db-5272-9092-a0543eb9f6ac, identifier: AY48728
2026-03-30 08:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UT07561> (referer: https://www.auto1.com/v1/car-details-view/UT07561/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FA29131> (referer: https://www.auto1.com/v1/car-details-view/FA29131/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5d22e983-63db-5272-9092-a0543eb9f6ac with identifier: AY48728
2026-03-30 08:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5d22e983-63db-5272-9092-a0543eb9f6ac with identifier: AY48728
2026-03-30 08:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5d22e983-63db-5272-9092-a0543eb9f6ac with identifier: AY48728 to the API
2026-03-30 08:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-31T15:00:52Z',
'fuel_type': 'petrol',
'id': '5d22e983-63db-5272-9092-a0543eb9f6ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY48728',
'listing': 'auction',
'make': 'Opel',
'model': 'Corsa',
'odometer': 72841,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-29',
'seller_name': None,
'title': 'Opel Corsa 1.2 Turbo Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2023}
2026-03-30 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY48728%27 HTTP/1.1" 200 None
2026-03-30 08:35:55 [auto1.be] INFO: Saving data for AY48728: {'auction_closing_time': 1774969252.0, 'created_time': 1773238228.814637, 'last_price_update_time': 1774859755.493129}
2026-03-30 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AY48728') HTTP/1.1" 204 0
2026-03-30 08:35:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:55 [auto1.be] INFO: Found listing with ID: PD78607
2026-03-30 08:35:55 [auto1.be] INFO: Found listing with ID: NN42676
2026-03-30 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN42676%27 HTTP/1.1" 200 None
2026-03-30 08:35:55 [auto1.be] INFO: Scrape type for NN42676: 2
2026-03-30 08:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61bfc445-3d2d-5a5d-aaa0-e267f4cdef8a with identifier: NN42676
2026-03-30 08:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61bfc445-3d2d-5a5d-aaa0-e267f4cdef8a with scrape type 2
2026-03-30 08:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61bfc445-3d2d-5a5d-aaa0-e267f4cdef8a with scrape type 2
2026-03-30 08:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 61bfc445-3d2d-5a5d-aaa0-e267f4cdef8a, identifier: NN42676
2026-03-30 08:35:55 [auto1.be] INFO: Found listing with ID: DY90857
2026-03-30 08:35:55 [auto1.be] INFO: Found listing with ID: LB99980
2026-03-30 08:35:55 [auto1.be] INFO: Found listing with ID: FH32822
2026-03-30 08:35:55 [auto1.be] INFO: Found listing with ID: GS30663
2026-03-30 08:35:55 [auto1.be] INFO: Found listing with ID: YE48599
2026-03-30 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YE48599%27 HTTP/1.1" 200 None
2026-03-30 08:35:55 [auto1.be] INFO: Scrape type for YE48599: 2
2026-03-30 08:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2be78990-e0df-59b0-b49d-32fc0443e656 with identifier: YE48599
2026-03-30 08:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2be78990-e0df-59b0-b49d-32fc0443e656 with scrape type 2
2026-03-30 08:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2be78990-e0df-59b0-b49d-32fc0443e656 with scrape type 2
2026-03-30 08:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2be78990-e0df-59b0-b49d-32fc0443e656, identifier: YE48599
2026-03-30 08:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 61bfc445-3d2d-5a5d-aaa0-e267f4cdef8a with identifier: NN42676
2026-03-30 08:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 61bfc445-3d2d-5a5d-aaa0-e267f4cdef8a with identifier: NN42676
2026-03-30 08:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 61bfc445-3d2d-5a5d-aaa0-e267f4cdef8a with identifier: NN42676 to the API
2026-03-30 08:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-31T15:41:48Z',
'fuel_type': 'diesel',
'id': '61bfc445-3d2d-5a5d-aaa0-e267f4cdef8a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN42676',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 200663,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-29',
'seller_name': None,
'title': 'Renault Megane 1.5 dCi Expression',
'transmission': 'manual',
'trim': 'Expression',
'year': 2012}
2026-03-30 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN42676%27 HTTP/1.1" 200 None
2026-03-30 08:35:56 [auto1.be] INFO: Saving data for NN42676: {'auction_closing_time': 1774971708.0, 'created_time': 1774039010.613893, 'last_price_update_time': 1774859756.026536}
2026-03-30 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NN42676') HTTP/1.1" 204 0
2026-03-30 08:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2be78990-e0df-59b0-b49d-32fc0443e656 with identifier: YE48599
2026-03-30 08:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2be78990-e0df-59b0-b49d-32fc0443e656 with identifier: YE48599
2026-03-30 08:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2be78990-e0df-59b0-b49d-32fc0443e656 with identifier: YE48599 to the API
2026-03-30 08:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 177,
'expiration_date': '2026-03-31T15:28:40Z',
'fuel_type': 'diesel',
'id': '2be78990-e0df-59b0-b49d-32fc0443e656',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE48599',
'listing': 'auction',
'make': 'Audi',
'model': 'A5',
'odometer': 161867,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-11',
'seller_name': None,
'title': 'Audi A5 2.0 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-30 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YE48599%27 HTTP/1.1" 200 None
2026-03-30 08:35:56 [auto1.be] INFO: Saving data for YE48599: {'auction_closing_time': 1774970920.0, 'created_time': 1773240053.318975, 'last_price_update_time': 1774859756.582333}
2026-03-30 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YE48599') HTTP/1.1" 204 0
2026-03-30 08:35:56 [auto1.be] INFO: Found listing with ID: RH39924
2026-03-30 08:35:56 [auto1.be] INFO: Found listing with ID: ML39304
2026-03-30 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML39304%27 HTTP/1.1" 200 None
2026-03-30 08:35:56 [auto1.be] INFO: Scrape type for ML39304: 2
2026-03-30 08:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 747b4f7e-ddb6-546c-89d8-af2e0c9d84a6 with identifier: ML39304
2026-03-30 08:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 747b4f7e-ddb6-546c-89d8-af2e0c9d84a6 with scrape type 2
2026-03-30 08:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 747b4f7e-ddb6-546c-89d8-af2e0c9d84a6 with scrape type 2
2026-03-30 08:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 747b4f7e-ddb6-546c-89d8-af2e0c9d84a6, identifier: ML39304
2026-03-30 08:35:56 [auto1.be] INFO: Found listing with ID: XY44449
2026-03-30 08:35:56 [auto1.be] INFO: Found listing with ID: JT22008
2026-03-30 08:35:56 [auto1.be] INFO: Found listing with ID: KN48892
2026-03-30 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KN48892%27 HTTP/1.1" 200 None
2026-03-30 08:35:56 [auto1.be] INFO: Scrape type for KN48892: 2
2026-03-30 08:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2697c76c-c67c-5f1f-8bee-d854a6fce05a with identifier: KN48892
2026-03-30 08:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2697c76c-c67c-5f1f-8bee-d854a6fce05a with scrape type 2
2026-03-30 08:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2697c76c-c67c-5f1f-8bee-d854a6fce05a with scrape type 2
2026-03-30 08:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2697c76c-c67c-5f1f-8bee-d854a6fce05a, identifier: KN48892
2026-03-30 08:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 747b4f7e-ddb6-546c-89d8-af2e0c9d84a6 with identifier: ML39304
2026-03-30 08:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 747b4f7e-ddb6-546c-89d8-af2e0c9d84a6 with identifier: ML39304
2026-03-30 08:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 747b4f7e-ddb6-546c-89d8-af2e0c9d84a6 with identifier: ML39304 to the API
2026-03-30 08:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 98,
'expiration_date': '2026-03-31T15:14:40Z',
'fuel_type': 'petrol',
'id': '747b4f7e-ddb6-546c-89d8-af2e0c9d84a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML39304',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 131400,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-10-06',
'seller_name': None,
'title': 'Renault Megane 1.4 Extreme',
'transmission': 'manual',
'trim': 'Extreme',
'year': 2008}
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML39304%27 HTTP/1.1" 200 None
2026-03-30 08:35:57 [auto1.be] INFO: Saving data for ML39304: {'auction_closing_time': 1774970080.0, 'created_time': 1774557533.556009, 'last_price_update_time': 1774859757.178163}
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ML39304') HTTP/1.1" 204 0
2026-03-30 08:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2697c76c-c67c-5f1f-8bee-d854a6fce05a with identifier: KN48892
2026-03-30 08:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2697c76c-c67c-5f1f-8bee-d854a6fce05a with identifier: KN48892
2026-03-30 08:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2697c76c-c67c-5f1f-8bee-d854a6fce05a with identifier: KN48892 to the API
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:46:47Z',
'fuel_type': 'diesel',
'id': '2697c76c-c67c-5f1f-8bee-d854a6fce05a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN48892',
'listing': 'auction',
'make': 'Renault',
'model': 'Grand Scenic',
'odometer': 160504,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-22',
'seller_name': None,
'title': 'Renault Grand Scenic 1.6 dCi BOSE Edition',
'transmission': 'manual',
'trim': 'BOSE Edition',
'year': 2014}
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KN48892%27 HTTP/1.1" 200 None
2026-03-30 08:35:57 [auto1.be] INFO: Saving data for KN48892: {'auction_closing_time': 1774972007.0, 'created_time': 1774471088.690051, 'last_price_update_time': 1774859757.550137}
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KN48892') HTTP/1.1" 204 0
2026-03-30 08:35:57 [auto1.be] INFO: Found listing with ID: EP05559
2026-03-30 08:35:57 [auto1.be] INFO: Found listing with ID: XV08295
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XV08295%27 HTTP/1.1" 200 None
2026-03-30 08:35:57 [auto1.be] INFO: Scrape type for XV08295: 2
2026-03-30 08:35:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 004018dc-bab7-51f6-b5b0-44dbf7f0f931 with identifier: XV08295
2026-03-30 08:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 004018dc-bab7-51f6-b5b0-44dbf7f0f931 with scrape type 2
2026-03-30 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 004018dc-bab7-51f6-b5b0-44dbf7f0f931 with scrape type 2
2026-03-30 08:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 004018dc-bab7-51f6-b5b0-44dbf7f0f931, identifier: XV08295
2026-03-30 08:35:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e22ca9a-d4d0-5c4a-999c-6db9b04cb3d7 with identifier: UT07561
2026-03-30 08:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e22ca9a-d4d0-5c4a-999c-6db9b04cb3d7 with scrape type 1
2026-03-30 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8e22ca9a-d4d0-5c4a-999c-6db9b04cb3d7
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F06%252Fbb0640ca60b19198739286912baf9bf0%252Fpa%252FUT07561_03c9e1fbb2f731e3d55ce20626ef39a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/06/bb0640ca60b19198739286912baf9bf0/pa/UT07561_03c9e1fbb2f731e3d55ce20626ef39a5.jpg already downloaded
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F06%252Fbb0640ca60b19198739286912baf9bf0%252Fpa%252FUT07561_ca201aef231103e507c9b8535aa20b8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/06/bb0640ca60b19198739286912baf9bf0/pa/UT07561_ca201aef231103e507c9b8535aa20b8b.jpg already downloaded
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F06%252Fbb0640ca60b19198739286912baf9bf0%252Fpa%252FUT07561_20c757223ff14c010581c6537a27f7a5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/06/bb0640ca60b19198739286912baf9bf0/pa/UT07561_20c757223ff14c010581c6537a27f7a5.jpg already downloaded
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F06%252Fbb0640ca60b19198739286912baf9bf0%252Fpa%252FUT07561_07627cc8a6bddba13a1faf6f0149cfbb.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/06/bb0640ca60b19198739286912baf9bf0/pa/UT07561_07627cc8a6bddba13a1faf6f0149cfbb.jpg already downloaded
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F06%252Fbb0640ca60b19198739286912baf9bf0%252Fpa%252FUT07561_9a894da004577b97a55c7199eb0a6a0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/06/bb0640ca60b19198739286912baf9bf0/pa/UT07561_9a894da004577b97a55c7199eb0a6a0d.jpg already downloaded
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F06%252Fbb0640ca60b19198739286912baf9bf0%252Fpa%252FUT07561_6cf6bc6db9579608639816333b36a072.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/06/bb0640ca60b19198739286912baf9bf0/pa/UT07561_6cf6bc6db9579608639816333b36a072.jpg already downloaded
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F06%252Fbb0640ca60b19198739286912baf9bf0%252Fpa%252FUT07561_6751a5e5f961e85004da17ebd595258d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/06/bb0640ca60b19198739286912baf9bf0/pa/UT07561_6751a5e5f961e85004da17ebd595258d.jpg already downloaded
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F06%252Fbb0640ca60b19198739286912baf9bf0%252Fpa%252FUT07561_f5ce1f4de33437449875bb23e7122b53.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/06/bb0640ca60b19198739286912baf9bf0/pa/UT07561_f5ce1f4de33437449875bb23e7122b53.jpg already downloaded
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F06%252Fbb0640ca60b19198739286912baf9bf0%252Fpa%252FUT07561_e56bcf297ac4d52750a929b01d5c0d90.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/06/bb0640ca60b19198739286912baf9bf0/pa/UT07561_e56bcf297ac4d52750a929b01d5c0d90.jpg already downloaded
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F06%252Fbb0640ca60b19198739286912baf9bf0%252Fpa%252FUT07561_b2d0938a8f16628279df6b8afda0d02b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/06/bb0640ca60b19198739286912baf9bf0/pa/UT07561_b2d0938a8f16628279df6b8afda0d02b.jpg already downloaded
2026-03-30 08:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8e22ca9a-d4d0-5c4a-999c-6db9b04cb3d7, identifier: UT07561
2026-03-30 08:35:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1ead2ef-692d-5878-b7c5-741185e4ce42 with identifier: FA29131
2026-03-30 08:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1ead2ef-692d-5878-b7c5-741185e4ce42 with scrape type 1
2026-03-30 08:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item a1ead2ef-692d-5878-b7c5-741185e4ce42
2026-03-30 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1d%252Ff71dac23e1b4043d6152a1445a2dd230%252Fpa%252FFA29131_c2118ed559fe32424beabdafaf38d2ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1d/f71dac23e1b4043d6152a1445a2dd230/pa/FA29131_c2118ed559fe32424beabdafaf38d2ee.jpg not downloaded yet
2026-03-30 08:35:58 [auto1.be] INFO: Found listing with ID: HJ61714
2026-03-30 08:35:58 [auto1.be] INFO: Found listing with ID: EM93050
2026-03-30 08:35:58 [auto1.be] INFO: Found listing with ID: PV35906
2026-03-30 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV35906%27 HTTP/1.1" 200 None
2026-03-30 08:35:58 [auto1.be] INFO: Scrape type for PV35906: 2
2026-03-30 08:35:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e909e59a-6370-539e-96ba-297396904918 with identifier: PV35906
2026-03-30 08:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e909e59a-6370-539e-96ba-297396904918 with scrape type 2
2026-03-30 08:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e909e59a-6370-539e-96ba-297396904918 with scrape type 2
2026-03-30 08:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e909e59a-6370-539e-96ba-297396904918, identifier: PV35906
2026-03-30 08:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 004018dc-bab7-51f6-b5b0-44dbf7f0f931 with identifier: XV08295
2026-03-30 08:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 004018dc-bab7-51f6-b5b0-44dbf7f0f931 with identifier: XV08295
2026-03-30 08:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 004018dc-bab7-51f6-b5b0-44dbf7f0f931 with identifier: XV08295 to the API
2026-03-30 08:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:00:46Z',
'fuel_type': 'diesel',
'id': '004018dc-bab7-51f6-b5b0-44dbf7f0f931',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV08295',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 279052,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-03',
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 180 d Shooting Brake AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2018}
2026-03-30 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XV08295%27 HTTP/1.1" 200 None
2026-03-30 08:35:58 [auto1.be] INFO: Saving data for XV08295: {'auction_closing_time': 1774969246.0, 'created_time': 1773239670.90112, 'last_price_update_time': 1774859758.487472}
2026-03-30 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XV08295') HTTP/1.1" 204 0
2026-03-30 08:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MA67469> (referer: https://www.auto1.com/v1/car-details-view/MA67469/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8e22ca9a-d4d0-5c4a-999c-6db9b04cb3d7 with identifier: UT07561
2026-03-30 08:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8e22ca9a-d4d0-5c4a-999c-6db9b04cb3d7 with identifier: UT07561
2026-03-30 08:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8e22ca9a-d4d0-5c4a-999c-6db9b04cb3d7 with identifier: UT07561 to the API
2026-03-30 08:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UT07561>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 163,
'expiration_date': '2026-03-31T15:25:31Z',
'fuel_type': 'diesel',
'id': '8e22ca9a-d4d0-5c4a-999c-6db9b04cb3d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT07561',
'listing': 'auction',
'location': 'BE, Pelt',
'make': 'Jaguar',
'model': 'XE',
'odometer': 144186,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgbb/06/bb0640ca60b19198739286912baf9bf0/pa/UT07561_03c9e1fbb2f731e3d55ce20626ef39a5.jpg',
'https://img-pa.auto1.com/imgbb/06/bb0640ca60b19198739286912baf9bf0/pa/UT07561_ca201aef231103e507c9b8535aa20b8b.jpg',
'https://img-pa.auto1.com/imgbb/06/bb0640ca60b19198739286912baf9bf0/pa/UT07561_20c757223ff14c010581c6537a27f7a5.jpg',
'https://img-pa.auto1.com/imgbb/06/bb0640ca60b19198739286912baf9bf0/pa/UT07561_07627cc8a6bddba13a1faf6f0149cfbb.jpg',
'https://img-pa.auto1.com/imgbb/06/bb0640ca60b19198739286912baf9bf0/pa/UT07561_9a894da004577b97a55c7199eb0a6a0d.jpg',
'https://img-pa.auto1.com/imgbb/06/bb0640ca60b19198739286912baf9bf0/pa/UT07561_6cf6bc6db9579608639816333b36a072.jpg',
'https://img-pa.auto1.com/imgbb/06/bb0640ca60b19198739286912baf9bf0/pa/UT07561_6751a5e5f961e85004da17ebd595258d.jpg',
'https://img-pa.auto1.com/imgbb/06/bb0640ca60b19198739286912baf9bf0/pa/UT07561_f5ce1f4de33437449875bb23e7122b53.jpg',
'https://img-pa.auto1.com/imgbb/06/bb0640ca60b19198739286912baf9bf0/pa/UT07561_e56bcf297ac4d52750a929b01d5c0d90.jpg',
'https://img-pa.auto1.com/imgbb/06/bb0640ca60b19198739286912baf9bf0/pa/UT07561_b2d0938a8f16628279df6b8afda0d02b.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e22ca9a-d4d0-5c4a-999c-6db9b04cb3d7/8e22ca9a-d4d0-5c4a-999c-6db9b04cb3d7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3462531,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/06/bb0640ca60b19198739286912baf9bf0/pa/UT07561_03c9e1fbb2f731e3d55ce20626ef39a5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e22ca9a-d4d0-5c4a-999c-6db9b04cb3d7/8e22ca9a-d4d0-5c4a-999c-6db9b04cb3d7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91191,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/06/bb0640ca60b19198739286912baf9bf0/pa/UT07561_ca201aef231103e507c9b8535aa20b8b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e22ca9a-d4d0-5c4a-999c-6db9b04cb3d7/8e22ca9a-d4d0-5c4a-999c-6db9b04cb3d7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3190340,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/06/bb0640ca60b19198739286912baf9bf0/pa/UT07561_20c757223ff14c010581c6537a27f7a5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e22ca9a-d4d0-5c4a-999c-6db9b04cb3d7/8e22ca9a-d4d0-5c4a-999c-6db9b04cb3d7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82352,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/06/bb0640ca60b19198739286912baf9bf0/pa/UT07561_07627cc8a6bddba13a1faf6f0149cfbb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e22ca9a-d4d0-5c4a-999c-6db9b04cb3d7/8e22ca9a-d4d0-5c4a-999c-6db9b04cb3d7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3414584,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/06/bb0640ca60b19198739286912baf9bf0/pa/UT07561_9a894da004577b97a55c7199eb0a6a0d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e22ca9a-d4d0-5c4a-999c-6db9b04cb3d7/8e22ca9a-d4d0-5c4a-999c-6db9b04cb3d7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3084950,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/06/bb0640ca60b19198739286912baf9bf0/pa/UT07561_6cf6bc6db9579608639816333b36a072.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e22ca9a-d4d0-5c4a-999c-6db9b04cb3d7/8e22ca9a-d4d0-5c4a-999c-6db9b04cb3d7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3001583,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/06/bb0640ca60b19198739286912baf9bf0/pa/UT07561_6751a5e5f961e85004da17ebd595258d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e22ca9a-d4d0-5c4a-999c-6db9b04cb3d7/8e22ca9a-d4d0-5c4a-999c-6db9b04cb3d7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101652,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/06/bb0640ca60b19198739286912baf9bf0/pa/UT07561_f5ce1f4de33437449875bb23e7122b53.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e22ca9a-d4d0-5c4a-999c-6db9b04cb3d7/8e22ca9a-d4d0-5c4a-999c-6db9b04cb3d7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97324,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/06/bb0640ca60b19198739286912baf9bf0/pa/UT07561_e56bcf297ac4d52750a929b01d5c0d90.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e22ca9a-d4d0-5c4a-999c-6db9b04cb3d7/8e22ca9a-d4d0-5c4a-999c-6db9b04cb3d7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89373,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbb/06/bb0640ca60b19198739286912baf9bf0/pa/UT07561_b2d0938a8f16628279df6b8afda0d02b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-10-19',
'seats_number': 5,
'seller_name': None,
'title': 'Jaguar XE 20d E-Performance R-Sport',
'transmission': 'manual',
'trim': 'E-Performance R-Sport',
'year': 2015}
2026-03-30 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT07561%27 HTTP/1.1" 200 None
2026-03-30 08:35:58 [auto1.be] INFO: Saving data for UT07561: {'created_time': 1774859758.835441, 'last_price_update_time': 1774859758.835459, 'auction_closing_time': 1774970731.0}
2026-03-30 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UT07561') HTTP/1.1" 204 0
2026-03-30 08:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e909e59a-6370-539e-96ba-297396904918 with identifier: PV35906
2026-03-30 08:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e909e59a-6370-539e-96ba-297396904918 with identifier: PV35906
2026-03-30 08:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e909e59a-6370-539e-96ba-297396904918 with identifier: PV35906 to the API
2026-03-30 08:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:03:56Z',
'fuel_type': 'petrol',
'id': 'e909e59a-6370-539e-96ba-297396904918',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV35906',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3 Sportback',
'odometer': 23331,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-19',
'seller_name': None,
'title': 'Audi Q3 Sportback 40 TFSI quattro S line',
'transmission': 'automatic',
'trim': 'quattro S line',
'year': 2023}
2026-03-30 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PV35906%27 HTTP/1.1" 200 None
2026-03-30 08:35:59 [auto1.be] INFO: Saving data for PV35906: {'auction_closing_time': 1774969436.0, 'created_time': 1773132023.169378, 'last_price_update_time': 1774859759.38838}
2026-03-30 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PV35906') HTTP/1.1" 204 0
2026-03-30 08:35:59 [auto1.be] INFO: Found listing with ID: TX99790
2026-03-30 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX99790%27 HTTP/1.1" 200 None
2026-03-30 08:35:59 [auto1.be] INFO: Scrape type for TX99790: 2
2026-03-30 08:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 827fde2d-7546-599e-8772-8f271fb01470 with identifier: TX99790
2026-03-30 08:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 827fde2d-7546-599e-8772-8f271fb01470 with scrape type 2
2026-03-30 08:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 827fde2d-7546-599e-8772-8f271fb01470 with scrape type 2
2026-03-30 08:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 827fde2d-7546-599e-8772-8f271fb01470, identifier: TX99790
2026-03-30 08:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1d%252Ff71dac23e1b4043d6152a1445a2dd230%252Fpa%252FFA29131_3c3d749ebb0e0c4b447ea3580b5dc773.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1d/f71dac23e1b4043d6152a1445a2dd230/pa/FA29131_3c3d749ebb0e0c4b447ea3580b5dc773.jpg not downloaded yet
2026-03-30 08:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KP55338> (referer: https://www.auto1.com/v1/car-details-view/KP55338/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:35:59 [auto1.be] INFO: Found listing with ID: FA19213
2026-03-30 08:35:59 [auto1.be] INFO: Found listing with ID: GC80115
2026-03-30 08:35:59 [auto1.be] INFO: Found listing with ID: GL14353
2026-03-30 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GL14353%27 HTTP/1.1" 200 None
2026-03-30 08:35:59 [auto1.be] INFO: Scrape type for GL14353: 1
2026-03-30 08:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 827fde2d-7546-599e-8772-8f271fb01470 with identifier: TX99790
2026-03-30 08:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 827fde2d-7546-599e-8772-8f271fb01470 with identifier: TX99790
2026-03-30 08:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 827fde2d-7546-599e-8772-8f271fb01470 with identifier: TX99790 to the API
2026-03-30 08:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:42:53Z',
'fuel_type': 'diesel',
'id': '827fde2d-7546-599e-8772-8f271fb01470',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX99790',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'V-Klasse',
'odometer': 261282,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-19',
'seller_name': None,
'title': 'Mercedes-Benz V-Klasse V 250 d lang 4Matic BlueTEC',
'transmission': 'automatic',
'trim': 'lang 4Matic BlueTEC',
'year': 2018}
2026-03-30 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX99790%27 HTTP/1.1" 200 None
2026-03-30 08:35:59 [auto1.be] INFO: Saving data for TX99790: {'auction_closing_time': 1774971773.0, 'created_time': 1773301683.630884, 'last_price_update_time': 1774859759.869951}
2026-03-30 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TX99790') HTTP/1.1" 204 0
2026-03-30 08:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TS76065/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:35:59 [auto1.be] INFO: Found listing with ID: PL33803
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL33803%27 HTTP/1.1" 200 None
2026-03-30 08:36:00 [auto1.be] INFO: Scrape type for PL33803: 2
2026-03-30 08:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e691580-8a7c-5497-8113-4ce00c1cc7cf with identifier: PL33803
2026-03-30 08:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e691580-8a7c-5497-8113-4ce00c1cc7cf with scrape type 2
2026-03-30 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e691580-8a7c-5497-8113-4ce00c1cc7cf with scrape type 2
2026-03-30 08:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3e691580-8a7c-5497-8113-4ce00c1cc7cf, identifier: PL33803
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1d%252Ff71dac23e1b4043d6152a1445a2dd230%252Fpa%252FFA29131_aabaf15559aacc8eadc2565d30475a29.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1d/f71dac23e1b4043d6152a1445a2dd230/pa/FA29131_aabaf15559aacc8eadc2565d30475a29.jpg not downloaded yet
2026-03-30 08:36:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:00 [auto1.be] INFO: Found listing with ID: NH22682
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH22682%27 HTTP/1.1" 200 None
2026-03-30 08:36:00 [auto1.be] INFO: Scrape type for NH22682: 1
2026-03-30 08:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3e691580-8a7c-5497-8113-4ce00c1cc7cf with identifier: PL33803
2026-03-30 08:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3e691580-8a7c-5497-8113-4ce00c1cc7cf with identifier: PL33803
2026-03-30 08:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3e691580-8a7c-5497-8113-4ce00c1cc7cf with identifier: PL33803 to the API
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 192,
'expiration_date': '2026-03-31T15:53:27Z',
'fuel_type': 'petrol',
'id': '3e691580-8a7c-5497-8113-4ce00c1cc7cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL33803',
'listing': 'auction',
'make': 'MINI',
'model': 'Countryman',
'odometer': 64332,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-25',
'seller_name': None,
'title': 'MINI Countryman Cooper S ALL4',
'transmission': 'automatic',
'trim': 'ALL4',
'year': 2019}
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL33803%27 HTTP/1.1" 200 None
2026-03-30 08:36:00 [auto1.be] INFO: Saving data for PL33803: {'auction_closing_time': 1774972407.0, 'created_time': 1773131894.008373, 'last_price_update_time': 1774859760.488991}
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PL33803') HTTP/1.1" 204 0
2026-03-30 08:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TR13838> (referer: https://www.auto1.com/v1/car-details-view/TR13838/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a98809a-9b7a-5a3f-8e45-c6db6144f132 with identifier: MA67469
2026-03-30 08:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a98809a-9b7a-5a3f-8e45-c6db6144f132 with scrape type 1
2026-03-30 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1a98809a-9b7a-5a3f-8e45-c6db6144f132
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F8d%252F998ddc4f0779cb6353bc3bfe6cdd882e%252Fpa%252FMA67469_e92291bed87102b7909c21a88e8f45f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8d/998ddc4f0779cb6353bc3bfe6cdd882e/pa/MA67469_e92291bed87102b7909c21a88e8f45f4.jpg already downloaded
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F8d%252F998ddc4f0779cb6353bc3bfe6cdd882e%252Fpa%252FMA67469_eea4e4cd846b7846fd91ba92342e8a5c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8d/998ddc4f0779cb6353bc3bfe6cdd882e/pa/MA67469_eea4e4cd846b7846fd91ba92342e8a5c.jpg already downloaded
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F8d%252F998ddc4f0779cb6353bc3bfe6cdd882e%252Fpa%252FMA67469_d97c1e0b3cfe8af222aed52abfc02dad.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8d/998ddc4f0779cb6353bc3bfe6cdd882e/pa/MA67469_d97c1e0b3cfe8af222aed52abfc02dad.jpg already downloaded
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F8d%252F998ddc4f0779cb6353bc3bfe6cdd882e%252Fpa%252FMA67469_5e35a052fab768d75b830b05bbbadd4d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8d/998ddc4f0779cb6353bc3bfe6cdd882e/pa/MA67469_5e35a052fab768d75b830b05bbbadd4d.jpg already downloaded
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F8d%252F998ddc4f0779cb6353bc3bfe6cdd882e%252Fpa%252FMA67469_03f8fa8a780212d51e0887e8bfb3e918.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8d/998ddc4f0779cb6353bc3bfe6cdd882e/pa/MA67469_03f8fa8a780212d51e0887e8bfb3e918.jpg already downloaded
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F8d%252F998ddc4f0779cb6353bc3bfe6cdd882e%252Fpa%252FMA67469_4b096cd994df22df6202b481007688ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8d/998ddc4f0779cb6353bc3bfe6cdd882e/pa/MA67469_4b096cd994df22df6202b481007688ca.jpg already downloaded
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F8d%252F998ddc4f0779cb6353bc3bfe6cdd882e%252Fpa%252FMA67469_3f554b4a063b468499ed8057bc63a22b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8d/998ddc4f0779cb6353bc3bfe6cdd882e/pa/MA67469_3f554b4a063b468499ed8057bc63a22b.jpg already downloaded
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F8d%252F998ddc4f0779cb6353bc3bfe6cdd882e%252Fpa%252FMA67469_b2e13e67fce65472508cc3094c390846.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8d/998ddc4f0779cb6353bc3bfe6cdd882e/pa/MA67469_b2e13e67fce65472508cc3094c390846.jpg already downloaded
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F8d%252F998ddc4f0779cb6353bc3bfe6cdd882e%252Fpa%252FMA67469_3a27283d12bc46d383da24606b84b479.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8d/998ddc4f0779cb6353bc3bfe6cdd882e/pa/MA67469_3a27283d12bc46d383da24606b84b479.jpg already downloaded
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252F8d%252F998ddc4f0779cb6353bc3bfe6cdd882e%252Fpa%252FMA67469_ad91101b488fed413ce9bac1b4037b6c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/8d/998ddc4f0779cb6353bc3bfe6cdd882e/pa/MA67469_ad91101b488fed413ce9bac1b4037b6c.jpg already downloaded
2026-03-30 08:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1a98809a-9b7a-5a3f-8e45-c6db6144f132, identifier: MA67469
2026-03-30 08:36:00 [auto1.be] INFO: Found listing with ID: NA97131
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA97131%27 HTTP/1.1" 200 None
2026-03-30 08:36:00 [auto1.be] INFO: Scrape type for NA97131: 2
2026-03-30 08:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa512bfd-815a-5736-a788-9086ccd09518 with identifier: NA97131
2026-03-30 08:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa512bfd-815a-5736-a788-9086ccd09518 with scrape type 2
2026-03-30 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa512bfd-815a-5736-a788-9086ccd09518 with scrape type 2
2026-03-30 08:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fa512bfd-815a-5736-a788-9086ccd09518, identifier: NA97131
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1d%252Ff71dac23e1b4043d6152a1445a2dd230%252Fpa%252FFA29131_b149a21ce20b874ec4bc9218b2666dc5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1d/f71dac23e1b4043d6152a1445a2dd230/pa/FA29131_b149a21ce20b874ec4bc9218b2666dc5.jpg not downloaded yet
2026-03-30 08:36:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1a98809a-9b7a-5a3f-8e45-c6db6144f132 with identifier: MA67469
2026-03-30 08:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1a98809a-9b7a-5a3f-8e45-c6db6144f132 with identifier: MA67469
2026-03-30 08:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1a98809a-9b7a-5a3f-8e45-c6db6144f132 with identifier: MA67469 to the API
2026-03-30 08:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MA67469>
{'auction_title': '',
'c_o_2_emission_value': 166,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:20:46Z',
'fuel_type': 'petrol',
'id': '1a98809a-9b7a-5a3f-8e45-c6db6144f132',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA67469',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Jeep',
'model': 'Renegade',
'odometer': 95036,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 21,
'photo_urls': ['https://img-pa.auto1.com/img99/8d/998ddc4f0779cb6353bc3bfe6cdd882e/pa/MA67469_e92291bed87102b7909c21a88e8f45f4.jpg',
'https://img-pa.auto1.com/img99/8d/998ddc4f0779cb6353bc3bfe6cdd882e/pa/MA67469_eea4e4cd846b7846fd91ba92342e8a5c.jpg',
'https://img-pa.auto1.com/img99/8d/998ddc4f0779cb6353bc3bfe6cdd882e/pa/MA67469_d97c1e0b3cfe8af222aed52abfc02dad.jpg',
'https://img-pa.auto1.com/img99/8d/998ddc4f0779cb6353bc3bfe6cdd882e/pa/MA67469_5e35a052fab768d75b830b05bbbadd4d.jpg',
'https://img-pa.auto1.com/img99/8d/998ddc4f0779cb6353bc3bfe6cdd882e/pa/MA67469_03f8fa8a780212d51e0887e8bfb3e918.jpg',
'https://img-pa.auto1.com/img99/8d/998ddc4f0779cb6353bc3bfe6cdd882e/pa/MA67469_4b096cd994df22df6202b481007688ca.jpg',
'https://img-pa.auto1.com/img99/8d/998ddc4f0779cb6353bc3bfe6cdd882e/pa/MA67469_3f554b4a063b468499ed8057bc63a22b.jpg',
'https://img-pa.auto1.com/img99/8d/998ddc4f0779cb6353bc3bfe6cdd882e/pa/MA67469_b2e13e67fce65472508cc3094c390846.jpg',
'https://img-pa.auto1.com/img99/8d/998ddc4f0779cb6353bc3bfe6cdd882e/pa/MA67469_3a27283d12bc46d383da24606b84b479.jpg',
'https://img-pa.auto1.com/img99/8d/998ddc4f0779cb6353bc3bfe6cdd882e/pa/MA67469_ad91101b488fed413ce9bac1b4037b6c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a98809a-9b7a-5a3f-8e45-c6db6144f132/1a98809a-9b7a-5a3f-8e45-c6db6144f132_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98236,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/8d/998ddc4f0779cb6353bc3bfe6cdd882e/pa/MA67469_e92291bed87102b7909c21a88e8f45f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a98809a-9b7a-5a3f-8e45-c6db6144f132/1a98809a-9b7a-5a3f-8e45-c6db6144f132_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94787,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/8d/998ddc4f0779cb6353bc3bfe6cdd882e/pa/MA67469_eea4e4cd846b7846fd91ba92342e8a5c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a98809a-9b7a-5a3f-8e45-c6db6144f132/1a98809a-9b7a-5a3f-8e45-c6db6144f132_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101256,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/8d/998ddc4f0779cb6353bc3bfe6cdd882e/pa/MA67469_d97c1e0b3cfe8af222aed52abfc02dad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a98809a-9b7a-5a3f-8e45-c6db6144f132/1a98809a-9b7a-5a3f-8e45-c6db6144f132_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83182,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/8d/998ddc4f0779cb6353bc3bfe6cdd882e/pa/MA67469_5e35a052fab768d75b830b05bbbadd4d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a98809a-9b7a-5a3f-8e45-c6db6144f132/1a98809a-9b7a-5a3f-8e45-c6db6144f132_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98528,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/8d/998ddc4f0779cb6353bc3bfe6cdd882e/pa/MA67469_03f8fa8a780212d51e0887e8bfb3e918.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a98809a-9b7a-5a3f-8e45-c6db6144f132/1a98809a-9b7a-5a3f-8e45-c6db6144f132_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99827,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/8d/998ddc4f0779cb6353bc3bfe6cdd882e/pa/MA67469_4b096cd994df22df6202b481007688ca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a98809a-9b7a-5a3f-8e45-c6db6144f132/1a98809a-9b7a-5a3f-8e45-c6db6144f132_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105035,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/8d/998ddc4f0779cb6353bc3bfe6cdd882e/pa/MA67469_3f554b4a063b468499ed8057bc63a22b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a98809a-9b7a-5a3f-8e45-c6db6144f132/1a98809a-9b7a-5a3f-8e45-c6db6144f132_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107128,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/8d/998ddc4f0779cb6353bc3bfe6cdd882e/pa/MA67469_b2e13e67fce65472508cc3094c390846.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a98809a-9b7a-5a3f-8e45-c6db6144f132/1a98809a-9b7a-5a3f-8e45-c6db6144f132_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67324,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/8d/998ddc4f0779cb6353bc3bfe6cdd882e/pa/MA67469_3a27283d12bc46d383da24606b84b479.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a98809a-9b7a-5a3f-8e45-c6db6144f132/1a98809a-9b7a-5a3f-8e45-c6db6144f132_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91149,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img99/8d/998ddc4f0779cb6353bc3bfe6cdd882e/pa/MA67469_ad91101b488fed413ce9bac1b4037b6c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-07-30',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Renegade 1.0 TGDi Limited 4x2',
'transmission': 'manual',
'trim': 'Limited 4x2',
'year': 2018}
2026-03-30 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA67469%27 HTTP/1.1" 200 None
2026-03-30 08:36:01 [auto1.be] INFO: Saving data for MA67469: {'created_time': 1774859761.287466, 'last_price_update_time': 1774859761.287478, 'auction_closing_time': 1774970446.0}
2026-03-30 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MA67469') HTTP/1.1" 204 0
2026-03-30 08:36:01 [auto1.be] INFO: Found listing with ID: WR44467
2026-03-30 08:36:01 [auto1.be] INFO: Found listing with ID: FH77078
2026-03-30 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH77078%27 HTTP/1.1" 200 None
2026-03-30 08:36:01 [auto1.be] INFO: Scrape type for FH77078: 2
2026-03-30 08:36:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83ff5fcc-2479-58e8-b0f0-00ece727c441 with identifier: FH77078
2026-03-30 08:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83ff5fcc-2479-58e8-b0f0-00ece727c441 with scrape type 2
2026-03-30 08:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83ff5fcc-2479-58e8-b0f0-00ece727c441 with scrape type 2
2026-03-30 08:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 83ff5fcc-2479-58e8-b0f0-00ece727c441, identifier: FH77078
2026-03-30 08:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fa512bfd-815a-5736-a788-9086ccd09518 with identifier: NA97131
2026-03-30 08:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fa512bfd-815a-5736-a788-9086ccd09518 with identifier: NA97131
2026-03-30 08:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fa512bfd-815a-5736-a788-9086ccd09518 with identifier: NA97131 to the API
2026-03-30 08:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:25:56Z',
'fuel_type': 'diesel',
'id': 'fa512bfd-815a-5736-a788-9086ccd09518',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA97131',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 240009,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-10-22',
'seller_name': None,
'title': 'Opel Astra 1.6 CDTI DPF Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2015}
2026-03-30 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NA97131%27 HTTP/1.1" 200 None
2026-03-30 08:36:01 [auto1.be] INFO: Saving data for NA97131: {'auction_closing_time': 1774970756.0, 'created_time': 1773693880.422455, 'last_price_update_time': 1774859761.737386}
2026-03-30 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NA97131') HTTP/1.1" 204 0
2026-03-30 08:36:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 000c85fb-2193-59ee-ad6a-bdf070e98e47 with identifier: KP55338
2026-03-30 08:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 000c85fb-2193-59ee-ad6a-bdf070e98e47 with scrape type 1
2026-03-30 08:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 000c85fb-2193-59ee-ad6a-bdf070e98e47
2026-03-30 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F59%252F0b599ea3d6ea037f347df13c59a06423%252Fpa%252FKP55338_a6d9e16754bd330f127625560e0f8a1e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/59/0b599ea3d6ea037f347df13c59a06423/pa/KP55338_a6d9e16754bd330f127625560e0f8a1e.jpg already downloaded
2026-03-30 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F59%252F0b599ea3d6ea037f347df13c59a06423%252Fpa%252FKP55338_5ccde5d3156996d48b922049b6bf886a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/59/0b599ea3d6ea037f347df13c59a06423/pa/KP55338_5ccde5d3156996d48b922049b6bf886a.jpg already downloaded
2026-03-30 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F59%252F0b599ea3d6ea037f347df13c59a06423%252Fpa%252FKP55338_f6b63175831e8be41336a41c7d57dead.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/59/0b599ea3d6ea037f347df13c59a06423/pa/KP55338_f6b63175831e8be41336a41c7d57dead.jpg already downloaded
2026-03-30 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F59%252F0b599ea3d6ea037f347df13c59a06423%252Fpa%252FKP55338_8b36e3bcd744b087ed73d99098c3386f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/59/0b599ea3d6ea037f347df13c59a06423/pa/KP55338_8b36e3bcd744b087ed73d99098c3386f.jpg already downloaded
2026-03-30 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F59%252F0b599ea3d6ea037f347df13c59a06423%252Fpa%252FKP55338_f9a96d081aeb2b03b7cf9f605742c2fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/59/0b599ea3d6ea037f347df13c59a06423/pa/KP55338_f9a96d081aeb2b03b7cf9f605742c2fa.jpg already downloaded
2026-03-30 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F59%252F0b599ea3d6ea037f347df13c59a06423%252Fpa%252FKP55338_0bff2464e44c2471a67f0752976bda2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/59/0b599ea3d6ea037f347df13c59a06423/pa/KP55338_0bff2464e44c2471a67f0752976bda2b.jpg already downloaded
2026-03-30 08:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 000c85fb-2193-59ee-ad6a-bdf070e98e47, identifier: KP55338
2026-03-30 08:36:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/1d/f71dac23e1b4043d6152a1445a2dd230/pa/FA29131_c2118ed559fe32424beabdafaf38d2ee.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 83ff5fcc-2479-58e8-b0f0-00ece727c441 with identifier: FH77078
2026-03-30 08:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 83ff5fcc-2479-58e8-b0f0-00ece727c441 with identifier: FH77078
2026-03-30 08:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 83ff5fcc-2479-58e8-b0f0-00ece727c441 with identifier: FH77078 to the API
2026-03-30 08:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 250,
'expiration_date': '2026-03-31T15:33:44Z',
'fuel_type': 'diesel',
'id': '83ff5fcc-2479-58e8-b0f0-00ece727c441',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH77078',
'listing': 'auction',
'make': 'Audi',
'model': 'A8',
'odometer': 261821,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-23',
'seller_name': None,
'title': 'Audi A8 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2012}
2026-03-30 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH77078%27 HTTP/1.1" 200 None
2026-03-30 08:36:02 [auto1.be] INFO: Saving data for FH77078: {'auction_closing_time': 1774971224.0, 'created_time': 1774384635.419894, 'last_price_update_time': 1774859762.298403}
2026-03-30 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FH77078') HTTP/1.1" 204 0
2026-03-30 08:36:02 [auto1.be] INFO: Found listing with ID: FV38279
2026-03-30 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV38279%27 HTTP/1.1" 200 None
2026-03-30 08:36:02 [auto1.be] INFO: Scrape type for FV38279: 2
2026-03-30 08:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db3f6d01-1fec-55a2-8c18-c03d1f9dbf07 with identifier: FV38279
2026-03-30 08:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db3f6d01-1fec-55a2-8c18-c03d1f9dbf07 with scrape type 2
2026-03-30 08:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db3f6d01-1fec-55a2-8c18-c03d1f9dbf07 with scrape type 2
2026-03-30 08:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: db3f6d01-1fec-55a2-8c18-c03d1f9dbf07, identifier: FV38279
2026-03-30 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1d%252Ff71dac23e1b4043d6152a1445a2dd230%252Fpa%252FFA29131_305070a8f2400dcf5aa7a07698685524.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1d/f71dac23e1b4043d6152a1445a2dd230/pa/FA29131_305070a8f2400dcf5aa7a07698685524.jpg not downloaded yet
2026-03-30 08:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VP95014/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UU73016> (referer: https://www.auto1.com/v1/car-details-view/UU73016/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 000c85fb-2193-59ee-ad6a-bdf070e98e47 with identifier: KP55338
2026-03-30 08:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 000c85fb-2193-59ee-ad6a-bdf070e98e47 with identifier: KP55338
2026-03-30 08:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 000c85fb-2193-59ee-ad6a-bdf070e98e47 with identifier: KP55338 to the API
2026-03-30 08:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KP55338>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:45:45Z',
'fuel_type': 'diesel',
'id': '000c85fb-2193-59ee-ad6a-bdf070e98e47',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP55338',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Volvo',
'model': 'V50',
'odometer': 223569,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img0b/59/0b599ea3d6ea037f347df13c59a06423/pa/KP55338_a6d9e16754bd330f127625560e0f8a1e.jpg',
'https://img-pa.auto1.com/img0b/59/0b599ea3d6ea037f347df13c59a06423/pa/KP55338_5ccde5d3156996d48b922049b6bf886a.jpg',
'https://img-pa.auto1.com/img0b/59/0b599ea3d6ea037f347df13c59a06423/pa/KP55338_f6b63175831e8be41336a41c7d57dead.jpg',
'https://img-pa.auto1.com/img0b/59/0b599ea3d6ea037f347df13c59a06423/pa/KP55338_8b36e3bcd744b087ed73d99098c3386f.jpg',
'https://img-pa.auto1.com/img0b/59/0b599ea3d6ea037f347df13c59a06423/pa/KP55338_f9a96d081aeb2b03b7cf9f605742c2fa.jpg',
'https://img-pa.auto1.com/img0b/59/0b599ea3d6ea037f347df13c59a06423/pa/KP55338_0bff2464e44c2471a67f0752976bda2b.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_000c85fb-2193-59ee-ad6a-bdf070e98e47/000c85fb-2193-59ee-ad6a-bdf070e98e47_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92230,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/59/0b599ea3d6ea037f347df13c59a06423/pa/KP55338_a6d9e16754bd330f127625560e0f8a1e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_000c85fb-2193-59ee-ad6a-bdf070e98e47/000c85fb-2193-59ee-ad6a-bdf070e98e47_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81801,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/59/0b599ea3d6ea037f347df13c59a06423/pa/KP55338_5ccde5d3156996d48b922049b6bf886a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_000c85fb-2193-59ee-ad6a-bdf070e98e47/000c85fb-2193-59ee-ad6a-bdf070e98e47_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77879,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/59/0b599ea3d6ea037f347df13c59a06423/pa/KP55338_f6b63175831e8be41336a41c7d57dead.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_000c85fb-2193-59ee-ad6a-bdf070e98e47/000c85fb-2193-59ee-ad6a-bdf070e98e47_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50476,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/59/0b599ea3d6ea037f347df13c59a06423/pa/KP55338_8b36e3bcd744b087ed73d99098c3386f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_000c85fb-2193-59ee-ad6a-bdf070e98e47/000c85fb-2193-59ee-ad6a-bdf070e98e47_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118784,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/59/0b599ea3d6ea037f347df13c59a06423/pa/KP55338_f9a96d081aeb2b03b7cf9f605742c2fa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_000c85fb-2193-59ee-ad6a-bdf070e98e47/000c85fb-2193-59ee-ad6a-bdf070e98e47_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75123,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/59/0b599ea3d6ea037f347df13c59a06423/pa/KP55338_0bff2464e44c2471a67f0752976bda2b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-05-09',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo V50 1.6 D2 R-Design',
'transmission': 'manual',
'trim': 'R-Design',
'year': 2012}
2026-03-30 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP55338%27 HTTP/1.1" 200 None
2026-03-30 08:36:02 [auto1.be] INFO: Saving data for KP55338: {'created_time': 1774859762.769439, 'last_price_update_time': 1774859762.76945, 'auction_closing_time': 1774971945.0}
2026-03-30 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KP55338') HTTP/1.1" 204 0
2026-03-30 08:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/1d/f71dac23e1b4043d6152a1445a2dd230/pa/FA29131_3c3d749ebb0e0c4b447ea3580b5dc773.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:02 [auto1.be] INFO: Found listing with ID: BH52169
2026-03-30 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BH52169%27 HTTP/1.1" 200 None
2026-03-30 08:36:02 [auto1.be] INFO: Scrape type for BH52169: 2
2026-03-30 08:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0218965c-52a3-56e7-9b12-efd2fe68a2c0 with identifier: BH52169
2026-03-30 08:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0218965c-52a3-56e7-9b12-efd2fe68a2c0 with scrape type 2
2026-03-30 08:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0218965c-52a3-56e7-9b12-efd2fe68a2c0 with scrape type 2
2026-03-30 08:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0218965c-52a3-56e7-9b12-efd2fe68a2c0, identifier: BH52169
2026-03-30 08:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: db3f6d01-1fec-55a2-8c18-c03d1f9dbf07 with identifier: FV38279
2026-03-30 08:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: db3f6d01-1fec-55a2-8c18-c03d1f9dbf07 with identifier: FV38279
2026-03-30 08:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: db3f6d01-1fec-55a2-8c18-c03d1f9dbf07 with identifier: FV38279 to the API
2026-03-30 08:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 98,
'expiration_date': '2026-03-31T15:53:37Z',
'fuel_type': 'petrol',
'id': 'db3f6d01-1fec-55a2-8c18-c03d1f9dbf07',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV38279',
'listing': 'auction',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 130476,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-06-25',
'seller_name': None,
'title': 'Citroen Berlingo 1.6 Tendance',
'transmission': 'manual',
'trim': 'Tendance',
'year': 2012}
2026-03-30 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV38279%27 HTTP/1.1" 200 None
2026-03-30 08:36:03 [auto1.be] INFO: Saving data for FV38279: {'auction_closing_time': 1774972417.0, 'created_time': 1774038992.479627, 'last_price_update_time': 1774859763.329042}
2026-03-30 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FV38279') HTTP/1.1" 204 0
2026-03-30 08:36:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c287923-e7fc-5e5f-a4bc-ca70f6a9b291 with identifier: TR13838
2026-03-30 08:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c287923-e7fc-5e5f-a4bc-ca70f6a9b291 with scrape type 1
2026-03-30 08:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c287923-e7fc-5e5f-a4bc-ca70f6a9b291
2026-03-30 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F2d%252F5d2df2cb8ce4e17892aa1972507229ab%252Fpa%252FTR13838_463980978adf3dd1894eff644d774384.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/2d/5d2df2cb8ce4e17892aa1972507229ab/pa/TR13838_463980978adf3dd1894eff644d774384.jpg already downloaded
2026-03-30 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F2d%252F5d2df2cb8ce4e17892aa1972507229ab%252Fpa%252FTR13838_b3f1410d4ae167259bad2a37aed86e5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/2d/5d2df2cb8ce4e17892aa1972507229ab/pa/TR13838_b3f1410d4ae167259bad2a37aed86e5a.jpg already downloaded
2026-03-30 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F2d%252F5d2df2cb8ce4e17892aa1972507229ab%252Fpa%252FTR13838_e53e27c87fff719e48664eeff66e94f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/2d/5d2df2cb8ce4e17892aa1972507229ab/pa/TR13838_e53e27c87fff719e48664eeff66e94f6.jpg already downloaded
2026-03-30 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F2d%252F5d2df2cb8ce4e17892aa1972507229ab%252Fpa%252FTR13838_48f159edb17f9c41059988f48aa7dd45.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/2d/5d2df2cb8ce4e17892aa1972507229ab/pa/TR13838_48f159edb17f9c41059988f48aa7dd45.jpg already downloaded
2026-03-30 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F2d%252F5d2df2cb8ce4e17892aa1972507229ab%252Fpa%252FTR13838_1445ee1abd5c1fa4be6a6294d0eecd08.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/2d/5d2df2cb8ce4e17892aa1972507229ab/pa/TR13838_1445ee1abd5c1fa4be6a6294d0eecd08.jpg already downloaded
2026-03-30 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F2d%252F5d2df2cb8ce4e17892aa1972507229ab%252Fpa%252FTR13838_3ce1798b1a439a0fef428d447e88813c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/2d/5d2df2cb8ce4e17892aa1972507229ab/pa/TR13838_3ce1798b1a439a0fef428d447e88813c.jpg already downloaded
2026-03-30 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F2d%252F5d2df2cb8ce4e17892aa1972507229ab%252Fpa%252FTR13838_c1172f2fdcbe7ad1353896015515f271.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/2d/5d2df2cb8ce4e17892aa1972507229ab/pa/TR13838_c1172f2fdcbe7ad1353896015515f271.jpg already downloaded
2026-03-30 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F2d%252F5d2df2cb8ce4e17892aa1972507229ab%252Fpa%252FTR13838_f9d55280334ffd7d8b8a032169758f63.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/2d/5d2df2cb8ce4e17892aa1972507229ab/pa/TR13838_f9d55280334ffd7d8b8a032169758f63.jpg already downloaded
2026-03-30 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F2d%252F5d2df2cb8ce4e17892aa1972507229ab%252Fpa%252FTR13838_c8201b5ae5c1bb92505590190854e26b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/2d/5d2df2cb8ce4e17892aa1972507229ab/pa/TR13838_c8201b5ae5c1bb92505590190854e26b.jpg already downloaded
2026-03-30 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F2d%252F5d2df2cb8ce4e17892aa1972507229ab%252Fpa%252FTR13838_5de85835e59021493d27286aab717490.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/2d/5d2df2cb8ce4e17892aa1972507229ab/pa/TR13838_5de85835e59021493d27286aab717490.jpg already downloaded
2026-03-30 08:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3c287923-e7fc-5e5f-a4bc-ca70f6a9b291, identifier: TR13838
2026-03-30 08:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0218965c-52a3-56e7-9b12-efd2fe68a2c0 with identifier: BH52169
2026-03-30 08:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0218965c-52a3-56e7-9b12-efd2fe68a2c0 with identifier: BH52169
2026-03-30 08:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0218965c-52a3-56e7-9b12-efd2fe68a2c0 with identifier: BH52169 to the API
2026-03-30 08:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 100,
'expiration_date': '2026-03-31T15:23:43Z',
'fuel_type': 'diesel',
'id': '0218965c-52a3-56e7-9b12-efd2fe68a2c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH52169',
'listing': 'auction',
'make': 'Fiat',
'model': 'Doblo',
'odometer': 149890,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-29',
'seller_name': None,
'title': 'Fiat Doblo 1.6 JTDM SX Kasten',
'transmission': 'manual',
'trim': 'SX Kasten',
'year': 2012}
2026-03-30 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BH52169%27 HTTP/1.1" 200 None
2026-03-30 08:36:03 [auto1.be] INFO: Saving data for BH52169: {'auction_closing_time': 1774970623.0, 'created_time': 1773135185.488072, 'last_price_update_time': 1774859763.985126}
2026-03-30 08:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BH52169') HTTP/1.1" 204 0
2026-03-30 08:36:04 [auto1.be] INFO: Found listing with ID: TX28125
2026-03-30 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX28125%27 HTTP/1.1" 200 None
2026-03-30 08:36:04 [auto1.be] INFO: Scrape type for TX28125: 2
2026-03-30 08:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 609d2776-636a-505a-99b8-40bf6797ed97 with identifier: TX28125
2026-03-30 08:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 609d2776-636a-505a-99b8-40bf6797ed97 with scrape type 2
2026-03-30 08:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 609d2776-636a-505a-99b8-40bf6797ed97 with scrape type 2
2026-03-30 08:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 609d2776-636a-505a-99b8-40bf6797ed97, identifier: TX28125
2026-03-30 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1d%252Ff71dac23e1b4043d6152a1445a2dd230%252Fpa%252FFA29131_ba6529ab5b02c1f2bc871e1ea365c14b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1d/f71dac23e1b4043d6152a1445a2dd230/pa/FA29131_ba6529ab5b02c1f2bc871e1ea365c14b.jpg not downloaded yet
2026-03-30 08:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3c287923-e7fc-5e5f-a4bc-ca70f6a9b291 with identifier: TR13838
2026-03-30 08:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3c287923-e7fc-5e5f-a4bc-ca70f6a9b291 with identifier: TR13838
2026-03-30 08:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3c287923-e7fc-5e5f-a4bc-ca70f6a9b291 with identifier: TR13838 to the API
2026-03-30 08:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TR13838>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:40:20Z',
'fuel_type': 'petrol',
'id': '3c287923-e7fc-5e5f-a4bc-ca70f6a9b291',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR13838',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Seat',
'model': 'Ateca',
'odometer': 80231,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img5d/2d/5d2df2cb8ce4e17892aa1972507229ab/pa/TR13838_463980978adf3dd1894eff644d774384.jpg',
'https://img-pa.auto1.com/img5d/2d/5d2df2cb8ce4e17892aa1972507229ab/pa/TR13838_b3f1410d4ae167259bad2a37aed86e5a.jpg',
'https://img-pa.auto1.com/img5d/2d/5d2df2cb8ce4e17892aa1972507229ab/pa/TR13838_e53e27c87fff719e48664eeff66e94f6.jpg',
'https://img-pa.auto1.com/img5d/2d/5d2df2cb8ce4e17892aa1972507229ab/pa/TR13838_48f159edb17f9c41059988f48aa7dd45.jpg',
'https://img-pa.auto1.com/img5d/2d/5d2df2cb8ce4e17892aa1972507229ab/pa/TR13838_1445ee1abd5c1fa4be6a6294d0eecd08.jpg',
'https://img-pa.auto1.com/img5d/2d/5d2df2cb8ce4e17892aa1972507229ab/pa/TR13838_3ce1798b1a439a0fef428d447e88813c.jpg',
'https://img-pa.auto1.com/img5d/2d/5d2df2cb8ce4e17892aa1972507229ab/pa/TR13838_c1172f2fdcbe7ad1353896015515f271.jpg',
'https://img-pa.auto1.com/img5d/2d/5d2df2cb8ce4e17892aa1972507229ab/pa/TR13838_f9d55280334ffd7d8b8a032169758f63.jpg',
'https://img-pa.auto1.com/img5d/2d/5d2df2cb8ce4e17892aa1972507229ab/pa/TR13838_c8201b5ae5c1bb92505590190854e26b.jpg',
'https://img-pa.auto1.com/img5d/2d/5d2df2cb8ce4e17892aa1972507229ab/pa/TR13838_5de85835e59021493d27286aab717490.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c287923-e7fc-5e5f-a4bc-ca70f6a9b291/3c287923-e7fc-5e5f-a4bc-ca70f6a9b291_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86895,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/2d/5d2df2cb8ce4e17892aa1972507229ab/pa/TR13838_463980978adf3dd1894eff644d774384.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c287923-e7fc-5e5f-a4bc-ca70f6a9b291/3c287923-e7fc-5e5f-a4bc-ca70f6a9b291_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88746,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/2d/5d2df2cb8ce4e17892aa1972507229ab/pa/TR13838_b3f1410d4ae167259bad2a37aed86e5a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c287923-e7fc-5e5f-a4bc-ca70f6a9b291/3c287923-e7fc-5e5f-a4bc-ca70f6a9b291_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/2d/5d2df2cb8ce4e17892aa1972507229ab/pa/TR13838_e53e27c87fff719e48664eeff66e94f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c287923-e7fc-5e5f-a4bc-ca70f6a9b291/3c287923-e7fc-5e5f-a4bc-ca70f6a9b291_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82201,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/2d/5d2df2cb8ce4e17892aa1972507229ab/pa/TR13838_48f159edb17f9c41059988f48aa7dd45.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c287923-e7fc-5e5f-a4bc-ca70f6a9b291/3c287923-e7fc-5e5f-a4bc-ca70f6a9b291_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70755,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/2d/5d2df2cb8ce4e17892aa1972507229ab/pa/TR13838_1445ee1abd5c1fa4be6a6294d0eecd08.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c287923-e7fc-5e5f-a4bc-ca70f6a9b291/3c287923-e7fc-5e5f-a4bc-ca70f6a9b291_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80654,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/2d/5d2df2cb8ce4e17892aa1972507229ab/pa/TR13838_3ce1798b1a439a0fef428d447e88813c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c287923-e7fc-5e5f-a4bc-ca70f6a9b291/3c287923-e7fc-5e5f-a4bc-ca70f6a9b291_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80773,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/2d/5d2df2cb8ce4e17892aa1972507229ab/pa/TR13838_c1172f2fdcbe7ad1353896015515f271.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c287923-e7fc-5e5f-a4bc-ca70f6a9b291/3c287923-e7fc-5e5f-a4bc-ca70f6a9b291_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84960,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/2d/5d2df2cb8ce4e17892aa1972507229ab/pa/TR13838_f9d55280334ffd7d8b8a032169758f63.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c287923-e7fc-5e5f-a4bc-ca70f6a9b291/3c287923-e7fc-5e5f-a4bc-ca70f6a9b291_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82030,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/2d/5d2df2cb8ce4e17892aa1972507229ab/pa/TR13838_c8201b5ae5c1bb92505590190854e26b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c287923-e7fc-5e5f-a4bc-ca70f6a9b291/3c287923-e7fc-5e5f-a4bc-ca70f6a9b291_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56693,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/2d/5d2df2cb8ce4e17892aa1972507229ab/pa/TR13838_5de85835e59021493d27286aab717490.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-02-04',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Ateca 1.5 TSI ACT Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2021}
2026-03-30 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TR13838%27 HTTP/1.1" 200 None
2026-03-30 08:36:04 [auto1.be] INFO: Saving data for TR13838: {'created_time': 1774859764.440224, 'last_price_update_time': 1774859764.440236, 'auction_closing_time': 1774971620.0}
2026-03-30 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TR13838') HTTP/1.1" 204 0
2026-03-30 08:36:04 [auto1.be] INFO: Found listing with ID: NB29078
2026-03-30 08:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 609d2776-636a-505a-99b8-40bf6797ed97 with identifier: TX28125
2026-03-30 08:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 609d2776-636a-505a-99b8-40bf6797ed97 with identifier: TX28125
2026-03-30 08:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 609d2776-636a-505a-99b8-40bf6797ed97 with identifier: TX28125 to the API
2026-03-30 08:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:49:39Z',
'fuel_type': 'diesel',
'id': '609d2776-636a-505a-99b8-40bf6797ed97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX28125',
'listing': 'auction',
'make': 'Renault',
'model': 'Captur',
'odometer': 56389,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-10-23',
'seller_name': None,
'title': 'Renault Captur 1.5 dCi Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2014}
2026-03-30 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX28125%27 HTTP/1.1" 200 None
2026-03-30 08:36:04 [auto1.be] INFO: Saving data for TX28125: {'auction_closing_time': 1774972179.0, 'created_time': 1774039045.343658, 'last_price_update_time': 1774859764.78133}
2026-03-30 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TX28125') HTTP/1.1" 204 0
2026-03-30 08:36:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd90e3950>
2026-03-30 08:36:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ead2ef-692d-5878-b7c5-741185e4ce42/a1ead2ef-692d-5878-b7c5-741185e4ce42_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1d%252Ff71dac23e1b4043d6152a1445a2dd230%252Fpa%252FFA29131_c2118ed559fe32424beabdafaf38d2ee.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1d/f71dac23e1b4043d6152a1445a2dd230/pa/FA29131_c2118ed559fe32424beabdafaf38d2ee.jpg saved to cache
2026-03-30 08:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1ead2ef-692d-5878-b7c5-741185e4ce42
2026-03-30 08:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1df94b2-a3e4-5692-8c84-1ee12df9085e with identifier: UU73016
2026-03-30 08:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1df94b2-a3e4-5692-8c84-1ee12df9085e with scrape type 1
2026-03-30 08:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a1df94b2-a3e4-5692-8c84-1ee12df9085e
2026-03-30 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F54%252F665439437dbcb0e9a68fbd67bb9adc6e%252Fpa%252FUU73016_d9072c5a261491866d0f482469fbe5a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_d9072c5a261491866d0f482469fbe5a2.jpg not downloaded yet
2026-03-30 08:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/1d/f71dac23e1b4043d6152a1445a2dd230/pa/FA29131_aabaf15559aacc8eadc2565d30475a29.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:04 [auto1.be] INFO: Found listing with ID: MH10936
2026-03-30 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MH10936%27 HTTP/1.1" 200 None
2026-03-30 08:36:04 [auto1.be] INFO: Scrape type for MH10936: 2
2026-03-30 08:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b204a719-26b4-5425-83a5-bd1fb2b28a8c with identifier: MH10936
2026-03-30 08:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b204a719-26b4-5425-83a5-bd1fb2b28a8c with scrape type 2
2026-03-30 08:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b204a719-26b4-5425-83a5-bd1fb2b28a8c with scrape type 2
2026-03-30 08:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b204a719-26b4-5425-83a5-bd1fb2b28a8c, identifier: MH10936
2026-03-30 08:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/1d/f71dac23e1b4043d6152a1445a2dd230/pa/FA29131_b149a21ce20b874ec4bc9218b2666dc5.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b204a719-26b4-5425-83a5-bd1fb2b28a8c with identifier: MH10936
2026-03-30 08:36:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b204a719-26b4-5425-83a5-bd1fb2b28a8c with identifier: MH10936
2026-03-30 08:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b204a719-26b4-5425-83a5-bd1fb2b28a8c with identifier: MH10936 to the API
2026-03-30 08:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:56:58Z',
'fuel_type': 'diesel',
'id': 'b204a719-26b4-5425-83a5-bd1fb2b28a8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH10936',
'listing': 'auction',
'make': 'DS Automobiles',
'model': 'DS7 Crossback',
'odometer': 86232,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-26',
'seller_name': None,
'title': 'DS Automobiles DS7 Crossback 1.5 Blue-HDi SoChic',
'transmission': 'automatic',
'trim': 'SoChic',
'year': 2020}
2026-03-30 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MH10936%27 HTTP/1.1" 200 None
2026-03-30 08:36:05 [auto1.be] INFO: Saving data for MH10936: {'auction_closing_time': 1774972618.0, 'created_time': 1773301742.481658, 'last_price_update_time': 1774859765.388659}
2026-03-30 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MH10936') HTTP/1.1" 204 0
2026-03-30 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F54%252F665439437dbcb0e9a68fbd67bb9adc6e%252Fpa%252FUU73016_3f26ff4bf709df41efa667f3af14542a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_3f26ff4bf709df41efa667f3af14542a.jpg not downloaded yet
2026-03-30 08:36:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8f1d610>
2026-03-30 08:36:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ead2ef-692d-5878-b7c5-741185e4ce42/a1ead2ef-692d-5878-b7c5-741185e4ce42_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1d%252Ff71dac23e1b4043d6152a1445a2dd230%252Fpa%252FFA29131_3c3d749ebb0e0c4b447ea3580b5dc773.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1d/f71dac23e1b4043d6152a1445a2dd230/pa/FA29131_3c3d749ebb0e0c4b447ea3580b5dc773.jpg saved to cache
2026-03-30 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a1ead2ef-692d-5878-b7c5-741185e4ce42
2026-03-30 08:36:05 [auto1.be] INFO: Found listing with ID: CY95631
2026-03-30 08:36:05 [auto1.be] INFO: Found listing with ID: UF38996
2026-03-30 08:36:05 [auto1.be] INFO: Found listing with ID: ED62480
2026-03-30 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED62480%27 HTTP/1.1" 200 None
2026-03-30 08:36:05 [auto1.be] INFO: Scrape type for ED62480: 2
2026-03-30 08:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 484057bf-ec42-580c-b10b-437a9fb89d09 with identifier: ED62480
2026-03-30 08:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 484057bf-ec42-580c-b10b-437a9fb89d09 with scrape type 2
2026-03-30 08:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 484057bf-ec42-580c-b10b-437a9fb89d09 with scrape type 2
2026-03-30 08:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 484057bf-ec42-580c-b10b-437a9fb89d09, identifier: ED62480
2026-03-30 08:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EH30324/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 484057bf-ec42-580c-b10b-437a9fb89d09 with identifier: ED62480
2026-03-30 08:36:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 484057bf-ec42-580c-b10b-437a9fb89d09 with identifier: ED62480
2026-03-30 08:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 484057bf-ec42-580c-b10b-437a9fb89d09 with identifier: ED62480 to the API
2026-03-30 08:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 60,
'expiration_date': '2026-03-31T15:12:17Z',
'fuel_type': 'petrol',
'id': '484057bf-ec42-580c-b10b-437a9fb89d09',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED62480',
'listing': 'auction',
'make': 'Peugeot',
'model': '206+',
'odometer': 133970,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-10-07',
'seller_name': None,
'title': 'Peugeot 206+ 1.1 Urban',
'transmission': 'manual',
'trim': 'Urban',
'year': 2012}
2026-03-30 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ED62480%27 HTTP/1.1" 200 None
2026-03-30 08:36:05 [auto1.be] INFO: Saving data for ED62480: {'auction_closing_time': 1774969937.0, 'created_time': 1774384543.233729, 'last_price_update_time': 1774859765.956529}
2026-03-30 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ED62480') HTTP/1.1" 204 0
2026-03-30 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F54%252F665439437dbcb0e9a68fbd67bb9adc6e%252Fpa%252FUU73016_a49882d95182c6e0206b37d082395867.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_a49882d95182c6e0206b37d082395867.jpg not downloaded yet
2026-03-30 08:36:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd858af90>
2026-03-30 08:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ead2ef-692d-5878-b7c5-741185e4ce42/a1ead2ef-692d-5878-b7c5-741185e4ce42_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1d%252Ff71dac23e1b4043d6152a1445a2dd230%252Fpa%252FFA29131_aabaf15559aacc8eadc2565d30475a29.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1d/f71dac23e1b4043d6152a1445a2dd230/pa/FA29131_aabaf15559aacc8eadc2565d30475a29.jpg saved to cache
2026-03-30 08:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1ead2ef-692d-5878-b7c5-741185e4ce42
2026-03-30 08:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/1d/f71dac23e1b4043d6152a1445a2dd230/pa/FA29131_305070a8f2400dcf5aa7a07698685524.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:06 [auto1.be] INFO: Found listing with ID: TZ53898
2026-03-30 08:36:06 [auto1.be] INFO: Found listing with ID: SR71847
2026-03-30 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR71847%27 HTTP/1.1" 200 None
2026-03-30 08:36:06 [auto1.be] INFO: Scrape type for SR71847: 2
2026-03-30 08:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01837aeb-71bd-5171-ac3c-963900840840 with identifier: SR71847
2026-03-30 08:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01837aeb-71bd-5171-ac3c-963900840840 with scrape type 2
2026-03-30 08:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01837aeb-71bd-5171-ac3c-963900840840 with scrape type 2
2026-03-30 08:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 01837aeb-71bd-5171-ac3c-963900840840, identifier: SR71847
2026-03-30 08:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd85b67d0>
2026-03-30 08:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ead2ef-692d-5878-b7c5-741185e4ce42/a1ead2ef-692d-5878-b7c5-741185e4ce42_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1d%252Ff71dac23e1b4043d6152a1445a2dd230%252Fpa%252FFA29131_b149a21ce20b874ec4bc9218b2666dc5.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1d/f71dac23e1b4043d6152a1445a2dd230/pa/FA29131_b149a21ce20b874ec4bc9218b2666dc5.jpg saved to cache
2026-03-30 08:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a1ead2ef-692d-5878-b7c5-741185e4ce42
2026-03-30 08:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 01837aeb-71bd-5171-ac3c-963900840840 with identifier: SR71847
2026-03-30 08:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 01837aeb-71bd-5171-ac3c-963900840840 with identifier: SR71847
2026-03-30 08:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 01837aeb-71bd-5171-ac3c-963900840840 with identifier: SR71847 to the API
2026-03-30 08:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 132,
'expiration_date': '2026-03-31T15:46:51Z',
'fuel_type': 'petrol',
'id': '01837aeb-71bd-5171-ac3c-963900840840',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR71847',
'listing': 'auction',
'make': 'Toyota',
'model': 'Verso',
'odometer': 74167,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-02-01',
'seller_name': None,
'title': 'Toyota Verso 1.6 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2012}
2026-03-30 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR71847%27 HTTP/1.1" 200 None
2026-03-30 08:36:06 [auto1.be] INFO: Saving data for SR71847: {'auction_closing_time': 1774972011.0, 'created_time': 1773301671.47644, 'last_price_update_time': 1774859766.619081}
2026-03-30 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SR71847') HTTP/1.1" 204 0
2026-03-30 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F54%252F665439437dbcb0e9a68fbd67bb9adc6e%252Fpa%252FUU73016_bbd2d2f108a10afe046f855329c3f9b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_bbd2d2f108a10afe046f855329c3f9b2.jpg not downloaded yet
2026-03-30 08:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/1d/f71dac23e1b4043d6152a1445a2dd230/pa/FA29131_ba6529ab5b02c1f2bc871e1ea365c14b.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:06 [auto1.be] INFO: Found listing with ID: MS84357
2026-03-30 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS84357%27 HTTP/1.1" 200 None
2026-03-30 08:36:06 [auto1.be] INFO: Scrape type for MS84357: 2
2026-03-30 08:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51a5a056-fc0b-547b-8a8f-79e538d433b0 with identifier: MS84357
2026-03-30 08:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51a5a056-fc0b-547b-8a8f-79e538d433b0 with scrape type 2
2026-03-30 08:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51a5a056-fc0b-547b-8a8f-79e538d433b0 with scrape type 2
2026-03-30 08:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 51a5a056-fc0b-547b-8a8f-79e538d433b0, identifier: MS84357
2026-03-30 08:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GL14353/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 51a5a056-fc0b-547b-8a8f-79e538d433b0 with identifier: MS84357
2026-03-30 08:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 51a5a056-fc0b-547b-8a8f-79e538d433b0 with identifier: MS84357
2026-03-30 08:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 51a5a056-fc0b-547b-8a8f-79e538d433b0 with identifier: MS84357 to the API
2026-03-30 08:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-31T15:41:48Z',
'fuel_type': 'petrol',
'id': '51a5a056-fc0b-547b-8a8f-79e538d433b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS84357',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 104781,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-14',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.0 TSI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2019}
2026-03-30 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MS84357%27 HTTP/1.1" 200 None
2026-03-30 08:36:07 [auto1.be] INFO: Saving data for MS84357: {'auction_closing_time': 1774971708.0, 'created_time': 1773134442.78482, 'last_price_update_time': 1774859767.231523}
2026-03-30 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MS84357') HTTP/1.1" 204 0
2026-03-30 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F54%252F665439437dbcb0e9a68fbd67bb9adc6e%252Fpa%252FUU73016_c983eb0486a64372fd94345c06ae5223.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_c983eb0486a64372fd94345c06ae5223.jpg not downloaded yet
2026-03-30 08:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_3f26ff4bf709df41efa667f3af14542a.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:07 [scrapy.extensions.logstats] INFO: Crawled 44 pages (at 44 pages/min), scraped 56 items (at 56 items/min)
2026-03-30 08:36:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 166MiB
2026-03-30 08:36:07 [auto1.be] INFO: Found listing with ID: PS28625
2026-03-30 08:36:07 [auto1.be] INFO: Found listing with ID: SJ72272
2026-03-30 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ72272%27 HTTP/1.1" 200 None
2026-03-30 08:36:07 [auto1.be] INFO: Scrape type for SJ72272: 2
2026-03-30 08:36:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60e85e86-c756-5403-a2d2-17bc69edb9cc with identifier: SJ72272
2026-03-30 08:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60e85e86-c756-5403-a2d2-17bc69edb9cc with scrape type 2
2026-03-30 08:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60e85e86-c756-5403-a2d2-17bc69edb9cc with scrape type 2
2026-03-30 08:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 60e85e86-c756-5403-a2d2-17bc69edb9cc, identifier: SJ72272
2026-03-30 08:36:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd84cae50>
2026-03-30 08:36:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ead2ef-692d-5878-b7c5-741185e4ce42/a1ead2ef-692d-5878-b7c5-741185e4ce42_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1d%252Ff71dac23e1b4043d6152a1445a2dd230%252Fpa%252FFA29131_305070a8f2400dcf5aa7a07698685524.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1d/f71dac23e1b4043d6152a1445a2dd230/pa/FA29131_305070a8f2400dcf5aa7a07698685524.jpg saved to cache
2026-03-30 08:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a1ead2ef-692d-5878-b7c5-741185e4ce42
2026-03-30 08:36:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 60e85e86-c756-5403-a2d2-17bc69edb9cc with identifier: SJ72272
2026-03-30 08:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 60e85e86-c756-5403-a2d2-17bc69edb9cc with identifier: SJ72272
2026-03-30 08:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 60e85e86-c756-5403-a2d2-17bc69edb9cc with identifier: SJ72272 to the API
2026-03-30 08:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 155,
'expiration_date': '2026-03-31T15:33:49Z',
'fuel_type': 'petrol',
'id': '60e85e86-c756-5403-a2d2-17bc69edb9cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ72272',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 101074,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-04-10',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2018}
2026-03-30 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ72272%27 HTTP/1.1" 200 None
2026-03-30 08:36:07 [auto1.be] INFO: Saving data for SJ72272: {'auction_closing_time': 1774971229.0, 'created_time': 1774471393.31772, 'last_price_update_time': 1774859767.804974}
2026-03-30 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SJ72272') HTTP/1.1" 204 0
2026-03-30 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F54%252F665439437dbcb0e9a68fbd67bb9adc6e%252Fpa%252FUU73016_4c4f11de8b6dca5531a09543442860d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_4c4f11de8b6dca5531a09543442860d9.jpg not downloaded yet
2026-03-30 08:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NH22682/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:07 [auto1.be] INFO: Found listing with ID: MD91238
2026-03-30 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD91238%27 HTTP/1.1" 200 None
2026-03-30 08:36:07 [auto1.be] INFO: Scrape type for MD91238: 2
2026-03-30 08:36:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da75691a-ea08-5b75-a3cd-5201273acd6a with identifier: MD91238
2026-03-30 08:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da75691a-ea08-5b75-a3cd-5201273acd6a with scrape type 2
2026-03-30 08:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da75691a-ea08-5b75-a3cd-5201273acd6a with scrape type 2
2026-03-30 08:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: da75691a-ea08-5b75-a3cd-5201273acd6a, identifier: MD91238
2026-03-30 08:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AG54530> (referer: https://www.auto1.com/v1/car-details-view/AG54530/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8542550>
2026-03-30 08:36:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ead2ef-692d-5878-b7c5-741185e4ce42/a1ead2ef-692d-5878-b7c5-741185e4ce42_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252F1d%252Ff71dac23e1b4043d6152a1445a2dd230%252Fpa%252FFA29131_ba6529ab5b02c1f2bc871e1ea365c14b.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/1d/f71dac23e1b4043d6152a1445a2dd230/pa/FA29131_ba6529ab5b02c1f2bc871e1ea365c14b.jpg saved to cache
2026-03-30 08:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a1ead2ef-692d-5878-b7c5-741185e4ce42
2026-03-30 08:36:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1ead2ef-692d-5878-b7c5-741185e4ce42, skipping ID generation
2026-03-30 08:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1ead2ef-692d-5878-b7c5-741185e4ce42 with scrape type 1
2026-03-30 08:36:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1ead2ef-692d-5878-b7c5-741185e4ce42 sending to next pipeline
2026-03-30 08:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a1ead2ef-692d-5878-b7c5-741185e4ce42, identifier: FA29131
2026-03-30 08:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_a49882d95182c6e0206b37d082395867.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: da75691a-ea08-5b75-a3cd-5201273acd6a with identifier: MD91238
2026-03-30 08:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: da75691a-ea08-5b75-a3cd-5201273acd6a with identifier: MD91238
2026-03-30 08:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: da75691a-ea08-5b75-a3cd-5201273acd6a with identifier: MD91238 to the API
2026-03-30 08:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 103,
'expiration_date': '2026-03-31T15:23:40Z',
'fuel_type': 'diesel',
'id': 'da75691a-ea08-5b75-a3cd-5201273acd6a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD91238',
'listing': 'auction',
'make': 'Renault',
'model': 'Scenic',
'odometer': 234620,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'Renault Scenic 1.5 dCi Eco',
'transmission': 'manual',
'trim': 'Eco',
'year': 2009}
2026-03-30 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD91238%27 HTTP/1.1" 200 None
2026-03-30 08:36:08 [auto1.be] INFO: Saving data for MD91238: {'auction_closing_time': 1774970620.0, 'created_time': 1774341354.006394, 'last_price_update_time': 1774859768.435369}
2026-03-30 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MD91238') HTTP/1.1" 204 0
2026-03-30 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F54%252F665439437dbcb0e9a68fbd67bb9adc6e%252Fpa%252FUU73016_7a5e59520f45c80602d0f83489cec258.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_7a5e59520f45c80602d0f83489cec258.jpg not downloaded yet
2026-03-30 08:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a1ead2ef-692d-5878-b7c5-741185e4ce42 with identifier: FA29131
2026-03-30 08:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a1ead2ef-692d-5878-b7c5-741185e4ce42 with identifier: FA29131
2026-03-30 08:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a1ead2ef-692d-5878-b7c5-741185e4ce42 with identifier: FA29131 to the API
2026-03-30 08:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf7/1d/f71dac23e1b4043d6152a1445a2dd230/pa/FA29131_ba6529ab5b02c1f2bc871e1ea365c14b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 105,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.7L',
'engine_horse_power': 110,
'expiration_date': '2026-03-31T15:04:12Z',
'fuel_type': 'diesel',
'id': 'a1ead2ef-692d-5878-b7c5-741185e4ce42',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA29131',
'listing': 'auction',
'location': 'BE, Mechelen',
'make': 'Opel',
'model': 'Astra',
'odometer': 219048,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ead2ef-692d-5878-b7c5-741185e4ce42/a1ead2ef-692d-5878-b7c5-741185e4ce42_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94528,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/1d/f71dac23e1b4043d6152a1445a2dd230/pa/FA29131_c2118ed559fe32424beabdafaf38d2ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ead2ef-692d-5878-b7c5-741185e4ce42/a1ead2ef-692d-5878-b7c5-741185e4ce42_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117140,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/1d/f71dac23e1b4043d6152a1445a2dd230/pa/FA29131_3c3d749ebb0e0c4b447ea3580b5dc773.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ead2ef-692d-5878-b7c5-741185e4ce42/a1ead2ef-692d-5878-b7c5-741185e4ce42_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89538,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/1d/f71dac23e1b4043d6152a1445a2dd230/pa/FA29131_aabaf15559aacc8eadc2565d30475a29.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ead2ef-692d-5878-b7c5-741185e4ce42/a1ead2ef-692d-5878-b7c5-741185e4ce42_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80495,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/1d/f71dac23e1b4043d6152a1445a2dd230/pa/FA29131_b149a21ce20b874ec4bc9218b2666dc5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ead2ef-692d-5878-b7c5-741185e4ce42/a1ead2ef-692d-5878-b7c5-741185e4ce42_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115356,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/1d/f71dac23e1b4043d6152a1445a2dd230/pa/FA29131_305070a8f2400dcf5aa7a07698685524.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ead2ef-692d-5878-b7c5-741185e4ce42/a1ead2ef-692d-5878-b7c5-741185e4ce42_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75911,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf7/1d/f71dac23e1b4043d6152a1445a2dd230/pa/FA29131_ba6529ab5b02c1f2bc871e1ea365c14b.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-07-26',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Astra 1.7 CDTI 150 Jahre Opel',
'transmission': 'manual',
'trim': '150 Jahre',
'year': 2012}
2026-03-30 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA29131%27 HTTP/1.1" 200 None
2026-03-30 08:36:08 [auto1.be] INFO: Saving data for FA29131: {'created_time': 1774859768.853177, 'last_price_update_time': 1774859768.853192, 'auction_closing_time': 1774969452.0}
2026-03-30 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FA29131') HTTP/1.1" 204 0
2026-03-30 08:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_bbd2d2f108a10afe046f855329c3f9b2.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:08 [auto1.be] INFO: Found listing with ID: WN85390
2026-03-30 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN85390%27 HTTP/1.1" 200 None
2026-03-30 08:36:08 [auto1.be] INFO: Scrape type for WN85390: 2
2026-03-30 08:36:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6ca133d-c56f-5344-9d0e-fa72d02b444f with identifier: WN85390
2026-03-30 08:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6ca133d-c56f-5344-9d0e-fa72d02b444f with scrape type 2
2026-03-30 08:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6ca133d-c56f-5344-9d0e-fa72d02b444f with scrape type 2
2026-03-30 08:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a6ca133d-c56f-5344-9d0e-fa72d02b444f, identifier: WN85390
2026-03-30 08:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd858c590>
2026-03-30 08:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1df94b2-a3e4-5692-8c84-1ee12df9085e/a1df94b2-a3e4-5692-8c84-1ee12df9085e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F54%252F665439437dbcb0e9a68fbd67bb9adc6e%252Fpa%252FUU73016_3f26ff4bf709df41efa667f3af14542a.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_3f26ff4bf709df41efa667f3af14542a.jpg saved to cache
2026-03-30 08:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a1df94b2-a3e4-5692-8c84-1ee12df9085e
2026-03-30 08:36:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a6ca133d-c56f-5344-9d0e-fa72d02b444f with identifier: WN85390
2026-03-30 08:36:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a6ca133d-c56f-5344-9d0e-fa72d02b444f with identifier: WN85390
2026-03-30 08:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a6ca133d-c56f-5344-9d0e-fa72d02b444f with identifier: WN85390 to the API
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 245,
'expiration_date': '2026-03-31T15:58:02Z',
'fuel_type': 'diesel',
'id': 'a6ca133d-c56f-5344-9d0e-fa72d02b444f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN85390',
'listing': 'auction',
'make': 'Audi',
'model': 'A5 Sportback',
'odometer': 213326,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-11-18',
'seller_name': None,
'title': 'Audi A5 Sportback 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2012}
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN85390%27 HTTP/1.1" 200 None
2026-03-30 08:36:09 [auto1.be] INFO: Saving data for WN85390: {'auction_closing_time': 1774972682.0, 'created_time': 1773132015.791776, 'last_price_update_time': 1774859769.587016}
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WN85390') HTTP/1.1" 204 0
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F54%252F665439437dbcb0e9a68fbd67bb9adc6e%252Fpa%252FUU73016_b9ce1c81a74e8210eb60eea7477a118d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_b9ce1c81a74e8210eb60eea7477a118d.jpg not downloaded yet
2026-03-30 08:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LW89201> (referer: https://www.auto1.com/v1/car-details-view/LW89201/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:09 [auto1.be] INFO: Found listing with ID: FV41606
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV41606%27 HTTP/1.1" 200 None
2026-03-30 08:36:09 [auto1.be] INFO: Scrape type for FV41606: 2
2026-03-30 08:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83e562bb-4d42-55be-b4e3-364202ff78db with identifier: FV41606
2026-03-30 08:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83e562bb-4d42-55be-b4e3-364202ff78db with scrape type 2
2026-03-30 08:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83e562bb-4d42-55be-b4e3-364202ff78db with scrape type 2
2026-03-30 08:36:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 83e562bb-4d42-55be-b4e3-364202ff78db, identifier: FV41606
2026-03-30 08:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WR16749> (referer: https://www.auto1.com/v1/car-details-view/WR16749/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56e4f0eb-e894-537a-a3fa-89ba6867e338 with identifier: AG54530
2026-03-30 08:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56e4f0eb-e894-537a-a3fa-89ba6867e338 with scrape type 1
2026-03-30 08:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 56e4f0eb-e894-537a-a3fa-89ba6867e338
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F2f%252F1b2f43e9c31f33e48aea336d47c2ccad%252Fpa%252FAG54530_8f5560a7c6ea47008c292dbd4bdd0d79.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/2f/1b2f43e9c31f33e48aea336d47c2ccad/pa/AG54530_8f5560a7c6ea47008c292dbd4bdd0d79.jpg already downloaded
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F2f%252F1b2f43e9c31f33e48aea336d47c2ccad%252Fpa%252FAG54530_b9690a62eb046f45a966f18521215f3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/2f/1b2f43e9c31f33e48aea336d47c2ccad/pa/AG54530_b9690a62eb046f45a966f18521215f3a.jpg already downloaded
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F2f%252F1b2f43e9c31f33e48aea336d47c2ccad%252Fpa%252FAG54530_2527b87a4556338258dc9eb340a275b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/2f/1b2f43e9c31f33e48aea336d47c2ccad/pa/AG54530_2527b87a4556338258dc9eb340a275b4.jpg already downloaded
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F2f%252F1b2f43e9c31f33e48aea336d47c2ccad%252Fpa%252FAG54530_2842eafb9ad3572fc48b5631c1c155fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/2f/1b2f43e9c31f33e48aea336d47c2ccad/pa/AG54530_2842eafb9ad3572fc48b5631c1c155fc.jpg already downloaded
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F2f%252F1b2f43e9c31f33e48aea336d47c2ccad%252Fpa%252FAG54530_28d57f31e0df595e327bd059e9d38c31.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/2f/1b2f43e9c31f33e48aea336d47c2ccad/pa/AG54530_28d57f31e0df595e327bd059e9d38c31.jpg already downloaded
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F2f%252F1b2f43e9c31f33e48aea336d47c2ccad%252Fpa%252FAG54530_1b9901749c6e92be07e0161c3067ff9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/2f/1b2f43e9c31f33e48aea336d47c2ccad/pa/AG54530_1b9901749c6e92be07e0161c3067ff9d.jpg already downloaded
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F2f%252F1b2f43e9c31f33e48aea336d47c2ccad%252Fpa%252FAG54530_8d1a4e8c79713e9b85102f23d2f29d2e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/2f/1b2f43e9c31f33e48aea336d47c2ccad/pa/AG54530_8d1a4e8c79713e9b85102f23d2f29d2e.jpg already downloaded
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F2f%252F1b2f43e9c31f33e48aea336d47c2ccad%252Fpa%252FAG54530_6b3b0656f732c8060a92854ee3ce91e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/2f/1b2f43e9c31f33e48aea336d47c2ccad/pa/AG54530_6b3b0656f732c8060a92854ee3ce91e5.jpg already downloaded
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F2f%252F1b2f43e9c31f33e48aea336d47c2ccad%252Fpa%252FAG54530_8f723bf00b64e29526d607e372f21c78.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/2f/1b2f43e9c31f33e48aea336d47c2ccad/pa/AG54530_8f723bf00b64e29526d607e372f21c78.jpg already downloaded
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F2f%252F1b2f43e9c31f33e48aea336d47c2ccad%252Fpa%252FAG54530_0538b37492033c03cd443970dd2ba88e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/2f/1b2f43e9c31f33e48aea336d47c2ccad/pa/AG54530_0538b37492033c03cd443970dd2ba88e.jpg already downloaded
2026-03-30 08:36:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 56e4f0eb-e894-537a-a3fa-89ba6867e338, identifier: AG54530
2026-03-30 08:36:10 [auto1.be] INFO: Channel: 24h | Page: 5 | totalHits: 1501 | hits on page: 40
2026-03-30 08:36:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd859bdd0>
2026-03-30 08:36:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1df94b2-a3e4-5692-8c84-1ee12df9085e/a1df94b2-a3e4-5692-8c84-1ee12df9085e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F54%252F665439437dbcb0e9a68fbd67bb9adc6e%252Fpa%252FUU73016_a49882d95182c6e0206b37d082395867.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_a49882d95182c6e0206b37d082395867.jpg saved to cache
2026-03-30 08:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1df94b2-a3e4-5692-8c84-1ee12df9085e
2026-03-30 08:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_c983eb0486a64372fd94345c06ae5223.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 83e562bb-4d42-55be-b4e3-364202ff78db with identifier: FV41606
2026-03-30 08:36:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 83e562bb-4d42-55be-b4e3-364202ff78db with identifier: FV41606
2026-03-30 08:36:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 83e562bb-4d42-55be-b4e3-364202ff78db with identifier: FV41606 to the API
2026-03-30 08:36:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-31T15:31:49Z',
'fuel_type': 'petrol',
'id': '83e562bb-4d42-55be-b4e3-364202ff78db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV41606',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 93280,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-19',
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Like',
'transmission': 'manual',
'trim': 'Like',
'year': 2017}
2026-03-30 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV41606%27 HTTP/1.1" 200 None
2026-03-30 08:36:10 [auto1.be] INFO: Saving data for FV41606: {'auction_closing_time': 1774971109.0, 'created_time': 1774125438.538684, 'last_price_update_time': 1774859770.417832}
2026-03-30 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FV41606') HTTP/1.1" 204 0
2026-03-30 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F54%252F665439437dbcb0e9a68fbd67bb9adc6e%252Fpa%252FUU73016_a20d7bfe956154d65c160222b16e12a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_a20d7bfe956154d65c160222b16e12a4.jpg not downloaded yet
2026-03-30 08:36:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 56e4f0eb-e894-537a-a3fa-89ba6867e338 with identifier: AG54530
2026-03-30 08:36:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 56e4f0eb-e894-537a-a3fa-89ba6867e338 with identifier: AG54530
2026-03-30 08:36:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 56e4f0eb-e894-537a-a3fa-89ba6867e338 with identifier: AG54530 to the API
2026-03-30 08:36:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AG54530>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 92,
'expiration_date': '2026-03-31T15:09:44Z',
'fuel_type': 'diesel',
'id': '56e4f0eb-e894-537a-a3fa-89ba6867e338',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG54530',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Peugeot',
'model': 'Partner',
'odometer': 176871,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img1b/2f/1b2f43e9c31f33e48aea336d47c2ccad/pa/AG54530_8f5560a7c6ea47008c292dbd4bdd0d79.jpg',
'https://img-pa.auto1.com/img1b/2f/1b2f43e9c31f33e48aea336d47c2ccad/pa/AG54530_b9690a62eb046f45a966f18521215f3a.jpg',
'https://img-pa.auto1.com/img1b/2f/1b2f43e9c31f33e48aea336d47c2ccad/pa/AG54530_2527b87a4556338258dc9eb340a275b4.jpg',
'https://img-pa.auto1.com/img1b/2f/1b2f43e9c31f33e48aea336d47c2ccad/pa/AG54530_2842eafb9ad3572fc48b5631c1c155fc.jpg',
'https://img-pa.auto1.com/img1b/2f/1b2f43e9c31f33e48aea336d47c2ccad/pa/AG54530_28d57f31e0df595e327bd059e9d38c31.jpg',
'https://img-pa.auto1.com/img1b/2f/1b2f43e9c31f33e48aea336d47c2ccad/pa/AG54530_1b9901749c6e92be07e0161c3067ff9d.jpg',
'https://img-pa.auto1.com/img1b/2f/1b2f43e9c31f33e48aea336d47c2ccad/pa/AG54530_8d1a4e8c79713e9b85102f23d2f29d2e.jpg',
'https://img-pa.auto1.com/img1b/2f/1b2f43e9c31f33e48aea336d47c2ccad/pa/AG54530_6b3b0656f732c8060a92854ee3ce91e5.jpg',
'https://img-pa.auto1.com/img1b/2f/1b2f43e9c31f33e48aea336d47c2ccad/pa/AG54530_8f723bf00b64e29526d607e372f21c78.jpg',
'https://img-pa.auto1.com/img1b/2f/1b2f43e9c31f33e48aea336d47c2ccad/pa/AG54530_0538b37492033c03cd443970dd2ba88e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56e4f0eb-e894-537a-a3fa-89ba6867e338/56e4f0eb-e894-537a-a3fa-89ba6867e338_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68826,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/2f/1b2f43e9c31f33e48aea336d47c2ccad/pa/AG54530_8f5560a7c6ea47008c292dbd4bdd0d79.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56e4f0eb-e894-537a-a3fa-89ba6867e338/56e4f0eb-e894-537a-a3fa-89ba6867e338_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70549,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/2f/1b2f43e9c31f33e48aea336d47c2ccad/pa/AG54530_b9690a62eb046f45a966f18521215f3a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56e4f0eb-e894-537a-a3fa-89ba6867e338/56e4f0eb-e894-537a-a3fa-89ba6867e338_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69009,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/2f/1b2f43e9c31f33e48aea336d47c2ccad/pa/AG54530_2527b87a4556338258dc9eb340a275b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56e4f0eb-e894-537a-a3fa-89ba6867e338/56e4f0eb-e894-537a-a3fa-89ba6867e338_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62292,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/2f/1b2f43e9c31f33e48aea336d47c2ccad/pa/AG54530_2842eafb9ad3572fc48b5631c1c155fc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56e4f0eb-e894-537a-a3fa-89ba6867e338/56e4f0eb-e894-537a-a3fa-89ba6867e338_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68084,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/2f/1b2f43e9c31f33e48aea336d47c2ccad/pa/AG54530_28d57f31e0df595e327bd059e9d38c31.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56e4f0eb-e894-537a-a3fa-89ba6867e338/56e4f0eb-e894-537a-a3fa-89ba6867e338_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69350,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/2f/1b2f43e9c31f33e48aea336d47c2ccad/pa/AG54530_1b9901749c6e92be07e0161c3067ff9d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56e4f0eb-e894-537a-a3fa-89ba6867e338/56e4f0eb-e894-537a-a3fa-89ba6867e338_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60840,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/2f/1b2f43e9c31f33e48aea336d47c2ccad/pa/AG54530_8d1a4e8c79713e9b85102f23d2f29d2e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56e4f0eb-e894-537a-a3fa-89ba6867e338/56e4f0eb-e894-537a-a3fa-89ba6867e338_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74216,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/2f/1b2f43e9c31f33e48aea336d47c2ccad/pa/AG54530_6b3b0656f732c8060a92854ee3ce91e5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56e4f0eb-e894-537a-a3fa-89ba6867e338/56e4f0eb-e894-537a-a3fa-89ba6867e338_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70026,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/2f/1b2f43e9c31f33e48aea336d47c2ccad/pa/AG54530_8f723bf00b64e29526d607e372f21c78.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56e4f0eb-e894-537a-a3fa-89ba6867e338/56e4f0eb-e894-537a-a3fa-89ba6867e338_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62177,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/2f/1b2f43e9c31f33e48aea336d47c2ccad/pa/AG54530_0538b37492033c03cd443970dd2ba88e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-06-24',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot Partner 1.6 HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2014}
2026-03-30 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG54530%27 HTTP/1.1" 200 None
2026-03-30 08:36:10 [auto1.be] INFO: Saving data for AG54530: {'created_time': 1774859770.77693, 'last_price_update_time': 1774859770.776943, 'auction_closing_time': 1774969784.0}
2026-03-30 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AG54530') HTTP/1.1" 204 0
2026-03-30 08:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_4c4f11de8b6dca5531a09543442860d9.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:10 [auto1.be] INFO: Found listing with ID: XC26287
2026-03-30 08:36:10 [auto1.be] INFO: Found listing with ID: EL40372
2026-03-30 08:36:10 [auto1.be] INFO: Found listing with ID: YX69957
2026-03-30 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX69957%27 HTTP/1.1" 200 None
2026-03-30 08:36:10 [auto1.be] INFO: Scrape type for YX69957: 1
2026-03-30 08:36:10 [auto1.be] INFO: Found listing with ID: YU57960
2026-03-30 08:36:10 [auto1.be] INFO: Found listing with ID: NJ53644
2026-03-30 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ53644%27 HTTP/1.1" 200 None
2026-03-30 08:36:10 [auto1.be] INFO: Scrape type for NJ53644: 2
2026-03-30 08:36:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44623cf2-fece-58a6-9429-68a52afad111 with identifier: NJ53644
2026-03-30 08:36:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44623cf2-fece-58a6-9429-68a52afad111 with scrape type 2
2026-03-30 08:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44623cf2-fece-58a6-9429-68a52afad111 with scrape type 2
2026-03-30 08:36:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 44623cf2-fece-58a6-9429-68a52afad111, identifier: NJ53644
2026-03-30 08:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VP95014> (referer: https://www.auto1.com/v1/car-details-view/VP95014/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8513b10>
2026-03-30 08:36:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1df94b2-a3e4-5692-8c84-1ee12df9085e/a1df94b2-a3e4-5692-8c84-1ee12df9085e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F54%252F665439437dbcb0e9a68fbd67bb9adc6e%252Fpa%252FUU73016_bbd2d2f108a10afe046f855329c3f9b2.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_bbd2d2f108a10afe046f855329c3f9b2.jpg saved to cache
2026-03-30 08:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a1df94b2-a3e4-5692-8c84-1ee12df9085e
2026-03-30 08:36:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F54%252F665439437dbcb0e9a68fbd67bb9adc6e%252Fpa%252FUU73016_d22ad76ce894725754a58f685c221c2d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_d22ad76ce894725754a58f685c221c2d.jpg not downloaded yet
2026-03-30 08:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 44623cf2-fece-58a6-9429-68a52afad111 with identifier: NJ53644
2026-03-30 08:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 44623cf2-fece-58a6-9429-68a52afad111 with identifier: NJ53644
2026-03-30 08:36:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 44623cf2-fece-58a6-9429-68a52afad111 with identifier: NJ53644 to the API
2026-03-30 08:36:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 102,
'expiration_date': '2026-03-31T15:12:16Z',
'fuel_type': 'diesel',
'id': '44623cf2-fece-58a6-9429-68a52afad111',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ53644',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 215236,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-01',
'seller_name': None,
'title': 'Volkswagen Caddy 1.6 TDI Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2015}
2026-03-30 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ53644%27 HTTP/1.1" 200 None
2026-03-30 08:36:11 [auto1.be] INFO: Saving data for NJ53644: {'auction_closing_time': 1774969936.0, 'created_time': 1773133167.364383, 'last_price_update_time': 1774859771.452193}
2026-03-30 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NJ53644') HTTP/1.1" 204 0
2026-03-30 08:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31516f29-62a3-5041-a755-30e1c1e5cc7a with identifier: LW89201
2026-03-30 08:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31516f29-62a3-5041-a755-30e1c1e5cc7a with scrape type 1
2026-03-30 08:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 31516f29-62a3-5041-a755-30e1c1e5cc7a
2026-03-30 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Ff5%252Fa0f59f472f24daf2c6eeec4a0f7d6e0d%252Fpa%252FLW89201_b70ea24bcd6954ffc0b86bd443f1805a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_b70ea24bcd6954ffc0b86bd443f1805a.jpg not downloaded yet
2026-03-30 08:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ff26a08-fa0d-58f0-9fdb-878cb60d7f63 with identifier: WR16749
2026-03-30 08:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ff26a08-fa0d-58f0-9fdb-878cb60d7f63 with scrape type 1
2026-03-30 08:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 2ff26a08-fa0d-58f0-9fdb-878cb60d7f63
2026-03-30 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F71%252F4871b017ef3d1ac588a1117fac31231f%252Fpa%252FWR16749_68b3b1efc3023ccf0db122064e1756e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/71/4871b017ef3d1ac588a1117fac31231f/pa/WR16749_68b3b1efc3023ccf0db122064e1756e6.jpg not downloaded yet
2026-03-30 08:36:11 [auto1.be] INFO: Found listing with ID: GS42296
2026-03-30 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS42296%27 HTTP/1.1" 200 None
2026-03-30 08:36:11 [auto1.be] INFO: Scrape type for GS42296: 2
2026-03-30 08:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f4255b7-de87-5111-a272-abcc4b5c9360 with identifier: GS42296
2026-03-30 08:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f4255b7-de87-5111-a272-abcc4b5c9360 with scrape type 2
2026-03-30 08:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f4255b7-de87-5111-a272-abcc4b5c9360 with scrape type 2
2026-03-30 08:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4f4255b7-de87-5111-a272-abcc4b5c9360, identifier: GS42296
2026-03-30 08:36:11 [auto1.be] INFO: Found listing with ID: GD38693
2026-03-30 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GD38693%27 HTTP/1.1" 200 None
2026-03-30 08:36:11 [auto1.be] INFO: Scrape type for GD38693: 2
2026-03-30 08:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 965876e4-690b-517d-aef2-99e3a2fb99a1 with identifier: GD38693
2026-03-30 08:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 965876e4-690b-517d-aef2-99e3a2fb99a1 with scrape type 2
2026-03-30 08:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 965876e4-690b-517d-aef2-99e3a2fb99a1 with scrape type 2
2026-03-30 08:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 965876e4-690b-517d-aef2-99e3a2fb99a1, identifier: GD38693
2026-03-30 08:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TS76065> (referer: https://www.auto1.com/v1/car-details-view/TS76065/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febdb7bba50>
2026-03-30 08:36:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1df94b2-a3e4-5692-8c84-1ee12df9085e/a1df94b2-a3e4-5692-8c84-1ee12df9085e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F54%252F665439437dbcb0e9a68fbd67bb9adc6e%252Fpa%252FUU73016_c983eb0486a64372fd94345c06ae5223.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_c983eb0486a64372fd94345c06ae5223.jpg saved to cache
2026-03-30 08:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a1df94b2-a3e4-5692-8c84-1ee12df9085e
2026-03-30 08:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_7a5e59520f45c80602d0f83489cec258.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4f4255b7-de87-5111-a272-abcc4b5c9360 with identifier: GS42296
2026-03-30 08:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4f4255b7-de87-5111-a272-abcc4b5c9360 with identifier: GS42296
2026-03-30 08:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4f4255b7-de87-5111-a272-abcc4b5c9360 with identifier: GS42296 to the API
2026-03-30 08:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:23:08Z',
'fuel_type': 'diesel',
'id': '4f4255b7-de87-5111-a272-abcc4b5c9360',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS42296',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Santa Fe',
'odometer': 143154,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-08',
'seller_name': None,
'title': 'Hyundai Santa Fe 2.0 CRDi CRDI',
'transmission': 'manual',
'trim': 'CRDI',
'year': 2011}
2026-03-30 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS42296%27 HTTP/1.1" 200 None
2026-03-30 08:36:12 [auto1.be] INFO: Saving data for GS42296: {'auction_closing_time': 1774970588.0, 'created_time': 1774471102.084137, 'last_price_update_time': 1774859772.679667}
2026-03-30 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GS42296') HTTP/1.1" 204 0
2026-03-30 08:36:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 965876e4-690b-517d-aef2-99e3a2fb99a1 with identifier: GD38693
2026-03-30 08:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 965876e4-690b-517d-aef2-99e3a2fb99a1 with identifier: GD38693
2026-03-30 08:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 965876e4-690b-517d-aef2-99e3a2fb99a1 with identifier: GD38693 to the API
2026-03-30 08:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:36:37Z',
'fuel_type': 'diesel',
'id': '965876e4-690b-517d-aef2-99e3a2fb99a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD38693',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Grand Picasso',
'odometer': 165140,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-13',
'seller_name': None,
'title': 'Citroen C4 Grand Picasso 1.6 e-HDi Exclusive',
'transmission': 'automatic',
'trim': 'Exclusive',
'year': 2014}
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GD38693%27 HTTP/1.1" 200 None
2026-03-30 08:36:13 [auto1.be] INFO: Saving data for GD38693: {'auction_closing_time': 1774971397.0, 'created_time': 1773131748.86501, 'last_price_update_time': 1774859773.350973}
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GD38693') HTTP/1.1" 204 0
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Ff5%252Fa0f59f472f24daf2c6eeec4a0f7d6e0d%252Fpa%252FLW89201_984621bca34b631cec9112e3087cd743.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_984621bca34b631cec9112e3087cd743.jpg not downloaded yet
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F71%252F4871b017ef3d1ac588a1117fac31231f%252Fpa%252FWR16749_a5c32ce1797b6ef73daf9579dda06c7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/71/4871b017ef3d1ac588a1117fac31231f/pa/WR16749_a5c32ce1797b6ef73daf9579dda06c7f.jpg not downloaded yet
2026-03-30 08:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8497410>
2026-03-30 08:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1df94b2-a3e4-5692-8c84-1ee12df9085e/a1df94b2-a3e4-5692-8c84-1ee12df9085e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F54%252F665439437dbcb0e9a68fbd67bb9adc6e%252Fpa%252FUU73016_4c4f11de8b6dca5531a09543442860d9.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_4c4f11de8b6dca5531a09543442860d9.jpg saved to cache
2026-03-30 08:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a1df94b2-a3e4-5692-8c84-1ee12df9085e
2026-03-30 08:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_b9ce1c81a74e8210eb60eea7477a118d.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:13 [auto1.be] INFO: Found listing with ID: PM47313
2026-03-30 08:36:13 [auto1.be] INFO: Found listing with ID: XV45416
2026-03-30 08:36:13 [auto1.be] INFO: Found listing with ID: UE43146
2026-03-30 08:36:13 [auto1.be] INFO: Found listing with ID: HL05710
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL05710%27 HTTP/1.1" 200 None
2026-03-30 08:36:13 [auto1.be] INFO: Scrape type for HL05710: 2
2026-03-30 08:36:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a9aed41-40ac-5acd-aa79-5920f5194a2f with identifier: HL05710
2026-03-30 08:36:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a9aed41-40ac-5acd-aa79-5920f5194a2f with scrape type 2
2026-03-30 08:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a9aed41-40ac-5acd-aa79-5920f5194a2f with scrape type 2
2026-03-30 08:36:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3a9aed41-40ac-5acd-aa79-5920f5194a2f, identifier: HL05710
2026-03-30 08:36:13 [auto1.be] INFO: Found listing with ID: KD01441
2026-03-30 08:36:13 [auto1.be] INFO: Found listing with ID: PH52818
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH52818%27 HTTP/1.1" 200 None
2026-03-30 08:36:13 [auto1.be] INFO: Scrape type for PH52818: 1
2026-03-30 08:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EH30324> (referer: https://www.auto1.com/v1/car-details-view/EH30324/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7bbed30-fb00-58db-abdb-c1eb9554656f with identifier: VP95014
2026-03-30 08:36:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7bbed30-fb00-58db-abdb-c1eb9554656f with scrape type 1
2026-03-30 08:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c7bbed30-fb00-58db-abdb-c1eb9554656f
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F89%252F0b893f32499abc49c428c060b118d6da%252Fpa%252FVP95014_e70f9b106816138e18bd065bdb2d873a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/89/0b893f32499abc49c428c060b118d6da/pa/VP95014_e70f9b106816138e18bd065bdb2d873a.jpg already downloaded
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F89%252F0b893f32499abc49c428c060b118d6da%252Fpa%252FVP95014_5f7e16f24882c70fdb7d4a442470abc1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/89/0b893f32499abc49c428c060b118d6da/pa/VP95014_5f7e16f24882c70fdb7d4a442470abc1.jpg already downloaded
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F89%252F0b893f32499abc49c428c060b118d6da%252Fpa%252FVP95014_d1c28a898ed7d2f0cd02840494116fd9.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/89/0b893f32499abc49c428c060b118d6da/pa/VP95014_d1c28a898ed7d2f0cd02840494116fd9.jpg already downloaded
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F89%252F0b893f32499abc49c428c060b118d6da%252Fpa%252FVP95014_b9ac236276b266bf08952a1490e83554.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/89/0b893f32499abc49c428c060b118d6da/pa/VP95014_b9ac236276b266bf08952a1490e83554.jpg already downloaded
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F89%252F0b893f32499abc49c428c060b118d6da%252Fpa%252FVP95014_d70378219e8d4e9fb74725a56882ae9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/89/0b893f32499abc49c428c060b118d6da/pa/VP95014_d70378219e8d4e9fb74725a56882ae9e.jpg already downloaded
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F89%252F0b893f32499abc49c428c060b118d6da%252Fpa%252FVP95014_177e216a9983679a0e437e12f2a4562d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/89/0b893f32499abc49c428c060b118d6da/pa/VP95014_177e216a9983679a0e437e12f2a4562d.jpg already downloaded
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F89%252F0b893f32499abc49c428c060b118d6da%252Fpa%252FVP95014_8ccc7105a6283fd57b513c66854e215d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/89/0b893f32499abc49c428c060b118d6da/pa/VP95014_8ccc7105a6283fd57b513c66854e215d.jpg already downloaded
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F89%252F0b893f32499abc49c428c060b118d6da%252Fpa%252FVP95014_c53b69c9c0dabcf014e07698025e445e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/89/0b893f32499abc49c428c060b118d6da/pa/VP95014_c53b69c9c0dabcf014e07698025e445e.jpg already downloaded
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F89%252F0b893f32499abc49c428c060b118d6da%252Fpa%252FVP95014_75671b59205c24e1eac64a4d733de1e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/89/0b893f32499abc49c428c060b118d6da/pa/VP95014_75671b59205c24e1eac64a4d733de1e1.jpg already downloaded
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F89%252F0b893f32499abc49c428c060b118d6da%252Fpa%252FVP95014_8bd25a1fa651305b3f416e5a4a9d4f07.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/89/0b893f32499abc49c428c060b118d6da/pa/VP95014_8bd25a1fa651305b3f416e5a4a9d4f07.jpg already downloaded
2026-03-30 08:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c7bbed30-fb00-58db-abdb-c1eb9554656f, identifier: VP95014
2026-03-30 08:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3a9aed41-40ac-5acd-aa79-5920f5194a2f with identifier: HL05710
2026-03-30 08:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3a9aed41-40ac-5acd-aa79-5920f5194a2f with identifier: HL05710
2026-03-30 08:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3a9aed41-40ac-5acd-aa79-5920f5194a2f with identifier: HL05710 to the API
2026-03-30 08:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:22:51Z',
'fuel_type': 'diesel',
'id': '3a9aed41-40ac-5acd-aa79-5920f5194a2f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL05710',
'listing': 'auction',
'make': 'Volvo',
'model': 'C30',
'odometer': 38534,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-03-08',
'seller_name': None,
'title': 'Volvo C30 1.6 DRIVe',
'transmission': 'manual',
'trim': '',
'year': 2012}
2026-03-30 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HL05710%27 HTTP/1.1" 200 None
2026-03-30 08:36:14 [auto1.be] INFO: Saving data for HL05710: {'auction_closing_time': 1774970571.0, 'created_time': 1773225861.989248, 'last_price_update_time': 1774859774.343298}
2026-03-30 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HL05710') HTTP/1.1" 204 0
2026-03-30 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Ff5%252Fa0f59f472f24daf2c6eeec4a0f7d6e0d%252Fpa%252FLW89201_28ef5d91b1ac97a968ae212f66a2cc3c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_28ef5d91b1ac97a968ae212f66a2cc3c.jpg not downloaded yet
2026-03-30 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F71%252F4871b017ef3d1ac588a1117fac31231f%252Fpa%252FWR16749_5a169cda44f4ed1546a4c1ac9ccec5f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/71/4871b017ef3d1ac588a1117fac31231f/pa/WR16749_5a169cda44f4ed1546a4c1ac9ccec5f9.jpg not downloaded yet
2026-03-30 08:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c7bbed30-fb00-58db-abdb-c1eb9554656f with identifier: VP95014
2026-03-30 08:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c7bbed30-fb00-58db-abdb-c1eb9554656f with identifier: VP95014
2026-03-30 08:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c7bbed30-fb00-58db-abdb-c1eb9554656f with identifier: VP95014 to the API
2026-03-30 08:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VP95014>
{'auction_title': '',
'c_o_2_emission_value': 150,
'category': None,
'color': 'brown',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 132,
'expiration_date': '2026-03-31T15:31:12Z',
'fuel_type': 'petrol',
'id': 'c7bbed30-fb00-58db-abdb-c1eb9554656f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP95014',
'listing': 'auction',
'location': 'BE, Pelt',
'make': 'Toyota',
'model': 'Avensis',
'odometer': 81625,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img0b/89/0b893f32499abc49c428c060b118d6da/pa/VP95014_e70f9b106816138e18bd065bdb2d873a.jpg',
'https://img-pa.auto1.com/img0b/89/0b893f32499abc49c428c060b118d6da/pa/VP95014_5f7e16f24882c70fdb7d4a442470abc1.jpg',
'https://img-pa.auto1.com/img0b/89/0b893f32499abc49c428c060b118d6da/pa/VP95014_d1c28a898ed7d2f0cd02840494116fd9.jpg',
'https://img-pa.auto1.com/img0b/89/0b893f32499abc49c428c060b118d6da/pa/VP95014_b9ac236276b266bf08952a1490e83554.jpg',
'https://img-pa.auto1.com/img0b/89/0b893f32499abc49c428c060b118d6da/pa/VP95014_d70378219e8d4e9fb74725a56882ae9e.jpg',
'https://img-pa.auto1.com/img0b/89/0b893f32499abc49c428c060b118d6da/pa/VP95014_177e216a9983679a0e437e12f2a4562d.jpg',
'https://img-pa.auto1.com/img0b/89/0b893f32499abc49c428c060b118d6da/pa/VP95014_8ccc7105a6283fd57b513c66854e215d.jpg',
'https://img-pa.auto1.com/img0b/89/0b893f32499abc49c428c060b118d6da/pa/VP95014_c53b69c9c0dabcf014e07698025e445e.jpg',
'https://img-pa.auto1.com/img0b/89/0b893f32499abc49c428c060b118d6da/pa/VP95014_75671b59205c24e1eac64a4d733de1e1.jpg',
'https://img-pa.auto1.com/img0b/89/0b893f32499abc49c428c060b118d6da/pa/VP95014_8bd25a1fa651305b3f416e5a4a9d4f07.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7bbed30-fb00-58db-abdb-c1eb9554656f/c7bbed30-fb00-58db-abdb-c1eb9554656f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82668,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/89/0b893f32499abc49c428c060b118d6da/pa/VP95014_e70f9b106816138e18bd065bdb2d873a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7bbed30-fb00-58db-abdb-c1eb9554656f/c7bbed30-fb00-58db-abdb-c1eb9554656f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81969,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/89/0b893f32499abc49c428c060b118d6da/pa/VP95014_5f7e16f24882c70fdb7d4a442470abc1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7bbed30-fb00-58db-abdb-c1eb9554656f/c7bbed30-fb00-58db-abdb-c1eb9554656f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86095,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/89/0b893f32499abc49c428c060b118d6da/pa/VP95014_d1c28a898ed7d2f0cd02840494116fd9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7bbed30-fb00-58db-abdb-c1eb9554656f/c7bbed30-fb00-58db-abdb-c1eb9554656f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81500,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/89/0b893f32499abc49c428c060b118d6da/pa/VP95014_b9ac236276b266bf08952a1490e83554.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7bbed30-fb00-58db-abdb-c1eb9554656f/c7bbed30-fb00-58db-abdb-c1eb9554656f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78510,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/89/0b893f32499abc49c428c060b118d6da/pa/VP95014_d70378219e8d4e9fb74725a56882ae9e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7bbed30-fb00-58db-abdb-c1eb9554656f/c7bbed30-fb00-58db-abdb-c1eb9554656f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87813,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/89/0b893f32499abc49c428c060b118d6da/pa/VP95014_177e216a9983679a0e437e12f2a4562d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7bbed30-fb00-58db-abdb-c1eb9554656f/c7bbed30-fb00-58db-abdb-c1eb9554656f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74847,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/89/0b893f32499abc49c428c060b118d6da/pa/VP95014_8ccc7105a6283fd57b513c66854e215d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7bbed30-fb00-58db-abdb-c1eb9554656f/c7bbed30-fb00-58db-abdb-c1eb9554656f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84061,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/89/0b893f32499abc49c428c060b118d6da/pa/VP95014_c53b69c9c0dabcf014e07698025e445e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7bbed30-fb00-58db-abdb-c1eb9554656f/c7bbed30-fb00-58db-abdb-c1eb9554656f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77333,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/89/0b893f32499abc49c428c060b118d6da/pa/VP95014_75671b59205c24e1eac64a4d733de1e1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7bbed30-fb00-58db-abdb-c1eb9554656f/c7bbed30-fb00-58db-abdb-c1eb9554656f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72492,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/89/0b893f32499abc49c428c060b118d6da/pa/VP95014_8bd25a1fa651305b3f416e5a4a9d4f07.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-04-09',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Avensis 1.6',
'transmission': 'manual',
'trim': '',
'year': 2014}
2026-03-30 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP95014%27 HTTP/1.1" 200 None
2026-03-30 08:36:14 [auto1.be] INFO: Saving data for VP95014: {'created_time': 1774859774.732213, 'last_price_update_time': 1774859774.732225, 'auction_closing_time': 1774971072.0}
2026-03-30 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VP95014') HTTP/1.1" 204 0
2026-03-30 08:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_a20d7bfe956154d65c160222b16e12a4.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:14 [auto1.be] INFO: Found listing with ID: NH80895
2026-03-30 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH80895%27 HTTP/1.1" 200 None
2026-03-30 08:36:14 [auto1.be] INFO: Scrape type for NH80895: 2
2026-03-30 08:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4858125d-d60e-5b4b-a95e-58218feb8a21 with identifier: NH80895
2026-03-30 08:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4858125d-d60e-5b4b-a95e-58218feb8a21 with scrape type 2
2026-03-30 08:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4858125d-d60e-5b4b-a95e-58218feb8a21 with scrape type 2
2026-03-30 08:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4858125d-d60e-5b4b-a95e-58218feb8a21, identifier: NH80895
2026-03-30 08:36:14 [auto1.be] INFO: Found listing with ID: DA58595
2026-03-30 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DA58595%27 HTTP/1.1" 200 None
2026-03-30 08:36:14 [auto1.be] INFO: Scrape type for DA58595: 1
2026-03-30 08:36:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25bf27d2-b603-506b-bd64-f9227800eed0 with identifier: TS76065
2026-03-30 08:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25bf27d2-b603-506b-bd64-f9227800eed0 with scrape type 1
2026-03-30 08:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 25bf27d2-b603-506b-bd64-f9227800eed0
2026-03-30 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fa9%252F39a9f66bf2fd468072f072bb7047cc69%252Fpa%252FTS76065_0e90b3d51506fdbf10b61038da2c8a34.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_0e90b3d51506fdbf10b61038da2c8a34.jpg not downloaded yet
2026-03-30 08:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febdaf74bd0>
2026-03-30 08:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1df94b2-a3e4-5692-8c84-1ee12df9085e/a1df94b2-a3e4-5692-8c84-1ee12df9085e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F54%252F665439437dbcb0e9a68fbd67bb9adc6e%252Fpa%252FUU73016_7a5e59520f45c80602d0f83489cec258.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_7a5e59520f45c80602d0f83489cec258.jpg saved to cache
2026-03-30 08:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a1df94b2-a3e4-5692-8c84-1ee12df9085e
2026-03-30 08:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4858125d-d60e-5b4b-a95e-58218feb8a21 with identifier: NH80895
2026-03-30 08:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4858125d-d60e-5b4b-a95e-58218feb8a21 with identifier: NH80895
2026-03-30 08:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4858125d-d60e-5b4b-a95e-58218feb8a21 with identifier: NH80895 to the API
2026-03-30 08:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 320,
'expiration_date': '2026-03-31T15:26:15Z',
'fuel_type': 'petrol',
'id': '4858125d-d60e-5b4b-a95e-58218feb8a21',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH80895',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 41873,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-08',
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TSI R 4Motion',
'transmission': 'automatic',
'trim': 'R 4Motion',
'year': 2023}
2026-03-30 08:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH80895%27 HTTP/1.1" 200 None
2026-03-30 08:36:15 [auto1.be] INFO: Saving data for NH80895: {'auction_closing_time': 1774970775.0, 'created_time': 1774384640.948828, 'last_price_update_time': 1774859775.401405}
2026-03-30 08:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NH80895') HTTP/1.1" 204 0
2026-03-30 08:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Ff5%252Fa0f59f472f24daf2c6eeec4a0f7d6e0d%252Fpa%252FLW89201_216f03f9c787f97c8bbdd6cc625c6fa2.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_216f03f9c787f97c8bbdd6cc625c6fa2.jpg not downloaded yet
2026-03-30 08:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F71%252F4871b017ef3d1ac588a1117fac31231f%252Fpa%252FWR16749_71ca99c5c5050f2dc2d2fd656ca4c42a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/71/4871b017ef3d1ac588a1117fac31231f/pa/WR16749_71ca99c5c5050f2dc2d2fd656ca4c42a.jpg not downloaded yet
2026-03-30 08:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/71/4871b017ef3d1ac588a1117fac31231f/pa/WR16749_68b3b1efc3023ccf0db122064e1756e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_d22ad76ce894725754a58f685c221c2d.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:15 [auto1.be] INFO: Found listing with ID: VW71513
2026-03-30 08:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW71513%27 HTTP/1.1" 200 None
2026-03-30 08:36:15 [auto1.be] INFO: Scrape type for VW71513: 2
2026-03-30 08:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2953698-693a-5e57-87e1-b5a5fb178847 with identifier: VW71513
2026-03-30 08:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2953698-693a-5e57-87e1-b5a5fb178847 with scrape type 2
2026-03-30 08:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2953698-693a-5e57-87e1-b5a5fb178847 with scrape type 2
2026-03-30 08:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e2953698-693a-5e57-87e1-b5a5fb178847, identifier: VW71513
2026-03-30 08:36:15 [auto1.be] INFO: Found listing with ID: PL94274
2026-03-30 08:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL94274%27 HTTP/1.1" 200 None
2026-03-30 08:36:15 [auto1.be] INFO: Scrape type for PL94274: 1
2026-03-30 08:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fa9%252F39a9f66bf2fd468072f072bb7047cc69%252Fpa%252FTS76065_a55c8a1403c87c07797d0040a0f72909.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_a55c8a1403c87c07797d0040a0f72909.jpg not downloaded yet
2026-03-30 08:36:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd84e0690>
2026-03-30 08:36:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1df94b2-a3e4-5692-8c84-1ee12df9085e/a1df94b2-a3e4-5692-8c84-1ee12df9085e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F54%252F665439437dbcb0e9a68fbd67bb9adc6e%252Fpa%252FUU73016_b9ce1c81a74e8210eb60eea7477a118d.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_b9ce1c81a74e8210eb60eea7477a118d.jpg saved to cache
2026-03-30 08:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a1df94b2-a3e4-5692-8c84-1ee12df9085e
2026-03-30 08:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0333184a-fd46-57f1-948a-ae0f68b22111 with identifier: EH30324
2026-03-30 08:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0333184a-fd46-57f1-948a-ae0f68b22111 with scrape type 1
2026-03-30 08:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0333184a-fd46-57f1-948a-ae0f68b22111
2026-03-30 08:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe0%252Fcde074db263b54306897b79f29d18ba8%252Fpa%252FEH30324_9e0c0d393198d6238338f21deb643c7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_9e0c0d393198d6238338f21deb643c7f.jpg not downloaded yet
2026-03-30 08:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e2953698-693a-5e57-87e1-b5a5fb178847 with identifier: VW71513
2026-03-30 08:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e2953698-693a-5e57-87e1-b5a5fb178847 with identifier: VW71513
2026-03-30 08:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e2953698-693a-5e57-87e1-b5a5fb178847 with identifier: VW71513 to the API
2026-03-30 08:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 252,
'expiration_date': '2026-03-31T15:37:21Z',
'fuel_type': 'petrol',
'id': 'e2953698-693a-5e57-87e1-b5a5fb178847',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW71513',
'listing': 'auction',
'make': 'Audi',
'model': 'A7 Sportback',
'odometer': 145941,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-04',
'seller_name': None,
'title': 'Audi A7 Sportback 2.0 TFSI',
'transmission': 'automatic',
'trim': '',
'year': 2018}
2026-03-30 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW71513%27 HTTP/1.1" 200 None
2026-03-30 08:36:16 [auto1.be] INFO: Saving data for VW71513: {'auction_closing_time': 1774971441.0, 'created_time': 1773693872.113411, 'last_price_update_time': 1774859776.122201}
2026-03-30 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VW71513') HTTP/1.1" 204 0
2026-03-30 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Ff5%252Fa0f59f472f24daf2c6eeec4a0f7d6e0d%252Fpa%252FLW89201_710aae4a639b52e1c30cc38f4ac06d38.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_710aae4a639b52e1c30cc38f4ac06d38.jpg not downloaded yet
2026-03-30 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F71%252F4871b017ef3d1ac588a1117fac31231f%252Fpa%252FWR16749_cf5d9fb561a803f0a5926a347e593b36.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/71/4871b017ef3d1ac588a1117fac31231f/pa/WR16749_cf5d9fb561a803f0a5926a347e593b36.jpg not downloaded yet
2026-03-30 08:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GL14353> (referer: https://www.auto1.com/v1/car-details-view/GL14353/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd91785d0>
2026-03-30 08:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1df94b2-a3e4-5692-8c84-1ee12df9085e/a1df94b2-a3e4-5692-8c84-1ee12df9085e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F54%252F665439437dbcb0e9a68fbd67bb9adc6e%252Fpa%252FUU73016_a20d7bfe956154d65c160222b16e12a4.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_a20d7bfe956154d65c160222b16e12a4.jpg saved to cache
2026-03-30 08:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a1df94b2-a3e4-5692-8c84-1ee12df9085e
2026-03-30 08:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_984621bca34b631cec9112e3087cd743.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:16 [auto1.be] INFO: Found listing with ID: SD69002
2026-03-30 08:36:16 [auto1.be] INFO: Found listing with ID: GX79489
2026-03-30 08:36:16 [auto1.be] INFO: Found listing with ID: WW33850
2026-03-30 08:36:16 [auto1.be] INFO: Found listing with ID: YN20871
2026-03-30 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN20871%27 HTTP/1.1" 200 None
2026-03-30 08:36:16 [auto1.be] INFO: Scrape type for YN20871: 2
2026-03-30 08:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cef3fc2-f5f6-5e9f-80dc-c10c2faab1ca with identifier: YN20871
2026-03-30 08:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cef3fc2-f5f6-5e9f-80dc-c10c2faab1ca with scrape type 2
2026-03-30 08:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cef3fc2-f5f6-5e9f-80dc-c10c2faab1ca with scrape type 2
2026-03-30 08:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4cef3fc2-f5f6-5e9f-80dc-c10c2faab1ca, identifier: YN20871
2026-03-30 08:36:16 [auto1.be] INFO: Found listing with ID: ZX58483
2026-03-30 08:36:16 [auto1.be] INFO: Found listing with ID: MX38879
2026-03-30 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX38879%27 HTTP/1.1" 200 None
2026-03-30 08:36:16 [auto1.be] INFO: Scrape type for MX38879: 1
2026-03-30 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fa9%252F39a9f66bf2fd468072f072bb7047cc69%252Fpa%252FTS76065_d91a7ae3ab836fa7ba0b57b31bbd61b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_d91a7ae3ab836fa7ba0b57b31bbd61b8.jpg not downloaded yet
2026-03-30 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe0%252Fcde074db263b54306897b79f29d18ba8%252Fpa%252FEH30324_4fdeeb1b575e82b21be48a5291d50593.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_4fdeeb1b575e82b21be48a5291d50593.jpg not downloaded yet
2026-03-30 08:36:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/71/4871b017ef3d1ac588a1117fac31231f/pa/WR16749_a5c32ce1797b6ef73daf9579dda06c7f.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4cef3fc2-f5f6-5e9f-80dc-c10c2faab1ca with identifier: YN20871
2026-03-30 08:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4cef3fc2-f5f6-5e9f-80dc-c10c2faab1ca with identifier: YN20871
2026-03-30 08:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4cef3fc2-f5f6-5e9f-80dc-c10c2faab1ca with identifier: YN20871 to the API
2026-03-30 08:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:12:23Z',
'fuel_type': 'diesel',
'id': '4cef3fc2-f5f6-5e9f-80dc-c10c2faab1ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN20871',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 98429,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-15',
'seller_name': None,
'title': 'BMW 2er 216d Gran Tourer Advantage',
'transmission': 'manual',
'trim': 'Advantage',
'year': 2019}
2026-03-30 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN20871%27 HTTP/1.1" 200 None
2026-03-30 08:36:16 [auto1.be] INFO: Saving data for YN20871: {'auction_closing_time': 1774969943.0, 'created_time': 1773238354.96279, 'last_price_update_time': 1774859776.976738}
2026-03-30 08:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YN20871') HTTP/1.1" 204 0
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Ff5%252Fa0f59f472f24daf2c6eeec4a0f7d6e0d%252Fpa%252FLW89201_482bbfd08149878604ff1c1a655d2894.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_482bbfd08149878604ff1c1a655d2894.jpg not downloaded yet
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F71%252F4871b017ef3d1ac588a1117fac31231f%252Fpa%252FWR16749_eebab2358408f2223a0c2c001d027c9c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/71/4871b017ef3d1ac588a1117fac31231f/pa/WR16749_eebab2358408f2223a0c2c001d027c9c.jpg not downloaded yet
2026-03-30 08:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd838e450>
2026-03-30 08:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ff26a08-fa0d-58f0-9fdb-878cb60d7f63/2ff26a08-fa0d-58f0-9fdb-878cb60d7f63_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F71%252F4871b017ef3d1ac588a1117fac31231f%252Fpa%252FWR16749_68b3b1efc3023ccf0db122064e1756e6.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/71/4871b017ef3d1ac588a1117fac31231f/pa/WR16749_68b3b1efc3023ccf0db122064e1756e6.jpg saved to cache
2026-03-30 08:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2ff26a08-fa0d-58f0-9fdb-878cb60d7f63
2026-03-30 08:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd84a0bd0>
2026-03-30 08:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1df94b2-a3e4-5692-8c84-1ee12df9085e/a1df94b2-a3e4-5692-8c84-1ee12df9085e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F54%252F665439437dbcb0e9a68fbd67bb9adc6e%252Fpa%252FUU73016_d22ad76ce894725754a58f685c221c2d.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_d22ad76ce894725754a58f685c221c2d.jpg saved to cache
2026-03-30 08:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a1df94b2-a3e4-5692-8c84-1ee12df9085e
2026-03-30 08:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/71/4871b017ef3d1ac588a1117fac31231f/pa/WR16749_5a169cda44f4ed1546a4c1ac9ccec5f9.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_28ef5d91b1ac97a968ae212f66a2cc3c.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:17 [auto1.be] INFO: Found listing with ID: AU97754
2026-03-30 08:36:17 [auto1.be] INFO: Found listing with ID: AH26966
2026-03-30 08:36:17 [auto1.be] INFO: Found listing with ID: YU57960
2026-03-30 08:36:17 [auto1.be] INFO: Found listing with ID: PK81975
2026-03-30 08:36:17 [auto1.be] INFO: Found listing with ID: JJ16156
2026-03-30 08:36:17 [auto1.be] INFO: Found listing with ID: BM50316
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BM50316%27 HTTP/1.1" 200 None
2026-03-30 08:36:17 [auto1.be] INFO: Scrape type for BM50316: 1
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fa9%252F39a9f66bf2fd468072f072bb7047cc69%252Fpa%252FTS76065_919fc805679ebc8a973a09dbee08a406.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_919fc805679ebc8a973a09dbee08a406.jpg not downloaded yet
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe0%252Fcde074db263b54306897b79f29d18ba8%252Fpa%252FEH30324_dc63b3a2799e39a8949eec3e407df314.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_dc63b3a2799e39a8949eec3e407df314.jpg not downloaded yet
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Ff5%252Fa0f59f472f24daf2c6eeec4a0f7d6e0d%252Fpa%252FLW89201_ac4fe7fa6c2b839dc282c824edf6c66c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_ac4fe7fa6c2b839dc282c824edf6c66c.jpg not downloaded yet
2026-03-30 08:36:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35898f5c-7d84-56b5-bfaf-71a10ee533e7 with identifier: GL14353
2026-03-30 08:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35898f5c-7d84-56b5-bfaf-71a10ee533e7 with scrape type 1
2026-03-30 08:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 35898f5c-7d84-56b5-bfaf-71a10ee533e7
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Ffc%252F87fc890996351fd4cdf760e2385c48c7%252Fpa%252FGL14353_e4f82cd0809052cbd5bb9b2b19641165.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_e4f82cd0809052cbd5bb9b2b19641165.jpg not downloaded yet
2026-03-30 08:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febdae9ff50>
2026-03-30 08:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31516f29-62a3-5041-a755-30e1c1e5cc7a/31516f29-62a3-5041-a755-30e1c1e5cc7a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Ff5%252Fa0f59f472f24daf2c6eeec4a0f7d6e0d%252Fpa%252FLW89201_984621bca34b631cec9112e3087cd743.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_984621bca34b631cec9112e3087cd743.jpg saved to cache
2026-03-30 08:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 31516f29-62a3-5041-a755-30e1c1e5cc7a
2026-03-30 08:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_216f03f9c787f97c8bbdd6cc625c6fa2.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/71/4871b017ef3d1ac588a1117fac31231f/pa/WR16749_71ca99c5c5050f2dc2d2fd656ca4c42a.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:17 [auto1.be] INFO: Found listing with ID: GF12513
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF12513%27 HTTP/1.1" 200 None
2026-03-30 08:36:17 [auto1.be] INFO: Scrape type for GF12513: 2
2026-03-30 08:36:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 794aec5f-40b9-5c31-99d8-ac09c409074c with identifier: GF12513
2026-03-30 08:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 794aec5f-40b9-5c31-99d8-ac09c409074c with scrape type 2
2026-03-30 08:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 794aec5f-40b9-5c31-99d8-ac09c409074c with scrape type 2
2026-03-30 08:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 794aec5f-40b9-5c31-99d8-ac09c409074c, identifier: GF12513
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fa9%252F39a9f66bf2fd468072f072bb7047cc69%252Fpa%252FTS76065_d558032619e2e1047443a8d2dbc2f1e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_d558032619e2e1047443a8d2dbc2f1e5.jpg not downloaded yet
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe0%252Fcde074db263b54306897b79f29d18ba8%252Fpa%252FEH30324_7799d0ed27ebdf12816345a22e9b8e70.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_7799d0ed27ebdf12816345a22e9b8e70.jpg not downloaded yet
2026-03-30 08:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd858f610>
2026-03-30 08:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ff26a08-fa0d-58f0-9fdb-878cb60d7f63/2ff26a08-fa0d-58f0-9fdb-878cb60d7f63_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F71%252F4871b017ef3d1ac588a1117fac31231f%252Fpa%252FWR16749_a5c32ce1797b6ef73daf9579dda06c7f.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/71/4871b017ef3d1ac588a1117fac31231f/pa/WR16749_a5c32ce1797b6ef73daf9579dda06c7f.jpg saved to cache
2026-03-30 08:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2ff26a08-fa0d-58f0-9fdb-878cb60d7f63
2026-03-30 08:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 794aec5f-40b9-5c31-99d8-ac09c409074c with identifier: GF12513
2026-03-30 08:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 794aec5f-40b9-5c31-99d8-ac09c409074c with identifier: GF12513
2026-03-30 08:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 794aec5f-40b9-5c31-99d8-ac09c409074c with identifier: GF12513 to the API
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:06:06Z',
'fuel_type': 'diesel',
'id': '794aec5f-40b9-5c31-99d8-ac09c409074c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF12513',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 121504,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-02-25',
'seller_name': None,
'title': 'Ford Mondeo 1.6 TDCi Ambiente',
'transmission': 'manual',
'trim': 'Ambiente',
'year': 2014}
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF12513%27 HTTP/1.1" 200 None
2026-03-30 08:36:18 [auto1.be] INFO: Saving data for GF12513: {'auction_closing_time': 1774969566.0, 'created_time': 1773136895.605222, 'last_price_update_time': 1774859778.085928}
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GF12513') HTTP/1.1" 204 0
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Ff5%252Fa0f59f472f24daf2c6eeec4a0f7d6e0d%252Fpa%252FLW89201_01772f8f2e8f774d21d7b865cc0b875a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_01772f8f2e8f774d21d7b865cc0b875a.jpg not downloaded yet
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Ffc%252F87fc890996351fd4cdf760e2385c48c7%252Fpa%252FGL14353_654775b5c1ccb34b72f0072bdceeaeaf.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_654775b5c1ccb34b72f0072bdceeaeaf.jpg not downloaded yet
2026-03-30 08:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/71/4871b017ef3d1ac588a1117fac31231f/pa/WR16749_cf5d9fb561a803f0a5926a347e593b36.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:18 [auto1.be] INFO: Found listing with ID: JA60978
2026-03-30 08:36:18 [auto1.be] INFO: Found listing with ID: RD04523
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD04523%27 HTTP/1.1" 200 None
2026-03-30 08:36:18 [auto1.be] INFO: Scrape type for RD04523: 1
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fa9%252F39a9f66bf2fd468072f072bb7047cc69%252Fpa%252FTS76065_ea0488ea57dcecfe611d72f840a6a060.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_ea0488ea57dcecfe611d72f840a6a060.jpg not downloaded yet
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe0%252Fcde074db263b54306897b79f29d18ba8%252Fpa%252FEH30324_e08b50f1f016fb2e4efc62766230b1db.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_e08b50f1f016fb2e4efc62766230b1db.jpg not downloaded yet
2026-03-30 08:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd86043d0>
2026-03-30 08:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ff26a08-fa0d-58f0-9fdb-878cb60d7f63/2ff26a08-fa0d-58f0-9fdb-878cb60d7f63_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F71%252F4871b017ef3d1ac588a1117fac31231f%252Fpa%252FWR16749_5a169cda44f4ed1546a4c1ac9ccec5f9.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/71/4871b017ef3d1ac588a1117fac31231f/pa/WR16749_5a169cda44f4ed1546a4c1ac9ccec5f9.jpg saved to cache
2026-03-30 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2ff26a08-fa0d-58f0-9fdb-878cb60d7f63
2026-03-30 08:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd85aded0>
2026-03-30 08:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31516f29-62a3-5041-a755-30e1c1e5cc7a/31516f29-62a3-5041-a755-30e1c1e5cc7a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Ff5%252Fa0f59f472f24daf2c6eeec4a0f7d6e0d%252Fpa%252FLW89201_28ef5d91b1ac97a968ae212f66a2cc3c.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_28ef5d91b1ac97a968ae212f66a2cc3c.jpg saved to cache
2026-03-30 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 31516f29-62a3-5041-a755-30e1c1e5cc7a
2026-03-30 08:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_a55c8a1403c87c07797d0040a0f72909.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Ff5%252Fa0f59f472f24daf2c6eeec4a0f7d6e0d%252Fpa%252FLW89201_ee01faf6a5c4b78fd5b13b403d4b0ccc.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_ee01faf6a5c4b78fd5b13b403d4b0ccc.jpg not downloaded yet
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Ffc%252F87fc890996351fd4cdf760e2385c48c7%252Fpa%252FGL14353_78d8adbf4b6cb781e41b3ae443224cc4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_78d8adbf4b6cb781e41b3ae443224cc4.jpg not downloaded yet
2026-03-30 08:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8ebef90>
2026-03-30 08:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31516f29-62a3-5041-a755-30e1c1e5cc7a/31516f29-62a3-5041-a755-30e1c1e5cc7a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Ff5%252Fa0f59f472f24daf2c6eeec4a0f7d6e0d%252Fpa%252FLW89201_216f03f9c787f97c8bbdd6cc625c6fa2.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_216f03f9c787f97c8bbdd6cc625c6fa2.jpg saved to cache
2026-03-30 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 31516f29-62a3-5041-a755-30e1c1e5cc7a
2026-03-30 08:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd852d250>
2026-03-30 08:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ff26a08-fa0d-58f0-9fdb-878cb60d7f63/2ff26a08-fa0d-58f0-9fdb-878cb60d7f63_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F71%252F4871b017ef3d1ac588a1117fac31231f%252Fpa%252FWR16749_71ca99c5c5050f2dc2d2fd656ca4c42a.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/71/4871b017ef3d1ac588a1117fac31231f/pa/WR16749_71ca99c5c5050f2dc2d2fd656ca4c42a.jpg saved to cache
2026-03-30 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2ff26a08-fa0d-58f0-9fdb-878cb60d7f63
2026-03-30 08:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_d91a7ae3ab836fa7ba0b57b31bbd61b8.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:18 [auto1.be] INFO: Found listing with ID: SG92006
2026-03-30 08:36:18 [auto1.be] INFO: Found listing with ID: PH13121
2026-03-30 08:36:18 [auto1.be] INFO: Found listing with ID: EF47293
2026-03-30 08:36:18 [auto1.be] INFO: Found listing with ID: GG54325
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG54325%27 HTTP/1.1" 200 None
2026-03-30 08:36:18 [auto1.be] INFO: Scrape type for GG54325: 1
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fa9%252F39a9f66bf2fd468072f072bb7047cc69%252Fpa%252FTS76065_a9644a9cff9d4fa9e40f3c4e622d7851.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_a9644a9cff9d4fa9e40f3c4e622d7851.jpg not downloaded yet
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe0%252Fcde074db263b54306897b79f29d18ba8%252Fpa%252FEH30324_939a1efe50dac6374eb53e5690c2dc50.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_939a1efe50dac6374eb53e5690c2dc50.jpg not downloaded yet
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Ff5%252Fa0f59f472f24daf2c6eeec4a0f7d6e0d%252Fpa%252FLW89201_ec1069156fc8c3648b4ac044d2cda7b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_ec1069156fc8c3648b4ac044d2cda7b8.jpg not downloaded yet
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Ffc%252F87fc890996351fd4cdf760e2385c48c7%252Fpa%252FGL14353_d9cd27f829150e0d88edc034e9a84d5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_d9cd27f829150e0d88edc034e9a84d5a.jpg not downloaded yet
2026-03-30 08:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PH52818/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd83cccd0>
2026-03-30 08:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ff26a08-fa0d-58f0-9fdb-878cb60d7f63/2ff26a08-fa0d-58f0-9fdb-878cb60d7f63_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F71%252F4871b017ef3d1ac588a1117fac31231f%252Fpa%252FWR16749_cf5d9fb561a803f0a5926a347e593b36.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/71/4871b017ef3d1ac588a1117fac31231f/pa/WR16749_cf5d9fb561a803f0a5926a347e593b36.jpg saved to cache
2026-03-30 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2ff26a08-fa0d-58f0-9fdb-878cb60d7f63
2026-03-30 08:36:18 [auto1.be] INFO: Found listing with ID: BH83667
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BH83667%27 HTTP/1.1" 200 None
2026-03-30 08:36:18 [auto1.be] INFO: Scrape type for BH83667: 1
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fa9%252F39a9f66bf2fd468072f072bb7047cc69%252Fpa%252FTS76065_e103a8c54f665b068b783b60d566a7b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_e103a8c54f665b068b783b60d566a7b2.jpg not downloaded yet
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe0%252Fcde074db263b54306897b79f29d18ba8%252Fpa%252FEH30324_431f6764bdc31c9acfea22e76dbf179a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_431f6764bdc31c9acfea22e76dbf179a.jpg not downloaded yet
2026-03-30 08:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DA58595/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_dc63b3a2799e39a8949eec3e407df314.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Ffc%252F87fc890996351fd4cdf760e2385c48c7%252Fpa%252FGL14353_bd9070993aaf51c75f76ea9b45c6d2a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_bd9070993aaf51c75f76ea9b45c6d2a1.jpg not downloaded yet
2026-03-30 08:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NH22682> (referer: https://www.auto1.com/v1/car-details-view/NH22682/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YX69957/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_919fc805679ebc8a973a09dbee08a406.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:18 [auto1.be] INFO: Found listing with ID: DA89043
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DA89043%27 HTTP/1.1" 200 None
2026-03-30 08:36:18 [auto1.be] INFO: Scrape type for DA89043: 1
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fa9%252F39a9f66bf2fd468072f072bb7047cc69%252Fpa%252FTS76065_969cebb838df2f8f74fa9185d5aa8a0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_969cebb838df2f8f74fa9185d5aa8a0c.jpg not downloaded yet
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe0%252Fcde074db263b54306897b79f29d18ba8%252Fpa%252FEH30324_34aab85af1f87746d91aed7d7a5f21f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_34aab85af1f87746d91aed7d7a5f21f3.jpg not downloaded yet
2026-03-30 08:36:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd83be8d0>
2026-03-30 08:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25bf27d2-b603-506b-bd64-f9227800eed0/25bf27d2-b603-506b-bd64-f9227800eed0_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fa9%252F39a9f66bf2fd468072f072bb7047cc69%252Fpa%252FTS76065_a55c8a1403c87c07797d0040a0f72909.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_a55c8a1403c87c07797d0040a0f72909.jpg saved to cache
2026-03-30 08:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 25bf27d2-b603-506b-bd64-f9227800eed0
2026-03-30 08:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd852dd50>
2026-03-30 08:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25bf27d2-b603-506b-bd64-f9227800eed0/25bf27d2-b603-506b-bd64-f9227800eed0_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fa9%252F39a9f66bf2fd468072f072bb7047cc69%252Fpa%252FTS76065_d91a7ae3ab836fa7ba0b57b31bbd61b8.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_d91a7ae3ab836fa7ba0b57b31bbd61b8.jpg saved to cache
2026-03-30 08:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 25bf27d2-b603-506b-bd64-f9227800eed0
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Ffc%252F87fc890996351fd4cdf760e2385c48c7%252Fpa%252FGL14353_9698c4eb64b846c8d9ddb3d681962198.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_9698c4eb64b846c8d9ddb3d681962198.jpg not downloaded yet
2026-03-30 08:36:19 [auto1.be] INFO: Found listing with ID: AE99564
2026-03-30 08:36:19 [auto1.be] INFO: Found listing with ID: BC23498
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC23498%27 HTTP/1.1" 200 None
2026-03-30 08:36:19 [auto1.be] INFO: Scrape type for BC23498: 1
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fa9%252F39a9f66bf2fd468072f072bb7047cc69%252Fpa%252FTS76065_0a5e2a0c766fe42ae7f52cd21ded1589.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_0a5e2a0c766fe42ae7f52cd21ded1589.jpg not downloaded yet
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe0%252Fcde074db263b54306897b79f29d18ba8%252Fpa%252FEH30324_11e2bad6e5da924c2b4ed30b1341dea4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_11e2bad6e5da924c2b4ed30b1341dea4.jpg not downloaded yet
2026-03-30 08:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_7799d0ed27ebdf12816345a22e9b8e70.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Ffc%252F87fc890996351fd4cdf760e2385c48c7%252Fpa%252FGL14353_539de9d7234e010f59ef2b44f2ab29a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_539de9d7234e010f59ef2b44f2ab29a2.jpg not downloaded yet
2026-03-30 08:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8588f50>
2026-03-30 08:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0333184a-fd46-57f1-948a-ae0f68b22111/0333184a-fd46-57f1-948a-ae0f68b22111_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe0%252Fcde074db263b54306897b79f29d18ba8%252Fpa%252FEH30324_dc63b3a2799e39a8949eec3e407df314.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_dc63b3a2799e39a8949eec3e407df314.jpg saved to cache
2026-03-30 08:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0333184a-fd46-57f1-948a-ae0f68b22111
2026-03-30 08:36:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b942f899-81c1-5457-b3e1-6439fd0d0a96 with identifier: NH22682
2026-03-30 08:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b942f899-81c1-5457-b3e1-6439fd0d0a96 with scrape type 1
2026-03-30 08:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b942f899-81c1-5457-b3e1-6439fd0d0a96
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F55%252Ffb55c49c1599ce2a090c3481f4e215b0%252Fpa%252FNH22682_f5e2e4c55578223f5948221845af23fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_f5e2e4c55578223f5948221845af23fe.jpg not downloaded yet
2026-03-30 08:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8407cd0>
2026-03-30 08:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25bf27d2-b603-506b-bd64-f9227800eed0/25bf27d2-b603-506b-bd64-f9227800eed0_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fa9%252F39a9f66bf2fd468072f072bb7047cc69%252Fpa%252FTS76065_919fc805679ebc8a973a09dbee08a406.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_919fc805679ebc8a973a09dbee08a406.jpg saved to cache
2026-03-30 08:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 25bf27d2-b603-506b-bd64-f9227800eed0
2026-03-30 08:36:19 [auto1.be] INFO: Found listing with ID: VP07407
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP07407%27 HTTP/1.1" 200 None
2026-03-30 08:36:19 [auto1.be] INFO: Scrape type for VP07407: 1
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe0%252Fcde074db263b54306897b79f29d18ba8%252Fpa%252FEH30324_d4744c3e61706dd9eda28571b9b41a40.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_d4744c3e61706dd9eda28571b9b41a40.jpg not downloaded yet
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Ffc%252F87fc890996351fd4cdf760e2385c48c7%252Fpa%252FGL14353_a7e2b5473d6e51a23320031fb2f4c96f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_a7e2b5473d6e51a23320031fb2f4c96f.jpg not downloaded yet
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F55%252Ffb55c49c1599ce2a090c3481f4e215b0%252Fpa%252FNH22682_251ce0e52f82a0290c8f4029371aaa1e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_251ce0e52f82a0290c8f4029371aaa1e.jpg not downloaded yet
2026-03-30 08:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_654775b5c1ccb34b72f0072bdceeaeaf.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_78d8adbf4b6cb781e41b3ae443224cc4.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:19 [auto1.be] INFO: Found listing with ID: TS12124
2026-03-30 08:36:19 [auto1.be] INFO: Found listing with ID: JY99068
2026-03-30 08:36:19 [auto1.be] INFO: Found listing with ID: JC64183
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC64183%27 HTTP/1.1" 200 None
2026-03-30 08:36:19 [auto1.be] INFO: Scrape type for JC64183: 1
2026-03-30 08:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PL94274/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Ffc%252F87fc890996351fd4cdf760e2385c48c7%252Fpa%252FGL14353_3831cacfce6a0be6d0b0ed989c1f484d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_3831cacfce6a0be6d0b0ed989c1f484d.jpg not downloaded yet
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F55%252Ffb55c49c1599ce2a090c3481f4e215b0%252Fpa%252FNH22682_9fd7398bf74e0e24e962fc29ae0453e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_9fd7398bf74e0e24e962fc29ae0453e7.jpg not downloaded yet
2026-03-30 08:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd83f8810>
2026-03-30 08:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0333184a-fd46-57f1-948a-ae0f68b22111/0333184a-fd46-57f1-948a-ae0f68b22111_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe0%252Fcde074db263b54306897b79f29d18ba8%252Fpa%252FEH30324_7799d0ed27ebdf12816345a22e9b8e70.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_7799d0ed27ebdf12816345a22e9b8e70.jpg saved to cache
2026-03-30 08:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0333184a-fd46-57f1-948a-ae0f68b22111
2026-03-30 08:36:19 [auto1.be] INFO: Found listing with ID: LJ62513
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LJ62513%27 HTTP/1.1" 200 None
2026-03-30 08:36:19 [auto1.be] INFO: Scrape type for LJ62513: 2
2026-03-30 08:36:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 349b8d4d-e3d9-5ebb-ae51-d4379048a244 with identifier: LJ62513
2026-03-30 08:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 349b8d4d-e3d9-5ebb-ae51-d4379048a244 with scrape type 2
2026-03-30 08:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 349b8d4d-e3d9-5ebb-ae51-d4379048a244 with scrape type 2
2026-03-30 08:36:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 349b8d4d-e3d9-5ebb-ae51-d4379048a244, identifier: LJ62513
2026-03-30 08:36:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 349b8d4d-e3d9-5ebb-ae51-d4379048a244 with identifier: LJ62513
2026-03-30 08:36:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 349b8d4d-e3d9-5ebb-ae51-d4379048a244 with identifier: LJ62513
2026-03-30 08:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 349b8d4d-e3d9-5ebb-ae51-d4379048a244 with identifier: LJ62513 to the API
2026-03-30 08:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 306,
'expiration_date': '2026-03-31T15:56:58Z',
'fuel_type': 'petrol',
'id': '349b8d4d-e3d9-5ebb-ae51-d4379048a244',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ62513',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 52061,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-17',
'seller_name': None,
'title': 'BMW 1er M135i xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2022}
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LJ62513%27 HTTP/1.1" 200 None
2026-03-30 08:36:20 [auto1.be] INFO: Saving data for LJ62513: {'auction_closing_time': 1774972618.0, 'created_time': 1774298190.150234, 'last_price_update_time': 1774859780.15213}
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LJ62513') HTTP/1.1" 204 0
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Ffc%252F87fc890996351fd4cdf760e2385c48c7%252Fpa%252FGL14353_e04902a4f0c4755e535c56aa851a1a8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_e04902a4f0c4755e535c56aa851a1a8e.jpg not downloaded yet
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F55%252Ffb55c49c1599ce2a090c3481f4e215b0%252Fpa%252FNH22682_953bef209b8e1d15dcbfaf4021ca82a4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_953bef209b8e1d15dcbfaf4021ca82a4.jpg not downloaded yet
2026-03-30 08:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_939a1efe50dac6374eb53e5690c2dc50.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_431f6764bdc31c9acfea22e76dbf179a.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_e103a8c54f665b068b783b60d566a7b2.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:20 [auto1.be] INFO: Found listing with ID: XE18058
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE18058%27 HTTP/1.1" 200 None
2026-03-30 08:36:20 [auto1.be] INFO: Scrape type for XE18058: 2
2026-03-30 08:36:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6aded8fe-0ab2-580b-8a7a-b78fe47f830f with identifier: XE18058
2026-03-30 08:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6aded8fe-0ab2-580b-8a7a-b78fe47f830f with scrape type 2
2026-03-30 08:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6aded8fe-0ab2-580b-8a7a-b78fe47f830f with scrape type 2
2026-03-30 08:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6aded8fe-0ab2-580b-8a7a-b78fe47f830f, identifier: XE18058
2026-03-30 08:36:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd83fa550>
2026-03-30 08:36:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35898f5c-7d84-56b5-bfaf-71a10ee533e7/35898f5c-7d84-56b5-bfaf-71a10ee533e7_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Ffc%252F87fc890996351fd4cdf760e2385c48c7%252Fpa%252FGL14353_654775b5c1ccb34b72f0072bdceeaeaf.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_654775b5c1ccb34b72f0072bdceeaeaf.jpg saved to cache
2026-03-30 08:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 35898f5c-7d84-56b5-bfaf-71a10ee533e7
2026-03-30 08:36:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8eda110>
2026-03-30 08:36:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35898f5c-7d84-56b5-bfaf-71a10ee533e7/35898f5c-7d84-56b5-bfaf-71a10ee533e7_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Ffc%252F87fc890996351fd4cdf760e2385c48c7%252Fpa%252FGL14353_78d8adbf4b6cb781e41b3ae443224cc4.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_78d8adbf4b6cb781e41b3ae443224cc4.jpg saved to cache
2026-03-30 08:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 35898f5c-7d84-56b5-bfaf-71a10ee533e7
2026-03-30 08:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6aded8fe-0ab2-580b-8a7a-b78fe47f830f with identifier: XE18058
2026-03-30 08:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6aded8fe-0ab2-580b-8a7a-b78fe47f830f with identifier: XE18058
2026-03-30 08:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6aded8fe-0ab2-580b-8a7a-b78fe47f830f with identifier: XE18058 to the API
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 185,
'expiration_date': '2026-03-31T15:35:35Z',
'fuel_type': 'diesel',
'id': '6aded8fe-0ab2-580b-8a7a-b78fe47f830f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE18058',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 402075,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-29',
'seller_name': None,
'title': 'BMW X3 xDrive 20d',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE18058%27 HTTP/1.1" 200 None
2026-03-30 08:36:20 [auto1.be] INFO: Saving data for XE18058: {'auction_closing_time': 1774971335.0, 'created_time': 1773136158.490518, 'last_price_update_time': 1774859780.865599}
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XE18058') HTTP/1.1" 204 0
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F55%252Ffb55c49c1599ce2a090c3481f4e215b0%252Fpa%252FNH22682_1cfe4d950b3958b88f04b016b14c4de8.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_1cfe4d950b3958b88f04b016b14c4de8.jpg not downloaded yet
2026-03-30 08:36:20 [auto1.be] INFO: Found listing with ID: UY40990
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY40990%27 HTTP/1.1" 200 None
2026-03-30 08:36:20 [auto1.be] INFO: Scrape type for UY40990: 1
2026-03-30 08:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_d9cd27f829150e0d88edc034e9a84d5a.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F55%252Ffb55c49c1599ce2a090c3481f4e215b0%252Fpa%252FNH22682_8c2cc2af4c81560a9383c34acb283ab5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_8c2cc2af4c81560a9383c34acb283ab5.jpg not downloaded yet
2026-03-30 08:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_9698c4eb64b846c8d9ddb3d681962198.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_ec1069156fc8c3648b4ac044d2cda7b8.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:20 [auto1.be] INFO: Found listing with ID: CM92821
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM92821%27 HTTP/1.1" 200 None
2026-03-30 08:36:20 [auto1.be] INFO: Scrape type for CM92821: 1
2026-03-30 08:36:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8eacd10>
2026-03-30 08:36:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0333184a-fd46-57f1-948a-ae0f68b22111/0333184a-fd46-57f1-948a-ae0f68b22111_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe0%252Fcde074db263b54306897b79f29d18ba8%252Fpa%252FEH30324_939a1efe50dac6374eb53e5690c2dc50.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_939a1efe50dac6374eb53e5690c2dc50.jpg saved to cache
2026-03-30 08:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0333184a-fd46-57f1-948a-ae0f68b22111
2026-03-30 08:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd91157d0>
2026-03-30 08:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0333184a-fd46-57f1-948a-ae0f68b22111/0333184a-fd46-57f1-948a-ae0f68b22111_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe0%252Fcde074db263b54306897b79f29d18ba8%252Fpa%252FEH30324_431f6764bdc31c9acfea22e76dbf179a.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_431f6764bdc31c9acfea22e76dbf179a.jpg saved to cache
2026-03-30 08:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0333184a-fd46-57f1-948a-ae0f68b22111
2026-03-30 08:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd90f6a10>
2026-03-30 08:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25bf27d2-b603-506b-bd64-f9227800eed0/25bf27d2-b603-506b-bd64-f9227800eed0_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fa9%252F39a9f66bf2fd468072f072bb7047cc69%252Fpa%252FTS76065_e103a8c54f665b068b783b60d566a7b2.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_e103a8c54f665b068b783b60d566a7b2.jpg saved to cache
2026-03-30 08:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 25bf27d2-b603-506b-bd64-f9227800eed0
2026-03-30 08:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_d9072c5a261491866d0f482469fbe5a2.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F55%252Ffb55c49c1599ce2a090c3481f4e215b0%252Fpa%252FNH22682_45521c29582e9f246f489c99ac101662.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_45521c29582e9f246f489c99ac101662.jpg not downloaded yet
2026-03-30 08:36:21 [auto1.be] INFO: Found listing with ID: HM28534
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM28534%27 HTTP/1.1" 200 None
2026-03-30 08:36:21 [auto1.be] INFO: Scrape type for HM28534: 2
2026-03-30 08:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12fd8785-a85a-584b-9fa7-755ac0bf3d47 with identifier: HM28534
2026-03-30 08:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12fd8785-a85a-584b-9fa7-755ac0bf3d47 with scrape type 2
2026-03-30 08:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12fd8785-a85a-584b-9fa7-755ac0bf3d47 with scrape type 2
2026-03-30 08:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 12fd8785-a85a-584b-9fa7-755ac0bf3d47, identifier: HM28534
2026-03-30 08:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_d4744c3e61706dd9eda28571b9b41a40.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 12fd8785-a85a-584b-9fa7-755ac0bf3d47 with identifier: HM28534
2026-03-30 08:36:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 12fd8785-a85a-584b-9fa7-755ac0bf3d47 with identifier: HM28534
2026-03-30 08:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 12fd8785-a85a-584b-9fa7-755ac0bf3d47 with identifier: HM28534 to the API
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:11:16Z',
'fuel_type': 'diesel',
'id': '12fd8785-a85a-584b-9fa7-755ac0bf3d47',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM28534',
'listing': 'auction',
'make': 'Ford',
'model': 'Transit Custom',
'odometer': 39264,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-28',
'seller_name': None,
'title': 'Ford Transit Custom 2.0 TDCi 300 L1 Trend',
'transmission': 'automatic',
'trim': '300 L1 Trend',
'year': 2023}
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM28534%27 HTTP/1.1" 200 None
2026-03-30 08:36:21 [auto1.be] INFO: Saving data for HM28534: {'auction_closing_time': 1774969876.0, 'created_time': 1774384671.874855, 'last_price_update_time': 1774859781.569936}
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HM28534') HTTP/1.1" 204 0
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F55%252Ffb55c49c1599ce2a090c3481f4e215b0%252Fpa%252FNH22682_74d5ecf4188fd5244575b1e022b298b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_74d5ecf4188fd5244575b1e022b298b4.jpg not downloaded yet
2026-03-30 08:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febdb1b8790>
2026-03-30 08:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35898f5c-7d84-56b5-bfaf-71a10ee533e7/35898f5c-7d84-56b5-bfaf-71a10ee533e7_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Ffc%252F87fc890996351fd4cdf760e2385c48c7%252Fpa%252FGL14353_d9cd27f829150e0d88edc034e9a84d5a.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_d9cd27f829150e0d88edc034e9a84d5a.jpg saved to cache
2026-03-30 08:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 35898f5c-7d84-56b5-bfaf-71a10ee533e7
2026-03-30 08:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febdb276a10>
2026-03-30 08:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35898f5c-7d84-56b5-bfaf-71a10ee533e7/35898f5c-7d84-56b5-bfaf-71a10ee533e7_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Ffc%252F87fc890996351fd4cdf760e2385c48c7%252Fpa%252FGL14353_9698c4eb64b846c8d9ddb3d681962198.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_9698c4eb64b846c8d9ddb3d681962198.jpg saved to cache
2026-03-30 08:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 35898f5c-7d84-56b5-bfaf-71a10ee533e7
2026-03-30 08:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8fe1dd0>
2026-03-30 08:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31516f29-62a3-5041-a755-30e1c1e5cc7a/31516f29-62a3-5041-a755-30e1c1e5cc7a_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Ff5%252Fa0f59f472f24daf2c6eeec4a0f7d6e0d%252Fpa%252FLW89201_ec1069156fc8c3648b4ac044d2cda7b8.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_ec1069156fc8c3648b4ac044d2cda7b8.jpg saved to cache
2026-03-30 08:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 31516f29-62a3-5041-a755-30e1c1e5cc7a
2026-03-30 08:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_3831cacfce6a0be6d0b0ed989c1f484d.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:21 [auto1.be] INFO: Found listing with ID: TL00014
2026-03-30 08:36:21 [auto1.be] INFO: Found listing with ID: TS78695
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS78695%27 HTTP/1.1" 200 None
2026-03-30 08:36:21 [auto1.be] INFO: Scrape type for TS78695: 2
2026-03-30 08:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96a46ff3-2841-596e-82ad-2237ea14a7d5 with identifier: TS78695
2026-03-30 08:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96a46ff3-2841-596e-82ad-2237ea14a7d5 with scrape type 2
2026-03-30 08:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96a46ff3-2841-596e-82ad-2237ea14a7d5 with scrape type 2
2026-03-30 08:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 96a46ff3-2841-596e-82ad-2237ea14a7d5, identifier: TS78695
2026-03-30 08:36:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 96a46ff3-2841-596e-82ad-2237ea14a7d5 with identifier: TS78695
2026-03-30 08:36:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 96a46ff3-2841-596e-82ad-2237ea14a7d5 with identifier: TS78695
2026-03-30 08:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 96a46ff3-2841-596e-82ad-2237ea14a7d5 with identifier: TS78695 to the API
2026-03-30 08:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 195,
'expiration_date': '2026-03-31T15:12:08Z',
'fuel_type': 'diesel',
'id': '96a46ff3-2841-596e-82ad-2237ea14a7d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS78695',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 134886,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-04-10',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2019}
2026-03-30 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS78695%27 HTTP/1.1" 200 None
2026-03-30 08:36:22 [auto1.be] INFO: Saving data for TS78695: {'auction_closing_time': 1774969928.0, 'created_time': 1773866304.909616, 'last_price_update_time': 1774859782.240794}
2026-03-30 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TS78695') HTTP/1.1" 204 0
2026-03-30 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F55%252Ffb55c49c1599ce2a090c3481f4e215b0%252Fpa%252FNH22682_99ffd7d7a6a77dd56a5a0a03fb261715.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_99ffd7d7a6a77dd56a5a0a03fb261715.jpg not downloaded yet
2026-03-30 08:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BH83667/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_9fd7398bf74e0e24e962fc29ae0453e7.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_251ce0e52f82a0290c8f4029371aaa1e.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:22 [auto1.be] INFO: Found listing with ID: YW02361
2026-03-30 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW02361%27 HTTP/1.1" 200 None
2026-03-30 08:36:22 [auto1.be] INFO: Scrape type for YW02361: 1
2026-03-30 08:36:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 08:36:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 08:36:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 08:36:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 08:36:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 08:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febdaf2de10>
2026-03-30 08:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1df94b2-a3e4-5692-8c84-1ee12df9085e/a1df94b2-a3e4-5692-8c84-1ee12df9085e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F54%252F665439437dbcb0e9a68fbd67bb9adc6e%252Fpa%252FUU73016_d9072c5a261491866d0f482469fbe5a2.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_d9072c5a261491866d0f482469fbe5a2.jpg saved to cache
2026-03-30 08:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1df94b2-a3e4-5692-8c84-1ee12df9085e
2026-03-30 08:36:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1df94b2-a3e4-5692-8c84-1ee12df9085e, skipping ID generation
2026-03-30 08:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1df94b2-a3e4-5692-8c84-1ee12df9085e with scrape type 1
2026-03-30 08:36:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1df94b2-a3e4-5692-8c84-1ee12df9085e sending to next pipeline
2026-03-30 08:36:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a1df94b2-a3e4-5692-8c84-1ee12df9085e, identifier: UU73016
2026-03-30 08:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd90eaa50>
2026-03-30 08:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0333184a-fd46-57f1-948a-ae0f68b22111/0333184a-fd46-57f1-948a-ae0f68b22111_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe0%252Fcde074db263b54306897b79f29d18ba8%252Fpa%252FEH30324_d4744c3e61706dd9eda28571b9b41a40.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_d4744c3e61706dd9eda28571b9b41a40.jpg saved to cache
2026-03-30 08:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0333184a-fd46-57f1-948a-ae0f68b22111
2026-03-30 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F55%252Ffb55c49c1599ce2a090c3481f4e215b0%252Fpa%252FNH22682_01a1eb6e46445d8c3086482244317480.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_01a1eb6e46445d8c3086482244317480.jpg not downloaded yet
2026-03-30 08:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a1df94b2-a3e4-5692-8c84-1ee12df9085e with identifier: UU73016
2026-03-30 08:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a1df94b2-a3e4-5692-8c84-1ee12df9085e with identifier: UU73016
2026-03-30 08:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a1df94b2-a3e4-5692-8c84-1ee12df9085e with identifier: UU73016 to the API
2026-03-30 08:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_d9072c5a261491866d0f482469fbe5a2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 89,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 115,
'expiration_date': '2026-03-31T15:34:49Z',
'fuel_type': 'diesel',
'id': 'a1df94b2-a3e4-5692-8c84-1ee12df9085e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU73016',
'listing': 'auction',
'location': 'BE',
'make': 'BMW',
'model': '1er',
'odometer': 168804,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1df94b2-a3e4-5692-8c84-1ee12df9085e/a1df94b2-a3e4-5692-8c84-1ee12df9085e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3159385,
'Height': 3024,
'OriginUrl': 'https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_d9072c5a261491866d0f482469fbe5a2.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1df94b2-a3e4-5692-8c84-1ee12df9085e/a1df94b2-a3e4-5692-8c84-1ee12df9085e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99551,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_3f26ff4bf709df41efa667f3af14542a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1df94b2-a3e4-5692-8c84-1ee12df9085e/a1df94b2-a3e4-5692-8c84-1ee12df9085e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92696,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_a49882d95182c6e0206b37d082395867.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1df94b2-a3e4-5692-8c84-1ee12df9085e/a1df94b2-a3e4-5692-8c84-1ee12df9085e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92653,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_bbd2d2f108a10afe046f855329c3f9b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1df94b2-a3e4-5692-8c84-1ee12df9085e/a1df94b2-a3e4-5692-8c84-1ee12df9085e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106526,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_c983eb0486a64372fd94345c06ae5223.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1df94b2-a3e4-5692-8c84-1ee12df9085e/a1df94b2-a3e4-5692-8c84-1ee12df9085e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112668,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_4c4f11de8b6dca5531a09543442860d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1df94b2-a3e4-5692-8c84-1ee12df9085e/a1df94b2-a3e4-5692-8c84-1ee12df9085e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103924,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_7a5e59520f45c80602d0f83489cec258.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1df94b2-a3e4-5692-8c84-1ee12df9085e/a1df94b2-a3e4-5692-8c84-1ee12df9085e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120086,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_b9ce1c81a74e8210eb60eea7477a118d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1df94b2-a3e4-5692-8c84-1ee12df9085e/a1df94b2-a3e4-5692-8c84-1ee12df9085e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98965,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_a20d7bfe956154d65c160222b16e12a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1df94b2-a3e4-5692-8c84-1ee12df9085e/a1df94b2-a3e4-5692-8c84-1ee12df9085e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92744,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/54/665439437dbcb0e9a68fbd67bb9adc6e/pa/UU73016_d22ad76ce894725754a58f685c221c2d.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2015-08-24',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 116d EfficientDynamics Advantage',
'transmission': 'manual',
'trim': 'EfficientDynamics Advantage',
'year': 2015}
2026-03-30 08:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UU73016%27 HTTP/1.1" 200 None
2026-03-30 08:36:23 [auto1.be] INFO: Saving data for UU73016: {'created_time': 1774859783.007245, 'last_price_update_time': 1774859783.007255, 'auction_closing_time': 1774971289.0}
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UU73016') HTTP/1.1" 204 0
2026-03-30 08:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_1cfe4d950b3958b88f04b016b14c4de8.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:23 [auto1.be] INFO: Found listing with ID: BC43211
2026-03-30 08:36:23 [auto1.be] INFO: Found listing with ID: JD88445
2026-03-30 08:36:23 [auto1.be] INFO: Found listing with ID: HH39749
2026-03-30 08:36:23 [auto1.be] INFO: Found listing with ID: WY71149
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WY71149%27 HTTP/1.1" 200 None
2026-03-30 08:36:23 [auto1.be] INFO: Scrape type for WY71149: 2
2026-03-30 08:36:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0846587-b0c4-5012-a56a-51c5b6b4349c with identifier: WY71149
2026-03-30 08:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0846587-b0c4-5012-a56a-51c5b6b4349c with scrape type 2
2026-03-30 08:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0846587-b0c4-5012-a56a-51c5b6b4349c with scrape type 2
2026-03-30 08:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b0846587-b0c4-5012-a56a-51c5b6b4349c, identifier: WY71149
2026-03-30 08:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VP07407/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_45521c29582e9f246f489c99ac101662.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b0846587-b0c4-5012-a56a-51c5b6b4349c with identifier: WY71149
2026-03-30 08:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b0846587-b0c4-5012-a56a-51c5b6b4349c with identifier: WY71149
2026-03-30 08:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b0846587-b0c4-5012-a56a-51c5b6b4349c with identifier: WY71149 to the API
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 180,
'expiration_date': '2026-03-31T15:37:14Z',
'fuel_type': 'diesel',
'id': 'b0846587-b0c4-5012-a56a-51c5b6b4349c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY71149',
'listing': 'auction',
'make': 'Peugeot',
'model': '3008',
'odometer': 166313,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-11',
'seller_name': None,
'title': 'Peugeot 3008 2.0 Blue-HDi GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2018}
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WY71149%27 HTTP/1.1" 200 None
2026-03-30 08:36:23 [auto1.be] INFO: Saving data for WY71149: {'auction_closing_time': 1774971434.0, 'created_time': 1774265786.193953, 'last_price_update_time': 1774859783.477593}
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WY71149') HTTP/1.1" 204 0
2026-03-30 08:36:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8f90050>
2026-03-30 08:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35898f5c-7d84-56b5-bfaf-71a10ee533e7/35898f5c-7d84-56b5-bfaf-71a10ee533e7_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Ffc%252F87fc890996351fd4cdf760e2385c48c7%252Fpa%252FGL14353_3831cacfce6a0be6d0b0ed989c1f484d.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_3831cacfce6a0be6d0b0ed989c1f484d.jpg saved to cache
2026-03-30 08:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 35898f5c-7d84-56b5-bfaf-71a10ee533e7
2026-03-30 08:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8533cd0>
2026-03-30 08:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b942f899-81c1-5457-b3e1-6439fd0d0a96/b942f899-81c1-5457-b3e1-6439fd0d0a96_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F55%252Ffb55c49c1599ce2a090c3481f4e215b0%252Fpa%252FNH22682_9fd7398bf74e0e24e962fc29ae0453e7.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_9fd7398bf74e0e24e962fc29ae0453e7.jpg saved to cache
2026-03-30 08:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b942f899-81c1-5457-b3e1-6439fd0d0a96
2026-03-30 08:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd85303d0>
2026-03-30 08:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b942f899-81c1-5457-b3e1-6439fd0d0a96/b942f899-81c1-5457-b3e1-6439fd0d0a96_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F55%252Ffb55c49c1599ce2a090c3481f4e215b0%252Fpa%252FNH22682_251ce0e52f82a0290c8f4029371aaa1e.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_251ce0e52f82a0290c8f4029371aaa1e.jpg saved to cache
2026-03-30 08:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b942f899-81c1-5457-b3e1-6439fd0d0a96
2026-03-30 08:36:23 [auto1.be] INFO: Found listing with ID: YA69116
2026-03-30 08:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JC64183/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_74d5ecf4188fd5244575b1e022b298b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PL94274> (referer: https://www.auto1.com/v1/car-details-view/PL94274/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UY40990/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd913ae90>
2026-03-30 08:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b942f899-81c1-5457-b3e1-6439fd0d0a96/b942f899-81c1-5457-b3e1-6439fd0d0a96_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F55%252Ffb55c49c1599ce2a090c3481f4e215b0%252Fpa%252FNH22682_1cfe4d950b3958b88f04b016b14c4de8.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_1cfe4d950b3958b88f04b016b14c4de8.jpg saved to cache
2026-03-30 08:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b942f899-81c1-5457-b3e1-6439fd0d0a96
2026-03-30 08:36:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8eb6550>
2026-03-30 08:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b942f899-81c1-5457-b3e1-6439fd0d0a96/b942f899-81c1-5457-b3e1-6439fd0d0a96_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F55%252Ffb55c49c1599ce2a090c3481f4e215b0%252Fpa%252FNH22682_45521c29582e9f246f489c99ac101662.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_45521c29582e9f246f489c99ac101662.jpg saved to cache
2026-03-30 08:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b942f899-81c1-5457-b3e1-6439fd0d0a96
2026-03-30 08:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_9e0c0d393198d6238338f21deb643c7f.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_b70ea24bcd6954ffc0b86bd443f1805a.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd90fae90>
2026-03-30 08:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b942f899-81c1-5457-b3e1-6439fd0d0a96/b942f899-81c1-5457-b3e1-6439fd0d0a96_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F55%252Ffb55c49c1599ce2a090c3481f4e215b0%252Fpa%252FNH22682_74d5ecf4188fd5244575b1e022b298b4.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_74d5ecf4188fd5244575b1e022b298b4.jpg saved to cache
2026-03-30 08:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b942f899-81c1-5457-b3e1-6439fd0d0a96
2026-03-30 08:36:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c5555b0-6b60-5700-993e-b6cdc96a25d4 with identifier: PL94274
2026-03-30 08:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c5555b0-6b60-5700-993e-b6cdc96a25d4 with scrape type 1
2026-03-30 08:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6c5555b0-6b60-5700-993e-b6cdc96a25d4
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fe1%252Faae1e7713f3328322897c7eb027bbff1%252Fpa%252FPL94274_74c3890f5a164130889c52275702f71f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e1/aae1e7713f3328322897c7eb027bbff1/pa/PL94274_74c3890f5a164130889c52275702f71f.jpg already downloaded
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fe1%252Faae1e7713f3328322897c7eb027bbff1%252Fpa%252FPL94274_460b71f95a31a6cc2786f198ed097893.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e1/aae1e7713f3328322897c7eb027bbff1/pa/PL94274_460b71f95a31a6cc2786f198ed097893.jpg already downloaded
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fe1%252Faae1e7713f3328322897c7eb027bbff1%252Fpa%252FPL94274_a8c6b97760c2768086f6ef4e38a98a75.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e1/aae1e7713f3328322897c7eb027bbff1/pa/PL94274_a8c6b97760c2768086f6ef4e38a98a75.jpg already downloaded
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fe1%252Faae1e7713f3328322897c7eb027bbff1%252Fpa%252FPL94274_5af7a3bbcab67d0924991131c57a0c47.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e1/aae1e7713f3328322897c7eb027bbff1/pa/PL94274_5af7a3bbcab67d0924991131c57a0c47.jpg already downloaded
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fe1%252Faae1e7713f3328322897c7eb027bbff1%252Fpa%252FPL94274_8ea721ecb1caec510fceb195994bae2c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e1/aae1e7713f3328322897c7eb027bbff1/pa/PL94274_8ea721ecb1caec510fceb195994bae2c.jpg already downloaded
2026-03-30 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fe1%252Faae1e7713f3328322897c7eb027bbff1%252Fpa%252FPL94274_f8854f023092c84bd5f7ec58815f3ff0.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e1/aae1e7713f3328322897c7eb027bbff1/pa/PL94274_f8854f023092c84bd5f7ec58815f3ff0.jpg already downloaded
2026-03-30 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fe1%252Faae1e7713f3328322897c7eb027bbff1%252Fpa%252FPL94274_c068386561d44afce7f5bdfac398e04f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e1/aae1e7713f3328322897c7eb027bbff1/pa/PL94274_c068386561d44afce7f5bdfac398e04f.jpg already downloaded
2026-03-30 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fe1%252Faae1e7713f3328322897c7eb027bbff1%252Fpa%252FPL94274_e7fdc22f202b9ba7e0f8f42ee5e2c112.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e1/aae1e7713f3328322897c7eb027bbff1/pa/PL94274_e7fdc22f202b9ba7e0f8f42ee5e2c112.jpg already downloaded
2026-03-30 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fe1%252Faae1e7713f3328322897c7eb027bbff1%252Fpa%252FPL94274_14f9681e31b521fd82dd1a395087c58f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e1/aae1e7713f3328322897c7eb027bbff1/pa/PL94274_14f9681e31b521fd82dd1a395087c58f.jpg already downloaded
2026-03-30 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252Fe1%252Faae1e7713f3328322897c7eb027bbff1%252Fpa%252FPL94274_5c69629477051d1467b00c2a65d80ff8.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/e1/aae1e7713f3328322897c7eb027bbff1/pa/PL94274_5c69629477051d1467b00c2a65d80ff8.jpg already downloaded
2026-03-30 08:36:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6c5555b0-6b60-5700-993e-b6cdc96a25d4, identifier: PL94274
2026-03-30 08:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_4fdeeb1b575e82b21be48a5291d50593.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6c5555b0-6b60-5700-993e-b6cdc96a25d4 with identifier: PL94274
2026-03-30 08:36:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6c5555b0-6b60-5700-993e-b6cdc96a25d4 with identifier: PL94274
2026-03-30 08:36:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6c5555b0-6b60-5700-993e-b6cdc96a25d4 with identifier: PL94274 to the API
2026-03-30 08:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PL94274>
{'auction_title': '',
'c_o_2_emission_value': 116,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:40:45Z',
'fuel_type': 'petrol',
'id': '6c5555b0-6b60-5700-993e-b6cdc96a25d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL94274',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 176123,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgaa/e1/aae1e7713f3328322897c7eb027bbff1/pa/PL94274_74c3890f5a164130889c52275702f71f.jpg',
'https://img-pa.auto1.com/imgaa/e1/aae1e7713f3328322897c7eb027bbff1/pa/PL94274_460b71f95a31a6cc2786f198ed097893.jpg',
'https://img-pa.auto1.com/imgaa/e1/aae1e7713f3328322897c7eb027bbff1/pa/PL94274_a8c6b97760c2768086f6ef4e38a98a75.jpg',
'https://img-pa.auto1.com/imgaa/e1/aae1e7713f3328322897c7eb027bbff1/pa/PL94274_5af7a3bbcab67d0924991131c57a0c47.jpg',
'https://img-pa.auto1.com/imgaa/e1/aae1e7713f3328322897c7eb027bbff1/pa/PL94274_8ea721ecb1caec510fceb195994bae2c.jpg',
'https://img-pa.auto1.com/imgaa/e1/aae1e7713f3328322897c7eb027bbff1/pa/PL94274_f8854f023092c84bd5f7ec58815f3ff0.jpg',
'https://img-pa.auto1.com/imgaa/e1/aae1e7713f3328322897c7eb027bbff1/pa/PL94274_c068386561d44afce7f5bdfac398e04f.jpg',
'https://img-pa.auto1.com/imgaa/e1/aae1e7713f3328322897c7eb027bbff1/pa/PL94274_e7fdc22f202b9ba7e0f8f42ee5e2c112.jpg',
'https://img-pa.auto1.com/imgaa/e1/aae1e7713f3328322897c7eb027bbff1/pa/PL94274_14f9681e31b521fd82dd1a395087c58f.jpg',
'https://img-pa.auto1.com/imgaa/e1/aae1e7713f3328322897c7eb027bbff1/pa/PL94274_5c69629477051d1467b00c2a65d80ff8.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c5555b0-6b60-5700-993e-b6cdc96a25d4/6c5555b0-6b60-5700-993e-b6cdc96a25d4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69253,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/e1/aae1e7713f3328322897c7eb027bbff1/pa/PL94274_74c3890f5a164130889c52275702f71f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c5555b0-6b60-5700-993e-b6cdc96a25d4/6c5555b0-6b60-5700-993e-b6cdc96a25d4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73878,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/e1/aae1e7713f3328322897c7eb027bbff1/pa/PL94274_460b71f95a31a6cc2786f198ed097893.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c5555b0-6b60-5700-993e-b6cdc96a25d4/6c5555b0-6b60-5700-993e-b6cdc96a25d4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63766,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/e1/aae1e7713f3328322897c7eb027bbff1/pa/PL94274_a8c6b97760c2768086f6ef4e38a98a75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c5555b0-6b60-5700-993e-b6cdc96a25d4/6c5555b0-6b60-5700-993e-b6cdc96a25d4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55884,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/e1/aae1e7713f3328322897c7eb027bbff1/pa/PL94274_5af7a3bbcab67d0924991131c57a0c47.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c5555b0-6b60-5700-993e-b6cdc96a25d4/6c5555b0-6b60-5700-993e-b6cdc96a25d4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57325,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/e1/aae1e7713f3328322897c7eb027bbff1/pa/PL94274_8ea721ecb1caec510fceb195994bae2c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c5555b0-6b60-5700-993e-b6cdc96a25d4/6c5555b0-6b60-5700-993e-b6cdc96a25d4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58677,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/e1/aae1e7713f3328322897c7eb027bbff1/pa/PL94274_f8854f023092c84bd5f7ec58815f3ff0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c5555b0-6b60-5700-993e-b6cdc96a25d4/6c5555b0-6b60-5700-993e-b6cdc96a25d4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50191,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/e1/aae1e7713f3328322897c7eb027bbff1/pa/PL94274_c068386561d44afce7f5bdfac398e04f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c5555b0-6b60-5700-993e-b6cdc96a25d4/6c5555b0-6b60-5700-993e-b6cdc96a25d4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57251,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/e1/aae1e7713f3328322897c7eb027bbff1/pa/PL94274_e7fdc22f202b9ba7e0f8f42ee5e2c112.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c5555b0-6b60-5700-993e-b6cdc96a25d4/6c5555b0-6b60-5700-993e-b6cdc96a25d4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62732,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/e1/aae1e7713f3328322897c7eb027bbff1/pa/PL94274_14f9681e31b521fd82dd1a395087c58f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c5555b0-6b60-5700-993e-b6cdc96a25d4/6c5555b0-6b60-5700-993e-b6cdc96a25d4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60632,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/e1/aae1e7713f3328322897c7eb027bbff1/pa/PL94274_5c69629477051d1467b00c2a65d80ff8.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-09-25',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Octavia 1.4 TSI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2013}
2026-03-30 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PL94274%27 HTTP/1.1" 200 None
2026-03-30 08:36:24 [auto1.be] INFO: Saving data for PL94274: {'created_time': 1774859784.528021, 'last_price_update_time': 1774859784.528033, 'auction_closing_time': 1774971645.0}
2026-03-30 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PL94274') HTTP/1.1" 204 0
2026-03-30 08:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_953bef209b8e1d15dcbfaf4021ca82a4.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_e04902a4f0c4755e535c56aa851a1a8e.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_0e90b3d51506fdbf10b61038da2c8a34.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_01a1eb6e46445d8c3086482244317480.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_a7e2b5473d6e51a23320031fb2f4c96f.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 08:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd913bfd0>
2026-03-30 08:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0333184a-fd46-57f1-948a-ae0f68b22111/0333184a-fd46-57f1-948a-ae0f68b22111_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe0%252Fcde074db263b54306897b79f29d18ba8%252Fpa%252FEH30324_9e0c0d393198d6238338f21deb643c7f.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_9e0c0d393198d6238338f21deb643c7f.jpg saved to cache
2026-03-30 08:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0333184a-fd46-57f1-948a-ae0f68b22111
2026-03-30 08:36:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 08:36:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 08:36:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 08:36:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 08:36:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 08:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8ec5890>
2026-03-30 08:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31516f29-62a3-5041-a755-30e1c1e5cc7a/31516f29-62a3-5041-a755-30e1c1e5cc7a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Ff5%252Fa0f59f472f24daf2c6eeec4a0f7d6e0d%252Fpa%252FLW89201_b70ea24bcd6954ffc0b86bd443f1805a.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_b70ea24bcd6954ffc0b86bd443f1805a.jpg saved to cache
2026-03-30 08:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 31516f29-62a3-5041-a755-30e1c1e5cc7a
2026-03-30 08:36:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 08:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd85d7e90>
2026-03-30 08:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0333184a-fd46-57f1-948a-ae0f68b22111/0333184a-fd46-57f1-948a-ae0f68b22111_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe0%252Fcde074db263b54306897b79f29d18ba8%252Fpa%252FEH30324_4fdeeb1b575e82b21be48a5291d50593.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_4fdeeb1b575e82b21be48a5291d50593.jpg saved to cache
2026-03-30 08:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0333184a-fd46-57f1-948a-ae0f68b22111
2026-03-30 08:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CM92821/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febe8b59c90>
2026-03-30 08:36:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b942f899-81c1-5457-b3e1-6439fd0d0a96/b942f899-81c1-5457-b3e1-6439fd0d0a96_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F55%252Ffb55c49c1599ce2a090c3481f4e215b0%252Fpa%252FNH22682_953bef209b8e1d15dcbfaf4021ca82a4.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_953bef209b8e1d15dcbfaf4021ca82a4.jpg saved to cache
2026-03-30 08:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b942f899-81c1-5457-b3e1-6439fd0d0a96
2026-03-30 08:36:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8f38290>
2026-03-30 08:36:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35898f5c-7d84-56b5-bfaf-71a10ee533e7/35898f5c-7d84-56b5-bfaf-71a10ee533e7_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Ffc%252F87fc890996351fd4cdf760e2385c48c7%252Fpa%252FGL14353_e04902a4f0c4755e535c56aa851a1a8e.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_e04902a4f0c4755e535c56aa851a1a8e.jpg saved to cache
2026-03-30 08:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 35898f5c-7d84-56b5-bfaf-71a10ee533e7
2026-03-30 08:36:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 08:36:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 08:36:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 08:36:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 08:36:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 08:36:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8fb8dd0>
2026-03-30 08:36:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25bf27d2-b603-506b-bd64-f9227800eed0/25bf27d2-b603-506b-bd64-f9227800eed0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fa9%252F39a9f66bf2fd468072f072bb7047cc69%252Fpa%252FTS76065_0e90b3d51506fdbf10b61038da2c8a34.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_0e90b3d51506fdbf10b61038da2c8a34.jpg saved to cache
2026-03-30 08:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 25bf27d2-b603-506b-bd64-f9227800eed0
2026-03-30 08:36:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8530fd0>
2026-03-30 08:36:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b942f899-81c1-5457-b3e1-6439fd0d0a96/b942f899-81c1-5457-b3e1-6439fd0d0a96_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F55%252Ffb55c49c1599ce2a090c3481f4e215b0%252Fpa%252FNH22682_01a1eb6e46445d8c3086482244317480.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_01a1eb6e46445d8c3086482244317480.jpg saved to cache
2026-03-30 08:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b942f899-81c1-5457-b3e1-6439fd0d0a96
2026-03-30 08:36:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd84aa6d0>
2026-03-30 08:36:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35898f5c-7d84-56b5-bfaf-71a10ee533e7/35898f5c-7d84-56b5-bfaf-71a10ee533e7_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Ffc%252F87fc890996351fd4cdf760e2385c48c7%252Fpa%252FGL14353_a7e2b5473d6e51a23320031fb2f4c96f.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_a7e2b5473d6e51a23320031fb2f4c96f.jpg saved to cache
2026-03-30 08:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 35898f5c-7d84-56b5-bfaf-71a10ee533e7
2026-03-30 08:36:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YW02361/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_8c2cc2af4c81560a9383c34acb283ab5.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_99ffd7d7a6a77dd56a5a0a03fb261715.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_f5e2e4c55578223f5948221845af23fe.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_0a5e2a0c766fe42ae7f52cd21ded1589.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 08:36:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd907bc90>
2026-03-30 08:36:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b942f899-81c1-5457-b3e1-6439fd0d0a96/b942f899-81c1-5457-b3e1-6439fd0d0a96_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F55%252Ffb55c49c1599ce2a090c3481f4e215b0%252Fpa%252FNH22682_8c2cc2af4c81560a9383c34acb283ab5.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_8c2cc2af4c81560a9383c34acb283ab5.jpg saved to cache
2026-03-30 08:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b942f899-81c1-5457-b3e1-6439fd0d0a96
2026-03-30 08:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_539de9d7234e010f59ef2b44f2ab29a2.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_11e2bad6e5da924c2b4ed30b1341dea4.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_34aab85af1f87746d91aed7d7a5f21f3.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BH83667> (referer: https://www.auto1.com/v1/car-details-view/BH83667/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 08:36:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8fd4550>
2026-03-30 08:36:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b942f899-81c1-5457-b3e1-6439fd0d0a96/b942f899-81c1-5457-b3e1-6439fd0d0a96_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F55%252Ffb55c49c1599ce2a090c3481f4e215b0%252Fpa%252FNH22682_99ffd7d7a6a77dd56a5a0a03fb261715.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_99ffd7d7a6a77dd56a5a0a03fb261715.jpg saved to cache
2026-03-30 08:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b942f899-81c1-5457-b3e1-6439fd0d0a96
2026-03-30 08:36:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 08:36:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd83e7690>
2026-03-30 08:36:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b942f899-81c1-5457-b3e1-6439fd0d0a96/b942f899-81c1-5457-b3e1-6439fd0d0a96_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F55%252Ffb55c49c1599ce2a090c3481f4e215b0%252Fpa%252FNH22682_f5e2e4c55578223f5948221845af23fe.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_f5e2e4c55578223f5948221845af23fe.jpg saved to cache
2026-03-30 08:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b942f899-81c1-5457-b3e1-6439fd0d0a96
2026-03-30 08:36:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b942f899-81c1-5457-b3e1-6439fd0d0a96, skipping ID generation
2026-03-30 08:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b942f899-81c1-5457-b3e1-6439fd0d0a96 with scrape type 1
2026-03-30 08:36:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b942f899-81c1-5457-b3e1-6439fd0d0a96 sending to next pipeline
2026-03-30 08:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b942f899-81c1-5457-b3e1-6439fd0d0a96, identifier: NH22682
2026-03-30 08:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd85a3c90>
2026-03-30 08:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25bf27d2-b603-506b-bd64-f9227800eed0/25bf27d2-b603-506b-bd64-f9227800eed0_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fa9%252F39a9f66bf2fd468072f072bb7047cc69%252Fpa%252FTS76065_0a5e2a0c766fe42ae7f52cd21ded1589.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_0a5e2a0c766fe42ae7f52cd21ded1589.jpg saved to cache
2026-03-30 08:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 25bf27d2-b603-506b-bd64-f9227800eed0
2026-03-30 08:36:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b942f899-81c1-5457-b3e1-6439fd0d0a96 with identifier: NH22682
2026-03-30 08:36:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b942f899-81c1-5457-b3e1-6439fd0d0a96 with identifier: NH22682
2026-03-30 08:36:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b942f899-81c1-5457-b3e1-6439fd0d0a96 with identifier: NH22682 to the API
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_f5e2e4c55578223f5948221845af23fe.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.2L',
'engine_horse_power': 131,
'expiration_date': '2026-03-31T15:44:56Z',
'fuel_type': 'petrol',
'id': 'b942f899-81c1-5457-b3e1-6439fd0d0a96',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH22682',
'listing': 'auction',
'location': 'BE, Vilvoorde',
'make': 'Citroen',
'model': 'C3 Aircross',
'odometer': 99639,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b942f899-81c1-5457-b3e1-6439fd0d0a96/b942f899-81c1-5457-b3e1-6439fd0d0a96_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3013606,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_f5e2e4c55578223f5948221845af23fe.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b942f899-81c1-5457-b3e1-6439fd0d0a96/b942f899-81c1-5457-b3e1-6439fd0d0a96_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83564,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_251ce0e52f82a0290c8f4029371aaa1e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b942f899-81c1-5457-b3e1-6439fd0d0a96/b942f899-81c1-5457-b3e1-6439fd0d0a96_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92767,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_9fd7398bf74e0e24e962fc29ae0453e7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b942f899-81c1-5457-b3e1-6439fd0d0a96/b942f899-81c1-5457-b3e1-6439fd0d0a96_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68979,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_953bef209b8e1d15dcbfaf4021ca82a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b942f899-81c1-5457-b3e1-6439fd0d0a96/b942f899-81c1-5457-b3e1-6439fd0d0a96_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106854,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_1cfe4d950b3958b88f04b016b14c4de8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b942f899-81c1-5457-b3e1-6439fd0d0a96/b942f899-81c1-5457-b3e1-6439fd0d0a96_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2883780,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_8c2cc2af4c81560a9383c34acb283ab5.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b942f899-81c1-5457-b3e1-6439fd0d0a96/b942f899-81c1-5457-b3e1-6439fd0d0a96_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38955,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_45521c29582e9f246f489c99ac101662.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b942f899-81c1-5457-b3e1-6439fd0d0a96/b942f899-81c1-5457-b3e1-6439fd0d0a96_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61748,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_74d5ecf4188fd5244575b1e022b298b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b942f899-81c1-5457-b3e1-6439fd0d0a96/b942f899-81c1-5457-b3e1-6439fd0d0a96_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3032226,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_99ffd7d7a6a77dd56a5a0a03fb261715.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b942f899-81c1-5457-b3e1-6439fd0d0a96/b942f899-81c1-5457-b3e1-6439fd0d0a96_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68406,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/55/fb55c49c1599ce2a090c3481f4e215b0/pa/NH22682_01a1eb6e46445d8c3086482244317480.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-04-27',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 Aircross 1.2 PureTech Feel Pack',
'transmission': 'automatic',
'trim': 'Feel Pack',
'year': 2021}
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NH22682%27 HTTP/1.1" 200 None
2026-03-30 08:36:26 [auto1.be] INFO: Saving data for NH22682: {'created_time': 1774859786.696878, 'last_price_update_time': 1774859786.696891, 'auction_closing_time': 1774971896.0}
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NH22682') HTTP/1.1" 204 0
2026-03-30 08:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YX69957> (referer: https://www.auto1.com/v1/car-details-view/YX69957/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd854bc90>
2026-03-30 08:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35898f5c-7d84-56b5-bfaf-71a10ee533e7/35898f5c-7d84-56b5-bfaf-71a10ee533e7_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Ffc%252F87fc890996351fd4cdf760e2385c48c7%252Fpa%252FGL14353_539de9d7234e010f59ef2b44f2ab29a2.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_539de9d7234e010f59ef2b44f2ab29a2.jpg saved to cache
2026-03-30 08:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 35898f5c-7d84-56b5-bfaf-71a10ee533e7
2026-03-30 08:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd84f7bd0>
2026-03-30 08:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0333184a-fd46-57f1-948a-ae0f68b22111/0333184a-fd46-57f1-948a-ae0f68b22111_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe0%252Fcde074db263b54306897b79f29d18ba8%252Fpa%252FEH30324_11e2bad6e5da924c2b4ed30b1341dea4.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_11e2bad6e5da924c2b4ed30b1341dea4.jpg saved to cache
2026-03-30 08:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0333184a-fd46-57f1-948a-ae0f68b22111
2026-03-30 08:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd85d4d10>
2026-03-30 08:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0333184a-fd46-57f1-948a-ae0f68b22111/0333184a-fd46-57f1-948a-ae0f68b22111_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe0%252Fcde074db263b54306897b79f29d18ba8%252Fpa%252FEH30324_34aab85af1f87746d91aed7d7a5f21f3.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_34aab85af1f87746d91aed7d7a5f21f3.jpg saved to cache
2026-03-30 08:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0333184a-fd46-57f1-948a-ae0f68b22111
2026-03-30 08:36:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 523f3519-43ac-55b1-b899-1be7dcff460f with identifier: BH83667
2026-03-30 08:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 523f3519-43ac-55b1-b899-1be7dcff460f with scrape type 1
2026-03-30 08:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 523f3519-43ac-55b1-b899-1be7dcff460f
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F8e%252F788e651eccabeb79e328e13a5f2dcba9%252Fpa%252FBH83667_6cea36ebbc0b29e64dc9454229f4c664.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/8e/788e651eccabeb79e328e13a5f2dcba9/pa/BH83667_6cea36ebbc0b29e64dc9454229f4c664.jpg already downloaded
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F8e%252F788e651eccabeb79e328e13a5f2dcba9%252Fpa%252FBH83667_d6b355fd85882d1613122e68522ecf0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/8e/788e651eccabeb79e328e13a5f2dcba9/pa/BH83667_d6b355fd85882d1613122e68522ecf0a.jpg already downloaded
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F8e%252F788e651eccabeb79e328e13a5f2dcba9%252Fpa%252FBH83667_1fddfd071061a9571a19ceaf9a0d0656.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/8e/788e651eccabeb79e328e13a5f2dcba9/pa/BH83667_1fddfd071061a9571a19ceaf9a0d0656.jpg already downloaded
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F8e%252F788e651eccabeb79e328e13a5f2dcba9%252Fpa%252FBH83667_e396a43820699eec8e5ec26afb767590.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/8e/788e651eccabeb79e328e13a5f2dcba9/pa/BH83667_e396a43820699eec8e5ec26afb767590.jpg already downloaded
2026-03-30 08:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F8e%252F788e651eccabeb79e328e13a5f2dcba9%252Fpa%252FBH83667_78ad6b2d97acc59adc001d82d44a68bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/8e/788e651eccabeb79e328e13a5f2dcba9/pa/BH83667_78ad6b2d97acc59adc001d82d44a68bb.jpg already downloaded
2026-03-30 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F8e%252F788e651eccabeb79e328e13a5f2dcba9%252Fpa%252FBH83667_ab297e698b475409a75f37b27bcb5c9c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/8e/788e651eccabeb79e328e13a5f2dcba9/pa/BH83667_ab297e698b475409a75f37b27bcb5c9c.jpg already downloaded
2026-03-30 08:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 523f3519-43ac-55b1-b899-1be7dcff460f, identifier: BH83667
2026-03-30 08:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 523f3519-43ac-55b1-b899-1be7dcff460f with identifier: BH83667
2026-03-30 08:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 523f3519-43ac-55b1-b899-1be7dcff460f with identifier: BH83667
2026-03-30 08:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 523f3519-43ac-55b1-b899-1be7dcff460f with identifier: BH83667 to the API
2026-03-30 08:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BH83667>
{'auction_title': '',
'c_o_2_emission_value': 271,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 3',
'engine': '2.7L',
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:08:16Z',
'fuel_type': 'diesel',
'id': '523f3519-43ac-55b1-b899-1be7dcff460f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH83667',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Land Rover',
'model': 'Range Rover Sport',
'odometer': 269176,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img78/8e/788e651eccabeb79e328e13a5f2dcba9/pa/BH83667_6cea36ebbc0b29e64dc9454229f4c664.jpg',
'https://img-pa.auto1.com/img78/8e/788e651eccabeb79e328e13a5f2dcba9/pa/BH83667_d6b355fd85882d1613122e68522ecf0a.jpg',
'https://img-pa.auto1.com/img78/8e/788e651eccabeb79e328e13a5f2dcba9/pa/BH83667_1fddfd071061a9571a19ceaf9a0d0656.jpg',
'https://img-pa.auto1.com/img78/8e/788e651eccabeb79e328e13a5f2dcba9/pa/BH83667_e396a43820699eec8e5ec26afb767590.jpg',
'https://img-pa.auto1.com/img78/8e/788e651eccabeb79e328e13a5f2dcba9/pa/BH83667_78ad6b2d97acc59adc001d82d44a68bb.jpg',
'https://img-pa.auto1.com/img78/8e/788e651eccabeb79e328e13a5f2dcba9/pa/BH83667_ab297e698b475409a75f37b27bcb5c9c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_523f3519-43ac-55b1-b899-1be7dcff460f/523f3519-43ac-55b1-b899-1be7dcff460f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83435,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/8e/788e651eccabeb79e328e13a5f2dcba9/pa/BH83667_6cea36ebbc0b29e64dc9454229f4c664.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_523f3519-43ac-55b1-b899-1be7dcff460f/523f3519-43ac-55b1-b899-1be7dcff460f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81034,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/8e/788e651eccabeb79e328e13a5f2dcba9/pa/BH83667_d6b355fd85882d1613122e68522ecf0a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_523f3519-43ac-55b1-b899-1be7dcff460f/523f3519-43ac-55b1-b899-1be7dcff460f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80073,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/8e/788e651eccabeb79e328e13a5f2dcba9/pa/BH83667_1fddfd071061a9571a19ceaf9a0d0656.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_523f3519-43ac-55b1-b899-1be7dcff460f/523f3519-43ac-55b1-b899-1be7dcff460f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61852,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/8e/788e651eccabeb79e328e13a5f2dcba9/pa/BH83667_e396a43820699eec8e5ec26afb767590.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_523f3519-43ac-55b1-b899-1be7dcff460f/523f3519-43ac-55b1-b899-1be7dcff460f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125933,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/8e/788e651eccabeb79e328e13a5f2dcba9/pa/BH83667_78ad6b2d97acc59adc001d82d44a68bb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_523f3519-43ac-55b1-b899-1be7dcff460f/523f3519-43ac-55b1-b899-1be7dcff460f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63644,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img78/8e/788e651eccabeb79e328e13a5f2dcba9/pa/BH83667_ab297e698b475409a75f37b27bcb5c9c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2006-05-09',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Range Rover Sport 2.7 Td V6 TD HSE',
'transmission': 'automatic',
'trim': 'TD HSE',
'year': 2006}
2026-03-30 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BH83667%27 HTTP/1.1" 200 None
2026-03-30 08:36:27 [auto1.be] INFO: Saving data for BH83667: {'created_time': 1774859787.458992, 'last_price_update_time': 1774859787.459008, 'auction_closing_time': 1774969696.0}
2026-03-30 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BH83667') HTTP/1.1" 204 0
2026-03-30 08:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_bd9070993aaf51c75f76ea9b45c6d2a1.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72e2b7a6-c34c-53fe-b926-19813eb4a967 with identifier: YX69957
2026-03-30 08:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72e2b7a6-c34c-53fe-b926-19813eb4a967 with scrape type 1
2026-03-30 08:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 72e2b7a6-c34c-53fe-b926-19813eb4a967
2026-03-30 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fee%252Fb1ee7c8222f27ca4cbdda0719c980719%252Fpa%252FYX69957_b670614b57123cd69ca1ef62bd1015d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ee/b1ee7c8222f27ca4cbdda0719c980719/pa/YX69957_b670614b57123cd69ca1ef62bd1015d1.jpg already downloaded
2026-03-30 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fee%252Fb1ee7c8222f27ca4cbdda0719c980719%252Fpa%252FYX69957_9d4cfc2af33f04954a68dc27083b7886.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ee/b1ee7c8222f27ca4cbdda0719c980719/pa/YX69957_9d4cfc2af33f04954a68dc27083b7886.jpg already downloaded
2026-03-30 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fee%252Fb1ee7c8222f27ca4cbdda0719c980719%252Fpa%252FYX69957_51641479ff9a63aaf4cf62c9afe93f8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ee/b1ee7c8222f27ca4cbdda0719c980719/pa/YX69957_51641479ff9a63aaf4cf62c9afe93f8e.jpg already downloaded
2026-03-30 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fee%252Fb1ee7c8222f27ca4cbdda0719c980719%252Fpa%252FYX69957_516a3a18a27ec3f9942f84265d2a318d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ee/b1ee7c8222f27ca4cbdda0719c980719/pa/YX69957_516a3a18a27ec3f9942f84265d2a318d.jpg already downloaded
2026-03-30 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fee%252Fb1ee7c8222f27ca4cbdda0719c980719%252Fpa%252FYX69957_b8da0c9027f1b4bdd3c50b670cb8c407.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ee/b1ee7c8222f27ca4cbdda0719c980719/pa/YX69957_b8da0c9027f1b4bdd3c50b670cb8c407.jpg already downloaded
2026-03-30 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fee%252Fb1ee7c8222f27ca4cbdda0719c980719%252Fpa%252FYX69957_8cdb398eb3ca8ffca63662ed5fde98ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/ee/b1ee7c8222f27ca4cbdda0719c980719/pa/YX69957_8cdb398eb3ca8ffca63662ed5fde98ba.jpg already downloaded
2026-03-30 08:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 72e2b7a6-c34c-53fe-b926-19813eb4a967, identifier: YX69957
2026-03-30 08:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_969cebb838df2f8f74fa9185d5aa8a0c.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_a9644a9cff9d4fa9e40f3c4e622d7851.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_ee01faf6a5c4b78fd5b13b403d4b0ccc.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 72e2b7a6-c34c-53fe-b926-19813eb4a967 with identifier: YX69957
2026-03-30 08:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 72e2b7a6-c34c-53fe-b926-19813eb4a967 with identifier: YX69957
2026-03-30 08:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 72e2b7a6-c34c-53fe-b926-19813eb4a967 with identifier: YX69957 to the API
2026-03-30 08:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YX69957>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.1L',
'engine_horse_power': 60,
'expiration_date': '2026-03-31T15:04:54Z',
'fuel_type': 'petrol',
'id': '72e2b7a6-c34c-53fe-b926-19813eb4a967',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX69957',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Peugeot',
'model': '206+',
'odometer': 141414,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/imgb1/ee/b1ee7c8222f27ca4cbdda0719c980719/pa/YX69957_b670614b57123cd69ca1ef62bd1015d1.jpg',
'https://img-pa.auto1.com/imgb1/ee/b1ee7c8222f27ca4cbdda0719c980719/pa/YX69957_9d4cfc2af33f04954a68dc27083b7886.jpg',
'https://img-pa.auto1.com/imgb1/ee/b1ee7c8222f27ca4cbdda0719c980719/pa/YX69957_51641479ff9a63aaf4cf62c9afe93f8e.jpg',
'https://img-pa.auto1.com/imgb1/ee/b1ee7c8222f27ca4cbdda0719c980719/pa/YX69957_516a3a18a27ec3f9942f84265d2a318d.jpg',
'https://img-pa.auto1.com/imgb1/ee/b1ee7c8222f27ca4cbdda0719c980719/pa/YX69957_b8da0c9027f1b4bdd3c50b670cb8c407.jpg',
'https://img-pa.auto1.com/imgb1/ee/b1ee7c8222f27ca4cbdda0719c980719/pa/YX69957_8cdb398eb3ca8ffca63662ed5fde98ba.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72e2b7a6-c34c-53fe-b926-19813eb4a967/72e2b7a6-c34c-53fe-b926-19813eb4a967_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78871,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb1/ee/b1ee7c8222f27ca4cbdda0719c980719/pa/YX69957_b670614b57123cd69ca1ef62bd1015d1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72e2b7a6-c34c-53fe-b926-19813eb4a967/72e2b7a6-c34c-53fe-b926-19813eb4a967_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77301,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb1/ee/b1ee7c8222f27ca4cbdda0719c980719/pa/YX69957_9d4cfc2af33f04954a68dc27083b7886.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72e2b7a6-c34c-53fe-b926-19813eb4a967/72e2b7a6-c34c-53fe-b926-19813eb4a967_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80338,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb1/ee/b1ee7c8222f27ca4cbdda0719c980719/pa/YX69957_51641479ff9a63aaf4cf62c9afe93f8e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72e2b7a6-c34c-53fe-b926-19813eb4a967/72e2b7a6-c34c-53fe-b926-19813eb4a967_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75275,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb1/ee/b1ee7c8222f27ca4cbdda0719c980719/pa/YX69957_516a3a18a27ec3f9942f84265d2a318d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72e2b7a6-c34c-53fe-b926-19813eb4a967/72e2b7a6-c34c-53fe-b926-19813eb4a967_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102691,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb1/ee/b1ee7c8222f27ca4cbdda0719c980719/pa/YX69957_b8da0c9027f1b4bdd3c50b670cb8c407.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72e2b7a6-c34c-53fe-b926-19813eb4a967/72e2b7a6-c34c-53fe-b926-19813eb4a967_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72206,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb1/ee/b1ee7c8222f27ca4cbdda0719c980719/pa/YX69957_8cdb398eb3ca8ffca63662ed5fde98ba.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-04-26',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 206+ 1.1 Urban',
'transmission': 'manual',
'trim': 'Urban',
'year': 2011}
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YX69957%27 HTTP/1.1" 200 None
2026-03-30 08:36:28 [auto1.be] INFO: Saving data for YX69957: {'created_time': 1774859788.024329, 'last_price_update_time': 1774859788.02434, 'auction_closing_time': 1774969494.0}
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YX69957') HTTP/1.1" 204 0
2026-03-30 08:36:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UY40990> (referer: https://www.auto1.com/v1/car-details-view/UY40990/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DA58595> (referer: https://www.auto1.com/v1/car-details-view/DA58595/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd851c950>
2026-03-30 08:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35898f5c-7d84-56b5-bfaf-71a10ee533e7/35898f5c-7d84-56b5-bfaf-71a10ee533e7_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Ffc%252F87fc890996351fd4cdf760e2385c48c7%252Fpa%252FGL14353_bd9070993aaf51c75f76ea9b45c6d2a1.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_bd9070993aaf51c75f76ea9b45c6d2a1.jpg saved to cache
2026-03-30 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 35898f5c-7d84-56b5-bfaf-71a10ee533e7
2026-03-30 08:36:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VP07407> (referer: https://www.auto1.com/v1/car-details-view/VP07407/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PH52818> (referer: https://www.auto1.com/v1/car-details-view/PH52818/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8606ad0>
2026-03-30 08:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25bf27d2-b603-506b-bd64-f9227800eed0/25bf27d2-b603-506b-bd64-f9227800eed0_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fa9%252F39a9f66bf2fd468072f072bb7047cc69%252Fpa%252FTS76065_969cebb838df2f8f74fa9185d5aa8a0c.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_969cebb838df2f8f74fa9185d5aa8a0c.jpg saved to cache
2026-03-30 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 25bf27d2-b603-506b-bd64-f9227800eed0
2026-03-30 08:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8e929d0>
2026-03-30 08:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25bf27d2-b603-506b-bd64-f9227800eed0/25bf27d2-b603-506b-bd64-f9227800eed0_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fa9%252F39a9f66bf2fd468072f072bb7047cc69%252Fpa%252FTS76065_a9644a9cff9d4fa9e40f3c4e622d7851.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_a9644a9cff9d4fa9e40f3c4e622d7851.jpg saved to cache
2026-03-30 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 25bf27d2-b603-506b-bd64-f9227800eed0
2026-03-30 08:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd84b3510>
2026-03-30 08:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31516f29-62a3-5041-a755-30e1c1e5cc7a/31516f29-62a3-5041-a755-30e1c1e5cc7a_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Ff5%252Fa0f59f472f24daf2c6eeec4a0f7d6e0d%252Fpa%252FLW89201_ee01faf6a5c4b78fd5b13b403d4b0ccc.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_ee01faf6a5c4b78fd5b13b403d4b0ccc.jpg saved to cache
2026-03-30 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 31516f29-62a3-5041-a755-30e1c1e5cc7a
2026-03-30 08:36:28 [auto1.be] INFO: Channel: 24h | Page: 6 | totalHits: 1502 | hits on page: 40
2026-03-30 08:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_e4f82cd0809052cbd5bb9b2b19641165.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:28 [auto1.be] INFO: Found listing with ID: YA69116
2026-03-30 08:36:28 [auto1.be] INFO: Found listing with ID: DJ79108
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ79108%27 HTTP/1.1" 200 None
2026-03-30 08:36:28 [auto1.be] INFO: Scrape type for DJ79108: 1
2026-03-30 08:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BC23498/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_ea0488ea57dcecfe611d72f840a6a060.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_01772f8f2e8f774d21d7b865cc0b875a.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_d558032619e2e1047443a8d2dbc2f1e5.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2a762ee-ea46-52c8-85ed-7de128fdbf80 with identifier: UY40990
2026-03-30 08:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2a762ee-ea46-52c8-85ed-7de128fdbf80 with scrape type 1
2026-03-30 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c2a762ee-ea46-52c8-85ed-7de128fdbf80
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fac%252Fbaace6a7b32f44266cb2736a96d41bf2%252Fpa%252FUY40990_875d7d351e5051c79f3deefa5dc4ed0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_875d7d351e5051c79f3deefa5dc4ed0d.jpg not downloaded yet
2026-03-30 08:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f89fc995-08d2-5939-93e9-d932c8bbcea2 with identifier: DA58595
2026-03-30 08:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f89fc995-08d2-5939-93e9-d932c8bbcea2 with scrape type 1
2026-03-30 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f89fc995-08d2-5939-93e9-d932c8bbcea2
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F3b%252F983b5396e7f7881e122eb5d1ab3cae41%252Fpa%252FDA58595_197f309b5b8d3ce0d0b25d2b9023521f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/3b/983b5396e7f7881e122eb5d1ab3cae41/pa/DA58595_197f309b5b8d3ce0d0b25d2b9023521f.jpg already downloaded
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F3b%252F983b5396e7f7881e122eb5d1ab3cae41%252Fpa%252FDA58595_f5f552dca7413dcb39d2986358295943.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/3b/983b5396e7f7881e122eb5d1ab3cae41/pa/DA58595_f5f552dca7413dcb39d2986358295943.jpg already downloaded
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F3b%252F983b5396e7f7881e122eb5d1ab3cae41%252Fpa%252FDA58595_8a11c74658fbc07f028876c419699227.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/3b/983b5396e7f7881e122eb5d1ab3cae41/pa/DA58595_8a11c74658fbc07f028876c419699227.jpg already downloaded
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F3b%252F983b5396e7f7881e122eb5d1ab3cae41%252Fpa%252FDA58595_5587535dc8d366d7bf261a9023db905e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/3b/983b5396e7f7881e122eb5d1ab3cae41/pa/DA58595_5587535dc8d366d7bf261a9023db905e.jpg already downloaded
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F3b%252F983b5396e7f7881e122eb5d1ab3cae41%252Fpa%252FDA58595_81c9c2bbdb729b50bf96cf308056902b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/3b/983b5396e7f7881e122eb5d1ab3cae41/pa/DA58595_81c9c2bbdb729b50bf96cf308056902b.jpg already downloaded
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F3b%252F983b5396e7f7881e122eb5d1ab3cae41%252Fpa%252FDA58595_50a5af14d5cccd6a2feda74350e4eb49.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/3b/983b5396e7f7881e122eb5d1ab3cae41/pa/DA58595_50a5af14d5cccd6a2feda74350e4eb49.jpg already downloaded
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F3b%252F983b5396e7f7881e122eb5d1ab3cae41%252Fpa%252FDA58595_c8955d7ee3f6c68cf6e2226379012365.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/3b/983b5396e7f7881e122eb5d1ab3cae41/pa/DA58595_c8955d7ee3f6c68cf6e2226379012365.jpg already downloaded
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F3b%252F983b5396e7f7881e122eb5d1ab3cae41%252Fpa%252FDA58595_81608636c2beefd5acf44898d717b5d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/3b/983b5396e7f7881e122eb5d1ab3cae41/pa/DA58595_81608636c2beefd5acf44898d717b5d5.jpg already downloaded
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F3b%252F983b5396e7f7881e122eb5d1ab3cae41%252Fpa%252FDA58595_fea709937292175d25e43c0eb24fccc1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/3b/983b5396e7f7881e122eb5d1ab3cae41/pa/DA58595_fea709937292175d25e43c0eb24fccc1.jpg already downloaded
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F3b%252F983b5396e7f7881e122eb5d1ab3cae41%252Fpa%252FDA58595_411b5de005fb598768a70fc06492b713.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/3b/983b5396e7f7881e122eb5d1ab3cae41/pa/DA58595_411b5de005fb598768a70fc06492b713.jpg already downloaded
2026-03-30 08:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f89fc995-08d2-5939-93e9-d932c8bbcea2, identifier: DA58595
2026-03-30 08:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdcb8bcf-401b-5502-9a32-c6366b81df73 with identifier: VP07407
2026-03-30 08:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdcb8bcf-401b-5502-9a32-c6366b81df73 with scrape type 1
2026-03-30 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bdcb8bcf-401b-5502-9a32-c6366b81df73
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9e%252F9b9e4ec55910e9adf550681565e2a646%252Fpa%252FVP07407_d0954d9ee73b043cde5139892b6b7bb1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9e/9b9e4ec55910e9adf550681565e2a646/pa/VP07407_d0954d9ee73b043cde5139892b6b7bb1.jpg already downloaded
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9e%252F9b9e4ec55910e9adf550681565e2a646%252Fpa%252FVP07407_bf9068846d444f978762bede4d18428e.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9e/9b9e4ec55910e9adf550681565e2a646/pa/VP07407_bf9068846d444f978762bede4d18428e.jpg already downloaded
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9e%252F9b9e4ec55910e9adf550681565e2a646%252Fpa%252FVP07407_c1e81a909e41efa7b5b551fbe9d43ff7.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9e/9b9e4ec55910e9adf550681565e2a646/pa/VP07407_c1e81a909e41efa7b5b551fbe9d43ff7.jpg already downloaded
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9e%252F9b9e4ec55910e9adf550681565e2a646%252Fpa%252FVP07407_8371fe77b337bf92b930c40cdd1d16d4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9e/9b9e4ec55910e9adf550681565e2a646/pa/VP07407_8371fe77b337bf92b930c40cdd1d16d4.jpg already downloaded
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9e%252F9b9e4ec55910e9adf550681565e2a646%252Fpa%252FVP07407_547729eada02baaa20066346a9e6decc.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9e/9b9e4ec55910e9adf550681565e2a646/pa/VP07407_547729eada02baaa20066346a9e6decc.jpg already downloaded
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9e%252F9b9e4ec55910e9adf550681565e2a646%252Fpa%252FVP07407_2345957d89b499838fb82c1e287d15e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9e/9b9e4ec55910e9adf550681565e2a646/pa/VP07407_2345957d89b499838fb82c1e287d15e9.jpg already downloaded
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9e%252F9b9e4ec55910e9adf550681565e2a646%252Fpa%252FVP07407_103a701f6a005241ccf43eea70e696a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9e/9b9e4ec55910e9adf550681565e2a646/pa/VP07407_103a701f6a005241ccf43eea70e696a6.jpg already downloaded
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9e%252F9b9e4ec55910e9adf550681565e2a646%252Fpa%252FVP07407_04f7a90f2091663694730332636b2bf3.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9e/9b9e4ec55910e9adf550681565e2a646/pa/VP07407_04f7a90f2091663694730332636b2bf3.jpg already downloaded
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9e%252F9b9e4ec55910e9adf550681565e2a646%252Fpa%252FVP07407_8430be7792ab690f27176f907844972d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9e/9b9e4ec55910e9adf550681565e2a646/pa/VP07407_8430be7792ab690f27176f907844972d.jpg already downloaded
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F9e%252F9b9e4ec55910e9adf550681565e2a646%252Fpa%252FVP07407_4f04bb77b012b840afe99860a9227efb.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/9e/9b9e4ec55910e9adf550681565e2a646/pa/VP07407_4f04bb77b012b840afe99860a9227efb.jpg already downloaded
2026-03-30 08:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bdcb8bcf-401b-5502-9a32-c6366b81df73, identifier: VP07407
2026-03-30 08:36:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: badad0ba-34bc-5670-8e24-40ca4661e630 with identifier: PH52818
2026-03-30 08:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item badad0ba-34bc-5670-8e24-40ca4661e630 with scrape type 1
2026-03-30 08:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item badad0ba-34bc-5670-8e24-40ca4661e630
2026-03-30 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F46%252Ffa462ad004367c17a441e4738608a497%252Fpa%252FPH52818_a73426825f306636264f2665634f6c0a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_a73426825f306636264f2665634f6c0a.jpg not downloaded yet
2026-03-30 08:36:29 [auto1.be] INFO: Found listing with ID: LM02594
2026-03-30 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM02594%27 HTTP/1.1" 200 None
2026-03-30 08:36:29 [auto1.be] INFO: Scrape type for LM02594: 2
2026-03-30 08:36:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cea52d7-237f-58b6-b1b7-f8daf23514a3 with identifier: LM02594
2026-03-30 08:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cea52d7-237f-58b6-b1b7-f8daf23514a3 with scrape type 2
2026-03-30 08:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cea52d7-237f-58b6-b1b7-f8daf23514a3 with scrape type 2
2026-03-30 08:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8cea52d7-237f-58b6-b1b7-f8daf23514a3, identifier: LM02594
2026-03-30 08:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f89fc995-08d2-5939-93e9-d932c8bbcea2 with identifier: DA58595
2026-03-30 08:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f89fc995-08d2-5939-93e9-d932c8bbcea2 with identifier: DA58595
2026-03-30 08:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f89fc995-08d2-5939-93e9-d932c8bbcea2 with identifier: DA58595 to the API
2026-03-30 08:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DA58595>
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6B',
'engine': '1.6L',
'engine_horse_power': 100,
'expiration_date': '2026-03-31T15:51:04Z',
'fuel_type': 'diesel',
'id': 'f89fc995-08d2-5939-93e9-d932c8bbcea2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA58595',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 56430,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img98/3b/983b5396e7f7881e122eb5d1ab3cae41/pa/DA58595_197f309b5b8d3ce0d0b25d2b9023521f.jpg',
'https://img-pa.auto1.com/img98/3b/983b5396e7f7881e122eb5d1ab3cae41/pa/DA58595_f5f552dca7413dcb39d2986358295943.jpg',
'https://img-pa.auto1.com/img98/3b/983b5396e7f7881e122eb5d1ab3cae41/pa/DA58595_8a11c74658fbc07f028876c419699227.jpg',
'https://img-pa.auto1.com/img98/3b/983b5396e7f7881e122eb5d1ab3cae41/pa/DA58595_5587535dc8d366d7bf261a9023db905e.jpg',
'https://img-pa.auto1.com/img98/3b/983b5396e7f7881e122eb5d1ab3cae41/pa/DA58595_81c9c2bbdb729b50bf96cf308056902b.jpg',
'https://img-pa.auto1.com/img98/3b/983b5396e7f7881e122eb5d1ab3cae41/pa/DA58595_50a5af14d5cccd6a2feda74350e4eb49.jpg',
'https://img-pa.auto1.com/img98/3b/983b5396e7f7881e122eb5d1ab3cae41/pa/DA58595_c8955d7ee3f6c68cf6e2226379012365.jpg',
'https://img-pa.auto1.com/img98/3b/983b5396e7f7881e122eb5d1ab3cae41/pa/DA58595_81608636c2beefd5acf44898d717b5d5.jpg',
'https://img-pa.auto1.com/img98/3b/983b5396e7f7881e122eb5d1ab3cae41/pa/DA58595_fea709937292175d25e43c0eb24fccc1.jpg',
'https://img-pa.auto1.com/img98/3b/983b5396e7f7881e122eb5d1ab3cae41/pa/DA58595_411b5de005fb598768a70fc06492b713.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89fc995-08d2-5939-93e9-d932c8bbcea2/f89fc995-08d2-5939-93e9-d932c8bbcea2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71533,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/3b/983b5396e7f7881e122eb5d1ab3cae41/pa/DA58595_197f309b5b8d3ce0d0b25d2b9023521f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89fc995-08d2-5939-93e9-d932c8bbcea2/f89fc995-08d2-5939-93e9-d932c8bbcea2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64701,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/3b/983b5396e7f7881e122eb5d1ab3cae41/pa/DA58595_f5f552dca7413dcb39d2986358295943.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89fc995-08d2-5939-93e9-d932c8bbcea2/f89fc995-08d2-5939-93e9-d932c8bbcea2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75110,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/3b/983b5396e7f7881e122eb5d1ab3cae41/pa/DA58595_8a11c74658fbc07f028876c419699227.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89fc995-08d2-5939-93e9-d932c8bbcea2/f89fc995-08d2-5939-93e9-d932c8bbcea2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64077,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/3b/983b5396e7f7881e122eb5d1ab3cae41/pa/DA58595_5587535dc8d366d7bf261a9023db905e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89fc995-08d2-5939-93e9-d932c8bbcea2/f89fc995-08d2-5939-93e9-d932c8bbcea2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58144,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/3b/983b5396e7f7881e122eb5d1ab3cae41/pa/DA58595_81c9c2bbdb729b50bf96cf308056902b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89fc995-08d2-5939-93e9-d932c8bbcea2/f89fc995-08d2-5939-93e9-d932c8bbcea2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61909,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/3b/983b5396e7f7881e122eb5d1ab3cae41/pa/DA58595_50a5af14d5cccd6a2feda74350e4eb49.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89fc995-08d2-5939-93e9-d932c8bbcea2/f89fc995-08d2-5939-93e9-d932c8bbcea2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72261,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/3b/983b5396e7f7881e122eb5d1ab3cae41/pa/DA58595_c8955d7ee3f6c68cf6e2226379012365.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89fc995-08d2-5939-93e9-d932c8bbcea2/f89fc995-08d2-5939-93e9-d932c8bbcea2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66663,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/3b/983b5396e7f7881e122eb5d1ab3cae41/pa/DA58595_81608636c2beefd5acf44898d717b5d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89fc995-08d2-5939-93e9-d932c8bbcea2/f89fc995-08d2-5939-93e9-d932c8bbcea2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60790,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/3b/983b5396e7f7881e122eb5d1ab3cae41/pa/DA58595_fea709937292175d25e43c0eb24fccc1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f89fc995-08d2-5939-93e9-d932c8bbcea2/f89fc995-08d2-5939-93e9-d932c8bbcea2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80840,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/3b/983b5396e7f7881e122eb5d1ab3cae41/pa/DA58595_411b5de005fb598768a70fc06492b713.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-01-02',
'seats_number': 3,
'seller_name': None,
'title': 'Citroen Berlingo 1.6 Blue-HDi Business L1',
'transmission': 'manual',
'trim': 'Business L1',
'year': 2018}
2026-03-30 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DA58595%27 HTTP/1.1" 200 None
2026-03-30 08:36:29 [auto1.be] INFO: Saving data for DA58595: {'created_time': 1774859789.521846, 'last_price_update_time': 1774859789.521857, 'auction_closing_time': 1774972264.0}
2026-03-30 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DA58595') HTTP/1.1" 204 0
2026-03-30 08:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bdcb8bcf-401b-5502-9a32-c6366b81df73 with identifier: VP07407
2026-03-30 08:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bdcb8bcf-401b-5502-9a32-c6366b81df73 with identifier: VP07407
2026-03-30 08:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bdcb8bcf-401b-5502-9a32-c6366b81df73 with identifier: VP07407 to the API
2026-03-30 08:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VP07407>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 140,
'expiration_date': '2026-03-31T15:50:54Z',
'fuel_type': 'petrol',
'id': 'bdcb8bcf-401b-5502-9a32-c6366b81df73',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP07407',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'BMW',
'model': 'X2',
'odometer': 140027,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img9b/9e/9b9e4ec55910e9adf550681565e2a646/pa/VP07407_d0954d9ee73b043cde5139892b6b7bb1.jpg',
'https://img-pa.auto1.com/img9b/9e/9b9e4ec55910e9adf550681565e2a646/pa/VP07407_bf9068846d444f978762bede4d18428e.jpg',
'https://img-pa.auto1.com/img9b/9e/9b9e4ec55910e9adf550681565e2a646/pa/VP07407_c1e81a909e41efa7b5b551fbe9d43ff7.jpg',
'https://img-pa.auto1.com/img9b/9e/9b9e4ec55910e9adf550681565e2a646/pa/VP07407_8371fe77b337bf92b930c40cdd1d16d4.jpg',
'https://img-pa.auto1.com/img9b/9e/9b9e4ec55910e9adf550681565e2a646/pa/VP07407_547729eada02baaa20066346a9e6decc.jpg',
'https://img-pa.auto1.com/img9b/9e/9b9e4ec55910e9adf550681565e2a646/pa/VP07407_2345957d89b499838fb82c1e287d15e9.jpg',
'https://img-pa.auto1.com/img9b/9e/9b9e4ec55910e9adf550681565e2a646/pa/VP07407_103a701f6a005241ccf43eea70e696a6.jpg',
'https://img-pa.auto1.com/img9b/9e/9b9e4ec55910e9adf550681565e2a646/pa/VP07407_04f7a90f2091663694730332636b2bf3.jpg',
'https://img-pa.auto1.com/img9b/9e/9b9e4ec55910e9adf550681565e2a646/pa/VP07407_8430be7792ab690f27176f907844972d.jpg',
'https://img-pa.auto1.com/img9b/9e/9b9e4ec55910e9adf550681565e2a646/pa/VP07407_4f04bb77b012b840afe99860a9227efb.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdcb8bcf-401b-5502-9a32-c6366b81df73/bdcb8bcf-401b-5502-9a32-c6366b81df73_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3775548,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9b/9e/9b9e4ec55910e9adf550681565e2a646/pa/VP07407_d0954d9ee73b043cde5139892b6b7bb1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdcb8bcf-401b-5502-9a32-c6366b81df73/bdcb8bcf-401b-5502-9a32-c6366b81df73_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3546191,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9b/9e/9b9e4ec55910e9adf550681565e2a646/pa/VP07407_bf9068846d444f978762bede4d18428e.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdcb8bcf-401b-5502-9a32-c6366b81df73/bdcb8bcf-401b-5502-9a32-c6366b81df73_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3223955,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9b/9e/9b9e4ec55910e9adf550681565e2a646/pa/VP07407_c1e81a909e41efa7b5b551fbe9d43ff7.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdcb8bcf-401b-5502-9a32-c6366b81df73/bdcb8bcf-401b-5502-9a32-c6366b81df73_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3611661,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9b/9e/9b9e4ec55910e9adf550681565e2a646/pa/VP07407_8371fe77b337bf92b930c40cdd1d16d4.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdcb8bcf-401b-5502-9a32-c6366b81df73/bdcb8bcf-401b-5502-9a32-c6366b81df73_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3381981,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9b/9e/9b9e4ec55910e9adf550681565e2a646/pa/VP07407_547729eada02baaa20066346a9e6decc.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdcb8bcf-401b-5502-9a32-c6366b81df73/bdcb8bcf-401b-5502-9a32-c6366b81df73_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3424642,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9b/9e/9b9e4ec55910e9adf550681565e2a646/pa/VP07407_2345957d89b499838fb82c1e287d15e9.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdcb8bcf-401b-5502-9a32-c6366b81df73/bdcb8bcf-401b-5502-9a32-c6366b81df73_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86417,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/9e/9b9e4ec55910e9adf550681565e2a646/pa/VP07407_103a701f6a005241ccf43eea70e696a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdcb8bcf-401b-5502-9a32-c6366b81df73/bdcb8bcf-401b-5502-9a32-c6366b81df73_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110076,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/9e/9b9e4ec55910e9adf550681565e2a646/pa/VP07407_04f7a90f2091663694730332636b2bf3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdcb8bcf-401b-5502-9a32-c6366b81df73/bdcb8bcf-401b-5502-9a32-c6366b81df73_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3792602,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img9b/9e/9b9e4ec55910e9adf550681565e2a646/pa/VP07407_8430be7792ab690f27176f907844972d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdcb8bcf-401b-5502-9a32-c6366b81df73/bdcb8bcf-401b-5502-9a32-c6366b81df73_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58583,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/9e/9b9e4ec55910e9adf550681565e2a646/pa/VP07407_4f04bb77b012b840afe99860a9227efb.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-07-23',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X2 sDrive 18i',
'transmission': 'automatic',
'trim': '',
'year': 2020}
2026-03-30 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP07407%27 HTTP/1.1" 200 None
2026-03-30 08:36:29 [auto1.be] INFO: Saving data for VP07407: {'created_time': 1774859789.876122, 'last_price_update_time': 1774859789.876133, 'auction_closing_time': 1774972254.0}
2026-03-30 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VP07407') HTTP/1.1" 204 0
2026-03-30 08:36:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_ac4fe7fa6c2b839dc282c824edf6c66c.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8cea52d7-237f-58b6-b1b7-f8daf23514a3 with identifier: LM02594
2026-03-30 08:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8cea52d7-237f-58b6-b1b7-f8daf23514a3 with identifier: LM02594
2026-03-30 08:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8cea52d7-237f-58b6-b1b7-f8daf23514a3 with identifier: LM02594 to the API
2026-03-30 08:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:52:32Z',
'fuel_type': 'diesel',
'id': '8cea52d7-237f-58b6-b1b7-f8daf23514a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM02594',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 164267,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-05',
'seller_name': None,
'title': 'Audi A6 2.0 TDI Ultra',
'transmission': 'automatic',
'trim': 'Ultra',
'year': 2017}
2026-03-30 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM02594%27 HTTP/1.1" 200 None
2026-03-30 08:36:30 [auto1.be] INFO: Saving data for LM02594: {'auction_closing_time': 1774972352.0, 'created_time': 1773384064.269949, 'last_price_update_time': 1774859790.221135}
2026-03-30 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LM02594') HTTP/1.1" 204 0
2026-03-30 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fac%252Fbaace6a7b32f44266cb2736a96d41bf2%252Fpa%252FUY40990_79ce91d34c65a1ec7157bcd35964077c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_79ce91d34c65a1ec7157bcd35964077c.jpg not downloaded yet
2026-03-30 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F46%252Ffa462ad004367c17a441e4738608a497%252Fpa%252FPH52818_7cd7cfd1b7b3ffbffbe4287db341d5c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_7cd7cfd1b7b3ffbffbe4287db341d5c0.jpg not downloaded yet
2026-03-30 08:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/71/4871b017ef3d1ac588a1117fac31231f/pa/WR16749_eebab2358408f2223a0c2c001d027c9c.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_482bbfd08149878604ff1c1a655d2894.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:30 [auto1.be] INFO: Found listing with ID: ER70694
2026-03-30 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER70694%27 HTTP/1.1" 200 None
2026-03-30 08:36:30 [auto1.be] INFO: Scrape type for ER70694: 1
2026-03-30 08:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CM92821> (referer: https://www.auto1.com/v1/car-details-view/CM92821/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd858f250>
2026-03-30 08:36:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35898f5c-7d84-56b5-bfaf-71a10ee533e7/35898f5c-7d84-56b5-bfaf-71a10ee533e7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Ffc%252F87fc890996351fd4cdf760e2385c48c7%252Fpa%252FGL14353_e4f82cd0809052cbd5bb9b2b19641165.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_e4f82cd0809052cbd5bb9b2b19641165.jpg saved to cache
2026-03-30 08:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 35898f5c-7d84-56b5-bfaf-71a10ee533e7
2026-03-30 08:36:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 35898f5c-7d84-56b5-bfaf-71a10ee533e7, skipping ID generation
2026-03-30 08:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35898f5c-7d84-56b5-bfaf-71a10ee533e7 with scrape type 1
2026-03-30 08:36:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 35898f5c-7d84-56b5-bfaf-71a10ee533e7 sending to next pipeline
2026-03-30 08:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 35898f5c-7d84-56b5-bfaf-71a10ee533e7, identifier: GL14353
2026-03-30 08:36:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd85d1f50>
2026-03-30 08:36:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25bf27d2-b603-506b-bd64-f9227800eed0/25bf27d2-b603-506b-bd64-f9227800eed0_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fa9%252F39a9f66bf2fd468072f072bb7047cc69%252Fpa%252FTS76065_ea0488ea57dcecfe611d72f840a6a060.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_ea0488ea57dcecfe611d72f840a6a060.jpg saved to cache
2026-03-30 08:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 25bf27d2-b603-506b-bd64-f9227800eed0
2026-03-30 08:36:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd841c710>
2026-03-30 08:36:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31516f29-62a3-5041-a755-30e1c1e5cc7a/31516f29-62a3-5041-a755-30e1c1e5cc7a_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Ff5%252Fa0f59f472f24daf2c6eeec4a0f7d6e0d%252Fpa%252FLW89201_01772f8f2e8f774d21d7b865cc0b875a.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_01772f8f2e8f774d21d7b865cc0b875a.jpg saved to cache
2026-03-30 08:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 31516f29-62a3-5041-a755-30e1c1e5cc7a
2026-03-30 08:36:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd85b4090>
2026-03-30 08:36:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25bf27d2-b603-506b-bd64-f9227800eed0/25bf27d2-b603-506b-bd64-f9227800eed0_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252Fa9%252F39a9f66bf2fd468072f072bb7047cc69%252Fpa%252FTS76065_d558032619e2e1047443a8d2dbc2f1e5.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_d558032619e2e1047443a8d2dbc2f1e5.jpg saved to cache
2026-03-30 08:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 25bf27d2-b603-506b-bd64-f9227800eed0
2026-03-30 08:36:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 25bf27d2-b603-506b-bd64-f9227800eed0, skipping ID generation
2026-03-30 08:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25bf27d2-b603-506b-bd64-f9227800eed0 with scrape type 1
2026-03-30 08:36:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 25bf27d2-b603-506b-bd64-f9227800eed0 sending to next pipeline
2026-03-30 08:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 25bf27d2-b603-506b-bd64-f9227800eed0, identifier: TS76065
2026-03-30 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fac%252Fbaace6a7b32f44266cb2736a96d41bf2%252Fpa%252FUY40990_46ef7f59d7eab456a305776565b7f844.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_46ef7f59d7eab456a305776565b7f844.jpg not downloaded yet
2026-03-30 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F46%252Ffa462ad004367c17a441e4738608a497%252Fpa%252FPH52818_c29a2a985f796278d01f956a93455dab.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_c29a2a985f796278d01f956a93455dab.jpg not downloaded yet
2026-03-30 08:36:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 35898f5c-7d84-56b5-bfaf-71a10ee533e7 with identifier: GL14353
2026-03-30 08:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 35898f5c-7d84-56b5-bfaf-71a10ee533e7 with identifier: GL14353
2026-03-30 08:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 35898f5c-7d84-56b5-bfaf-71a10ee533e7 with identifier: GL14353 to the API
2026-03-30 08:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_e4f82cd0809052cbd5bb9b2b19641165.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 292,
'expiration_date': '2026-03-31T15:36:19Z',
'fuel_type': 'hybrid',
'id': '35898f5c-7d84-56b5-bfaf-71a10ee533e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL14353',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'BMW',
'model': 'X3',
'odometer': 124321,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35898f5c-7d84-56b5-bfaf-71a10ee533e7/35898f5c-7d84-56b5-bfaf-71a10ee533e7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69405,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_e4f82cd0809052cbd5bb9b2b19641165.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35898f5c-7d84-56b5-bfaf-71a10ee533e7/35898f5c-7d84-56b5-bfaf-71a10ee533e7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68661,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_654775b5c1ccb34b72f0072bdceeaeaf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35898f5c-7d84-56b5-bfaf-71a10ee533e7/35898f5c-7d84-56b5-bfaf-71a10ee533e7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65516,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_78d8adbf4b6cb781e41b3ae443224cc4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35898f5c-7d84-56b5-bfaf-71a10ee533e7/35898f5c-7d84-56b5-bfaf-71a10ee533e7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58210,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_d9cd27f829150e0d88edc034e9a84d5a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35898f5c-7d84-56b5-bfaf-71a10ee533e7/35898f5c-7d84-56b5-bfaf-71a10ee533e7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55354,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_bd9070993aaf51c75f76ea9b45c6d2a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35898f5c-7d84-56b5-bfaf-71a10ee533e7/35898f5c-7d84-56b5-bfaf-71a10ee533e7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69707,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_9698c4eb64b846c8d9ddb3d681962198.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35898f5c-7d84-56b5-bfaf-71a10ee533e7/35898f5c-7d84-56b5-bfaf-71a10ee533e7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55707,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_539de9d7234e010f59ef2b44f2ab29a2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35898f5c-7d84-56b5-bfaf-71a10ee533e7/35898f5c-7d84-56b5-bfaf-71a10ee533e7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74820,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_a7e2b5473d6e51a23320031fb2f4c96f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35898f5c-7d84-56b5-bfaf-71a10ee533e7/35898f5c-7d84-56b5-bfaf-71a10ee533e7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62951,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_3831cacfce6a0be6d0b0ed989c1f484d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35898f5c-7d84-56b5-bfaf-71a10ee533e7/35898f5c-7d84-56b5-bfaf-71a10ee533e7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67940,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img87/fc/87fc890996351fd4cdf760e2385c48c7/pa/GL14353_e04902a4f0c4755e535c56aa851a1a8e.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2020-12-15',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X3 xDrive 30e M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2020}
2026-03-30 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GL14353%27 HTTP/1.1" 200 None
2026-03-30 08:36:31 [auto1.be] INFO: Saving data for GL14353: {'created_time': 1774859791.572985, 'last_price_update_time': 1774859791.572996, 'auction_closing_time': 1774971379.0}
2026-03-30 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GL14353') HTTP/1.1" 204 0
2026-03-30 08:36:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 25bf27d2-b603-506b-bd64-f9227800eed0 with identifier: TS76065
2026-03-30 08:36:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 25bf27d2-b603-506b-bd64-f9227800eed0 with identifier: TS76065
2026-03-30 08:36:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 25bf27d2-b603-506b-bd64-f9227800eed0 with identifier: TS76065 to the API
2026-03-30 08:36:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_d558032619e2e1047443a8d2dbc2f1e5.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 258,
'expiration_date': '2026-03-31T15:52:08Z',
'fuel_type': 'diesel',
'id': '25bf27d2-b603-506b-bd64-f9227800eed0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS76065',
'listing': 'auction',
'location': 'BE',
'make': 'Land Rover',
'model': 'Range Rover Sport',
'odometer': 262862,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25bf27d2-b603-506b-bd64-f9227800eed0/25bf27d2-b603-506b-bd64-f9227800eed0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3239222,
'Height': 3024,
'OriginUrl': 'https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_0e90b3d51506fdbf10b61038da2c8a34.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25bf27d2-b603-506b-bd64-f9227800eed0/25bf27d2-b603-506b-bd64-f9227800eed0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100108,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_a55c8a1403c87c07797d0040a0f72909.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25bf27d2-b603-506b-bd64-f9227800eed0/25bf27d2-b603-506b-bd64-f9227800eed0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97920,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_d91a7ae3ab836fa7ba0b57b31bbd61b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25bf27d2-b603-506b-bd64-f9227800eed0/25bf27d2-b603-506b-bd64-f9227800eed0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75680,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_919fc805679ebc8a973a09dbee08a406.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25bf27d2-b603-506b-bd64-f9227800eed0/25bf27d2-b603-506b-bd64-f9227800eed0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101483,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_d558032619e2e1047443a8d2dbc2f1e5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25bf27d2-b603-506b-bd64-f9227800eed0/25bf27d2-b603-506b-bd64-f9227800eed0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101283,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_ea0488ea57dcecfe611d72f840a6a060.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25bf27d2-b603-506b-bd64-f9227800eed0/25bf27d2-b603-506b-bd64-f9227800eed0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94639,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_a9644a9cff9d4fa9e40f3c4e622d7851.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25bf27d2-b603-506b-bd64-f9227800eed0/25bf27d2-b603-506b-bd64-f9227800eed0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117066,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_e103a8c54f665b068b783b60d566a7b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25bf27d2-b603-506b-bd64-f9227800eed0/25bf27d2-b603-506b-bd64-f9227800eed0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82577,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_969cebb838df2f8f74fa9185d5aa8a0c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25bf27d2-b603-506b-bd64-f9227800eed0/25bf27d2-b603-506b-bd64-f9227800eed0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92952,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img39/a9/39a9f66bf2fd468072f072bb7047cc69/pa/TS76065_0a5e2a0c766fe42ae7f52cd21ded1589.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-01-20',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Range Rover Sport 3.0 TD V6 HSE Dynamic',
'transmission': 'automatic',
'trim': 'HSE Dynamic',
'year': 2016}
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS76065%27 HTTP/1.1" 200 None
2026-03-30 08:36:32 [auto1.be] INFO: Saving data for TS76065: {'created_time': 1774859792.061848, 'last_price_update_time': 1774859792.061859, 'auction_closing_time': 1774972328.0}
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TS76065') HTTP/1.1" 204 0
2026-03-30 08:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_710aae4a639b52e1c30cc38f4ac06d38.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:32 [auto1.be] INFO: Found listing with ID: UK31480
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UK31480%27 HTTP/1.1" 200 None
2026-03-30 08:36:32 [auto1.be] INFO: Scrape type for UK31480: 1
2026-03-30 08:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8f927d0>
2026-03-30 08:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31516f29-62a3-5041-a755-30e1c1e5cc7a/31516f29-62a3-5041-a755-30e1c1e5cc7a_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Ff5%252Fa0f59f472f24daf2c6eeec4a0f7d6e0d%252Fpa%252FLW89201_ac4fe7fa6c2b839dc282c824edf6c66c.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_ac4fe7fa6c2b839dc282c824edf6c66c.jpg saved to cache
2026-03-30 08:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 31516f29-62a3-5041-a755-30e1c1e5cc7a
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fac%252Fbaace6a7b32f44266cb2736a96d41bf2%252Fpa%252FUY40990_bda9b10a961b6f12d3e7568f230f0c15.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_bda9b10a961b6f12d3e7568f230f0c15.jpg not downloaded yet
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F46%252Ffa462ad004367c17a441e4738608a497%252Fpa%252FPH52818_132aaac6ea4ed81e88374a876a920c92.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_132aaac6ea4ed81e88374a876a920c92.jpg not downloaded yet
2026-03-30 08:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd85e7650>
2026-03-30 08:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ff26a08-fa0d-58f0-9fdb-878cb60d7f63/2ff26a08-fa0d-58f0-9fdb-878cb60d7f63_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F71%252F4871b017ef3d1ac588a1117fac31231f%252Fpa%252FWR16749_eebab2358408f2223a0c2c001d027c9c.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/71/4871b017ef3d1ac588a1117fac31231f/pa/WR16749_eebab2358408f2223a0c2c001d027c9c.jpg saved to cache
2026-03-30 08:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2ff26a08-fa0d-58f0-9fdb-878cb60d7f63
2026-03-30 08:36:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2ff26a08-fa0d-58f0-9fdb-878cb60d7f63, skipping ID generation
2026-03-30 08:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ff26a08-fa0d-58f0-9fdb-878cb60d7f63 with scrape type 1
2026-03-30 08:36:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2ff26a08-fa0d-58f0-9fdb-878cb60d7f63 sending to next pipeline
2026-03-30 08:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2ff26a08-fa0d-58f0-9fdb-878cb60d7f63, identifier: WR16749
2026-03-30 08:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd84a1b50>
2026-03-30 08:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31516f29-62a3-5041-a755-30e1c1e5cc7a/31516f29-62a3-5041-a755-30e1c1e5cc7a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Ff5%252Fa0f59f472f24daf2c6eeec4a0f7d6e0d%252Fpa%252FLW89201_482bbfd08149878604ff1c1a655d2894.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_482bbfd08149878604ff1c1a655d2894.jpg saved to cache
2026-03-30 08:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 31516f29-62a3-5041-a755-30e1c1e5cc7a
2026-03-30 08:36:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c423a61-8fc8-563b-8be0-f24416a8f6db with identifier: CM92821
2026-03-30 08:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c423a61-8fc8-563b-8be0-f24416a8f6db with scrape type 1
2026-03-30 08:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8c423a61-8fc8-563b-8be0-f24416a8f6db
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F51%252F9751e5ade3113c390573e72c8465ec4c%252Fpa%252FCM92821_6473917662e6751d01f424c017d7104b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/51/9751e5ade3113c390573e72c8465ec4c/pa/CM92821_6473917662e6751d01f424c017d7104b.jpg already downloaded
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F51%252F9751e5ade3113c390573e72c8465ec4c%252Fpa%252FCM92821_3ee39f34bfa9cb88d2262d66d716e432.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/51/9751e5ade3113c390573e72c8465ec4c/pa/CM92821_3ee39f34bfa9cb88d2262d66d716e432.jpg already downloaded
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F51%252F9751e5ade3113c390573e72c8465ec4c%252Fpa%252FCM92821_7f700bf877919884ccc4450b05277ecc.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/51/9751e5ade3113c390573e72c8465ec4c/pa/CM92821_7f700bf877919884ccc4450b05277ecc.jpg already downloaded
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F51%252F9751e5ade3113c390573e72c8465ec4c%252Fpa%252FCM92821_f95a061b43116a40abe52b7963f2ac13.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/51/9751e5ade3113c390573e72c8465ec4c/pa/CM92821_f95a061b43116a40abe52b7963f2ac13.jpg already downloaded
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F51%252F9751e5ade3113c390573e72c8465ec4c%252Fpa%252FCM92821_a195a16e37cb22707bf521ffaba2cd81.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/51/9751e5ade3113c390573e72c8465ec4c/pa/CM92821_a195a16e37cb22707bf521ffaba2cd81.jpg already downloaded
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F51%252F9751e5ade3113c390573e72c8465ec4c%252Fpa%252FCM92821_cd6514770033386d4433a1df6e634bde.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/51/9751e5ade3113c390573e72c8465ec4c/pa/CM92821_cd6514770033386d4433a1df6e634bde.jpg already downloaded
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F51%252F9751e5ade3113c390573e72c8465ec4c%252Fpa%252FCM92821_5c6f8465b529fde95fe13f590015294f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/51/9751e5ade3113c390573e72c8465ec4c/pa/CM92821_5c6f8465b529fde95fe13f590015294f.jpg already downloaded
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F51%252F9751e5ade3113c390573e72c8465ec4c%252Fpa%252FCM92821_e3515978c5b776692a8a792716d0dc26.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/51/9751e5ade3113c390573e72c8465ec4c/pa/CM92821_e3515978c5b776692a8a792716d0dc26.jpg already downloaded
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F51%252F9751e5ade3113c390573e72c8465ec4c%252Fpa%252FCM92821_0eb56cb8675252bcb04dc0361aaea6fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/51/9751e5ade3113c390573e72c8465ec4c/pa/CM92821_0eb56cb8675252bcb04dc0361aaea6fa.jpg already downloaded
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252F51%252F9751e5ade3113c390573e72c8465ec4c%252Fpa%252FCM92821_143522cbc38592e36ae8c1a4f8eb40e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/51/9751e5ade3113c390573e72c8465ec4c/pa/CM92821_143522cbc38592e36ae8c1a4f8eb40e9.jpg already downloaded
2026-03-30 08:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8c423a61-8fc8-563b-8be0-f24416a8f6db, identifier: CM92821
2026-03-30 08:36:32 [auto1.be] INFO: Found listing with ID: CN63024
2026-03-30 08:36:32 [auto1.be] INFO: Found listing with ID: CP45384
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP45384%27 HTTP/1.1" 200 None
2026-03-30 08:36:32 [auto1.be] INFO: Scrape type for CP45384: 2
2026-03-30 08:36:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aeeb539e-b277-507f-b39c-643e85304586 with identifier: CP45384
2026-03-30 08:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aeeb539e-b277-507f-b39c-643e85304586 with scrape type 2
2026-03-30 08:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aeeb539e-b277-507f-b39c-643e85304586 with scrape type 2
2026-03-30 08:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: aeeb539e-b277-507f-b39c-643e85304586, identifier: CP45384
2026-03-30 08:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GG54325/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DA89043/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RD04523/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YW02361> (referer: https://www.auto1.com/v1/car-details-view/YW02361/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JC64183> (referer: https://www.auto1.com/v1/car-details-view/JC64183/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2ff26a08-fa0d-58f0-9fdb-878cb60d7f63 with identifier: WR16749
2026-03-30 08:36:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2ff26a08-fa0d-58f0-9fdb-878cb60d7f63 with identifier: WR16749
2026-03-30 08:36:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2ff26a08-fa0d-58f0-9fdb-878cb60d7f63 with identifier: WR16749 to the API
2026-03-30 08:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img48/71/4871b017ef3d1ac588a1117fac31231f/pa/WR16749_eebab2358408f2223a0c2c001d027c9c.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 143,
'expiration_date': '2026-03-31T15:59:47Z',
'fuel_type': 'diesel',
'id': '2ff26a08-fa0d-58f0-9fdb-878cb60d7f63',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR16749',
'listing': 'auction',
'location': 'BE, Hasselt',
'make': 'BMW',
'model': '1er',
'odometer': 160242,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ff26a08-fa0d-58f0-9fdb-878cb60d7f63/2ff26a08-fa0d-58f0-9fdb-878cb60d7f63_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75560,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/71/4871b017ef3d1ac588a1117fac31231f/pa/WR16749_68b3b1efc3023ccf0db122064e1756e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ff26a08-fa0d-58f0-9fdb-878cb60d7f63/2ff26a08-fa0d-58f0-9fdb-878cb60d7f63_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69693,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/71/4871b017ef3d1ac588a1117fac31231f/pa/WR16749_a5c32ce1797b6ef73daf9579dda06c7f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ff26a08-fa0d-58f0-9fdb-878cb60d7f63/2ff26a08-fa0d-58f0-9fdb-878cb60d7f63_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76066,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/71/4871b017ef3d1ac588a1117fac31231f/pa/WR16749_5a169cda44f4ed1546a4c1ac9ccec5f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ff26a08-fa0d-58f0-9fdb-878cb60d7f63/2ff26a08-fa0d-58f0-9fdb-878cb60d7f63_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73297,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/71/4871b017ef3d1ac588a1117fac31231f/pa/WR16749_71ca99c5c5050f2dc2d2fd656ca4c42a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ff26a08-fa0d-58f0-9fdb-878cb60d7f63/2ff26a08-fa0d-58f0-9fdb-878cb60d7f63_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83088,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/71/4871b017ef3d1ac588a1117fac31231f/pa/WR16749_cf5d9fb561a803f0a5926a347e593b36.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ff26a08-fa0d-58f0-9fdb-878cb60d7f63/2ff26a08-fa0d-58f0-9fdb-878cb60d7f63_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87841,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img48/71/4871b017ef3d1ac588a1117fac31231f/pa/WR16749_eebab2358408f2223a0c2c001d027c9c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2008-09-16',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 118d',
'transmission': 'manual',
'trim': '',
'year': 2008}
2026-03-30 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WR16749%27 HTTP/1.1" 200 None
2026-03-30 08:36:34 [auto1.be] INFO: Saving data for WR16749: {'created_time': 1774859794.05254, 'last_price_update_time': 1774859794.052551, 'auction_closing_time': 1774972787.0}
2026-03-30 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WR16749') HTTP/1.1" 204 0
2026-03-30 08:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8c423a61-8fc8-563b-8be0-f24416a8f6db with identifier: CM92821
2026-03-30 08:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8c423a61-8fc8-563b-8be0-f24416a8f6db with identifier: CM92821
2026-03-30 08:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8c423a61-8fc8-563b-8be0-f24416a8f6db with identifier: CM92821 to the API
2026-03-30 08:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CM92821>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-03-31T15:50:18Z',
'fuel_type': 'diesel',
'id': '8c423a61-8fc8-563b-8be0-f24416a8f6db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM92821',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Citroen',
'model': 'C4 Picasso',
'odometer': 144522,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img97/51/9751e5ade3113c390573e72c8465ec4c/pa/CM92821_6473917662e6751d01f424c017d7104b.jpg',
'https://img-pa.auto1.com/img97/51/9751e5ade3113c390573e72c8465ec4c/pa/CM92821_3ee39f34bfa9cb88d2262d66d716e432.jpg',
'https://img-pa.auto1.com/img97/51/9751e5ade3113c390573e72c8465ec4c/pa/CM92821_7f700bf877919884ccc4450b05277ecc.jpg',
'https://img-pa.auto1.com/img97/51/9751e5ade3113c390573e72c8465ec4c/pa/CM92821_f95a061b43116a40abe52b7963f2ac13.jpg',
'https://img-pa.auto1.com/img97/51/9751e5ade3113c390573e72c8465ec4c/pa/CM92821_a195a16e37cb22707bf521ffaba2cd81.jpg',
'https://img-pa.auto1.com/img97/51/9751e5ade3113c390573e72c8465ec4c/pa/CM92821_cd6514770033386d4433a1df6e634bde.jpg',
'https://img-pa.auto1.com/img97/51/9751e5ade3113c390573e72c8465ec4c/pa/CM92821_5c6f8465b529fde95fe13f590015294f.jpg',
'https://img-pa.auto1.com/img97/51/9751e5ade3113c390573e72c8465ec4c/pa/CM92821_e3515978c5b776692a8a792716d0dc26.jpg',
'https://img-pa.auto1.com/img97/51/9751e5ade3113c390573e72c8465ec4c/pa/CM92821_0eb56cb8675252bcb04dc0361aaea6fa.jpg',
'https://img-pa.auto1.com/img97/51/9751e5ade3113c390573e72c8465ec4c/pa/CM92821_143522cbc38592e36ae8c1a4f8eb40e9.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c423a61-8fc8-563b-8be0-f24416a8f6db/8c423a61-8fc8-563b-8be0-f24416a8f6db_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2613811,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img97/51/9751e5ade3113c390573e72c8465ec4c/pa/CM92821_6473917662e6751d01f424c017d7104b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c423a61-8fc8-563b-8be0-f24416a8f6db/8c423a61-8fc8-563b-8be0-f24416a8f6db_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66320,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/51/9751e5ade3113c390573e72c8465ec4c/pa/CM92821_3ee39f34bfa9cb88d2262d66d716e432.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c423a61-8fc8-563b-8be0-f24416a8f6db/8c423a61-8fc8-563b-8be0-f24416a8f6db_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71252,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/51/9751e5ade3113c390573e72c8465ec4c/pa/CM92821_7f700bf877919884ccc4450b05277ecc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c423a61-8fc8-563b-8be0-f24416a8f6db/8c423a61-8fc8-563b-8be0-f24416a8f6db_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62969,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/51/9751e5ade3113c390573e72c8465ec4c/pa/CM92821_f95a061b43116a40abe52b7963f2ac13.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c423a61-8fc8-563b-8be0-f24416a8f6db/8c423a61-8fc8-563b-8be0-f24416a8f6db_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62401,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/51/9751e5ade3113c390573e72c8465ec4c/pa/CM92821_a195a16e37cb22707bf521ffaba2cd81.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c423a61-8fc8-563b-8be0-f24416a8f6db/8c423a61-8fc8-563b-8be0-f24416a8f6db_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74136,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/51/9751e5ade3113c390573e72c8465ec4c/pa/CM92821_cd6514770033386d4433a1df6e634bde.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c423a61-8fc8-563b-8be0-f24416a8f6db/8c423a61-8fc8-563b-8be0-f24416a8f6db_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63615,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/51/9751e5ade3113c390573e72c8465ec4c/pa/CM92821_5c6f8465b529fde95fe13f590015294f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c423a61-8fc8-563b-8be0-f24416a8f6db/8c423a61-8fc8-563b-8be0-f24416a8f6db_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69834,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/51/9751e5ade3113c390573e72c8465ec4c/pa/CM92821_e3515978c5b776692a8a792716d0dc26.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c423a61-8fc8-563b-8be0-f24416a8f6db/8c423a61-8fc8-563b-8be0-f24416a8f6db_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65701,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/51/9751e5ade3113c390573e72c8465ec4c/pa/CM92821_0eb56cb8675252bcb04dc0361aaea6fa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c423a61-8fc8-563b-8be0-f24416a8f6db/8c423a61-8fc8-563b-8be0-f24416a8f6db_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67468,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/51/9751e5ade3113c390573e72c8465ec4c/pa/CM92821_143522cbc38592e36ae8c1a4f8eb40e9.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2018-12-10',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C4 Picasso 1.6 Blue-HDi Selection',
'transmission': 'manual',
'trim': 'Selection',
'year': 2018}
2026-03-30 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM92821%27 HTTP/1.1" 200 None
2026-03-30 08:36:34 [auto1.be] INFO: Saving data for CM92821: {'created_time': 1774859794.450667, 'last_price_update_time': 1774859794.450677, 'auction_closing_time': 1774972218.0}
2026-03-30 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CM92821') HTTP/1.1" 204 0
2026-03-30 08:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_a73426825f306636264f2665634f6c0a.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_875d7d351e5051c79f3deefa5dc4ed0d.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: aeeb539e-b277-507f-b39c-643e85304586 with identifier: CP45384
2026-03-30 08:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: aeeb539e-b277-507f-b39c-643e85304586 with identifier: CP45384
2026-03-30 08:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: aeeb539e-b277-507f-b39c-643e85304586 with identifier: CP45384 to the API
2026-03-30 08:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 211,
'expiration_date': '2026-03-31T15:06:47Z',
'fuel_type': 'diesel',
'id': 'aeeb539e-b277-507f-b39c-643e85304586',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP45384',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 120912,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-05-13',
'seller_name': None,
'title': 'Volvo XC60 2.0 B4 Diesel Mild-Hybrid R Design AWD',
'transmission': 'automatic',
'trim': 'R Design AWD',
'year': 2020}
2026-03-30 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP45384%27 HTTP/1.1" 200 None
2026-03-30 08:36:34 [auto1.be] INFO: Saving data for CP45384: {'auction_closing_time': 1774969607.0, 'created_time': 1773132746.852, 'last_price_update_time': 1774859794.80717}
2026-03-30 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CP45384') HTTP/1.1" 204 0
2026-03-30 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fac%252Fbaace6a7b32f44266cb2736a96d41bf2%252Fpa%252FUY40990_d3dd93e3f233166f45c1f867c8679942.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_d3dd93e3f233166f45c1f867c8679942.jpg not downloaded yet
2026-03-30 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F46%252Ffa462ad004367c17a441e4738608a497%252Fpa%252FPH52818_c2e478c9092c8be92efbff7b431fc617.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_c2e478c9092c8be92efbff7b431fc617.jpg not downloaded yet
2026-03-30 08:36:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BM50316/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8f7b750>
2026-03-30 08:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_31516f29-62a3-5041-a755-30e1c1e5cc7a/31516f29-62a3-5041-a755-30e1c1e5cc7a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252Ff5%252Fa0f59f472f24daf2c6eeec4a0f7d6e0d%252Fpa%252FLW89201_710aae4a639b52e1c30cc38f4ac06d38.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_710aae4a639b52e1c30cc38f4ac06d38.jpg saved to cache
2026-03-30 08:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 31516f29-62a3-5041-a755-30e1c1e5cc7a
2026-03-30 08:36:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 31516f29-62a3-5041-a755-30e1c1e5cc7a, skipping ID generation
2026-03-30 08:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31516f29-62a3-5041-a755-30e1c1e5cc7a with scrape type 1
2026-03-30 08:36:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 31516f29-62a3-5041-a755-30e1c1e5cc7a sending to next pipeline
2026-03-30 08:36:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 31516f29-62a3-5041-a755-30e1c1e5cc7a, identifier: LW89201
2026-03-30 08:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_79ce91d34c65a1ec7157bcd35964077c.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_7cd7cfd1b7b3ffbffbe4287db341d5c0.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:35 [auto1.be] INFO: Found listing with ID: EB13238
2026-03-30 08:36:35 [auto1.be] INFO: Found listing with ID: YU54459
2026-03-30 08:36:35 [auto1.be] INFO: Found listing with ID: NS58610
2026-03-30 08:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS58610%27 HTTP/1.1" 200 None
2026-03-30 08:36:35 [auto1.be] INFO: Scrape type for NS58610: 2
2026-03-30 08:36:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 712f90ad-279f-528e-a4e2-65024e0cf352 with identifier: NS58610
2026-03-30 08:36:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 712f90ad-279f-528e-a4e2-65024e0cf352 with scrape type 2
2026-03-30 08:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 712f90ad-279f-528e-a4e2-65024e0cf352 with scrape type 2
2026-03-30 08:36:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 712f90ad-279f-528e-a4e2-65024e0cf352, identifier: NS58610
2026-03-30 08:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 31516f29-62a3-5041-a755-30e1c1e5cc7a with identifier: LW89201
2026-03-30 08:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 31516f29-62a3-5041-a755-30e1c1e5cc7a with identifier: LW89201
2026-03-30 08:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 31516f29-62a3-5041-a755-30e1c1e5cc7a with identifier: LW89201 to the API
2026-03-30 08:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_710aae4a639b52e1c30cc38f4ac06d38.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:06:03Z',
'fuel_type': 'petrol',
'id': '31516f29-62a3-5041-a755-30e1c1e5cc7a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW89201',
'listing': 'auction',
'location': 'BE',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 96361,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 18,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31516f29-62a3-5041-a755-30e1c1e5cc7a/31516f29-62a3-5041-a755-30e1c1e5cc7a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3231050,
'Height': 3024,
'OriginUrl': 'https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_b70ea24bcd6954ffc0b86bd443f1805a.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31516f29-62a3-5041-a755-30e1c1e5cc7a/31516f29-62a3-5041-a755-30e1c1e5cc7a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64522,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_984621bca34b631cec9112e3087cd743.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31516f29-62a3-5041-a755-30e1c1e5cc7a/31516f29-62a3-5041-a755-30e1c1e5cc7a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115185,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_28ef5d91b1ac97a968ae212f66a2cc3c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31516f29-62a3-5041-a755-30e1c1e5cc7a/31516f29-62a3-5041-a755-30e1c1e5cc7a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112772,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_216f03f9c787f97c8bbdd6cc625c6fa2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31516f29-62a3-5041-a755-30e1c1e5cc7a/31516f29-62a3-5041-a755-30e1c1e5cc7a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119817,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_710aae4a639b52e1c30cc38f4ac06d38.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31516f29-62a3-5041-a755-30e1c1e5cc7a/31516f29-62a3-5041-a755-30e1c1e5cc7a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76245,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_482bbfd08149878604ff1c1a655d2894.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31516f29-62a3-5041-a755-30e1c1e5cc7a/31516f29-62a3-5041-a755-30e1c1e5cc7a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66356,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_ac4fe7fa6c2b839dc282c824edf6c66c.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31516f29-62a3-5041-a755-30e1c1e5cc7a/31516f29-62a3-5041-a755-30e1c1e5cc7a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120424,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_01772f8f2e8f774d21d7b865cc0b875a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31516f29-62a3-5041-a755-30e1c1e5cc7a/31516f29-62a3-5041-a755-30e1c1e5cc7a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95955,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_ee01faf6a5c4b78fd5b13b403d4b0ccc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_31516f29-62a3-5041-a755-30e1c1e5cc7a/31516f29-62a3-5041-a755-30e1c1e5cc7a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72557,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/f5/a0f59f472f24daf2c6eeec4a0f7d6e0d/pa/LW89201_ec1069156fc8c3648b4ac044d2cda7b8.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2021-05-30',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.0 EcoBoost ST-Line',
'transmission': 'manual',
'trim': 'ST-Line',
'year': 2021}
2026-03-30 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LW89201%27 HTTP/1.1" 200 None
2026-03-30 08:36:36 [auto1.be] INFO: Saving data for LW89201: {'created_time': 1774859796.071758, 'last_price_update_time': 1774859796.07177, 'auction_closing_time': 1774969563.0}
2026-03-30 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LW89201') HTTP/1.1" 204 0
2026-03-30 08:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 712f90ad-279f-528e-a4e2-65024e0cf352 with identifier: NS58610
2026-03-30 08:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 712f90ad-279f-528e-a4e2-65024e0cf352 with identifier: NS58610
2026-03-30 08:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 712f90ad-279f-528e-a4e2-65024e0cf352 with identifier: NS58610 to the API
2026-03-30 08:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 99,
'expiration_date': '2026-03-31T15:16:13Z',
'fuel_type': 'diesel',
'id': '712f90ad-279f-528e-a4e2-65024e0cf352',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS58610',
'listing': 'auction',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 82224,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-18',
'seller_name': None,
'title': 'Citroen Berlingo 1.6 Blue-HDi Worker M',
'transmission': 'manual',
'trim': 'Worker M',
'year': 2019}
2026-03-30 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS58610%27 HTTP/1.1" 200 None
2026-03-30 08:36:36 [auto1.be] INFO: Saving data for NS58610: {'auction_closing_time': 1774970173.0, 'created_time': 1774384577.405415, 'last_price_update_time': 1774859796.683388}
2026-03-30 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NS58610') HTTP/1.1" 204 0
2026-03-30 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fac%252Fbaace6a7b32f44266cb2736a96d41bf2%252Fpa%252FUY40990_2448d672f0b864cba822e5d216e55dfc.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_2448d672f0b864cba822e5d216e55dfc.jpg not downloaded yet
2026-03-30 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F46%252Ffa462ad004367c17a441e4738608a497%252Fpa%252FPH52818_3ebeff1da31d627b5bdd812d65e1437f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_3ebeff1da31d627b5bdd812d65e1437f.jpg not downloaded yet
2026-03-30 08:36:36 [auto1.be] INFO: Found listing with ID: MD39375
2026-03-30 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD39375%27 HTTP/1.1" 200 None
2026-03-30 08:36:36 [auto1.be] INFO: Scrape type for MD39375: 2
2026-03-30 08:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6f213a5-7404-512c-bbab-565407f10070 with identifier: MD39375
2026-03-30 08:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6f213a5-7404-512c-bbab-565407f10070 with scrape type 2
2026-03-30 08:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6f213a5-7404-512c-bbab-565407f10070 with scrape type 2
2026-03-30 08:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c6f213a5-7404-512c-bbab-565407f10070, identifier: MD39375
2026-03-30 08:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b08f87c-f0b3-5e1b-9d13-ebce27f46463 with identifier: YW02361
2026-03-30 08:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b08f87c-f0b3-5e1b-9d13-ebce27f46463 with scrape type 1
2026-03-30 08:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3b08f87c-f0b3-5e1b-9d13-ebce27f46463
2026-03-30 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F98038124bd4d5bdd4bdcf674a2410fa7%252Fpa%252FYW02361_83c2755a8e69fcbdca90e7793409e412.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_83c2755a8e69fcbdca90e7793409e412.jpg not downloaded yet
2026-03-30 08:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f10792e4-b645-5918-b693-518f0394ad0e with identifier: JC64183
2026-03-30 08:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f10792e4-b645-5918-b693-518f0394ad0e with scrape type 1
2026-03-30 08:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f10792e4-b645-5918-b693-518f0394ad0e
2026-03-30 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fd7%252Ff0d702ff37d8d0be1e0222469bfa344e%252Fpa%252FJC64183_0be1b4c25d7c4fe21436266d50a6d370.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/d7/f0d702ff37d8d0be1e0222469bfa344e/pa/JC64183_0be1b4c25d7c4fe21436266d50a6d370.jpg already downloaded
2026-03-30 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fd7%252Ff0d702ff37d8d0be1e0222469bfa344e%252Fpa%252FJC64183_cd11334236114b46533da668d3f2e611.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/d7/f0d702ff37d8d0be1e0222469bfa344e/pa/JC64183_cd11334236114b46533da668d3f2e611.jpg already downloaded
2026-03-30 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fd7%252Ff0d702ff37d8d0be1e0222469bfa344e%252Fpa%252FJC64183_8d2c7179e3f591ee6d002c012605c9f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/d7/f0d702ff37d8d0be1e0222469bfa344e/pa/JC64183_8d2c7179e3f591ee6d002c012605c9f6.jpg already downloaded
2026-03-30 08:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fd7%252Ff0d702ff37d8d0be1e0222469bfa344e%252Fpa%252FJC64183_14ea52957311b9928c0bd016e42e9e02.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/d7/f0d702ff37d8d0be1e0222469bfa344e/pa/JC64183_14ea52957311b9928c0bd016e42e9e02.jpg already downloaded
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fd7%252Ff0d702ff37d8d0be1e0222469bfa344e%252Fpa%252FJC64183_617f1c0625817160a51bb7efee0de753.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/d7/f0d702ff37d8d0be1e0222469bfa344e/pa/JC64183_617f1c0625817160a51bb7efee0de753.jpg already downloaded
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fd7%252Ff0d702ff37d8d0be1e0222469bfa344e%252Fpa%252FJC64183_50041942e2bb5e8e3c3110cf07ab6e12.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/d7/f0d702ff37d8d0be1e0222469bfa344e/pa/JC64183_50041942e2bb5e8e3c3110cf07ab6e12.jpg already downloaded
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fd7%252Ff0d702ff37d8d0be1e0222469bfa344e%252Fpa%252FJC64183_28afca7d8501b6170bfaebf910aaa072.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/d7/f0d702ff37d8d0be1e0222469bfa344e/pa/JC64183_28afca7d8501b6170bfaebf910aaa072.jpg already downloaded
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fd7%252Ff0d702ff37d8d0be1e0222469bfa344e%252Fpa%252FJC64183_c0d385c5d3f7adee58ecad1bb2009b82.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/d7/f0d702ff37d8d0be1e0222469bfa344e/pa/JC64183_c0d385c5d3f7adee58ecad1bb2009b82.jpg already downloaded
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fd7%252Ff0d702ff37d8d0be1e0222469bfa344e%252Fpa%252FJC64183_cd2f42981236df2e8fc794f5d8299123.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/d7/f0d702ff37d8d0be1e0222469bfa344e/pa/JC64183_cd2f42981236df2e8fc794f5d8299123.jpg already downloaded
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fd7%252Ff0d702ff37d8d0be1e0222469bfa344e%252Fpa%252FJC64183_eb21e46ff31a72a3036a47a98a772db3.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/d7/f0d702ff37d8d0be1e0222469bfa344e/pa/JC64183_eb21e46ff31a72a3036a47a98a772db3.jpg already downloaded
2026-03-30 08:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f10792e4-b645-5918-b693-518f0394ad0e, identifier: JC64183
2026-03-30 08:36:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8ef78d0>
2026-03-30 08:36:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_badad0ba-34bc-5670-8e24-40ca4661e630/badad0ba-34bc-5670-8e24-40ca4661e630_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F46%252Ffa462ad004367c17a441e4738608a497%252Fpa%252FPH52818_a73426825f306636264f2665634f6c0a.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_a73426825f306636264f2665634f6c0a.jpg saved to cache
2026-03-30 08:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item badad0ba-34bc-5670-8e24-40ca4661e630
2026-03-30 08:36:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd82bd0d0>
2026-03-30 08:36:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2a762ee-ea46-52c8-85ed-7de128fdbf80/c2a762ee-ea46-52c8-85ed-7de128fdbf80_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fac%252Fbaace6a7b32f44266cb2736a96d41bf2%252Fpa%252FUY40990_875d7d351e5051c79f3deefa5dc4ed0d.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_875d7d351e5051c79f3deefa5dc4ed0d.jpg saved to cache
2026-03-30 08:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c2a762ee-ea46-52c8-85ed-7de128fdbf80
2026-03-30 08:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_bda9b10a961b6f12d3e7568f230f0c15.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c6f213a5-7404-512c-bbab-565407f10070 with identifier: MD39375
2026-03-30 08:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c6f213a5-7404-512c-bbab-565407f10070 with identifier: MD39375
2026-03-30 08:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c6f213a5-7404-512c-bbab-565407f10070 with identifier: MD39375 to the API
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-31T15:41:13Z',
'fuel_type': 'diesel',
'id': 'c6f213a5-7404-512c-bbab-565407f10070',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD39375',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 177128,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-03-17',
'seller_name': None,
'title': 'Volkswagen Polo 1.6 TDI Life',
'transmission': 'automatic',
'trim': 'Life',
'year': 2014}
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD39375%27 HTTP/1.1" 200 None
2026-03-30 08:36:37 [auto1.be] INFO: Saving data for MD39375: {'auction_closing_time': 1774971673.0, 'created_time': 1774611393.594095, 'last_price_update_time': 1774859797.665451}
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MD39375') HTTP/1.1" 204 0
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fac%252Fbaace6a7b32f44266cb2736a96d41bf2%252Fpa%252FUY40990_57e5a8fc34e3155b8be05082361c7652.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_57e5a8fc34e3155b8be05082361c7652.jpg not downloaded yet
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F46%252Ffa462ad004367c17a441e4738608a497%252Fpa%252FPH52818_630e1069502bb3bcfd8920cce4a59811.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_630e1069502bb3bcfd8920cce4a59811.jpg not downloaded yet
2026-03-30 08:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f10792e4-b645-5918-b693-518f0394ad0e with identifier: JC64183
2026-03-30 08:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f10792e4-b645-5918-b693-518f0394ad0e with identifier: JC64183
2026-03-30 08:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f10792e4-b645-5918-b693-518f0394ad0e with identifier: JC64183 to the API
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JC64183>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 185,
'expiration_date': '2026-03-31T15:53:48Z',
'fuel_type': 'diesel',
'id': 'f10792e4-b645-5918-b693-518f0394ad0e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC64183',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'BMW',
'model': '4er',
'odometer': 118713,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgf0/d7/f0d702ff37d8d0be1e0222469bfa344e/pa/JC64183_0be1b4c25d7c4fe21436266d50a6d370.jpg',
'https://img-pa.auto1.com/imgf0/d7/f0d702ff37d8d0be1e0222469bfa344e/pa/JC64183_cd11334236114b46533da668d3f2e611.jpg',
'https://img-pa.auto1.com/imgf0/d7/f0d702ff37d8d0be1e0222469bfa344e/pa/JC64183_8d2c7179e3f591ee6d002c012605c9f6.jpg',
'https://img-pa.auto1.com/imgf0/d7/f0d702ff37d8d0be1e0222469bfa344e/pa/JC64183_14ea52957311b9928c0bd016e42e9e02.jpg',
'https://img-pa.auto1.com/imgf0/d7/f0d702ff37d8d0be1e0222469bfa344e/pa/JC64183_617f1c0625817160a51bb7efee0de753.jpg',
'https://img-pa.auto1.com/imgf0/d7/f0d702ff37d8d0be1e0222469bfa344e/pa/JC64183_50041942e2bb5e8e3c3110cf07ab6e12.jpg',
'https://img-pa.auto1.com/imgf0/d7/f0d702ff37d8d0be1e0222469bfa344e/pa/JC64183_28afca7d8501b6170bfaebf910aaa072.jpg',
'https://img-pa.auto1.com/imgf0/d7/f0d702ff37d8d0be1e0222469bfa344e/pa/JC64183_c0d385c5d3f7adee58ecad1bb2009b82.jpg',
'https://img-pa.auto1.com/imgf0/d7/f0d702ff37d8d0be1e0222469bfa344e/pa/JC64183_cd2f42981236df2e8fc794f5d8299123.jpg',
'https://img-pa.auto1.com/imgf0/d7/f0d702ff37d8d0be1e0222469bfa344e/pa/JC64183_eb21e46ff31a72a3036a47a98a772db3.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f10792e4-b645-5918-b693-518f0394ad0e/f10792e4-b645-5918-b693-518f0394ad0e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61373,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/d7/f0d702ff37d8d0be1e0222469bfa344e/pa/JC64183_0be1b4c25d7c4fe21436266d50a6d370.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f10792e4-b645-5918-b693-518f0394ad0e/f10792e4-b645-5918-b693-518f0394ad0e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2819280,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/d7/f0d702ff37d8d0be1e0222469bfa344e/pa/JC64183_cd11334236114b46533da668d3f2e611.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f10792e4-b645-5918-b693-518f0394ad0e/f10792e4-b645-5918-b693-518f0394ad0e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62912,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/d7/f0d702ff37d8d0be1e0222469bfa344e/pa/JC64183_8d2c7179e3f591ee6d002c012605c9f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f10792e4-b645-5918-b693-518f0394ad0e/f10792e4-b645-5918-b693-518f0394ad0e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2541385,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/d7/f0d702ff37d8d0be1e0222469bfa344e/pa/JC64183_14ea52957311b9928c0bd016e42e9e02.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f10792e4-b645-5918-b693-518f0394ad0e/f10792e4-b645-5918-b693-518f0394ad0e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2538708,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/d7/f0d702ff37d8d0be1e0222469bfa344e/pa/JC64183_617f1c0625817160a51bb7efee0de753.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f10792e4-b645-5918-b693-518f0394ad0e/f10792e4-b645-5918-b693-518f0394ad0e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69156,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/d7/f0d702ff37d8d0be1e0222469bfa344e/pa/JC64183_50041942e2bb5e8e3c3110cf07ab6e12.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f10792e4-b645-5918-b693-518f0394ad0e/f10792e4-b645-5918-b693-518f0394ad0e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53701,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/d7/f0d702ff37d8d0be1e0222469bfa344e/pa/JC64183_28afca7d8501b6170bfaebf910aaa072.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f10792e4-b645-5918-b693-518f0394ad0e/f10792e4-b645-5918-b693-518f0394ad0e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63721,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/d7/f0d702ff37d8d0be1e0222469bfa344e/pa/JC64183_c0d385c5d3f7adee58ecad1bb2009b82.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f10792e4-b645-5918-b693-518f0394ad0e/f10792e4-b645-5918-b693-518f0394ad0e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63816,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/d7/f0d702ff37d8d0be1e0222469bfa344e/pa/JC64183_cd2f42981236df2e8fc794f5d8299123.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f10792e4-b645-5918-b693-518f0394ad0e/f10792e4-b645-5918-b693-518f0394ad0e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2510896,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgf0/d7/f0d702ff37d8d0be1e0222469bfa344e/pa/JC64183_eb21e46ff31a72a3036a47a98a772db3.jpg',
'Width': 2048}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2014-06-26',
'seats_number': 4,
'seller_name': None,
'title': 'BMW 4er 420d',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC64183%27 HTTP/1.1" 200 None
2026-03-30 08:36:38 [auto1.be] INFO: Saving data for JC64183: {'created_time': 1774859798.111121, 'last_price_update_time': 1774859798.111134, 'auction_closing_time': 1774972428.0}
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JC64183') HTTP/1.1" 204 0
2026-03-30 08:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_46ef7f59d7eab456a305776565b7f844.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_c29a2a985f796278d01f956a93455dab.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_132aaac6ea4ed81e88374a876a920c92.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: VK40214
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: KM41856
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: FG04950
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: SR54305
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR54305%27 HTTP/1.1" 200 None
2026-03-30 08:36:38 [auto1.be] INFO: Scrape type for SR54305: 0
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: HM64227
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM64227%27 HTTP/1.1" 200 None
2026-03-30 08:36:38 [auto1.be] INFO: Scrape type for HM64227: 0
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: YN29778
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: XN45926
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XN45926%27 HTTP/1.1" 200 None
2026-03-30 08:36:38 [auto1.be] INFO: Scrape type for XN45926: 0
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: VP75874
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: MJ73226
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MJ73226%27 HTTP/1.1" 200 None
2026-03-30 08:36:38 [auto1.be] INFO: Scrape type for MJ73226: 0
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: SU19738
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: KX00210
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: PE06051
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: TF58036
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF58036%27 HTTP/1.1" 200 None
2026-03-30 08:36:38 [auto1.be] INFO: Scrape type for TF58036: 0
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: VR76359
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: GS35098
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS35098%27 HTTP/1.1" 200 None
2026-03-30 08:36:38 [auto1.be] INFO: Scrape type for GS35098: 0
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: BS14605
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS14605%27 HTTP/1.1" 200 None
2026-03-30 08:36:38 [auto1.be] INFO: Scrape type for BS14605: 0
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: ZC01857
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: HT59149
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: JN20180
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JN20180%27 HTTP/1.1" 200 None
2026-03-30 08:36:38 [auto1.be] INFO: Scrape type for JN20180: 0
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: XG78085
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XG78085%27 HTTP/1.1" 200 None
2026-03-30 08:36:38 [auto1.be] INFO: Scrape type for XG78085: 0
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: VX47829
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VX47829%27 HTTP/1.1" 200 None
2026-03-30 08:36:38 [auto1.be] INFO: Scrape type for VX47829: 0
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: JV43445
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: GK69232
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GK69232%27 HTTP/1.1" 200 None
2026-03-30 08:36:38 [auto1.be] INFO: Scrape type for GK69232: 0
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: FJ11174
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ11174%27 HTTP/1.1" 200 None
2026-03-30 08:36:38 [auto1.be] INFO: Scrape type for FJ11174: 0
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: YP46156
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: SZ91004
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ91004%27 HTTP/1.1" 200 None
2026-03-30 08:36:38 [auto1.be] INFO: Scrape type for SZ91004: 0
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: KD38906
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: DG03200
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: CH88253
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CH88253%27 HTTP/1.1" 200 None
2026-03-30 08:36:38 [auto1.be] INFO: Scrape type for CH88253: 0
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F98038124bd4d5bdd4bdcf674a2410fa7%252Fpa%252FYW02361_50f99b2a3f4d57e185017e8dc3859479.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_50f99b2a3f4d57e185017e8dc3859479.jpg not downloaded yet
2026-03-30 08:36:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd82e7890>
2026-03-30 08:36:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2a762ee-ea46-52c8-85ed-7de128fdbf80/c2a762ee-ea46-52c8-85ed-7de128fdbf80_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fac%252Fbaace6a7b32f44266cb2736a96d41bf2%252Fpa%252FUY40990_79ce91d34c65a1ec7157bcd35964077c.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_79ce91d34c65a1ec7157bcd35964077c.jpg saved to cache
2026-03-30 08:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c2a762ee-ea46-52c8-85ed-7de128fdbf80
2026-03-30 08:36:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd84a8fd0>
2026-03-30 08:36:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_badad0ba-34bc-5670-8e24-40ca4661e630/badad0ba-34bc-5670-8e24-40ca4661e630_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F46%252Ffa462ad004367c17a441e4738608a497%252Fpa%252FPH52818_7cd7cfd1b7b3ffbffbe4287db341d5c0.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_7cd7cfd1b7b3ffbffbe4287db341d5c0.jpg saved to cache
2026-03-30 08:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item badad0ba-34bc-5670-8e24-40ca4661e630
2026-03-30 08:36:38 [auto1.be] INFO: Channel: 24h | Page: 7 | totalHits: 1502 | hits on page: 40
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fac%252Fbaace6a7b32f44266cb2736a96d41bf2%252Fpa%252FUY40990_23b81725970533a7da21a72f73756de1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_23b81725970533a7da21a72f73756de1.jpg not downloaded yet
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F46%252Ffa462ad004367c17a441e4738608a497%252Fpa%252FPH52818_8dcf6ee6332fd1d7665f816069f3633f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_8dcf6ee6332fd1d7665f816069f3633f.jpg not downloaded yet
2026-03-30 08:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_d3dd93e3f233166f45c1f867c8679942.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F98038124bd4d5bdd4bdcf674a2410fa7%252Fpa%252FYW02361_7dc26de174a7d1d21534f274015abae9.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_7dc26de174a7d1d21534f274015abae9.jpg not downloaded yet
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: TY37950
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TY37950%27 HTTP/1.1" 200 None
2026-03-30 08:36:38 [auto1.be] INFO: Scrape type for TY37950: 0
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: KD13812
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD13812%27 HTTP/1.1" 200 None
2026-03-30 08:36:38 [auto1.be] INFO: Scrape type for KD13812: 0
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: WN92129
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN92129%27 HTTP/1.1" 200 None
2026-03-30 08:36:38 [auto1.be] INFO: Scrape type for WN92129: 0
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: VW53084
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: HD96937
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HD96937%27 HTTP/1.1" 200 None
2026-03-30 08:36:38 [auto1.be] INFO: Scrape type for HD96937: 0
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: NE40925
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NE40925%27 HTTP/1.1" 200 None
2026-03-30 08:36:38 [auto1.be] INFO: Scrape type for NE40925: 0
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: TU29469
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU29469%27 HTTP/1.1" 200 None
2026-03-30 08:36:38 [auto1.be] INFO: Scrape type for TU29469: 0
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: ZP62550
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP62550%27 HTTP/1.1" 200 None
2026-03-30 08:36:38 [auto1.be] INFO: Scrape type for ZP62550: 0
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: RK88808
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK88808%27 HTTP/1.1" 200 None
2026-03-30 08:36:38 [auto1.be] INFO: Scrape type for RK88808: 0
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: LG48907
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG48907%27 HTTP/1.1" 200 None
2026-03-30 08:36:38 [auto1.be] INFO: Scrape type for LG48907: 0
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: TX40265
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX40265%27 HTTP/1.1" 200 None
2026-03-30 08:36:38 [auto1.be] INFO: Scrape type for TX40265: 0
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: RJ95996
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: LU32507
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: FT44143
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: DT10357
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DT10357%27 HTTP/1.1" 200 None
2026-03-30 08:36:38 [auto1.be] INFO: Scrape type for DT10357: 0
2026-03-30 08:36:38 [auto1.be] INFO: Found listing with ID: SW43031
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW43031%27 HTTP/1.1" 200 None
2026-03-30 08:36:38 [auto1.be] INFO: Scrape type for SW43031: 2
2026-03-30 08:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2231bb70-71ba-582f-8672-6424b8dc86f1 with identifier: SW43031
2026-03-30 08:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2231bb70-71ba-582f-8672-6424b8dc86f1 with scrape type 2
2026-03-30 08:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2231bb70-71ba-582f-8672-6424b8dc86f1 with scrape type 2
2026-03-30 08:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2231bb70-71ba-582f-8672-6424b8dc86f1, identifier: SW43031
2026-03-30 08:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MX38879/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8fe0b50>
2026-03-30 08:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2a762ee-ea46-52c8-85ed-7de128fdbf80/c2a762ee-ea46-52c8-85ed-7de128fdbf80_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fac%252Fbaace6a7b32f44266cb2736a96d41bf2%252Fpa%252FUY40990_bda9b10a961b6f12d3e7568f230f0c15.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_bda9b10a961b6f12d3e7568f230f0c15.jpg saved to cache
2026-03-30 08:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c2a762ee-ea46-52c8-85ed-7de128fdbf80
2026-03-30 08:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_c2e478c9092c8be92efbff7b431fc617.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fac%252Fbaace6a7b32f44266cb2736a96d41bf2%252Fpa%252FUY40990_61c838495e95f7480dcc86762a3ec4a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_61c838495e95f7480dcc86762a3ec4a8.jpg not downloaded yet
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F46%252Ffa462ad004367c17a441e4738608a497%252Fpa%252FPH52818_4d2f9a402cab503bec193ede86b1325a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_4d2f9a402cab503bec193ede86b1325a.jpg not downloaded yet
2026-03-30 08:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2231bb70-71ba-582f-8672-6424b8dc86f1 with identifier: SW43031
2026-03-30 08:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2231bb70-71ba-582f-8672-6424b8dc86f1 with identifier: SW43031
2026-03-30 08:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2231bb70-71ba-582f-8672-6424b8dc86f1 with identifier: SW43031 to the API
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:32:53Z',
'fuel_type': 'diesel',
'id': '2231bb70-71ba-582f-8672-6424b8dc86f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW43031',
'listing': 'auction',
'make': 'Renault',
'model': 'Kangoo',
'odometer': 37871,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-08',
'seller_name': None,
'title': 'Renault Kangoo 1.5 BLUE dCi Rapid Maxi Extra',
'transmission': 'manual',
'trim': 'Rapid Maxi Extra',
'year': 2021}
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW43031%27 HTTP/1.1" 200 None
2026-03-30 08:36:39 [auto1.be] INFO: Saving data for SW43031: {'auction_closing_time': 1774884773.0, 'created_time': 1774773324.697819, 'last_price_update_time': 1774859799.404726}
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SW43031') HTTP/1.1" 204 0
2026-03-30 08:36:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd84b4950>
2026-03-30 08:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2a762ee-ea46-52c8-85ed-7de128fdbf80/c2a762ee-ea46-52c8-85ed-7de128fdbf80_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fac%252Fbaace6a7b32f44266cb2736a96d41bf2%252Fpa%252FUY40990_46ef7f59d7eab456a305776565b7f844.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_46ef7f59d7eab456a305776565b7f844.jpg saved to cache
2026-03-30 08:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c2a762ee-ea46-52c8-85ed-7de128fdbf80
2026-03-30 08:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8513510>
2026-03-30 08:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_badad0ba-34bc-5670-8e24-40ca4661e630/badad0ba-34bc-5670-8e24-40ca4661e630_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F46%252Ffa462ad004367c17a441e4738608a497%252Fpa%252FPH52818_c29a2a985f796278d01f956a93455dab.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_c29a2a985f796278d01f956a93455dab.jpg saved to cache
2026-03-30 08:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item badad0ba-34bc-5670-8e24-40ca4661e630
2026-03-30 08:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd910bc10>
2026-03-30 08:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_badad0ba-34bc-5670-8e24-40ca4661e630/badad0ba-34bc-5670-8e24-40ca4661e630_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F46%252Ffa462ad004367c17a441e4738608a497%252Fpa%252FPH52818_132aaac6ea4ed81e88374a876a920c92.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_132aaac6ea4ed81e88374a876a920c92.jpg saved to cache
2026-03-30 08:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item badad0ba-34bc-5670-8e24-40ca4661e630
2026-03-30 08:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_2448d672f0b864cba822e5d216e55dfc.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F98038124bd4d5bdd4bdcf674a2410fa7%252Fpa%252FYW02361_4465416336c99617f694d1add3ee5943.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_4465416336c99617f694d1add3ee5943.jpg not downloaded yet
2026-03-30 08:36:39 [auto1.be] INFO: Found listing with ID: KH45960
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH45960%27 HTTP/1.1" 200 None
2026-03-30 08:36:39 [auto1.be] INFO: Scrape type for KH45960: 2
2026-03-30 08:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ddc8b27-ee61-5001-ac67-ec82372107e7 with identifier: KH45960
2026-03-30 08:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ddc8b27-ee61-5001-ac67-ec82372107e7 with scrape type 2
2026-03-30 08:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ddc8b27-ee61-5001-ac67-ec82372107e7 with scrape type 2
2026-03-30 08:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5ddc8b27-ee61-5001-ac67-ec82372107e7, identifier: KH45960
2026-03-30 08:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_83c2755a8e69fcbdca90e7793409e412.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_3ebeff1da31d627b5bdd812d65e1437f.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fac%252Fbaace6a7b32f44266cb2736a96d41bf2%252Fpa%252FUY40990_501a16310a8a3ad361f83d674cc2dc96.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_501a16310a8a3ad361f83d674cc2dc96.jpg not downloaded yet
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F46%252Ffa462ad004367c17a441e4738608a497%252Fpa%252FPH52818_3eaec0f93a6c01e22d8582bdb77b10b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_3eaec0f93a6c01e22d8582bdb77b10b4.jpg not downloaded yet
2026-03-30 08:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5ddc8b27-ee61-5001-ac67-ec82372107e7 with identifier: KH45960
2026-03-30 08:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5ddc8b27-ee61-5001-ac67-ec82372107e7 with identifier: KH45960
2026-03-30 08:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5ddc8b27-ee61-5001-ac67-ec82372107e7 with identifier: KH45960 to the API
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 163,
'expiration_date': '2026-03-30T15:02:53Z',
'fuel_type': 'petrol',
'id': '5ddc8b27-ee61-5001-ac67-ec82372107e7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH45960',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC40',
'odometer': 71833,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-15',
'seller_name': None,
'title': 'Volvo XC40 1.5 T3 Momentum Core 2WD',
'transmission': 'automatic',
'trim': 'Momentum Core 2WD',
'year': 2022}
2026-03-30 08:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KH45960%27 HTTP/1.1" 200 None
2026-03-30 08:36:40 [auto1.be] INFO: Saving data for KH45960: {'auction_closing_time': 1774882973.0, 'created_time': 1774773323.800614, 'last_price_update_time': 1774859800.09452}
2026-03-30 08:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KH45960') HTTP/1.1" 204 0
2026-03-30 08:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd901eb10>
2026-03-30 08:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2a762ee-ea46-52c8-85ed-7de128fdbf80/c2a762ee-ea46-52c8-85ed-7de128fdbf80_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fac%252Fbaace6a7b32f44266cb2736a96d41bf2%252Fpa%252FUY40990_d3dd93e3f233166f45c1f867c8679942.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_d3dd93e3f233166f45c1f867c8679942.jpg saved to cache
2026-03-30 08:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c2a762ee-ea46-52c8-85ed-7de128fdbf80
2026-03-30 08:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_630e1069502bb3bcfd8920cce4a59811.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F98038124bd4d5bdd4bdcf674a2410fa7%252Fpa%252FYW02361_e577c352074970993d0be70b887e274a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_e577c352074970993d0be70b887e274a.jpg not downloaded yet
2026-03-30 08:36:40 [auto1.be] INFO: Found listing with ID: VR58028
2026-03-30 08:36:40 [auto1.be] INFO: Found listing with ID: EX99169
2026-03-30 08:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX99169%27 HTTP/1.1" 200 None
2026-03-30 08:36:40 [auto1.be] INFO: Scrape type for EX99169: 2
2026-03-30 08:36:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2592f4f8-0ed4-52ca-a19a-b8c0e18f9364 with identifier: EX99169
2026-03-30 08:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2592f4f8-0ed4-52ca-a19a-b8c0e18f9364 with scrape type 2
2026-03-30 08:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2592f4f8-0ed4-52ca-a19a-b8c0e18f9364 with scrape type 2
2026-03-30 08:36:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2592f4f8-0ed4-52ca-a19a-b8c0e18f9364, identifier: EX99169
2026-03-30 08:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UK31480/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DJ79108/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BC23498> (referer: https://www.auto1.com/v1/car-details-view/BC23498/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ER70694/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd82dde50>
2026-03-30 08:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_badad0ba-34bc-5670-8e24-40ca4661e630/badad0ba-34bc-5670-8e24-40ca4661e630_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F46%252Ffa462ad004367c17a441e4738608a497%252Fpa%252FPH52818_c2e478c9092c8be92efbff7b431fc617.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_c2e478c9092c8be92efbff7b431fc617.jpg saved to cache
2026-03-30 08:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item badad0ba-34bc-5670-8e24-40ca4661e630
2026-03-30 08:36:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2592f4f8-0ed4-52ca-a19a-b8c0e18f9364 with identifier: EX99169
2026-03-30 08:36:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2592f4f8-0ed4-52ca-a19a-b8c0e18f9364 with identifier: EX99169
2026-03-30 08:36:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2592f4f8-0ed4-52ca-a19a-b8c0e18f9364 with identifier: EX99169 to the API
2026-03-30 08:36:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:44:17Z',
'fuel_type': 'petrol',
'id': '2592f4f8-0ed4-52ca-a19a-b8c0e18f9364',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX99169',
'listing': 'auction',
'make': 'Citroen',
'model': 'Xsara Picasso',
'odometer': 142863,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-05-11',
'seller_name': None,
'title': 'Citroen Xsara Picasso 1.6 Family',
'transmission': 'manual',
'trim': 'Family',
'year': 2003}
2026-03-30 08:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EX99169%27 HTTP/1.1" 200 None
2026-03-30 08:36:40 [auto1.be] INFO: Saving data for EX99169: {'auction_closing_time': 1774885457.0, 'created_time': 1774557497.827252, 'last_price_update_time': 1774859800.698816}
2026-03-30 08:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EX99169') HTTP/1.1" 204 0
2026-03-30 08:36:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8418a90>
2026-03-30 08:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2a762ee-ea46-52c8-85ed-7de128fdbf80/c2a762ee-ea46-52c8-85ed-7de128fdbf80_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fac%252Fbaace6a7b32f44266cb2736a96d41bf2%252Fpa%252FUY40990_2448d672f0b864cba822e5d216e55dfc.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_2448d672f0b864cba822e5d216e55dfc.jpg saved to cache
2026-03-30 08:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c2a762ee-ea46-52c8-85ed-7de128fdbf80
2026-03-30 08:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_23b81725970533a7da21a72f73756de1.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F98038124bd4d5bdd4bdcf674a2410fa7%252Fpa%252FYW02361_aef81b5488906d11236ddc757a83ce89.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_aef81b5488906d11236ddc757a83ce89.jpg not downloaded yet
2026-03-30 08:36:40 [auto1.be] INFO: Found listing with ID: ES45973
2026-03-30 08:36:40 [auto1.be] INFO: Found listing with ID: DL06250
2026-03-30 08:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL06250%27 HTTP/1.1" 200 None
2026-03-30 08:36:40 [auto1.be] INFO: Scrape type for DL06250: 2
2026-03-30 08:36:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a11059d8-ebbd-53d2-a7cf-8fd4728842c3 with identifier: DL06250
2026-03-30 08:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a11059d8-ebbd-53d2-a7cf-8fd4728842c3 with scrape type 2
2026-03-30 08:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a11059d8-ebbd-53d2-a7cf-8fd4728842c3 with scrape type 2
2026-03-30 08:36:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a11059d8-ebbd-53d2-a7cf-8fd4728842c3, identifier: DL06250
2026-03-30 08:36:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febdaec9650>
2026-03-30 08:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b08f87c-f0b3-5e1b-9d13-ebce27f46463/3b08f87c-f0b3-5e1b-9d13-ebce27f46463_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F98038124bd4d5bdd4bdcf674a2410fa7%252Fpa%252FYW02361_83c2755a8e69fcbdca90e7793409e412.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_83c2755a8e69fcbdca90e7793409e412.jpg saved to cache
2026-03-30 08:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3b08f87c-f0b3-5e1b-9d13-ebce27f46463
2026-03-30 08:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd846be50>
2026-03-30 08:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_badad0ba-34bc-5670-8e24-40ca4661e630/badad0ba-34bc-5670-8e24-40ca4661e630_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F46%252Ffa462ad004367c17a441e4738608a497%252Fpa%252FPH52818_3ebeff1da31d627b5bdd812d65e1437f.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_3ebeff1da31d627b5bdd812d65e1437f.jpg saved to cache
2026-03-30 08:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item badad0ba-34bc-5670-8e24-40ca4661e630
2026-03-30 08:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_8dcf6ee6332fd1d7665f816069f3633f.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_61c838495e95f7480dcc86762a3ec4a8.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_7dc26de174a7d1d21534f274015abae9.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a11059d8-ebbd-53d2-a7cf-8fd4728842c3 with identifier: DL06250
2026-03-30 08:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a11059d8-ebbd-53d2-a7cf-8fd4728842c3 with identifier: DL06250
2026-03-30 08:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a11059d8-ebbd-53d2-a7cf-8fd4728842c3 with identifier: DL06250 to the API
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 113,
'expiration_date': '2026-03-30T15:08:41Z',
'fuel_type': 'petrol',
'id': 'a11059d8-ebbd-53d2-a7cf-8fd4728842c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL06250',
'listing': 'auction',
'make': 'Renault',
'model': 'Scenic',
'odometer': 176956,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-04-21',
'seller_name': None,
'title': 'Renault Scenic 1.6 Privilege Luxe',
'transmission': 'manual',
'trim': 'Privilege Luxe',
'year': 2005}
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL06250%27 HTTP/1.1" 200 None
2026-03-30 08:36:41 [auto1.be] INFO: Saving data for DL06250: {'auction_closing_time': 1774883321.0, 'created_time': 1773301742.016102, 'last_price_update_time': 1774859801.348894}
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DL06250') HTTP/1.1" 204 0
2026-03-30 08:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd83d6e10>
2026-03-30 08:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_badad0ba-34bc-5670-8e24-40ca4661e630/badad0ba-34bc-5670-8e24-40ca4661e630_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F46%252Ffa462ad004367c17a441e4738608a497%252Fpa%252FPH52818_630e1069502bb3bcfd8920cce4a59811.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_630e1069502bb3bcfd8920cce4a59811.jpg saved to cache
2026-03-30 08:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item badad0ba-34bc-5670-8e24-40ca4661e630
2026-03-30 08:36:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39971d1d-c827-5ed3-8836-2132277dbc44 with identifier: BC23498
2026-03-30 08:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39971d1d-c827-5ed3-8836-2132277dbc44 with scrape type 1
2026-03-30 08:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 39971d1d-c827-5ed3-8836-2132277dbc44
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bfd8f3786744ab7c444eaeaa62f88d%252Fpa%252FBC23498_8149f62d164b251d029071cf0ce01d67.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_8149f62d164b251d029071cf0ce01d67.jpg not downloaded yet
2026-03-30 08:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_4d2f9a402cab503bec193ede86b1325a.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F98038124bd4d5bdd4bdcf674a2410fa7%252Fpa%252FYW02361_27dbff88f6b6531f5ac1f76a39d944c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_27dbff88f6b6531f5ac1f76a39d944c9.jpg not downloaded yet
2026-03-30 08:36:41 [auto1.be] INFO: Found listing with ID: AM39981
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM39981%27 HTTP/1.1" 200 None
2026-03-30 08:36:41 [auto1.be] INFO: Scrape type for AM39981: 2
2026-03-30 08:36:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5f97f61-cf56-594a-bb29-aaccb3fe128d with identifier: AM39981
2026-03-30 08:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5f97f61-cf56-594a-bb29-aaccb3fe128d with scrape type 2
2026-03-30 08:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5f97f61-cf56-594a-bb29-aaccb3fe128d with scrape type 2
2026-03-30 08:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c5f97f61-cf56-594a-bb29-aaccb3fe128d, identifier: AM39981
2026-03-30 08:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_501a16310a8a3ad361f83d674cc2dc96.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_4465416336c99617f694d1add3ee5943.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c5f97f61-cf56-594a-bb29-aaccb3fe128d with identifier: AM39981
2026-03-30 08:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c5f97f61-cf56-594a-bb29-aaccb3fe128d with identifier: AM39981
2026-03-30 08:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c5f97f61-cf56-594a-bb29-aaccb3fe128d with identifier: AM39981 to the API
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:56:22Z',
'fuel_type': 'hybrid',
'id': 'c5f97f61-cf56-594a-bb29-aaccb3fe128d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM39981',
'listing': 'auction',
'make': 'Kia',
'model': 'Optima',
'odometer': 106202,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-15',
'seller_name': None,
'title': 'Kia Optima 2.0 Hybrid Spirit',
'transmission': 'automatic',
'trim': 'Spirit',
'year': 2017}
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM39981%27 HTTP/1.1" 200 None
2026-03-30 08:36:41 [auto1.be] INFO: Saving data for AM39981: {'auction_closing_time': 1774886182.0, 'created_time': 1774773325.352715, 'last_price_update_time': 1774859801.848485}
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AM39981') HTTP/1.1" 204 0
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bfd8f3786744ab7c444eaeaa62f88d%252Fpa%252FBC23498_0f1edc4b10bdbb3ae9120c5a0e46b5d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_0f1edc4b10bdbb3ae9120c5a0e46b5d9.jpg not downloaded yet
2026-03-30 08:36:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8396110>
2026-03-30 08:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2a762ee-ea46-52c8-85ed-7de128fdbf80/c2a762ee-ea46-52c8-85ed-7de128fdbf80_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fac%252Fbaace6a7b32f44266cb2736a96d41bf2%252Fpa%252FUY40990_23b81725970533a7da21a72f73756de1.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_23b81725970533a7da21a72f73756de1.jpg saved to cache
2026-03-30 08:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c2a762ee-ea46-52c8-85ed-7de128fdbf80
2026-03-30 08:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_57e5a8fc34e3155b8be05082361c7652.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_3eaec0f93a6c01e22d8582bdb77b10b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F98038124bd4d5bdd4bdcf674a2410fa7%252Fpa%252FYW02361_daea9b49e075c7bf1048346278e4a686.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_daea9b49e075c7bf1048346278e4a686.jpg not downloaded yet
2026-03-30 08:36:41 [auto1.be] INFO: Found listing with ID: NJ87931
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ87931%27 HTTP/1.1" 200 None
2026-03-30 08:36:41 [auto1.be] INFO: Scrape type for NJ87931: 2
2026-03-30 08:36:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 097ae4a4-9f02-51f3-b32c-47cda2e42db9 with identifier: NJ87931
2026-03-30 08:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 097ae4a4-9f02-51f3-b32c-47cda2e42db9 with scrape type 2
2026-03-30 08:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 097ae4a4-9f02-51f3-b32c-47cda2e42db9 with scrape type 2
2026-03-30 08:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 097ae4a4-9f02-51f3-b32c-47cda2e42db9, identifier: NJ87931
2026-03-30 08:36:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd82fea50>
2026-03-30 08:36:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_badad0ba-34bc-5670-8e24-40ca4661e630/badad0ba-34bc-5670-8e24-40ca4661e630_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F46%252Ffa462ad004367c17a441e4738608a497%252Fpa%252FPH52818_8dcf6ee6332fd1d7665f816069f3633f.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_8dcf6ee6332fd1d7665f816069f3633f.jpg saved to cache
2026-03-30 08:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item badad0ba-34bc-5670-8e24-40ca4661e630
2026-03-30 08:36:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febdb27c4d0>
2026-03-30 08:36:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2a762ee-ea46-52c8-85ed-7de128fdbf80/c2a762ee-ea46-52c8-85ed-7de128fdbf80_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fac%252Fbaace6a7b32f44266cb2736a96d41bf2%252Fpa%252FUY40990_61c838495e95f7480dcc86762a3ec4a8.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_61c838495e95f7480dcc86762a3ec4a8.jpg saved to cache
2026-03-30 08:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c2a762ee-ea46-52c8-85ed-7de128fdbf80
2026-03-30 08:36:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8f46e10>
2026-03-30 08:36:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b08f87c-f0b3-5e1b-9d13-ebce27f46463/3b08f87c-f0b3-5e1b-9d13-ebce27f46463_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F98038124bd4d5bdd4bdcf674a2410fa7%252Fpa%252FYW02361_7dc26de174a7d1d21534f274015abae9.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_7dc26de174a7d1d21534f274015abae9.jpg saved to cache
2026-03-30 08:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3b08f87c-f0b3-5e1b-9d13-ebce27f46463
2026-03-30 08:36:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_50f99b2a3f4d57e185017e8dc3859479.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 097ae4a4-9f02-51f3-b32c-47cda2e42db9 with identifier: NJ87931
2026-03-30 08:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 097ae4a4-9f02-51f3-b32c-47cda2e42db9 with identifier: NJ87931
2026-03-30 08:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 097ae4a4-9f02-51f3-b32c-47cda2e42db9 with identifier: NJ87931 to the API
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:50:22Z',
'fuel_type': 'diesel',
'id': '097ae4a4-9f02-51f3-b32c-47cda2e42db9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ87931',
'listing': 'auction',
'make': 'Citroen',
'model': 'C5',
'odometer': 223350,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-04-02',
'seller_name': None,
'title': 'Citroen C5 2.0 HDi Business Class',
'transmission': 'manual',
'trim': 'Business Class',
'year': 2012}
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ87931%27 HTTP/1.1" 200 None
2026-03-30 08:36:42 [auto1.be] INFO: Saving data for NJ87931: {'auction_closing_time': 1774885822.0, 'created_time': 1774557471.14209, 'last_price_update_time': 1774859802.572445}
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NJ87931') HTTP/1.1" 204 0
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bfd8f3786744ab7c444eaeaa62f88d%252Fpa%252FBC23498_d9c2f2507a0506904a3ebec7928b3797.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_d9c2f2507a0506904a3ebec7928b3797.jpg not downloaded yet
2026-03-30 08:36:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd83f9050>
2026-03-30 08:36:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_badad0ba-34bc-5670-8e24-40ca4661e630/badad0ba-34bc-5670-8e24-40ca4661e630_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F46%252Ffa462ad004367c17a441e4738608a497%252Fpa%252FPH52818_4d2f9a402cab503bec193ede86b1325a.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_4d2f9a402cab503bec193ede86b1325a.jpg saved to cache
2026-03-30 08:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item badad0ba-34bc-5670-8e24-40ca4661e630
2026-03-30 08:36:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_e577c352074970993d0be70b887e274a.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F98038124bd4d5bdd4bdcf674a2410fa7%252Fpa%252FYW02361_437334c5a127efbfc7abc935a3952165.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_437334c5a127efbfc7abc935a3952165.jpg not downloaded yet
2026-03-30 08:36:42 [auto1.be] INFO: Found listing with ID: RS13546
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS13546%27 HTTP/1.1" 200 None
2026-03-30 08:36:42 [auto1.be] INFO: Scrape type for RS13546: 2
2026-03-30 08:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f00bd44-25e5-558e-8f6a-dee957f3a308 with identifier: RS13546
2026-03-30 08:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f00bd44-25e5-558e-8f6a-dee957f3a308 with scrape type 2
2026-03-30 08:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f00bd44-25e5-558e-8f6a-dee957f3a308 with scrape type 2
2026-03-30 08:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8f00bd44-25e5-558e-8f6a-dee957f3a308, identifier: RS13546
2026-03-30 08:36:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febdaebc510>
2026-03-30 08:36:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2a762ee-ea46-52c8-85ed-7de128fdbf80/c2a762ee-ea46-52c8-85ed-7de128fdbf80_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fac%252Fbaace6a7b32f44266cb2736a96d41bf2%252Fpa%252FUY40990_501a16310a8a3ad361f83d674cc2dc96.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_501a16310a8a3ad361f83d674cc2dc96.jpg saved to cache
2026-03-30 08:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c2a762ee-ea46-52c8-85ed-7de128fdbf80
2026-03-30 08:36:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8e876d0>
2026-03-30 08:36:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b08f87c-f0b3-5e1b-9d13-ebce27f46463/3b08f87c-f0b3-5e1b-9d13-ebce27f46463_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F98038124bd4d5bdd4bdcf674a2410fa7%252Fpa%252FYW02361_4465416336c99617f694d1add3ee5943.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_4465416336c99617f694d1add3ee5943.jpg saved to cache
2026-03-30 08:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3b08f87c-f0b3-5e1b-9d13-ebce27f46463
2026-03-30 08:36:42 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (11963973) larger than download warn size (10485760) in request <GET https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_8149f62d164b251d029071cf0ce01d67.jpg>.
2026-03-30 08:36:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_aef81b5488906d11236ddc757a83ce89.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8f00bd44-25e5-558e-8f6a-dee957f3a308 with identifier: RS13546
2026-03-30 08:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8f00bd44-25e5-558e-8f6a-dee957f3a308 with identifier: RS13546
2026-03-30 08:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8f00bd44-25e5-558e-8f6a-dee957f3a308 with identifier: RS13546 to the API
2026-03-30 08:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:08:24Z',
'fuel_type': 'diesel',
'id': '8f00bd44-25e5-558e-8f6a-dee957f3a308',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS13546',
'listing': 'auction',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 211924,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-11-07',
'seller_name': None,
'title': 'Citroen Berlingo 1.9 Diesel 600 Kasten',
'transmission': 'manual',
'trim': '600 Kasten',
'year': 2001}
2026-03-30 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS13546%27 HTTP/1.1" 200 None
2026-03-30 08:36:43 [auto1.be] INFO: Saving data for RS13546: {'auction_closing_time': 1774883304.0, 'created_time': 1774557509.506569, 'last_price_update_time': 1774859803.20752}
2026-03-30 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RS13546') HTTP/1.1" 204 0
2026-03-30 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bfd8f3786744ab7c444eaeaa62f88d%252Fpa%252FBC23498_a82c578ec9e25713878e6290178a129a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_a82c578ec9e25713878e6290178a129a.jpg not downloaded yet
2026-03-30 08:36:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8ea2510>
2026-03-30 08:36:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2a762ee-ea46-52c8-85ed-7de128fdbf80/c2a762ee-ea46-52c8-85ed-7de128fdbf80_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252Fac%252Fbaace6a7b32f44266cb2736a96d41bf2%252Fpa%252FUY40990_57e5a8fc34e3155b8be05082361c7652.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_57e5a8fc34e3155b8be05082361c7652.jpg saved to cache
2026-03-30 08:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c2a762ee-ea46-52c8-85ed-7de128fdbf80
2026-03-30 08:36:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c2a762ee-ea46-52c8-85ed-7de128fdbf80, skipping ID generation
2026-03-30 08:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2a762ee-ea46-52c8-85ed-7de128fdbf80 with scrape type 1
2026-03-30 08:36:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c2a762ee-ea46-52c8-85ed-7de128fdbf80 sending to next pipeline
2026-03-30 08:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c2a762ee-ea46-52c8-85ed-7de128fdbf80, identifier: UY40990
2026-03-30 08:36:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd901abd0>
2026-03-30 08:36:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_badad0ba-34bc-5670-8e24-40ca4661e630/badad0ba-34bc-5670-8e24-40ca4661e630_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F46%252Ffa462ad004367c17a441e4738608a497%252Fpa%252FPH52818_3eaec0f93a6c01e22d8582bdb77b10b4.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_3eaec0f93a6c01e22d8582bdb77b10b4.jpg saved to cache
2026-03-30 08:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item badad0ba-34bc-5670-8e24-40ca4661e630
2026-03-30 08:36:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: badad0ba-34bc-5670-8e24-40ca4661e630, skipping ID generation
2026-03-30 08:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item badad0ba-34bc-5670-8e24-40ca4661e630 with scrape type 1
2026-03-30 08:36:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item badad0ba-34bc-5670-8e24-40ca4661e630 sending to next pipeline
2026-03-30 08:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: badad0ba-34bc-5670-8e24-40ca4661e630, identifier: PH52818
2026-03-30 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F98038124bd4d5bdd4bdcf674a2410fa7%252Fpa%252FYW02361_2b7cf647c74b2f3df000cec61ce7b0ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_2b7cf647c74b2f3df000cec61ce7b0ee.jpg not downloaded yet
2026-03-30 08:36:43 [auto1.be] INFO: Found listing with ID: MB50362
2026-03-30 08:36:43 [auto1.be] INFO: Found listing with ID: BR08123
2026-03-30 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR08123%27 HTTP/1.1" 200 None
2026-03-30 08:36:43 [auto1.be] INFO: Scrape type for BR08123: 2
2026-03-30 08:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4092a559-8164-57d5-a03e-9567c0410e0c with identifier: BR08123
2026-03-30 08:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4092a559-8164-57d5-a03e-9567c0410e0c with scrape type 2
2026-03-30 08:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4092a559-8164-57d5-a03e-9567c0410e0c with scrape type 2
2026-03-30 08:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4092a559-8164-57d5-a03e-9567c0410e0c, identifier: BR08123
2026-03-30 08:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c2a762ee-ea46-52c8-85ed-7de128fdbf80 with identifier: UY40990
2026-03-30 08:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c2a762ee-ea46-52c8-85ed-7de128fdbf80 with identifier: UY40990
2026-03-30 08:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c2a762ee-ea46-52c8-85ed-7de128fdbf80 with identifier: UY40990 to the API
2026-03-30 08:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_57e5a8fc34e3155b8be05082361c7652.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:55:00Z',
'fuel_type': 'petrol',
'id': 'c2a762ee-ea46-52c8-85ed-7de128fdbf80',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY40990',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 102478,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2a762ee-ea46-52c8-85ed-7de128fdbf80/c2a762ee-ea46-52c8-85ed-7de128fdbf80_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75112,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_875d7d351e5051c79f3deefa5dc4ed0d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2a762ee-ea46-52c8-85ed-7de128fdbf80/c2a762ee-ea46-52c8-85ed-7de128fdbf80_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75075,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_79ce91d34c65a1ec7157bcd35964077c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2a762ee-ea46-52c8-85ed-7de128fdbf80/c2a762ee-ea46-52c8-85ed-7de128fdbf80_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68956,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_46ef7f59d7eab456a305776565b7f844.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2a762ee-ea46-52c8-85ed-7de128fdbf80/c2a762ee-ea46-52c8-85ed-7de128fdbf80_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62850,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_bda9b10a961b6f12d3e7568f230f0c15.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2a762ee-ea46-52c8-85ed-7de128fdbf80/c2a762ee-ea46-52c8-85ed-7de128fdbf80_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60722,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_d3dd93e3f233166f45c1f867c8679942.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2a762ee-ea46-52c8-85ed-7de128fdbf80/c2a762ee-ea46-52c8-85ed-7de128fdbf80_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67184,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_2448d672f0b864cba822e5d216e55dfc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2a762ee-ea46-52c8-85ed-7de128fdbf80/c2a762ee-ea46-52c8-85ed-7de128fdbf80_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60953,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_57e5a8fc34e3155b8be05082361c7652.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2a762ee-ea46-52c8-85ed-7de128fdbf80/c2a762ee-ea46-52c8-85ed-7de128fdbf80_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70168,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_23b81725970533a7da21a72f73756de1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2a762ee-ea46-52c8-85ed-7de128fdbf80/c2a762ee-ea46-52c8-85ed-7de128fdbf80_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63584,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_61c838495e95f7480dcc86762a3ec4a8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2a762ee-ea46-52c8-85ed-7de128fdbf80/c2a762ee-ea46-52c8-85ed-7de128fdbf80_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55733,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgba/ac/baace6a7b32f44266cb2736a96d41bf2/pa/UY40990_501a16310a8a3ad361f83d674cc2dc96.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-03-04',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo 1.0 TSI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2019}
2026-03-30 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY40990%27 HTTP/1.1" 200 None
2026-03-30 08:36:44 [auto1.be] INFO: Saving data for UY40990: {'created_time': 1774859804.044791, 'last_price_update_time': 1774859804.044802, 'auction_closing_time': 1774972500.0}
2026-03-30 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UY40990') HTTP/1.1" 204 0
2026-03-30 08:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: badad0ba-34bc-5670-8e24-40ca4661e630 with identifier: PH52818
2026-03-30 08:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:36:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-30 08:36:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: badad0ba-34bc-5670-8e24-40ca4661e630 with identifier: PH52818
2026-03-30 08:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: badad0ba-34bc-5670-8e24-40ca4661e630 with identifier: PH52818 to the API
2026-03-30 08:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_3eaec0f93a6c01e22d8582bdb77b10b4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 153,
'category': None,
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 252,
'expiration_date': '2026-03-31T15:26:51Z',
'fuel_type': 'petrol',
'id': 'badad0ba-34bc-5670-8e24-40ca4661e630',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH52818',
'listing': 'auction',
'location': 'BE',
'make': 'BMW',
'model': '5er',
'odometer': 107147,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 74,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_badad0ba-34bc-5670-8e24-40ca4661e630/badad0ba-34bc-5670-8e24-40ca4661e630_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98092,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_a73426825f306636264f2665634f6c0a.jpg',
'Width': 799},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_badad0ba-34bc-5670-8e24-40ca4661e630/badad0ba-34bc-5670-8e24-40ca4661e630_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90544,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_7cd7cfd1b7b3ffbffbe4287db341d5c0.jpg',
'Width': 799},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_badad0ba-34bc-5670-8e24-40ca4661e630/badad0ba-34bc-5670-8e24-40ca4661e630_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96324,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_c29a2a985f796278d01f956a93455dab.jpg',
'Width': 799},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_badad0ba-34bc-5670-8e24-40ca4661e630/badad0ba-34bc-5670-8e24-40ca4661e630_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91475,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_132aaac6ea4ed81e88374a876a920c92.jpg',
'Width': 799},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_badad0ba-34bc-5670-8e24-40ca4661e630/badad0ba-34bc-5670-8e24-40ca4661e630_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93806,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_c2e478c9092c8be92efbff7b431fc617.jpg',
'Width': 799},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_badad0ba-34bc-5670-8e24-40ca4661e630/badad0ba-34bc-5670-8e24-40ca4661e630_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108416,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_3ebeff1da31d627b5bdd812d65e1437f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_badad0ba-34bc-5670-8e24-40ca4661e630/badad0ba-34bc-5670-8e24-40ca4661e630_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89760,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_630e1069502bb3bcfd8920cce4a59811.jpg',
'Width': 799},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_badad0ba-34bc-5670-8e24-40ca4661e630/badad0ba-34bc-5670-8e24-40ca4661e630_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 150428,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_8dcf6ee6332fd1d7665f816069f3633f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_badad0ba-34bc-5670-8e24-40ca4661e630/badad0ba-34bc-5670-8e24-40ca4661e630_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114017,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_4d2f9a402cab503bec193ede86b1325a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_badad0ba-34bc-5670-8e24-40ca4661e630/badad0ba-34bc-5670-8e24-40ca4661e630_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111433,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfa/46/fa462ad004367c17a441e4738608a497/pa/PH52818_3eaec0f93a6c01e22d8582bdb77b10b4.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-01-13',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 5er 530i xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2019}
2026-03-30 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH52818%27 HTTP/1.1" 200 None
2026-03-30 08:36:44 [auto1.be] INFO: Saving data for PH52818: {'created_time': 1774859804.634133, 'last_price_update_time': 1774859804.634154, 'auction_closing_time': 1774970811.0}
2026-03-30 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PH52818') HTTP/1.1" 204 0
2026-03-30 08:36:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd900b610>
2026-03-30 08:36:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b08f87c-f0b3-5e1b-9d13-ebce27f46463/3b08f87c-f0b3-5e1b-9d13-ebce27f46463_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F98038124bd4d5bdd4bdcf674a2410fa7%252Fpa%252FYW02361_50f99b2a3f4d57e185017e8dc3859479.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_50f99b2a3f4d57e185017e8dc3859479.jpg saved to cache
2026-03-30 08:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3b08f87c-f0b3-5e1b-9d13-ebce27f46463
2026-03-30 08:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_27dbff88f6b6531f5ac1f76a39d944c9.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4092a559-8164-57d5-a03e-9567c0410e0c with identifier: BR08123
2026-03-30 08:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4092a559-8164-57d5-a03e-9567c0410e0c with identifier: BR08123
2026-03-30 08:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4092a559-8164-57d5-a03e-9567c0410e0c with identifier: BR08123 to the API
2026-03-30 08:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:11:25Z',
'fuel_type': 'diesel',
'id': '4092a559-8164-57d5-a03e-9567c0410e0c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR08123',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 148687,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-22',
'seller_name': None,
'title': 'Volkswagen Passat 1.6 TDI Comfortline BlueMotion',
'transmission': 'manual',
'trim': 'Comfortline BlueMotion',
'year': 2017}
2026-03-30 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR08123%27 HTTP/1.1" 200 None
2026-03-30 08:36:44 [auto1.be] INFO: Saving data for BR08123: {'auction_closing_time': 1774883485.0, 'created_time': 1774471139.3196, 'last_price_update_time': 1774859804.981736}
2026-03-30 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BR08123') HTTP/1.1" 204 0
2026-03-30 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bfd8f3786744ab7c444eaeaa62f88d%252Fpa%252FBC23498_95464b33a8ba287f3bcfeaf98088c0d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_95464b33a8ba287f3bcfeaf98088c0d2.jpg not downloaded yet
2026-03-30 08:36:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8538250>
2026-03-30 08:36:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b08f87c-f0b3-5e1b-9d13-ebce27f46463/3b08f87c-f0b3-5e1b-9d13-ebce27f46463_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F98038124bd4d5bdd4bdcf674a2410fa7%252Fpa%252FYW02361_e577c352074970993d0be70b887e274a.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_e577c352074970993d0be70b887e274a.jpg saved to cache
2026-03-30 08:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3b08f87c-f0b3-5e1b-9d13-ebce27f46463
2026-03-30 08:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_0f1edc4b10bdbb3ae9120c5a0e46b5d9.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:45 [auto1.be] INFO: Found listing with ID: MR13936
2026-03-30 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR13936%27 HTTP/1.1" 200 None
2026-03-30 08:36:45 [auto1.be] INFO: Scrape type for MR13936: 2
2026-03-30 08:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 554c6eda-25b8-5f5c-b237-5fd019014ed8 with identifier: MR13936
2026-03-30 08:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 554c6eda-25b8-5f5c-b237-5fd019014ed8 with scrape type 2
2026-03-30 08:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 554c6eda-25b8-5f5c-b237-5fd019014ed8 with scrape type 2
2026-03-30 08:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 554c6eda-25b8-5f5c-b237-5fd019014ed8, identifier: MR13936
2026-03-30 08:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BM50316> (referer: https://www.auto1.com/v1/car-details-view/BM50316/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd84f5b10>
2026-03-30 08:36:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b08f87c-f0b3-5e1b-9d13-ebce27f46463/3b08f87c-f0b3-5e1b-9d13-ebce27f46463_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F98038124bd4d5bdd4bdcf674a2410fa7%252Fpa%252FYW02361_aef81b5488906d11236ddc757a83ce89.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_aef81b5488906d11236ddc757a83ce89.jpg saved to cache
2026-03-30 08:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3b08f87c-f0b3-5e1b-9d13-ebce27f46463
2026-03-30 08:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_daea9b49e075c7bf1048346278e4a686.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 554c6eda-25b8-5f5c-b237-5fd019014ed8 with identifier: MR13936
2026-03-30 08:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:36:45 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-30 08:36:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 554c6eda-25b8-5f5c-b237-5fd019014ed8 with identifier: MR13936
2026-03-30 08:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 554c6eda-25b8-5f5c-b237-5fd019014ed8 with identifier: MR13936 to the API
2026-03-30 08:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:57:55Z',
'fuel_type': 'diesel',
'id': '554c6eda-25b8-5f5c-b237-5fd019014ed8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR13936',
'listing': 'auction',
'make': 'Ford',
'model': 'Mondeo',
'odometer': 166842,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-04-22',
'seller_name': None,
'title': 'Ford Mondeo 1.8 Turbodiesel CLX',
'transmission': 'manual',
'trim': 'CLX',
'year': 2001}
2026-03-30 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MR13936%27 HTTP/1.1" 200 None
2026-03-30 08:36:45 [auto1.be] INFO: Saving data for MR13936: {'auction_closing_time': 1774886275.0, 'created_time': 1773693907.204172, 'last_price_update_time': 1774859805.619703}
2026-03-30 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MR13936') HTTP/1.1" 204 0
2026-03-30 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bfd8f3786744ab7c444eaeaa62f88d%252Fpa%252FBC23498_17ce90e8275d88809b27bbb703ce602a.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_17ce90e8275d88809b27bbb703ce602a.jpg not downloaded yet
2026-03-30 08:36:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RD04523> (referer: https://www.auto1.com/v1/car-details-view/RD04523/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GG54325> (referer: https://www.auto1.com/v1/car-details-view/GG54325/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_d9c2f2507a0506904a3ebec7928b3797.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:45 [auto1.be] INFO: Found listing with ID: VB51630
2026-03-30 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB51630%27 HTTP/1.1" 200 None
2026-03-30 08:36:45 [auto1.be] INFO: Scrape type for VB51630: 2
2026-03-30 08:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a778dadb-4594-5ba8-adfe-51f7584663f1 with identifier: VB51630
2026-03-30 08:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a778dadb-4594-5ba8-adfe-51f7584663f1 with scrape type 2
2026-03-30 08:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a778dadb-4594-5ba8-adfe-51f7584663f1 with scrape type 2
2026-03-30 08:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a778dadb-4594-5ba8-adfe-51f7584663f1, identifier: VB51630
2026-03-30 08:36:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd82aacd0>
2026-03-30 08:36:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b08f87c-f0b3-5e1b-9d13-ebce27f46463/3b08f87c-f0b3-5e1b-9d13-ebce27f46463_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F98038124bd4d5bdd4bdcf674a2410fa7%252Fpa%252FYW02361_27dbff88f6b6531f5ac1f76a39d944c9.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_27dbff88f6b6531f5ac1f76a39d944c9.jpg saved to cache
2026-03-30 08:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3b08f87c-f0b3-5e1b-9d13-ebce27f46463
2026-03-30 08:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_437334c5a127efbfc7abc935a3952165.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a778dadb-4594-5ba8-adfe-51f7584663f1 with identifier: VB51630
2026-03-30 08:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a778dadb-4594-5ba8-adfe-51f7584663f1 with identifier: VB51630
2026-03-30 08:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a778dadb-4594-5ba8-adfe-51f7584663f1 with identifier: VB51630 to the API
2026-03-30 08:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:56:14Z',
'fuel_type': 'diesel',
'id': 'a778dadb-4594-5ba8-adfe-51f7584663f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB51630',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 324983,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-31',
'seller_name': None,
'title': 'Ford Focus 1.6 TDCi Style+',
'transmission': 'manual',
'trim': 'Style+',
'year': 2010}
2026-03-30 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB51630%27 HTTP/1.1" 200 None
2026-03-30 08:36:47 [auto1.be] INFO: Saving data for VB51630: {'auction_closing_time': 1774886174.0, 'created_time': 1774125497.948713, 'last_price_update_time': 1774859807.164684}
2026-03-30 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VB51630') HTTP/1.1" 204 0
2026-03-30 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bfd8f3786744ab7c444eaeaa62f88d%252Fpa%252FBC23498_364f88fc039370bf5369cf9572f807fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_364f88fc039370bf5369cf9572f807fa.jpg not downloaded yet
2026-03-30 08:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DA89043> (referer: https://www.auto1.com/v1/car-details-view/DA89043/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd83af8d0>
2026-03-30 08:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39971d1d-c827-5ed3-8836-2132277dbc44/39971d1d-c827-5ed3-8836-2132277dbc44_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bfd8f3786744ab7c444eaeaa62f88d%252Fpa%252FBC23498_0f1edc4b10bdbb3ae9120c5a0e46b5d9.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_0f1edc4b10bdbb3ae9120c5a0e46b5d9.jpg saved to cache
2026-03-30 08:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 39971d1d-c827-5ed3-8836-2132277dbc44
2026-03-30 08:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_e08b50f1f016fb2e4efc62766230b1db.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_a82c578ec9e25713878e6290178a129a.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:47 [auto1.be] INFO: Found listing with ID: AD75254
2026-03-30 08:36:47 [auto1.be] INFO: Found listing with ID: KM93600
2026-03-30 08:36:47 [auto1.be] INFO: Found listing with ID: JZ74663
2026-03-30 08:36:47 [auto1.be] INFO: Found listing with ID: JW28444
2026-03-30 08:36:47 [auto1.be] INFO: Found listing with ID: ST41989
2026-03-30 08:36:47 [auto1.be] INFO: Found listing with ID: SB58546
2026-03-30 08:36:47 [auto1.be] INFO: Found listing with ID: ZN33988
2026-03-30 08:36:47 [auto1.be] INFO: Found listing with ID: WV98137
2026-03-30 08:36:47 [auto1.be] INFO: Found listing with ID: WM98444
2026-03-30 08:36:47 [auto1.be] INFO: Found listing with ID: YL67549
2026-03-30 08:36:47 [auto1.be] INFO: Found listing with ID: RJ01486
2026-03-30 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RJ01486%27 HTTP/1.1" 200 None
2026-03-30 08:36:47 [auto1.be] INFO: Scrape type for RJ01486: 0
2026-03-30 08:36:47 [auto1.be] INFO: Found listing with ID: WP77155
2026-03-30 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP77155%27 HTTP/1.1" 200 None
2026-03-30 08:36:47 [auto1.be] INFO: Scrape type for WP77155: 2
2026-03-30 08:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0459d37-eaec-5e41-9eac-069885b807ab with identifier: WP77155
2026-03-30 08:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0459d37-eaec-5e41-9eac-069885b807ab with scrape type 2
2026-03-30 08:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0459d37-eaec-5e41-9eac-069885b807ab with scrape type 2
2026-03-30 08:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f0459d37-eaec-5e41-9eac-069885b807ab, identifier: WP77155
2026-03-30 08:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9e1f2e2-274b-5380-bab7-61c853c9a738 with identifier: BM50316
2026-03-30 08:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9e1f2e2-274b-5380-bab7-61c853c9a738 with scrape type 1
2026-03-30 08:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a9e1f2e2-274b-5380-bab7-61c853c9a738
2026-03-30 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F54%252F7754074ffef72f8a61772e9a8b664b06%252Fpa%252FBM50316_a0df79c6e32ecd34f0d839c3267cfcd7.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_a0df79c6e32ecd34f0d839c3267cfcd7.jpg not downloaded yet
2026-03-30 08:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd9162b10>
2026-03-30 08:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b08f87c-f0b3-5e1b-9d13-ebce27f46463/3b08f87c-f0b3-5e1b-9d13-ebce27f46463_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F98038124bd4d5bdd4bdcf674a2410fa7%252Fpa%252FYW02361_daea9b49e075c7bf1048346278e4a686.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_daea9b49e075c7bf1048346278e4a686.jpg saved to cache
2026-03-30 08:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3b08f87c-f0b3-5e1b-9d13-ebce27f46463
2026-03-30 08:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_95464b33a8ba287f3bcfeaf98088c0d2.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_2b7cf647c74b2f3df000cec61ce7b0ee.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f0459d37-eaec-5e41-9eac-069885b807ab with identifier: WP77155
2026-03-30 08:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f0459d37-eaec-5e41-9eac-069885b807ab with identifier: WP77155
2026-03-30 08:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f0459d37-eaec-5e41-9eac-069885b807ab with identifier: WP77155 to the API
2026-03-30 08:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 209,
'expiration_date': '2026-03-30T15:12:11Z',
'fuel_type': 'diesel',
'id': 'f0459d37-eaec-5e41-9eac-069885b807ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP77155',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'Stelvio',
'odometer': 126869,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-31',
'seller_name': None,
'title': 'Alfa Romeo Stelvio 2.2 JTDM Veloce Ti Q4',
'transmission': 'automatic',
'trim': 'Veloce Ti Q4',
'year': 2022}
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP77155%27 HTTP/1.1" 200 None
2026-03-30 08:36:48 [auto1.be] INFO: Saving data for WP77155: {'auction_closing_time': 1774883531.0, 'created_time': 1774773329.323245, 'last_price_update_time': 1774859808.066085}
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WP77155') HTTP/1.1" 204 0
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bfd8f3786744ab7c444eaeaa62f88d%252Fpa%252FBC23498_4eb70f7d37d90fea370d03145d881c52.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_4eb70f7d37d90fea370d03145d881c52.jpg not downloaded yet
2026-03-30 08:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DJ79108> (referer: https://www.auto1.com/v1/car-details-view/DJ79108/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ER70694> (referer: https://www.auto1.com/v1/car-details-view/ER70694/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd9d1e44-c6b3-51db-8aa5-254d4ce19b6c with identifier: RD04523
2026-03-30 08:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd9d1e44-c6b3-51db-8aa5-254d4ce19b6c with scrape type 1
2026-03-30 08:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fd9d1e44-c6b3-51db-8aa5-254d4ce19b6c
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F05%252F12053588604320c47880f4660fec5bda%252Fpa%252FRD04523_7ff65f8e71312edb2d5554ff1155f06b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/05/12053588604320c47880f4660fec5bda/pa/RD04523_7ff65f8e71312edb2d5554ff1155f06b.jpg already downloaded
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F05%252F12053588604320c47880f4660fec5bda%252Fpa%252FRD04523_17dd6bdc3a31d7753ac2bd93a2747a6f.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/05/12053588604320c47880f4660fec5bda/pa/RD04523_17dd6bdc3a31d7753ac2bd93a2747a6f.jpg already downloaded
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F05%252F12053588604320c47880f4660fec5bda%252Fpa%252FRD04523_140763a6983944d24b364373640e6f1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/05/12053588604320c47880f4660fec5bda/pa/RD04523_140763a6983944d24b364373640e6f1b.jpg already downloaded
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F05%252F12053588604320c47880f4660fec5bda%252Fpa%252FRD04523_1cc1d494e3db40f7ef05de9ba78800d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/05/12053588604320c47880f4660fec5bda/pa/RD04523_1cc1d494e3db40f7ef05de9ba78800d3.jpg already downloaded
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F05%252F12053588604320c47880f4660fec5bda%252Fpa%252FRD04523_33a45541a1549825c216cb49d7cb6d70.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/05/12053588604320c47880f4660fec5bda/pa/RD04523_33a45541a1549825c216cb49d7cb6d70.jpg already downloaded
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F05%252F12053588604320c47880f4660fec5bda%252Fpa%252FRD04523_208ed9fa79a77b448df2c47a9aa1eed9.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/05/12053588604320c47880f4660fec5bda/pa/RD04523_208ed9fa79a77b448df2c47a9aa1eed9.jpg already downloaded
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F05%252F12053588604320c47880f4660fec5bda%252Fpa%252FRD04523_ef1f03155a73919c26dba1508ab146e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/05/12053588604320c47880f4660fec5bda/pa/RD04523_ef1f03155a73919c26dba1508ab146e9.jpg already downloaded
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F05%252F12053588604320c47880f4660fec5bda%252Fpa%252FRD04523_043178139c01000ea45004e4d92efe32.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/05/12053588604320c47880f4660fec5bda/pa/RD04523_043178139c01000ea45004e4d92efe32.jpg already downloaded
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F05%252F12053588604320c47880f4660fec5bda%252Fpa%252FRD04523_860bae4323bf78e5d7259bf6a1af57c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/05/12053588604320c47880f4660fec5bda/pa/RD04523_860bae4323bf78e5d7259bf6a1af57c1.jpg already downloaded
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F05%252F12053588604320c47880f4660fec5bda%252Fpa%252FRD04523_66a40f94b2c3ea91ae297f302e668149.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/05/12053588604320c47880f4660fec5bda/pa/RD04523_66a40f94b2c3ea91ae297f302e668149.jpg already downloaded
2026-03-30 08:36:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fd9d1e44-c6b3-51db-8aa5-254d4ce19b6c, identifier: RD04523
2026-03-30 08:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cc07b45-d470-52bc-8587-132c5507cd9b with identifier: GG54325
2026-03-30 08:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cc07b45-d470-52bc-8587-132c5507cd9b with scrape type 1
2026-03-30 08:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6cc07b45-d470-52bc-8587-132c5507cd9b
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F31%252F4231d26874e26ae0008d0ef761942aab%252Fpa%252FGG54325_062d67f2ae3db07117ad34bbfb4f6c84.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_062d67f2ae3db07117ad34bbfb4f6c84.jpg not downloaded yet
2026-03-30 08:36:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd9179fd0>
2026-03-30 08:36:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39971d1d-c827-5ed3-8836-2132277dbc44/39971d1d-c827-5ed3-8836-2132277dbc44_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bfd8f3786744ab7c444eaeaa62f88d%252Fpa%252FBC23498_d9c2f2507a0506904a3ebec7928b3797.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_d9c2f2507a0506904a3ebec7928b3797.jpg saved to cache
2026-03-30 08:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 39971d1d-c827-5ed3-8836-2132277dbc44
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F54%252F7754074ffef72f8a61772e9a8b664b06%252Fpa%252FBM50316_41dc9e792ffbec67b5b8e09547a0121c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_41dc9e792ffbec67b5b8e09547a0121c.jpg not downloaded yet
2026-03-30 08:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fd9d1e44-c6b3-51db-8aa5-254d4ce19b6c with identifier: RD04523
2026-03-30 08:36:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fd9d1e44-c6b3-51db-8aa5-254d4ce19b6c with identifier: RD04523
2026-03-30 08:36:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fd9d1e44-c6b3-51db-8aa5-254d4ce19b6c with identifier: RD04523 to the API
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RD04523>
{'auction_title': '',
'c_o_2_emission_value': 128,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6C',
'engine': '1.0L',
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:47:57Z',
'fuel_type': 'petrol',
'id': 'fd9d1e44-c6b3-51db-8aa5-254d4ce19b6c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD04523',
'listing': 'auction',
'location': 'BE, Milmort',
'make': 'Renault',
'model': 'Twingo',
'odometer': 126648,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img12/05/12053588604320c47880f4660fec5bda/pa/RD04523_7ff65f8e71312edb2d5554ff1155f06b.jpg',
'https://img-pa.auto1.com/img12/05/12053588604320c47880f4660fec5bda/pa/RD04523_17dd6bdc3a31d7753ac2bd93a2747a6f.jpg',
'https://img-pa.auto1.com/img12/05/12053588604320c47880f4660fec5bda/pa/RD04523_140763a6983944d24b364373640e6f1b.jpg',
'https://img-pa.auto1.com/img12/05/12053588604320c47880f4660fec5bda/pa/RD04523_1cc1d494e3db40f7ef05de9ba78800d3.jpg',
'https://img-pa.auto1.com/img12/05/12053588604320c47880f4660fec5bda/pa/RD04523_33a45541a1549825c216cb49d7cb6d70.jpg',
'https://img-pa.auto1.com/img12/05/12053588604320c47880f4660fec5bda/pa/RD04523_208ed9fa79a77b448df2c47a9aa1eed9.jpg',
'https://img-pa.auto1.com/img12/05/12053588604320c47880f4660fec5bda/pa/RD04523_ef1f03155a73919c26dba1508ab146e9.jpg',
'https://img-pa.auto1.com/img12/05/12053588604320c47880f4660fec5bda/pa/RD04523_043178139c01000ea45004e4d92efe32.jpg',
'https://img-pa.auto1.com/img12/05/12053588604320c47880f4660fec5bda/pa/RD04523_860bae4323bf78e5d7259bf6a1af57c1.jpg',
'https://img-pa.auto1.com/img12/05/12053588604320c47880f4660fec5bda/pa/RD04523_66a40f94b2c3ea91ae297f302e668149.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd9d1e44-c6b3-51db-8aa5-254d4ce19b6c/fd9d1e44-c6b3-51db-8aa5-254d4ce19b6c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2440163,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img12/05/12053588604320c47880f4660fec5bda/pa/RD04523_7ff65f8e71312edb2d5554ff1155f06b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd9d1e44-c6b3-51db-8aa5-254d4ce19b6c/fd9d1e44-c6b3-51db-8aa5-254d4ce19b6c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69081,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/05/12053588604320c47880f4660fec5bda/pa/RD04523_17dd6bdc3a31d7753ac2bd93a2747a6f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd9d1e44-c6b3-51db-8aa5-254d4ce19b6c/fd9d1e44-c6b3-51db-8aa5-254d4ce19b6c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2576133,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img12/05/12053588604320c47880f4660fec5bda/pa/RD04523_140763a6983944d24b364373640e6f1b.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd9d1e44-c6b3-51db-8aa5-254d4ce19b6c/fd9d1e44-c6b3-51db-8aa5-254d4ce19b6c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2456541,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img12/05/12053588604320c47880f4660fec5bda/pa/RD04523_1cc1d494e3db40f7ef05de9ba78800d3.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd9d1e44-c6b3-51db-8aa5-254d4ce19b6c/fd9d1e44-c6b3-51db-8aa5-254d4ce19b6c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2380728,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img12/05/12053588604320c47880f4660fec5bda/pa/RD04523_33a45541a1549825c216cb49d7cb6d70.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd9d1e44-c6b3-51db-8aa5-254d4ce19b6c/fd9d1e44-c6b3-51db-8aa5-254d4ce19b6c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68730,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/05/12053588604320c47880f4660fec5bda/pa/RD04523_208ed9fa79a77b448df2c47a9aa1eed9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd9d1e44-c6b3-51db-8aa5-254d4ce19b6c/fd9d1e44-c6b3-51db-8aa5-254d4ce19b6c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53953,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/05/12053588604320c47880f4660fec5bda/pa/RD04523_ef1f03155a73919c26dba1508ab146e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd9d1e44-c6b3-51db-8aa5-254d4ce19b6c/fd9d1e44-c6b3-51db-8aa5-254d4ce19b6c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61092,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/05/12053588604320c47880f4660fec5bda/pa/RD04523_043178139c01000ea45004e4d92efe32.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd9d1e44-c6b3-51db-8aa5-254d4ce19b6c/fd9d1e44-c6b3-51db-8aa5-254d4ce19b6c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2429893,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img12/05/12053588604320c47880f4660fec5bda/pa/RD04523_860bae4323bf78e5d7259bf6a1af57c1.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd9d1e44-c6b3-51db-8aa5-254d4ce19b6c/fd9d1e44-c6b3-51db-8aa5-254d4ce19b6c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72104,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/05/12053588604320c47880f4660fec5bda/pa/RD04523_66a40f94b2c3ea91ae297f302e668149.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-04-23',
'seats_number': 4,
'seller_name': None,
'title': 'Renault Twingo 1.0 SCe Limited',
'transmission': 'manual',
'trim': 'Limited',
'year': 2019}
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD04523%27 HTTP/1.1" 200 None
2026-03-30 08:36:48 [auto1.be] INFO: Saving data for RD04523: {'created_time': 1774859808.901595, 'last_price_update_time': 1774859808.901606, 'auction_closing_time': 1774972077.0}
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RD04523') HTTP/1.1" 204 0
2026-03-30 08:36:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd85253d0>
2026-03-30 08:36:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b08f87c-f0b3-5e1b-9d13-ebce27f46463/3b08f87c-f0b3-5e1b-9d13-ebce27f46463_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F98038124bd4d5bdd4bdcf674a2410fa7%252Fpa%252FYW02361_437334c5a127efbfc7abc935a3952165.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_437334c5a127efbfc7abc935a3952165.jpg saved to cache
2026-03-30 08:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3b08f87c-f0b3-5e1b-9d13-ebce27f46463
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bfd8f3786744ab7c444eaeaa62f88d%252Fpa%252FBC23498_37fb8e98ecdbf6075367ad79d4477d5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_37fb8e98ecdbf6075367ad79d4477d5d.jpg not downloaded yet
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F31%252F4231d26874e26ae0008d0ef761942aab%252Fpa%252FGG54325_cc84423598c4dd674123f379680227e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_cc84423598c4dd674123f379680227e4.jpg not downloaded yet
2026-03-30 08:36:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7 with identifier: DA89043
2026-03-30 08:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7 with scrape type 1
2026-03-30 08:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7
2026-03-30 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fc3%252F96c391410134c0ea3fcb98ff1b87be37%252Fpa%252FDA89043_69da97f54d40bd1268100b9cbd976e91.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_69da97f54d40bd1268100b9cbd976e91.jpg not downloaded yet
2026-03-30 08:36:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 08:36:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd84e9150>
2026-03-30 08:36:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0333184a-fd46-57f1-948a-ae0f68b22111/0333184a-fd46-57f1-948a-ae0f68b22111_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe0%252Fcde074db263b54306897b79f29d18ba8%252Fpa%252FEH30324_e08b50f1f016fb2e4efc62766230b1db.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_e08b50f1f016fb2e4efc62766230b1db.jpg saved to cache
2026-03-30 08:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0333184a-fd46-57f1-948a-ae0f68b22111
2026-03-30 08:36:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0333184a-fd46-57f1-948a-ae0f68b22111, skipping ID generation
2026-03-30 08:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0333184a-fd46-57f1-948a-ae0f68b22111 with scrape type 1
2026-03-30 08:36:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0333184a-fd46-57f1-948a-ae0f68b22111 sending to next pipeline
2026-03-30 08:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0333184a-fd46-57f1-948a-ae0f68b22111, identifier: EH30324
2026-03-30 08:36:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8ea4310>
2026-03-30 08:36:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39971d1d-c827-5ed3-8836-2132277dbc44/39971d1d-c827-5ed3-8836-2132277dbc44_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bfd8f3786744ab7c444eaeaa62f88d%252Fpa%252FBC23498_a82c578ec9e25713878e6290178a129a.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_a82c578ec9e25713878e6290178a129a.jpg saved to cache
2026-03-30 08:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 39971d1d-c827-5ed3-8836-2132277dbc44
2026-03-30 08:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_17ce90e8275d88809b27bbb703ce602a.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F54%252F7754074ffef72f8a61772e9a8b664b06%252Fpa%252FBM50316_c4ba75d611b8bbfdb72e98b22e3c3217.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_c4ba75d611b8bbfdb72e98b22e3c3217.jpg not downloaded yet
2026-03-30 08:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0333184a-fd46-57f1-948a-ae0f68b22111 with identifier: EH30324
2026-03-30 08:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0333184a-fd46-57f1-948a-ae0f68b22111 with identifier: EH30324
2026-03-30 08:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0333184a-fd46-57f1-948a-ae0f68b22111 with identifier: EH30324 to the API
2026-03-30 08:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_e08b50f1f016fb2e4efc62766230b1db.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '3.0L',
'engine_horse_power': 245,
'expiration_date': '2026-03-31T15:03:21Z',
'fuel_type': 'diesel',
'id': '0333184a-fd46-57f1-948a-ae0f68b22111',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH30324',
'listing': 'auction',
'location': 'BE, Bruxelles-Brussel',
'make': 'BMW',
'model': 'X5',
'odometer': 351754,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0333184a-fd46-57f1-948a-ae0f68b22111/0333184a-fd46-57f1-948a-ae0f68b22111_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2738634,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_9e0c0d393198d6238338f21deb643c7f.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0333184a-fd46-57f1-948a-ae0f68b22111/0333184a-fd46-57f1-948a-ae0f68b22111_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2805326,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_4fdeeb1b575e82b21be48a5291d50593.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0333184a-fd46-57f1-948a-ae0f68b22111/0333184a-fd46-57f1-948a-ae0f68b22111_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76875,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_dc63b3a2799e39a8949eec3e407df314.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0333184a-fd46-57f1-948a-ae0f68b22111/0333184a-fd46-57f1-948a-ae0f68b22111_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77132,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_7799d0ed27ebdf12816345a22e9b8e70.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0333184a-fd46-57f1-948a-ae0f68b22111/0333184a-fd46-57f1-948a-ae0f68b22111_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2682835,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_e08b50f1f016fb2e4efc62766230b1db.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0333184a-fd46-57f1-948a-ae0f68b22111/0333184a-fd46-57f1-948a-ae0f68b22111_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72824,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_939a1efe50dac6374eb53e5690c2dc50.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0333184a-fd46-57f1-948a-ae0f68b22111/0333184a-fd46-57f1-948a-ae0f68b22111_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69382,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_431f6764bdc31c9acfea22e76dbf179a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0333184a-fd46-57f1-948a-ae0f68b22111/0333184a-fd46-57f1-948a-ae0f68b22111_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76465,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_34aab85af1f87746d91aed7d7a5f21f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0333184a-fd46-57f1-948a-ae0f68b22111/0333184a-fd46-57f1-948a-ae0f68b22111_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73291,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_11e2bad6e5da924c2b4ed30b1341dea4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0333184a-fd46-57f1-948a-ae0f68b22111/0333184a-fd46-57f1-948a-ae0f68b22111_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61127,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/e0/cde074db263b54306897b79f29d18ba8/pa/EH30324_d4744c3e61706dd9eda28571b9b41a40.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2011-09-30',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X5 xDrive 30d',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EH30324%27 HTTP/1.1" 200 None
2026-03-30 08:36:50 [auto1.be] INFO: Saving data for EH30324: {'created_time': 1774859810.438, 'last_price_update_time': 1774859810.438011, 'auction_closing_time': 1774969401.0}
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EH30324') HTTP/1.1" 204 0
2026-03-30 08:36:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd90e3950>
2026-03-30 08:36:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39971d1d-c827-5ed3-8836-2132277dbc44/39971d1d-c827-5ed3-8836-2132277dbc44_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bfd8f3786744ab7c444eaeaa62f88d%252Fpa%252FBC23498_95464b33a8ba287f3bcfeaf98088c0d2.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_95464b33a8ba287f3bcfeaf98088c0d2.jpg saved to cache
2026-03-30 08:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 39971d1d-c827-5ed3-8836-2132277dbc44
2026-03-30 08:36:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd858cd90>
2026-03-30 08:36:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b08f87c-f0b3-5e1b-9d13-ebce27f46463/3b08f87c-f0b3-5e1b-9d13-ebce27f46463_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F98038124bd4d5bdd4bdcf674a2410fa7%252Fpa%252FYW02361_2b7cf647c74b2f3df000cec61ce7b0ee.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_2b7cf647c74b2f3df000cec61ce7b0ee.jpg saved to cache
2026-03-30 08:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3b08f87c-f0b3-5e1b-9d13-ebce27f46463
2026-03-30 08:36:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3b08f87c-f0b3-5e1b-9d13-ebce27f46463, skipping ID generation
2026-03-30 08:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b08f87c-f0b3-5e1b-9d13-ebce27f46463 with scrape type 1
2026-03-30 08:36:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3b08f87c-f0b3-5e1b-9d13-ebce27f46463 sending to next pipeline
2026-03-30 08:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3b08f87c-f0b3-5e1b-9d13-ebce27f46463, identifier: YW02361
2026-03-30 08:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7427f08-7e06-587e-8ddc-73d0ead9e47e with identifier: DJ79108
2026-03-30 08:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7427f08-7e06-587e-8ddc-73d0ead9e47e with scrape type 1
2026-03-30 08:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item d7427f08-7e06-587e-8ddc-73d0ead9e47e
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe9%252F02e9f627b4dfe89fc67d1640fa1ecc2c%252Fpa%252FDJ79108_06ca9adbbfaa70bdb6484cc936429569.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e9/02e9f627b4dfe89fc67d1640fa1ecc2c/pa/DJ79108_06ca9adbbfaa70bdb6484cc936429569.jpg already downloaded
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe9%252F02e9f627b4dfe89fc67d1640fa1ecc2c%252Fpa%252FDJ79108_bc79723c19e44ff83f0fec4ea27b8df1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e9/02e9f627b4dfe89fc67d1640fa1ecc2c/pa/DJ79108_bc79723c19e44ff83f0fec4ea27b8df1.jpg already downloaded
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe9%252F02e9f627b4dfe89fc67d1640fa1ecc2c%252Fpa%252FDJ79108_1c7880106373ef3a47163286158bb940.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e9/02e9f627b4dfe89fc67d1640fa1ecc2c/pa/DJ79108_1c7880106373ef3a47163286158bb940.jpg already downloaded
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe9%252F02e9f627b4dfe89fc67d1640fa1ecc2c%252Fpa%252FDJ79108_183865b509e21d32b1f6b4619d7bd2c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e9/02e9f627b4dfe89fc67d1640fa1ecc2c/pa/DJ79108_183865b509e21d32b1f6b4619d7bd2c1.jpg already downloaded
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe9%252F02e9f627b4dfe89fc67d1640fa1ecc2c%252Fpa%252FDJ79108_8e94be5027dc121a7f5871a7b07f8f31.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e9/02e9f627b4dfe89fc67d1640fa1ecc2c/pa/DJ79108_8e94be5027dc121a7f5871a7b07f8f31.jpg already downloaded
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252Fe9%252F02e9f627b4dfe89fc67d1640fa1ecc2c%252Fpa%252FDJ79108_c8dc2f4e7efbfce754bb9abfe57b7254.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e9/02e9f627b4dfe89fc67d1640fa1ecc2c/pa/DJ79108_c8dc2f4e7efbfce754bb9abfe57b7254.jpg already downloaded
2026-03-30 08:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d7427f08-7e06-587e-8ddc-73d0ead9e47e, identifier: DJ79108
2026-03-30 08:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba588f19-26bc-5a44-ab87-2a9899633bfe with identifier: ER70694
2026-03-30 08:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba588f19-26bc-5a44-ab87-2a9899633bfe with scrape type 1
2026-03-30 08:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ba588f19-26bc-5a44-ab87-2a9899633bfe
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f3e7efa195d5eab5ab7da619800b1e%252Fpa%252FER70694_add55302794467c0fbda4839de877ba6.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f3e7efa195d5eab5ab7da619800b1e/pa/ER70694_add55302794467c0fbda4839de877ba6.jpg already downloaded
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f3e7efa195d5eab5ab7da619800b1e%252Fpa%252FER70694_c7829e80714746f11e4f0cd07d01a9d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f3e7efa195d5eab5ab7da619800b1e/pa/ER70694_c7829e80714746f11e4f0cd07d01a9d3.jpg already downloaded
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f3e7efa195d5eab5ab7da619800b1e%252Fpa%252FER70694_d76df84d56293bd2f59bc6e83cd3e40b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f3e7efa195d5eab5ab7da619800b1e/pa/ER70694_d76df84d56293bd2f59bc6e83cd3e40b.jpg already downloaded
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f3e7efa195d5eab5ab7da619800b1e%252Fpa%252FER70694_8915211c2e10782dc56c173c5a5421d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f3e7efa195d5eab5ab7da619800b1e/pa/ER70694_8915211c2e10782dc56c173c5a5421d7.jpg already downloaded
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f3e7efa195d5eab5ab7da619800b1e%252Fpa%252FER70694_f94c8ab497f8a4fda806beab34c6c642.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f3e7efa195d5eab5ab7da619800b1e/pa/ER70694_f94c8ab497f8a4fda806beab34c6c642.jpg already downloaded
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f3e7efa195d5eab5ab7da619800b1e%252Fpa%252FER70694_ec571929f9ed33d47398ab0ab7281991.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f3e7efa195d5eab5ab7da619800b1e/pa/ER70694_ec571929f9ed33d47398ab0ab7281991.jpg already downloaded
2026-03-30 08:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f3e7efa195d5eab5ab7da619800b1e%252Fpa%252FER70694_40e87c928bb48e6ff04daec5a72d06a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f3e7efa195d5eab5ab7da619800b1e/pa/ER70694_40e87c928bb48e6ff04daec5a72d06a1.jpg already downloaded
2026-03-30 08:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f3e7efa195d5eab5ab7da619800b1e%252Fpa%252FER70694_6276ef0382561b49b8ce0fedbfa8f3b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f3e7efa195d5eab5ab7da619800b1e/pa/ER70694_6276ef0382561b49b8ce0fedbfa8f3b0.jpg already downloaded
2026-03-30 08:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f3e7efa195d5eab5ab7da619800b1e%252Fpa%252FER70694_df92f706ffdf32b811dedbc5fe4dc9df.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f3e7efa195d5eab5ab7da619800b1e/pa/ER70694_df92f706ffdf32b811dedbc5fe4dc9df.jpg already downloaded
2026-03-30 08:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Ff3%252Fd7f3e7efa195d5eab5ab7da619800b1e%252Fpa%252FER70694_e7314c668848de8f0795b21b6f8d3fc7.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/f3/d7f3e7efa195d5eab5ab7da619800b1e/pa/ER70694_e7314c668848de8f0795b21b6f8d3fc7.jpg already downloaded
2026-03-30 08:36:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ba588f19-26bc-5a44-ab87-2a9899633bfe, identifier: ER70694
2026-03-30 08:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bfd8f3786744ab7c444eaeaa62f88d%252Fpa%252FBC23498_23ad2ad59334999ef1d012029a6a21fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_23ad2ad59334999ef1d012029a6a21fb.jpg not downloaded yet
2026-03-30 08:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F31%252F4231d26874e26ae0008d0ef761942aab%252Fpa%252FGG54325_b327ca7eac625028827d7e72c2ffb4eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_b327ca7eac625028827d7e72c2ffb4eb.jpg not downloaded yet
2026-03-30 08:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fc3%252F96c391410134c0ea3fcb98ff1b87be37%252Fpa%252FDA89043_4c82a061fd7e98c3986445b10fde4923.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_4c82a061fd7e98c3986445b10fde4923.jpg not downloaded yet
2026-03-30 08:36:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3b08f87c-f0b3-5e1b-9d13-ebce27f46463 with identifier: YW02361
2026-03-30 08:36:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3b08f87c-f0b3-5e1b-9d13-ebce27f46463 with identifier: YW02361
2026-03-30 08:36:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3b08f87c-f0b3-5e1b-9d13-ebce27f46463 with identifier: YW02361 to the API
2026-03-30 08:36:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_2b7cf647c74b2f3df000cec61ce7b0ee.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-03-31T15:51:01Z',
'fuel_type': 'diesel',
'id': '3b08f87c-f0b3-5e1b-9d13-ebce27f46463',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW02361',
'listing': 'auction',
'location': 'BE, Wanze',
'make': 'Volkswagen',
'model': 'T6 California',
'odometer': 60575,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b08f87c-f0b3-5e1b-9d13-ebce27f46463/3b08f87c-f0b3-5e1b-9d13-ebce27f46463_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76028,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_83c2755a8e69fcbdca90e7793409e412.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b08f87c-f0b3-5e1b-9d13-ebce27f46463/3b08f87c-f0b3-5e1b-9d13-ebce27f46463_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81503,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_50f99b2a3f4d57e185017e8dc3859479.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b08f87c-f0b3-5e1b-9d13-ebce27f46463/3b08f87c-f0b3-5e1b-9d13-ebce27f46463_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82708,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_7dc26de174a7d1d21534f274015abae9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b08f87c-f0b3-5e1b-9d13-ebce27f46463/3b08f87c-f0b3-5e1b-9d13-ebce27f46463_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70352,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_4465416336c99617f694d1add3ee5943.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b08f87c-f0b3-5e1b-9d13-ebce27f46463/3b08f87c-f0b3-5e1b-9d13-ebce27f46463_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69238,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_e577c352074970993d0be70b887e274a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b08f87c-f0b3-5e1b-9d13-ebce27f46463/3b08f87c-f0b3-5e1b-9d13-ebce27f46463_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80597,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_aef81b5488906d11236ddc757a83ce89.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b08f87c-f0b3-5e1b-9d13-ebce27f46463/3b08f87c-f0b3-5e1b-9d13-ebce27f46463_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80372,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_27dbff88f6b6531f5ac1f76a39d944c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b08f87c-f0b3-5e1b-9d13-ebce27f46463/3b08f87c-f0b3-5e1b-9d13-ebce27f46463_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73698,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_daea9b49e075c7bf1048346278e4a686.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b08f87c-f0b3-5e1b-9d13-ebce27f46463/3b08f87c-f0b3-5e1b-9d13-ebce27f46463_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66890,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_437334c5a127efbfc7abc935a3952165.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3b08f87c-f0b3-5e1b-9d13-ebce27f46463/3b08f87c-f0b3-5e1b-9d13-ebce27f46463_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80893,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/03/98038124bd4d5bdd4bdcf674a2410fa7/pa/YW02361_2b7cf647c74b2f3df000cec61ce7b0ee.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2022-06-30',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen T6 California 2.0 TDI Beach Camper 4Motion',
'transmission': 'automatic',
'trim': 'Beach Camper 4Motion',
'year': 2022}
2026-03-30 08:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW02361%27 HTTP/1.1" 200 None
2026-03-30 08:36:51 [auto1.be] INFO: Saving data for YW02361: {'created_time': 1774859811.623008, 'last_price_update_time': 1774859811.623019, 'auction_closing_time': 1774972261.0}
2026-03-30 08:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YW02361') HTTP/1.1" 204 0
2026-03-30 08:36:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d7427f08-7e06-587e-8ddc-73d0ead9e47e with identifier: DJ79108
2026-03-30 08:36:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d7427f08-7e06-587e-8ddc-73d0ead9e47e with identifier: DJ79108
2026-03-30 08:36:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d7427f08-7e06-587e-8ddc-73d0ead9e47e with identifier: DJ79108 to the API
2026-03-30 08:36:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DJ79108>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.2L',
'engine_horse_power': 95,
'expiration_date': '2026-03-31T15:09:57Z',
'fuel_type': 'diesel',
'id': 'd7427f08-7e06-587e-8ddc-73d0ead9e47e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ79108',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Opel',
'model': 'Corsa',
'odometer': 187042,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img02/e9/02e9f627b4dfe89fc67d1640fa1ecc2c/pa/DJ79108_06ca9adbbfaa70bdb6484cc936429569.jpg',
'https://img-pa.auto1.com/img02/e9/02e9f627b4dfe89fc67d1640fa1ecc2c/pa/DJ79108_bc79723c19e44ff83f0fec4ea27b8df1.jpg',
'https://img-pa.auto1.com/img02/e9/02e9f627b4dfe89fc67d1640fa1ecc2c/pa/DJ79108_1c7880106373ef3a47163286158bb940.jpg',
'https://img-pa.auto1.com/img02/e9/02e9f627b4dfe89fc67d1640fa1ecc2c/pa/DJ79108_183865b509e21d32b1f6b4619d7bd2c1.jpg',
'https://img-pa.auto1.com/img02/e9/02e9f627b4dfe89fc67d1640fa1ecc2c/pa/DJ79108_8e94be5027dc121a7f5871a7b07f8f31.jpg',
'https://img-pa.auto1.com/img02/e9/02e9f627b4dfe89fc67d1640fa1ecc2c/pa/DJ79108_c8dc2f4e7efbfce754bb9abfe57b7254.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7427f08-7e06-587e-8ddc-73d0ead9e47e/d7427f08-7e06-587e-8ddc-73d0ead9e47e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110453,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/e9/02e9f627b4dfe89fc67d1640fa1ecc2c/pa/DJ79108_06ca9adbbfaa70bdb6484cc936429569.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7427f08-7e06-587e-8ddc-73d0ead9e47e/d7427f08-7e06-587e-8ddc-73d0ead9e47e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112622,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/e9/02e9f627b4dfe89fc67d1640fa1ecc2c/pa/DJ79108_bc79723c19e44ff83f0fec4ea27b8df1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7427f08-7e06-587e-8ddc-73d0ead9e47e/d7427f08-7e06-587e-8ddc-73d0ead9e47e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74690,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/e9/02e9f627b4dfe89fc67d1640fa1ecc2c/pa/DJ79108_1c7880106373ef3a47163286158bb940.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7427f08-7e06-587e-8ddc-73d0ead9e47e/d7427f08-7e06-587e-8ddc-73d0ead9e47e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60718,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/e9/02e9f627b4dfe89fc67d1640fa1ecc2c/pa/DJ79108_183865b509e21d32b1f6b4619d7bd2c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7427f08-7e06-587e-8ddc-73d0ead9e47e/d7427f08-7e06-587e-8ddc-73d0ead9e47e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 123037,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/e9/02e9f627b4dfe89fc67d1640fa1ecc2c/pa/DJ79108_8e94be5027dc121a7f5871a7b07f8f31.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7427f08-7e06-587e-8ddc-73d0ead9e47e/d7427f08-7e06-587e-8ddc-73d0ead9e47e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111308,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/e9/02e9f627b4dfe89fc67d1640fa1ecc2c/pa/DJ79108_c8dc2f4e7efbfce754bb9abfe57b7254.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2010-05-10',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Corsa 1.3 CDTI Selection',
'transmission': 'manual',
'trim': 'Selection',
'year': 2010}
2026-03-30 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ79108%27 HTTP/1.1" 200 None
2026-03-30 08:36:52 [auto1.be] INFO: Saving data for DJ79108: {'created_time': 1774859812.964407, 'last_price_update_time': 1774859812.964419, 'auction_closing_time': 1774969797.0}
2026-03-30 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DJ79108') HTTP/1.1" 204 0
2026-03-30 08:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ba588f19-26bc-5a44-ab87-2a9899633bfe with identifier: ER70694
2026-03-30 08:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ba588f19-26bc-5a44-ab87-2a9899633bfe with identifier: ER70694
2026-03-30 08:36:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ba588f19-26bc-5a44-ab87-2a9899633bfe with identifier: ER70694 to the API
2026-03-30 08:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ER70694>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.6L',
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:41:05Z',
'fuel_type': 'diesel',
'id': 'ba588f19-26bc-5a44-ab87-2a9899633bfe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER70694',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Peugeot',
'model': '2008',
'odometer': 184659,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/imgd7/f3/d7f3e7efa195d5eab5ab7da619800b1e/pa/ER70694_add55302794467c0fbda4839de877ba6.jpg',
'https://img-pa.auto1.com/imgd7/f3/d7f3e7efa195d5eab5ab7da619800b1e/pa/ER70694_c7829e80714746f11e4f0cd07d01a9d3.jpg',
'https://img-pa.auto1.com/imgd7/f3/d7f3e7efa195d5eab5ab7da619800b1e/pa/ER70694_d76df84d56293bd2f59bc6e83cd3e40b.jpg',
'https://img-pa.auto1.com/imgd7/f3/d7f3e7efa195d5eab5ab7da619800b1e/pa/ER70694_8915211c2e10782dc56c173c5a5421d7.jpg',
'https://img-pa.auto1.com/imgd7/f3/d7f3e7efa195d5eab5ab7da619800b1e/pa/ER70694_f94c8ab497f8a4fda806beab34c6c642.jpg',
'https://img-pa.auto1.com/imgd7/f3/d7f3e7efa195d5eab5ab7da619800b1e/pa/ER70694_ec571929f9ed33d47398ab0ab7281991.jpg',
'https://img-pa.auto1.com/imgd7/f3/d7f3e7efa195d5eab5ab7da619800b1e/pa/ER70694_40e87c928bb48e6ff04daec5a72d06a1.jpg',
'https://img-pa.auto1.com/imgd7/f3/d7f3e7efa195d5eab5ab7da619800b1e/pa/ER70694_6276ef0382561b49b8ce0fedbfa8f3b0.jpg',
'https://img-pa.auto1.com/imgd7/f3/d7f3e7efa195d5eab5ab7da619800b1e/pa/ER70694_df92f706ffdf32b811dedbc5fe4dc9df.jpg',
'https://img-pa.auto1.com/imgd7/f3/d7f3e7efa195d5eab5ab7da619800b1e/pa/ER70694_e7314c668848de8f0795b21b6f8d3fc7.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba588f19-26bc-5a44-ab87-2a9899633bfe/ba588f19-26bc-5a44-ab87-2a9899633bfe_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66238,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/f3/d7f3e7efa195d5eab5ab7da619800b1e/pa/ER70694_add55302794467c0fbda4839de877ba6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba588f19-26bc-5a44-ab87-2a9899633bfe/ba588f19-26bc-5a44-ab87-2a9899633bfe_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55538,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/f3/d7f3e7efa195d5eab5ab7da619800b1e/pa/ER70694_c7829e80714746f11e4f0cd07d01a9d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba588f19-26bc-5a44-ab87-2a9899633bfe/ba588f19-26bc-5a44-ab87-2a9899633bfe_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67544,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/f3/d7f3e7efa195d5eab5ab7da619800b1e/pa/ER70694_d76df84d56293bd2f59bc6e83cd3e40b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba588f19-26bc-5a44-ab87-2a9899633bfe/ba588f19-26bc-5a44-ab87-2a9899633bfe_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65479,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/f3/d7f3e7efa195d5eab5ab7da619800b1e/pa/ER70694_8915211c2e10782dc56c173c5a5421d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba588f19-26bc-5a44-ab87-2a9899633bfe/ba588f19-26bc-5a44-ab87-2a9899633bfe_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61802,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/f3/d7f3e7efa195d5eab5ab7da619800b1e/pa/ER70694_f94c8ab497f8a4fda806beab34c6c642.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba588f19-26bc-5a44-ab87-2a9899633bfe/ba588f19-26bc-5a44-ab87-2a9899633bfe_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64241,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/f3/d7f3e7efa195d5eab5ab7da619800b1e/pa/ER70694_ec571929f9ed33d47398ab0ab7281991.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba588f19-26bc-5a44-ab87-2a9899633bfe/ba588f19-26bc-5a44-ab87-2a9899633bfe_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57075,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/f3/d7f3e7efa195d5eab5ab7da619800b1e/pa/ER70694_40e87c928bb48e6ff04daec5a72d06a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba588f19-26bc-5a44-ab87-2a9899633bfe/ba588f19-26bc-5a44-ab87-2a9899633bfe_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67270,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/f3/d7f3e7efa195d5eab5ab7da619800b1e/pa/ER70694_6276ef0382561b49b8ce0fedbfa8f3b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba588f19-26bc-5a44-ab87-2a9899633bfe/ba588f19-26bc-5a44-ab87-2a9899633bfe_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55997,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/f3/d7f3e7efa195d5eab5ab7da619800b1e/pa/ER70694_df92f706ffdf32b811dedbc5fe4dc9df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba588f19-26bc-5a44-ab87-2a9899633bfe/ba588f19-26bc-5a44-ab87-2a9899633bfe_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68217,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/f3/d7f3e7efa195d5eab5ab7da619800b1e/pa/ER70694_e7314c668848de8f0795b21b6f8d3fc7.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.6 Blue-HDi Access',
'transmission': 'manual',
'trim': 'Access',
'year': 2016}
2026-03-30 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ER70694%27 HTTP/1.1" 200 None
2026-03-30 08:36:53 [auto1.be] INFO: Saving data for ER70694: {'created_time': 1774859813.315154, 'last_price_update_time': 1774859813.315167, 'auction_closing_time': 1774971665.0}
2026-03-30 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ER70694') HTTP/1.1" 204 0
2026-03-30 08:36:53 [auto1.be] INFO: Channel: 24h | Page: 8 | totalHits: 1502 | hits on page: 40
2026-03-30 08:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_364f88fc039370bf5369cf9572f807fa.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F54%252F7754074ffef72f8a61772e9a8b664b06%252Fpa%252FBM50316_f9eaa7aab4de96303ad0bb9a8bcca780.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_f9eaa7aab4de96303ad0bb9a8bcca780.jpg not downloaded yet
2026-03-30 08:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UK31480> (referer: https://www.auto1.com/v1/car-details-view/UK31480/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_4eb70f7d37d90fea370d03145d881c52.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_a0df79c6e32ecd34f0d839c3267cfcd7.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F31%252F4231d26874e26ae0008d0ef761942aab%252Fpa%252FGG54325_59339a06c941c9944f4dad206663bb12.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_59339a06c941c9944f4dad206663bb12.jpg not downloaded yet
2026-03-30 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fc3%252F96c391410134c0ea3fcb98ff1b87be37%252Fpa%252FDA89043_abc36b034870a0a6c1ce4c0635851b0c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_abc36b034870a0a6c1ce4c0635851b0c.jpg not downloaded yet
2026-03-30 08:36:53 [auto1.be] INFO: Found listing with ID: CY85383
2026-03-30 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY85383%27 HTTP/1.1" 200 None
2026-03-30 08:36:53 [auto1.be] INFO: Scrape type for CY85383: 2
2026-03-30 08:36:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 826fa6ec-4704-5fa6-a7eb-b6e12f335807 with identifier: CY85383
2026-03-30 08:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 826fa6ec-4704-5fa6-a7eb-b6e12f335807 with scrape type 2
2026-03-30 08:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 826fa6ec-4704-5fa6-a7eb-b6e12f335807 with scrape type 2
2026-03-30 08:36:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 826fa6ec-4704-5fa6-a7eb-b6e12f335807, identifier: CY85383
2026-03-30 08:36:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:36:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd90ee910>
2026-03-30 08:36:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39971d1d-c827-5ed3-8836-2132277dbc44/39971d1d-c827-5ed3-8836-2132277dbc44_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bfd8f3786744ab7c444eaeaa62f88d%252Fpa%252FBC23498_17ce90e8275d88809b27bbb703ce602a.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_17ce90e8275d88809b27bbb703ce602a.jpg saved to cache
2026-03-30 08:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 39971d1d-c827-5ed3-8836-2132277dbc44
2026-03-30 08:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_062d67f2ae3db07117ad34bbfb4f6c84.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F54%252F7754074ffef72f8a61772e9a8b664b06%252Fpa%252FBM50316_c29d0c17c13d28febe9ce51d7fb95107.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_c29d0c17c13d28febe9ce51d7fb95107.jpg not downloaded yet
2026-03-30 08:36:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 826fa6ec-4704-5fa6-a7eb-b6e12f335807 with identifier: CY85383
2026-03-30 08:36:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 826fa6ec-4704-5fa6-a7eb-b6e12f335807 with identifier: CY85383
2026-03-30 08:36:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 826fa6ec-4704-5fa6-a7eb-b6e12f335807 with identifier: CY85383 to the API
2026-03-30 08:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:45:59Z',
'fuel_type': 'petrol',
'id': '826fa6ec-4704-5fa6-a7eb-b6e12f335807',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY85383',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 126985,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-23',
'seller_name': None,
'title': 'BMW X1 sDrive 18i xLine',
'transmission': 'manual',
'trim': 'xLine',
'year': 2017}
2026-03-30 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CY85383%27 HTTP/1.1" 200 None
2026-03-30 08:36:53 [auto1.be] INFO: Saving data for CY85383: {'auction_closing_time': 1774885559.0, 'created_time': 1774773329.012051, 'last_price_update_time': 1774859813.912947}
2026-03-30 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CY85383') HTTP/1.1" 204 0
2026-03-30 08:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_cc84423598c4dd674123f379680227e4.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_37fb8e98ecdbf6075367ad79d4477d5d.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F31%252F4231d26874e26ae0008d0ef761942aab%252Fpa%252FGG54325_1ffdc57805a0cfe21e526d2d2c60a51b.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_1ffdc57805a0cfe21e526d2d2c60a51b.jpg not downloaded yet
2026-03-30 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fc3%252F96c391410134c0ea3fcb98ff1b87be37%252Fpa%252FDA89043_22b5738fdff3738b0aef64f88b78948c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_22b5738fdff3738b0aef64f88b78948c.jpg not downloaded yet
2026-03-30 08:36:53 [auto1.be] INFO: Found listing with ID: MK20841
2026-03-30 08:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK20841%27 HTTP/1.1" 200 None
2026-03-30 08:36:54 [auto1.be] INFO: Scrape type for MK20841: 2
2026-03-30 08:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f00419ab-005d-52a3-a1fe-e32ee02d70cd with identifier: MK20841
2026-03-30 08:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f00419ab-005d-52a3-a1fe-e32ee02d70cd with scrape type 2
2026-03-30 08:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f00419ab-005d-52a3-a1fe-e32ee02d70cd with scrape type 2
2026-03-30 08:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f00419ab-005d-52a3-a1fe-e32ee02d70cd, identifier: MK20841
2026-03-30 08:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_c4ba75d611b8bbfdb72e98b22e3c3217.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_69da97f54d40bd1268100b9cbd976e91.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_41dc9e792ffbec67b5b8e09547a0121c.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F54%252F7754074ffef72f8a61772e9a8b664b06%252Fpa%252FBM50316_b4fc7eb1502fb79554d9dd3df5305c33.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_b4fc7eb1502fb79554d9dd3df5305c33.jpg not downloaded yet
2026-03-30 08:36:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f00419ab-005d-52a3-a1fe-e32ee02d70cd with identifier: MK20841
2026-03-30 08:36:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f00419ab-005d-52a3-a1fe-e32ee02d70cd with identifier: MK20841
2026-03-30 08:36:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f00419ab-005d-52a3-a1fe-e32ee02d70cd with identifier: MK20841 to the API
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 252,
'expiration_date': '2026-03-30T15:34:55Z',
'fuel_type': 'hybrid',
'id': 'f00419ab-005d-52a3-a1fe-e32ee02d70cd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK20841',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 120199,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-08',
'seller_name': None,
'title': 'BMW 3er 330e Luxury Line',
'transmission': 'automatic',
'trim': 'Luxury Line',
'year': 2021}
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MK20841%27 HTTP/1.1" 200 None
2026-03-30 08:36:54 [auto1.be] INFO: Saving data for MK20841: {'auction_closing_time': 1774884895.0, 'created_time': 1773693544.683782, 'last_price_update_time': 1774859814.379774}
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MK20841') HTTP/1.1" 204 0
2026-03-30 08:36:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd82bc390>
2026-03-30 08:36:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39971d1d-c827-5ed3-8836-2132277dbc44/39971d1d-c827-5ed3-8836-2132277dbc44_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bfd8f3786744ab7c444eaeaa62f88d%252Fpa%252FBC23498_364f88fc039370bf5369cf9572f807fa.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_364f88fc039370bf5369cf9572f807fa.jpg saved to cache
2026-03-30 08:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 39971d1d-c827-5ed3-8836-2132277dbc44
2026-03-30 08:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3f28d5f-849f-56ee-93ca-e7fd6cab89ff with identifier: UK31480
2026-03-30 08:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3f28d5f-849f-56ee-93ca-e7fd6cab89ff with scrape type 1
2026-03-30 08:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item d3f28d5f-849f-56ee-93ca-e7fd6cab89ff
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F68%252F9e687025ba967a169c93a14842feffac%252Fpa%252FUK31480_8166f67433d6c331d50c860db25b1281.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/68/9e687025ba967a169c93a14842feffac/pa/UK31480_8166f67433d6c331d50c860db25b1281.jpg already downloaded
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F68%252F9e687025ba967a169c93a14842feffac%252Fpa%252FUK31480_1a0a411d48b5b1675f6e284fae6cf596.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/68/9e687025ba967a169c93a14842feffac/pa/UK31480_1a0a411d48b5b1675f6e284fae6cf596.jpg already downloaded
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F68%252F9e687025ba967a169c93a14842feffac%252Fpa%252FUK31480_b3dbafac363ca68e7b49ab98af157116.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/68/9e687025ba967a169c93a14842feffac/pa/UK31480_b3dbafac363ca68e7b49ab98af157116.jpg already downloaded
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F68%252F9e687025ba967a169c93a14842feffac%252Fpa%252FUK31480_e18827b2aec37bdffe67fe97ca742686.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/68/9e687025ba967a169c93a14842feffac/pa/UK31480_e18827b2aec37bdffe67fe97ca742686.jpg already downloaded
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F68%252F9e687025ba967a169c93a14842feffac%252Fpa%252FUK31480_234fc361679a163a8cab07a90fd1dead.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/68/9e687025ba967a169c93a14842feffac/pa/UK31480_234fc361679a163a8cab07a90fd1dead.jpg already downloaded
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F68%252F9e687025ba967a169c93a14842feffac%252Fpa%252FUK31480_5d6be8ab045294936d3682f923b70f1c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/68/9e687025ba967a169c93a14842feffac/pa/UK31480_5d6be8ab045294936d3682f923b70f1c.jpg already downloaded
2026-03-30 08:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d3f28d5f-849f-56ee-93ca-e7fd6cab89ff, identifier: UK31480
2026-03-30 08:36:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd84ea250>
2026-03-30 08:36:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39971d1d-c827-5ed3-8836-2132277dbc44/39971d1d-c827-5ed3-8836-2132277dbc44_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bfd8f3786744ab7c444eaeaa62f88d%252Fpa%252FBC23498_4eb70f7d37d90fea370d03145d881c52.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_4eb70f7d37d90fea370d03145d881c52.jpg saved to cache
2026-03-30 08:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 39971d1d-c827-5ed3-8836-2132277dbc44
2026-03-30 08:36:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd846e450>
2026-03-30 08:36:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9e1f2e2-274b-5380-bab7-61c853c9a738/a9e1f2e2-274b-5380-bab7-61c853c9a738_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F54%252F7754074ffef72f8a61772e9a8b664b06%252Fpa%252FBM50316_a0df79c6e32ecd34f0d839c3267cfcd7.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_a0df79c6e32ecd34f0d839c3267cfcd7.jpg saved to cache
2026-03-30 08:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a9e1f2e2-274b-5380-bab7-61c853c9a738
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F31%252F4231d26874e26ae0008d0ef761942aab%252Fpa%252FGG54325_73da6b1aecc99a5953376a821acec775.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_73da6b1aecc99a5953376a821acec775.jpg not downloaded yet
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fc3%252F96c391410134c0ea3fcb98ff1b87be37%252Fpa%252FDA89043_91aeb9c7ee0fb08fb003b9521c157ade.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_91aeb9c7ee0fb08fb003b9521c157ade.jpg not downloaded yet
2026-03-30 08:36:54 [auto1.be] INFO: Found listing with ID: NE45749
2026-03-30 08:36:54 [auto1.be] INFO: Found listing with ID: VP73114
2026-03-30 08:36:54 [auto1.be] INFO: Found listing with ID: XS85102
2026-03-30 08:36:54 [auto1.be] INFO: Found listing with ID: GB22067
2026-03-30 08:36:54 [auto1.be] INFO: Found listing with ID: RX06086
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX06086%27 HTTP/1.1" 200 None
2026-03-30 08:36:54 [auto1.be] INFO: Scrape type for RX06086: 2
2026-03-30 08:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0055cfc8-0ea8-5ed6-92c3-6262c976ff2d with identifier: RX06086
2026-03-30 08:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0055cfc8-0ea8-5ed6-92c3-6262c976ff2d with scrape type 2
2026-03-30 08:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0055cfc8-0ea8-5ed6-92c3-6262c976ff2d with scrape type 2
2026-03-30 08:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0055cfc8-0ea8-5ed6-92c3-6262c976ff2d, identifier: RX06086
2026-03-30 08:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d3f28d5f-849f-56ee-93ca-e7fd6cab89ff with identifier: UK31480
2026-03-30 08:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d3f28d5f-849f-56ee-93ca-e7fd6cab89ff with identifier: UK31480
2026-03-30 08:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d3f28d5f-849f-56ee-93ca-e7fd6cab89ff with identifier: UK31480 to the API
2026-03-30 08:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UK31480>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2026-03-31T15:41:41Z',
'fuel_type': 'petrol',
'id': 'd3f28d5f-849f-56ee-93ca-e7fd6cab89ff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK31480',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Fiat',
'model': '500',
'odometer': 172443,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 6,
'photo_urls': ['https://img-pa.auto1.com/img9e/68/9e687025ba967a169c93a14842feffac/pa/UK31480_8166f67433d6c331d50c860db25b1281.jpg',
'https://img-pa.auto1.com/img9e/68/9e687025ba967a169c93a14842feffac/pa/UK31480_1a0a411d48b5b1675f6e284fae6cf596.jpg',
'https://img-pa.auto1.com/img9e/68/9e687025ba967a169c93a14842feffac/pa/UK31480_b3dbafac363ca68e7b49ab98af157116.jpg',
'https://img-pa.auto1.com/img9e/68/9e687025ba967a169c93a14842feffac/pa/UK31480_e18827b2aec37bdffe67fe97ca742686.jpg',
'https://img-pa.auto1.com/img9e/68/9e687025ba967a169c93a14842feffac/pa/UK31480_234fc361679a163a8cab07a90fd1dead.jpg',
'https://img-pa.auto1.com/img9e/68/9e687025ba967a169c93a14842feffac/pa/UK31480_5d6be8ab045294936d3682f923b70f1c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3f28d5f-849f-56ee-93ca-e7fd6cab89ff/d3f28d5f-849f-56ee-93ca-e7fd6cab89ff_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73811,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/68/9e687025ba967a169c93a14842feffac/pa/UK31480_8166f67433d6c331d50c860db25b1281.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3f28d5f-849f-56ee-93ca-e7fd6cab89ff/d3f28d5f-849f-56ee-93ca-e7fd6cab89ff_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68892,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/68/9e687025ba967a169c93a14842feffac/pa/UK31480_1a0a411d48b5b1675f6e284fae6cf596.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3f28d5f-849f-56ee-93ca-e7fd6cab89ff/d3f28d5f-849f-56ee-93ca-e7fd6cab89ff_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74550,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/68/9e687025ba967a169c93a14842feffac/pa/UK31480_b3dbafac363ca68e7b49ab98af157116.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3f28d5f-849f-56ee-93ca-e7fd6cab89ff/d3f28d5f-849f-56ee-93ca-e7fd6cab89ff_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58137,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/68/9e687025ba967a169c93a14842feffac/pa/UK31480_e18827b2aec37bdffe67fe97ca742686.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3f28d5f-849f-56ee-93ca-e7fd6cab89ff/d3f28d5f-849f-56ee-93ca-e7fd6cab89ff_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96676,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/68/9e687025ba967a169c93a14842feffac/pa/UK31480_234fc361679a163a8cab07a90fd1dead.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3f28d5f-849f-56ee-93ca-e7fd6cab89ff/d3f28d5f-849f-56ee-93ca-e7fd6cab89ff_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67304,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/68/9e687025ba967a169c93a14842feffac/pa/UK31480_5d6be8ab045294936d3682f923b70f1c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2013-09-29',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2013}
2026-03-30 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UK31480%27 HTTP/1.1" 200 None
2026-03-30 08:36:55 [auto1.be] INFO: Saving data for UK31480: {'created_time': 1774859815.428942, 'last_price_update_time': 1774859815.428954, 'auction_closing_time': 1774971701.0}
2026-03-30 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UK31480') HTTP/1.1" 204 0
2026-03-30 08:36:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd833a450>
2026-03-30 08:36:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cc07b45-d470-52bc-8587-132c5507cd9b/6cc07b45-d470-52bc-8587-132c5507cd9b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F31%252F4231d26874e26ae0008d0ef761942aab%252Fpa%252FGG54325_062d67f2ae3db07117ad34bbfb4f6c84.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_062d67f2ae3db07117ad34bbfb4f6c84.jpg saved to cache
2026-03-30 08:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6cc07b45-d470-52bc-8587-132c5507cd9b
2026-03-30 08:36:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_f9eaa7aab4de96303ad0bb9a8bcca780.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_b327ca7eac625028827d7e72c2ffb4eb.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F54%252F7754074ffef72f8a61772e9a8b664b06%252Fpa%252FBM50316_1922f1a7c4f6ad1e816fe828acc68ab3.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_1922f1a7c4f6ad1e816fe828acc68ab3.jpg not downloaded yet
2026-03-30 08:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0055cfc8-0ea8-5ed6-92c3-6262c976ff2d with identifier: RX06086
2026-03-30 08:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0055cfc8-0ea8-5ed6-92c3-6262c976ff2d with identifier: RX06086
2026-03-30 08:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0055cfc8-0ea8-5ed6-92c3-6262c976ff2d with identifier: RX06086 to the API
2026-03-30 08:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:18:16Z',
'fuel_type': 'diesel',
'id': '0055cfc8-0ea8-5ed6-92c3-6262c976ff2d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX06086',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 51713,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-04',
'seller_name': None,
'title': 'BMW 3er 318d Mild-Hybrid Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2022}
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX06086%27 HTTP/1.1" 200 None
2026-03-30 08:36:56 [auto1.be] INFO: Saving data for RX06086: {'auction_closing_time': 1774883896.0, 'created_time': 1774773331.63355, 'last_price_update_time': 1774859816.359489}
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RX06086') HTTP/1.1" 204 0
2026-03-30 08:36:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_59339a06c941c9944f4dad206663bb12.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_4c82a061fd7e98c3986445b10fde4923.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_23ad2ad59334999ef1d012029a6a21fb.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F31%252F4231d26874e26ae0008d0ef761942aab%252Fpa%252FGG54325_3411471eb4b1c43c904c66add968d92c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_3411471eb4b1c43c904c66add968d92c.jpg not downloaded yet
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fc3%252F96c391410134c0ea3fcb98ff1b87be37%252Fpa%252FDA89043_51a3f3bc14465819febfba356e6049ba.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_51a3f3bc14465819febfba356e6049ba.jpg not downloaded yet
2026-03-30 08:36:56 [auto1.be] INFO: Found listing with ID: BJ49980
2026-03-30 08:36:56 [auto1.be] INFO: Found listing with ID: PE70540
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PE70540%27 HTTP/1.1" 200 None
2026-03-30 08:36:56 [auto1.be] INFO: Scrape type for PE70540: 0
2026-03-30 08:36:56 [auto1.be] INFO: Found listing with ID: ZZ18378
2026-03-30 08:36:56 [auto1.be] INFO: Found listing with ID: GN69495
2026-03-30 08:36:56 [auto1.be] INFO: Found listing with ID: XD29708
2026-03-30 08:36:56 [auto1.be] INFO: Found listing with ID: SK35491
2026-03-30 08:36:56 [auto1.be] INFO: Found listing with ID: KT58942
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT58942%27 HTTP/1.1" 200 None
2026-03-30 08:36:56 [auto1.be] INFO: Scrape type for KT58942: 2
2026-03-30 08:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa136741-a903-582a-8e45-c5ce6c6ac8cf with identifier: KT58942
2026-03-30 08:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa136741-a903-582a-8e45-c5ce6c6ac8cf with scrape type 2
2026-03-30 08:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa136741-a903-582a-8e45-c5ce6c6ac8cf with scrape type 2
2026-03-30 08:36:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: aa136741-a903-582a-8e45-c5ce6c6ac8cf, identifier: KT58942
2026-03-30 08:36:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8ff74d0>
2026-03-30 08:36:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cc07b45-d470-52bc-8587-132c5507cd9b/6cc07b45-d470-52bc-8587-132c5507cd9b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F31%252F4231d26874e26ae0008d0ef761942aab%252Fpa%252FGG54325_cc84423598c4dd674123f379680227e4.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_cc84423598c4dd674123f379680227e4.jpg saved to cache
2026-03-30 08:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6cc07b45-d470-52bc-8587-132c5507cd9b
2026-03-30 08:36:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd837f190>
2026-03-30 08:36:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39971d1d-c827-5ed3-8836-2132277dbc44/39971d1d-c827-5ed3-8836-2132277dbc44_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bfd8f3786744ab7c444eaeaa62f88d%252Fpa%252FBC23498_37fb8e98ecdbf6075367ad79d4477d5d.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_37fb8e98ecdbf6075367ad79d4477d5d.jpg saved to cache
2026-03-30 08:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 39971d1d-c827-5ed3-8836-2132277dbc44
2026-03-30 08:36:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8588310>
2026-03-30 08:36:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9e1f2e2-274b-5380-bab7-61c853c9a738/a9e1f2e2-274b-5380-bab7-61c853c9a738_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F54%252F7754074ffef72f8a61772e9a8b664b06%252Fpa%252FBM50316_c4ba75d611b8bbfdb72e98b22e3c3217.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_c4ba75d611b8bbfdb72e98b22e3c3217.jpg saved to cache
2026-03-30 08:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a9e1f2e2-274b-5380-bab7-61c853c9a738
2026-03-30 08:36:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd82fc0d0>
2026-03-30 08:36:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7/6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fc3%252F96c391410134c0ea3fcb98ff1b87be37%252Fpa%252FDA89043_69da97f54d40bd1268100b9cbd976e91.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_69da97f54d40bd1268100b9cbd976e91.jpg saved to cache
2026-03-30 08:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7
2026-03-30 08:36:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd84a1410>
2026-03-30 08:36:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9e1f2e2-274b-5380-bab7-61c853c9a738/a9e1f2e2-274b-5380-bab7-61c853c9a738_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F54%252F7754074ffef72f8a61772e9a8b664b06%252Fpa%252FBM50316_41dc9e792ffbec67b5b8e09547a0121c.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_41dc9e792ffbec67b5b8e09547a0121c.jpg saved to cache
2026-03-30 08:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a9e1f2e2-274b-5380-bab7-61c853c9a738
2026-03-30 08:36:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_abc36b034870a0a6c1ce4c0635851b0c.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F54%252F7754074ffef72f8a61772e9a8b664b06%252Fpa%252FBM50316_7bd17d6a501cb63b348d288718e508d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_7bd17d6a501cb63b348d288718e508d2.jpg not downloaded yet
2026-03-30 08:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: aa136741-a903-582a-8e45-c5ce6c6ac8cf with identifier: KT58942
2026-03-30 08:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: aa136741-a903-582a-8e45-c5ce6c6ac8cf with identifier: KT58942
2026-03-30 08:36:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: aa136741-a903-582a-8e45-c5ce6c6ac8cf with identifier: KT58942 to the API
2026-03-30 08:36:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 340,
'expiration_date': '2026-03-30T15:46:35Z',
'fuel_type': 'petrol',
'id': 'aa136741-a903-582a-8e45-c5ce6c6ac8cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT58942',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 92227,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-26',
'seller_name': None,
'title': 'Audi A6 55 TFSI Mild-Hybrid quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2018}
2026-03-30 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT58942%27 HTTP/1.1" 200 None
2026-03-30 08:36:57 [auto1.be] INFO: Saving data for KT58942: {'auction_closing_time': 1774885595.0, 'created_time': 1773693602.362588, 'last_price_update_time': 1774859817.163564}
2026-03-30 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KT58942') HTTP/1.1" 204 0
2026-03-30 08:36:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_c29d0c17c13d28febe9ce51d7fb95107.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F31%252F4231d26874e26ae0008d0ef761942aab%252Fpa%252FGG54325_ab83d8c2275254f955ca312c45d6cb85.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_ab83d8c2275254f955ca312c45d6cb85.jpg not downloaded yet
2026-03-30 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fc3%252F96c391410134c0ea3fcb98ff1b87be37%252Fpa%252FDA89043_f6a660a508a819f17951207fe1f63f1d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_f6a660a508a819f17951207fe1f63f1d.jpg not downloaded yet
2026-03-30 08:36:57 [auto1.be] INFO: Found listing with ID: UY87343
2026-03-30 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY87343%27 HTTP/1.1" 200 None
2026-03-30 08:36:57 [auto1.be] INFO: Scrape type for UY87343: 2
2026-03-30 08:36:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6b02178-5ddd-5ae9-a577-76fb518f9234 with identifier: UY87343
2026-03-30 08:36:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6b02178-5ddd-5ae9-a577-76fb518f9234 with scrape type 2
2026-03-30 08:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6b02178-5ddd-5ae9-a577-76fb518f9234 with scrape type 2
2026-03-30 08:36:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b6b02178-5ddd-5ae9-a577-76fb518f9234, identifier: UY87343
2026-03-30 08:36:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd838b490>
2026-03-30 08:36:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9e1f2e2-274b-5380-bab7-61c853c9a738/a9e1f2e2-274b-5380-bab7-61c853c9a738_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F54%252F7754074ffef72f8a61772e9a8b664b06%252Fpa%252FBM50316_f9eaa7aab4de96303ad0bb9a8bcca780.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_f9eaa7aab4de96303ad0bb9a8bcca780.jpg saved to cache
2026-03-30 08:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a9e1f2e2-274b-5380-bab7-61c853c9a738
2026-03-30 08:36:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8e8e450>
2026-03-30 08:36:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cc07b45-d470-52bc-8587-132c5507cd9b/6cc07b45-d470-52bc-8587-132c5507cd9b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F31%252F4231d26874e26ae0008d0ef761942aab%252Fpa%252FGG54325_b327ca7eac625028827d7e72c2ffb4eb.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_b327ca7eac625028827d7e72c2ffb4eb.jpg saved to cache
2026-03-30 08:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6cc07b45-d470-52bc-8587-132c5507cd9b
2026-03-30 08:36:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_1ffdc57805a0cfe21e526d2d2c60a51b.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_22b5738fdff3738b0aef64f88b78948c.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F54%252F7754074ffef72f8a61772e9a8b664b06%252Fpa%252FBM50316_479bb685b225b9d6f43d7fb8801f7262.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_479bb685b225b9d6f43d7fb8801f7262.jpg not downloaded yet
2026-03-30 08:36:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b6b02178-5ddd-5ae9-a577-76fb518f9234 with identifier: UY87343
2026-03-30 08:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:36:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-30 08:36:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:36:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b6b02178-5ddd-5ae9-a577-76fb518f9234 with identifier: UY87343
2026-03-30 08:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b6b02178-5ddd-5ae9-a577-76fb518f9234 with identifier: UY87343 to the API
2026-03-30 08:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 204,
'expiration_date': '2026-03-30T15:14:55Z',
'fuel_type': 'electro',
'id': 'b6b02178-5ddd-5ae9-a577-76fb518f9234',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY87343',
'listing': 'auction',
'make': 'MG',
'model': '4',
'odometer': 23495,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-26',
'seller_name': None,
'title': 'MG 4 electric drive 150 kW Luxury',
'transmission': 'automatic',
'trim': 'Luxury',
'year': 2023}
2026-03-30 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY87343%27 HTTP/1.1" 200 None
2026-03-30 08:36:57 [auto1.be] INFO: Saving data for UY87343: {'auction_closing_time': 1774883695.0, 'created_time': 1774773328.56874, 'last_price_update_time': 1774859817.959086}
2026-03-30 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UY87343') HTTP/1.1" 204 0
2026-03-30 08:36:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd83beb90>
2026-03-30 08:36:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cc07b45-d470-52bc-8587-132c5507cd9b/6cc07b45-d470-52bc-8587-132c5507cd9b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F31%252F4231d26874e26ae0008d0ef761942aab%252Fpa%252FGG54325_59339a06c941c9944f4dad206663bb12.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_59339a06c941c9944f4dad206663bb12.jpg saved to cache
2026-03-30 08:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6cc07b45-d470-52bc-8587-132c5507cd9b
2026-03-30 08:36:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd82e83d0>
2026-03-30 08:36:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7/6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7_image_1.jpg HTTP/1.1" 201 0
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fc3%252F96c391410134c0ea3fcb98ff1b87be37%252Fpa%252FDA89043_4c82a061fd7e98c3986445b10fde4923.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_4c82a061fd7e98c3986445b10fde4923.jpg saved to cache
2026-03-30 08:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7
2026-03-30 08:36:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd914aa10>
2026-03-30 08:36:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39971d1d-c827-5ed3-8836-2132277dbc44/39971d1d-c827-5ed3-8836-2132277dbc44_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bfd8f3786744ab7c444eaeaa62f88d%252Fpa%252FBC23498_23ad2ad59334999ef1d012029a6a21fb.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_23ad2ad59334999ef1d012029a6a21fb.jpg saved to cache
2026-03-30 08:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 39971d1d-c827-5ed3-8836-2132277dbc44
2026-03-30 08:36:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_b4fc7eb1502fb79554d9dd3df5305c33.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_73da6b1aecc99a5953376a821acec775.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F31%252F4231d26874e26ae0008d0ef761942aab%252Fpa%252FGG54325_1962e32ed21277c2f25bc8ed6e3ee915.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_1962e32ed21277c2f25bc8ed6e3ee915.jpg not downloaded yet
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fc3%252F96c391410134c0ea3fcb98ff1b87be37%252Fpa%252FDA89043_5a4460ab5c3da91a9e3301244ae84d35.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_5a4460ab5c3da91a9e3301244ae84d35.jpg not downloaded yet
2026-03-30 08:36:58 [auto1.be] INFO: Found listing with ID: MH83966
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MH83966%27 HTTP/1.1" 200 None
2026-03-30 08:36:58 [auto1.be] INFO: Scrape type for MH83966: 2
2026-03-30 08:36:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd52cec8-ca5a-5686-8bc0-418f55f3a58c with identifier: MH83966
2026-03-30 08:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd52cec8-ca5a-5686-8bc0-418f55f3a58c with scrape type 2
2026-03-30 08:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd52cec8-ca5a-5686-8bc0-418f55f3a58c with scrape type 2
2026-03-30 08:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bd52cec8-ca5a-5686-8bc0-418f55f3a58c, identifier: MH83966
2026-03-30 08:36:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8fe1550>
2026-03-30 08:36:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7/6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7_image_2.jpg HTTP/1.1" 201 0
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fc3%252F96c391410134c0ea3fcb98ff1b87be37%252Fpa%252FDA89043_abc36b034870a0a6c1ce4c0635851b0c.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_abc36b034870a0a6c1ce4c0635851b0c.jpg saved to cache
2026-03-30 08:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7
2026-03-30 08:36:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_1922f1a7c4f6ad1e816fe828acc68ab3.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_91aeb9c7ee0fb08fb003b9521c157ade.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F54%252F7754074ffef72f8a61772e9a8b664b06%252Fpa%252FBM50316_4be88ea2908b8d7ca9fe31eb35eae3d0.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_4be88ea2908b8d7ca9fe31eb35eae3d0.jpg not downloaded yet
2026-03-30 08:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bd52cec8-ca5a-5686-8bc0-418f55f3a58c with identifier: MH83966
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-30 08:36:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bd52cec8-ca5a-5686-8bc0-418f55f3a58c with identifier: MH83966
2026-03-30 08:36:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bd52cec8-ca5a-5686-8bc0-418f55f3a58c with identifier: MH83966 to the API
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:58:51Z',
'fuel_type': 'petrol',
'id': 'bd52cec8-ca5a-5686-8bc0-418f55f3a58c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH83966',
'listing': 'auction',
'make': 'BMW',
'model': 'X1',
'odometer': 33577,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-23',
'seller_name': None,
'title': 'BMW X1 sDrive 18i Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2021}
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MH83966%27 HTTP/1.1" 200 None
2026-03-30 08:36:58 [auto1.be] INFO: Saving data for MH83966: {'auction_closing_time': 1774886331.0, 'created_time': 1774773338.637832, 'last_price_update_time': 1774859818.745544}
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MH83966') HTTP/1.1" 204 0
2026-03-30 08:36:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd85e48d0>
2026-03-30 08:36:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9e1f2e2-274b-5380-bab7-61c853c9a738/a9e1f2e2-274b-5380-bab7-61c853c9a738_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F54%252F7754074ffef72f8a61772e9a8b664b06%252Fpa%252FBM50316_c29d0c17c13d28febe9ce51d7fb95107.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_c29d0c17c13d28febe9ce51d7fb95107.jpg saved to cache
2026-03-30 08:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a9e1f2e2-274b-5380-bab7-61c853c9a738
2026-03-30 08:36:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_3411471eb4b1c43c904c66add968d92c.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F31%252F4231d26874e26ae0008d0ef761942aab%252Fpa%252FGG54325_ad5c0e8fa6ff349fe6d79544048eded2.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_ad5c0e8fa6ff349fe6d79544048eded2.jpg not downloaded yet
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fc3%252F96c391410134c0ea3fcb98ff1b87be37%252Fpa%252FDA89043_348f76193004a0f556e8c33dcd68db31.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_348f76193004a0f556e8c33dcd68db31.jpg not downloaded yet
2026-03-30 08:36:58 [auto1.be] INFO: Found listing with ID: DE26055
2026-03-30 08:36:58 [auto1.be] INFO: Found listing with ID: AD76625
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD76625%27 HTTP/1.1" 200 None
2026-03-30 08:36:58 [auto1.be] INFO: Scrape type for AD76625: 2
2026-03-30 08:36:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75a91cdc-86c4-5050-8e38-0b274a59dfc5 with identifier: AD76625
2026-03-30 08:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75a91cdc-86c4-5050-8e38-0b274a59dfc5 with scrape type 2
2026-03-30 08:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75a91cdc-86c4-5050-8e38-0b274a59dfc5 with scrape type 2
2026-03-30 08:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 75a91cdc-86c4-5050-8e38-0b274a59dfc5, identifier: AD76625
2026-03-30 08:36:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8319d90>
2026-03-30 08:36:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cc07b45-d470-52bc-8587-132c5507cd9b/6cc07b45-d470-52bc-8587-132c5507cd9b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F31%252F4231d26874e26ae0008d0ef761942aab%252Fpa%252FGG54325_1ffdc57805a0cfe21e526d2d2c60a51b.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_1ffdc57805a0cfe21e526d2d2c60a51b.jpg saved to cache
2026-03-30 08:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6cc07b45-d470-52bc-8587-132c5507cd9b
2026-03-30 08:36:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8e865d0>
2026-03-30 08:36:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7/6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7_image_3.jpg HTTP/1.1" 201 0
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fc3%252F96c391410134c0ea3fcb98ff1b87be37%252Fpa%252FDA89043_22b5738fdff3738b0aef64f88b78948c.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_22b5738fdff3738b0aef64f88b78948c.jpg saved to cache
2026-03-30 08:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7
2026-03-30 08:36:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_51a3f3bc14465819febfba356e6049ba.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 75a91cdc-86c4-5050-8e38-0b274a59dfc5 with identifier: AD76625
2026-03-30 08:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 75a91cdc-86c4-5050-8e38-0b274a59dfc5 with identifier: AD76625
2026-03-30 08:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 75a91cdc-86c4-5050-8e38-0b274a59dfc5 with identifier: AD76625 to the API
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:23:09Z',
'fuel_type': 'petrol',
'id': '75a91cdc-86c4-5050-8e38-0b274a59dfc5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD76625',
'listing': 'auction',
'make': 'BMW',
'model': '4er',
'odometer': 215842,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-23',
'seller_name': None,
'title': 'BMW 4er 420i',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD76625%27 HTTP/1.1" 200 None
2026-03-30 08:36:59 [auto1.be] INFO: Saving data for AD76625: {'auction_closing_time': 1774884189.0, 'created_time': 1774773338.1770191, 'last_price_update_time': 1774859819.556966}
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AD76625') HTTP/1.1" 204 0
2026-03-30 08:36:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd82b7d90>
2026-03-30 08:36:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9e1f2e2-274b-5380-bab7-61c853c9a738/a9e1f2e2-274b-5380-bab7-61c853c9a738_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F54%252F7754074ffef72f8a61772e9a8b664b06%252Fpa%252FBM50316_b4fc7eb1502fb79554d9dd3df5305c33.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_b4fc7eb1502fb79554d9dd3df5305c33.jpg saved to cache
2026-03-30 08:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a9e1f2e2-274b-5380-bab7-61c853c9a738
2026-03-30 08:36:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd85307d0>
2026-03-30 08:36:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cc07b45-d470-52bc-8587-132c5507cd9b/6cc07b45-d470-52bc-8587-132c5507cd9b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F31%252F4231d26874e26ae0008d0ef761942aab%252Fpa%252FGG54325_73da6b1aecc99a5953376a821acec775.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_73da6b1aecc99a5953376a821acec775.jpg saved to cache
2026-03-30 08:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6cc07b45-d470-52bc-8587-132c5507cd9b
2026-03-30 08:36:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_ab83d8c2275254f955ca312c45d6cb85.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_7bd17d6a501cb63b348d288718e508d2.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fc3%252F96c391410134c0ea3fcb98ff1b87be37%252Fpa%252FDA89043_b27e19cda54b83406ea55f5c965259dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_b27e19cda54b83406ea55f5c965259dc.jpg not downloaded yet
2026-03-30 08:36:59 [auto1.be] INFO: Found listing with ID: ET26989
2026-03-30 08:36:59 [auto1.be] INFO: Found listing with ID: PF75414
2026-03-30 08:36:59 [auto1.be] INFO: Found listing with ID: WZ74297
2026-03-30 08:36:59 [auto1.be] INFO: Found listing with ID: KR32592
2026-03-30 08:36:59 [auto1.be] INFO: Found listing with ID: WU68692
2026-03-30 08:36:59 [auto1.be] INFO: Found listing with ID: HX23250
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX23250%27 HTTP/1.1" 200 None
2026-03-30 08:36:59 [auto1.be] INFO: Scrape type for HX23250: 2
2026-03-30 08:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6755ae0-a87b-5fa3-994f-3ce919988d38 with identifier: HX23250
2026-03-30 08:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6755ae0-a87b-5fa3-994f-3ce919988d38 with scrape type 2
2026-03-30 08:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6755ae0-a87b-5fa3-994f-3ce919988d38 with scrape type 2
2026-03-30 08:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c6755ae0-a87b-5fa3-994f-3ce919988d38, identifier: HX23250
2026-03-30 08:36:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd9148c90>
2026-03-30 08:36:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9e1f2e2-274b-5380-bab7-61c853c9a738/a9e1f2e2-274b-5380-bab7-61c853c9a738_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F54%252F7754074ffef72f8a61772e9a8b664b06%252Fpa%252FBM50316_1922f1a7c4f6ad1e816fe828acc68ab3.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_1922f1a7c4f6ad1e816fe828acc68ab3.jpg saved to cache
2026-03-30 08:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a9e1f2e2-274b-5380-bab7-61c853c9a738
2026-03-30 08:36:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:36:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8e8d890>
2026-03-30 08:36:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:36:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7/6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7_image_4.jpg HTTP/1.1" 201 0
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fc3%252F96c391410134c0ea3fcb98ff1b87be37%252Fpa%252FDA89043_91aeb9c7ee0fb08fb003b9521c157ade.jpg') HTTP/1.1" 204 0
2026-03-30 08:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_91aeb9c7ee0fb08fb003b9521c157ade.jpg saved to cache
2026-03-30 08:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7
2026-03-30 08:36:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_f6a660a508a819f17951207fe1f63f1d.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c6755ae0-a87b-5fa3-994f-3ce919988d38 with identifier: HX23250
2026-03-30 08:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c6755ae0-a87b-5fa3-994f-3ce919988d38 with identifier: HX23250
2026-03-30 08:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c6755ae0-a87b-5fa3-994f-3ce919988d38 with identifier: HX23250 to the API
2026-03-30 08:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:48:42Z',
'fuel_type': 'diesel',
'id': 'c6755ae0-a87b-5fa3-994f-3ce919988d38',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX23250',
'listing': 'auction',
'make': 'Skoda',
'model': 'Fabia',
'odometer': 294042,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-24',
'seller_name': None,
'title': 'Skoda Fabia 1.2 TDI Greenline',
'transmission': 'manual',
'trim': 'Greenline',
'year': 2011}
2026-03-30 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX23250%27 HTTP/1.1" 200 None
2026-03-30 08:37:00 [auto1.be] INFO: Saving data for HX23250: {'auction_closing_time': 1774885722.0, 'created_time': 1774557467.189421, 'last_price_update_time': 1774859820.217795}
2026-03-30 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HX23250') HTTP/1.1" 204 0
2026-03-30 08:37:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:37:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd900a090>
2026-03-30 08:37:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:37:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cc07b45-d470-52bc-8587-132c5507cd9b/6cc07b45-d470-52bc-8587-132c5507cd9b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F31%252F4231d26874e26ae0008d0ef761942aab%252Fpa%252FGG54325_3411471eb4b1c43c904c66add968d92c.jpg') HTTP/1.1" 204 0
2026-03-30 08:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_3411471eb4b1c43c904c66add968d92c.jpg saved to cache
2026-03-30 08:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6cc07b45-d470-52bc-8587-132c5507cd9b
2026-03-30 08:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_1962e32ed21277c2f25bc8ed6e3ee915.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_479bb685b225b9d6f43d7fb8801f7262.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:37:00 [auto1.be] INFO: Found listing with ID: DH89229
2026-03-30 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH89229%27 HTTP/1.1" 200 None
2026-03-30 08:37:00 [auto1.be] INFO: Scrape type for DH89229: 2
2026-03-30 08:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3a826ff-a041-5c74-bd69-de6316afe70b with identifier: DH89229
2026-03-30 08:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3a826ff-a041-5c74-bd69-de6316afe70b with scrape type 2
2026-03-30 08:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3a826ff-a041-5c74-bd69-de6316afe70b with scrape type 2
2026-03-30 08:37:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e3a826ff-a041-5c74-bd69-de6316afe70b, identifier: DH89229
2026-03-30 08:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MX38879> (referer: https://www.auto1.com/v1/car-details-view/MX38879/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:37:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:37:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd82b5ed0>
2026-03-30 08:37:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:37:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7/6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7_image_5.jpg HTTP/1.1" 201 0
2026-03-30 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fc3%252F96c391410134c0ea3fcb98ff1b87be37%252Fpa%252FDA89043_51a3f3bc14465819febfba356e6049ba.jpg') HTTP/1.1" 204 0
2026-03-30 08:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_51a3f3bc14465819febfba356e6049ba.jpg saved to cache
2026-03-30 08:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7
2026-03-30 08:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_4be88ea2908b8d7ca9fe31eb35eae3d0.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_5a4460ab5c3da91a9e3301244ae84d35.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e3a826ff-a041-5c74-bd69-de6316afe70b with identifier: DH89229
2026-03-30 08:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e3a826ff-a041-5c74-bd69-de6316afe70b with identifier: DH89229
2026-03-30 08:37:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e3a826ff-a041-5c74-bd69-de6316afe70b with identifier: DH89229 to the API
2026-03-30 08:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:05:46Z',
'fuel_type': 'petrol',
'id': 'e3a826ff-a041-5c74-bd69-de6316afe70b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH89229',
'listing': 'auction',
'make': 'Opel',
'model': 'Astra',
'odometer': 83992,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2000-03-27',
'seller_name': None,
'title': 'Opel Astra 1.4',
'transmission': 'manual',
'trim': '',
'year': 2000}
2026-03-30 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH89229%27 HTTP/1.1" 200 None
2026-03-30 08:37:00 [auto1.be] INFO: Saving data for DH89229: {'auction_closing_time': 1774883146.0, 'created_time': 1774557463.647659, 'last_price_update_time': 1774859820.764243}
2026-03-30 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DH89229') HTTP/1.1" 204 0
2026-03-30 08:37:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:37:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8591510>
2026-03-30 08:37:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:37:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cc07b45-d470-52bc-8587-132c5507cd9b/6cc07b45-d470-52bc-8587-132c5507cd9b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F31%252F4231d26874e26ae0008d0ef761942aab%252Fpa%252FGG54325_ab83d8c2275254f955ca312c45d6cb85.jpg') HTTP/1.1" 204 0
2026-03-30 08:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_ab83d8c2275254f955ca312c45d6cb85.jpg saved to cache
2026-03-30 08:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6cc07b45-d470-52bc-8587-132c5507cd9b
2026-03-30 08:37:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:37:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd856eb10>
2026-03-30 08:37:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:37:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9e1f2e2-274b-5380-bab7-61c853c9a738/a9e1f2e2-274b-5380-bab7-61c853c9a738_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F54%252F7754074ffef72f8a61772e9a8b664b06%252Fpa%252FBM50316_7bd17d6a501cb63b348d288718e508d2.jpg') HTTP/1.1" 204 0
2026-03-30 08:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_7bd17d6a501cb63b348d288718e508d2.jpg saved to cache
2026-03-30 08:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a9e1f2e2-274b-5380-bab7-61c853c9a738
2026-03-30 08:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_ad5c0e8fa6ff349fe6d79544048eded2.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:37:00 [auto1.be] INFO: Found listing with ID: UZ99297
2026-03-30 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UZ99297%27 HTTP/1.1" 200 None
2026-03-30 08:37:00 [auto1.be] INFO: Scrape type for UZ99297: 2
2026-03-30 08:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a20e57f3-b4bc-539e-aa39-15adc88a3859 with identifier: UZ99297
2026-03-30 08:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a20e57f3-b4bc-539e-aa39-15adc88a3859 with scrape type 2
2026-03-30 08:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a20e57f3-b4bc-539e-aa39-15adc88a3859 with scrape type 2
2026-03-30 08:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a20e57f3-b4bc-539e-aa39-15adc88a3859, identifier: UZ99297
2026-03-30 08:37:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:37:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8520650>
2026-03-30 08:37:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:37:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7/6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7_image_6.jpg HTTP/1.1" 201 0
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fc3%252F96c391410134c0ea3fcb98ff1b87be37%252Fpa%252FDA89043_f6a660a508a819f17951207fe1f63f1d.jpg') HTTP/1.1" 204 0
2026-03-30 08:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_f6a660a508a819f17951207fe1f63f1d.jpg saved to cache
2026-03-30 08:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7
2026-03-30 08:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a20e57f3-b4bc-539e-aa39-15adc88a3859 with identifier: UZ99297
2026-03-30 08:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a20e57f3-b4bc-539e-aa39-15adc88a3859 with identifier: UZ99297
2026-03-30 08:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a20e57f3-b4bc-539e-aa39-15adc88a3859 with identifier: UZ99297 to the API
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 224,
'expiration_date': '2026-03-30T15:08:25Z',
'fuel_type': 'hybrid',
'id': 'a20e57f3-b4bc-539e-aa39-15adc88a3859',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ99297',
'listing': 'auction',
'make': 'DS Automobiles',
'model': 'DS7 Crossback',
'odometer': 99165,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-11',
'seller_name': None,
'title': 'DS Automobiles DS7 Crossback 1.6 E-Tense Hybrid 4x2 So Chic',
'transmission': 'automatic',
'trim': '4x2 So Chic',
'year': 2021}
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UZ99297%27 HTTP/1.1" 200 None
2026-03-30 08:37:01 [auto1.be] INFO: Saving data for UZ99297: {'auction_closing_time': 1774883305.0, 'created_time': 1774773346.345587, 'last_price_update_time': 1774859821.456835}
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UZ99297') HTTP/1.1" 204 0
2026-03-30 08:37:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:37:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8438710>
2026-03-30 08:37:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:37:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cc07b45-d470-52bc-8587-132c5507cd9b/6cc07b45-d470-52bc-8587-132c5507cd9b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F31%252F4231d26874e26ae0008d0ef761942aab%252Fpa%252FGG54325_1962e32ed21277c2f25bc8ed6e3ee915.jpg') HTTP/1.1" 204 0
2026-03-30 08:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_1962e32ed21277c2f25bc8ed6e3ee915.jpg saved to cache
2026-03-30 08:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6cc07b45-d470-52bc-8587-132c5507cd9b
2026-03-30 08:37:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:37:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8588b10>
2026-03-30 08:37:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:37:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9e1f2e2-274b-5380-bab7-61c853c9a738/a9e1f2e2-274b-5380-bab7-61c853c9a738_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F54%252F7754074ffef72f8a61772e9a8b664b06%252Fpa%252FBM50316_479bb685b225b9d6f43d7fb8801f7262.jpg') HTTP/1.1" 204 0
2026-03-30 08:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_479bb685b225b9d6f43d7fb8801f7262.jpg saved to cache
2026-03-30 08:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a9e1f2e2-274b-5380-bab7-61c853c9a738
2026-03-30 08:37:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_b27e19cda54b83406ea55f5c965259dc.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:37:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_348f76193004a0f556e8c33dcd68db31.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:37:01 [auto1.be] INFO: Found listing with ID: DZ79289
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ79289%27 HTTP/1.1" 200 None
2026-03-30 08:37:01 [auto1.be] INFO: Scrape type for DZ79289: 2
2026-03-30 08:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ffbaf38-1261-55de-aa57-2a8a5e6cb02b with identifier: DZ79289
2026-03-30 08:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ffbaf38-1261-55de-aa57-2a8a5e6cb02b with scrape type 2
2026-03-30 08:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ffbaf38-1261-55de-aa57-2a8a5e6cb02b with scrape type 2
2026-03-30 08:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8ffbaf38-1261-55de-aa57-2a8a5e6cb02b, identifier: DZ79289
2026-03-30 08:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c996ff18-5de0-5c8a-8853-308d3e756f2f with identifier: MX38879
2026-03-30 08:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c996ff18-5de0-5c8a-8853-308d3e756f2f with scrape type 1
2026-03-30 08:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c996ff18-5de0-5c8a-8853-308d3e756f2f
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Ff7%252F09f7a6bbd0c26f9971969741a2702ea3%252Fpa%252FMX38879_6b049bf9a54c0fed656c533b86e9977c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f7/09f7a6bbd0c26f9971969741a2702ea3/pa/MX38879_6b049bf9a54c0fed656c533b86e9977c.jpg already downloaded
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Ff7%252F09f7a6bbd0c26f9971969741a2702ea3%252Fpa%252FMX38879_90d96cecbb47c7b71791a2d52fa67e21.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f7/09f7a6bbd0c26f9971969741a2702ea3/pa/MX38879_90d96cecbb47c7b71791a2d52fa67e21.jpg already downloaded
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Ff7%252F09f7a6bbd0c26f9971969741a2702ea3%252Fpa%252FMX38879_f5a7b1a04a7b451a3e4316f1921a6851.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f7/09f7a6bbd0c26f9971969741a2702ea3/pa/MX38879_f5a7b1a04a7b451a3e4316f1921a6851.jpg already downloaded
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Ff7%252F09f7a6bbd0c26f9971969741a2702ea3%252Fpa%252FMX38879_66ca49c3b6bf73b8cd23305025f694f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f7/09f7a6bbd0c26f9971969741a2702ea3/pa/MX38879_66ca49c3b6bf73b8cd23305025f694f3.jpg already downloaded
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Ff7%252F09f7a6bbd0c26f9971969741a2702ea3%252Fpa%252FMX38879_035ff263cd2e16c72acafd8057fd2784.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f7/09f7a6bbd0c26f9971969741a2702ea3/pa/MX38879_035ff263cd2e16c72acafd8057fd2784.jpg already downloaded
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Ff7%252F09f7a6bbd0c26f9971969741a2702ea3%252Fpa%252FMX38879_dac90edd3998f9399a9cad31882dd7fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f7/09f7a6bbd0c26f9971969741a2702ea3/pa/MX38879_dac90edd3998f9399a9cad31882dd7fa.jpg already downloaded
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Ff7%252F09f7a6bbd0c26f9971969741a2702ea3%252Fpa%252FMX38879_07046b5e4d456ec53d59122639a2428d.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f7/09f7a6bbd0c26f9971969741a2702ea3/pa/MX38879_07046b5e4d456ec53d59122639a2428d.jpg already downloaded
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Ff7%252F09f7a6bbd0c26f9971969741a2702ea3%252Fpa%252FMX38879_e87fd135ebf4b840a008e3167b581965.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f7/09f7a6bbd0c26f9971969741a2702ea3/pa/MX38879_e87fd135ebf4b840a008e3167b581965.jpg already downloaded
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Ff7%252F09f7a6bbd0c26f9971969741a2702ea3%252Fpa%252FMX38879_789d7e03cf7c5fe2c54e8ba0497fb1d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f7/09f7a6bbd0c26f9971969741a2702ea3/pa/MX38879_789d7e03cf7c5fe2c54e8ba0497fb1d5.jpg already downloaded
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Ff7%252F09f7a6bbd0c26f9971969741a2702ea3%252Fpa%252FMX38879_aff00f5fd06007795bf7f504e44ddb2c.jpg%27 HTTP/1.1" 200 None
2026-03-30 08:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/f7/09f7a6bbd0c26f9971969741a2702ea3/pa/MX38879_aff00f5fd06007795bf7f504e44ddb2c.jpg already downloaded
2026-03-30 08:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c996ff18-5de0-5c8a-8853-308d3e756f2f, identifier: MX38879
2026-03-30 08:37:01 [auto1.be] INFO: Channel: 24h | Page: 9 | totalHits: 1502 | hits on page: 40
2026-03-30 08:37:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:37:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd84dda90>
2026-03-30 08:37:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:37:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9e1f2e2-274b-5380-bab7-61c853c9a738/a9e1f2e2-274b-5380-bab7-61c853c9a738_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F54%252F7754074ffef72f8a61772e9a8b664b06%252Fpa%252FBM50316_4be88ea2908b8d7ca9fe31eb35eae3d0.jpg') HTTP/1.1" 204 0
2026-03-30 08:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_4be88ea2908b8d7ca9fe31eb35eae3d0.jpg saved to cache
2026-03-30 08:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a9e1f2e2-274b-5380-bab7-61c853c9a738
2026-03-30 08:37:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9e1f2e2-274b-5380-bab7-61c853c9a738, skipping ID generation
2026-03-30 08:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9e1f2e2-274b-5380-bab7-61c853c9a738 with scrape type 1
2026-03-30 08:37:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a9e1f2e2-274b-5380-bab7-61c853c9a738 sending to next pipeline
2026-03-30 08:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a9e1f2e2-274b-5380-bab7-61c853c9a738, identifier: BM50316
2026-03-30 08:37:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:37:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd84ed490>
2026-03-30 08:37:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:37:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7/6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7_image_7.jpg HTTP/1.1" 201 0
2026-03-30 08:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fc3%252F96c391410134c0ea3fcb98ff1b87be37%252Fpa%252FDA89043_5a4460ab5c3da91a9e3301244ae84d35.jpg') HTTP/1.1" 204 0
2026-03-30 08:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_5a4460ab5c3da91a9e3301244ae84d35.jpg saved to cache
2026-03-30 08:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7
2026-03-30 08:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8ffbaf38-1261-55de-aa57-2a8a5e6cb02b with identifier: DZ79289
2026-03-30 08:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8ffbaf38-1261-55de-aa57-2a8a5e6cb02b with identifier: DZ79289
2026-03-30 08:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8ffbaf38-1261-55de-aa57-2a8a5e6cb02b with identifier: DZ79289 to the API
2026-03-30 08:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:25:39Z',
'fuel_type': 'hybrid',
'id': '8ffbaf38-1261-55de-aa57-2a8a5e6cb02b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ79289',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 166165,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-12-04',
'seller_name': None,
'title': 'Volkswagen Passat 1.4 GTE',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-03-30 08:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DZ79289%27 HTTP/1.1" 200 None
2026-03-30 08:37:02 [auto1.be] INFO: Saving data for DZ79289: {'auction_closing_time': 1774884339.0, 'created_time': 1774773344.796559, 'last_price_update_time': 1774859822.431243}
2026-03-30 08:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DZ79289') HTTP/1.1" 204 0
2026-03-30 08:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c996ff18-5de0-5c8a-8853-308d3e756f2f with identifier: MX38879
2026-03-30 08:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c996ff18-5de0-5c8a-8853-308d3e756f2f with identifier: MX38879
2026-03-30 08:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c996ff18-5de0-5c8a-8853-308d3e756f2f with identifier: MX38879 to the API
2026-03-30 08:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MX38879>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.8L',
'engine_horse_power': 205,
'expiration_date': '2026-03-31T15:18:51Z',
'fuel_type': 'petrol',
'id': 'c996ff18-5de0-5c8a-8853-308d3e756f2f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX38879',
'listing': 'auction',
'location': 'BE, Charleroi',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 141029,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photo_urls': ['https://img-pa.auto1.com/img09/f7/09f7a6bbd0c26f9971969741a2702ea3/pa/MX38879_6b049bf9a54c0fed656c533b86e9977c.jpg',
'https://img-pa.auto1.com/img09/f7/09f7a6bbd0c26f9971969741a2702ea3/pa/MX38879_90d96cecbb47c7b71791a2d52fa67e21.jpg',
'https://img-pa.auto1.com/img09/f7/09f7a6bbd0c26f9971969741a2702ea3/pa/MX38879_f5a7b1a04a7b451a3e4316f1921a6851.jpg',
'https://img-pa.auto1.com/img09/f7/09f7a6bbd0c26f9971969741a2702ea3/pa/MX38879_66ca49c3b6bf73b8cd23305025f694f3.jpg',
'https://img-pa.auto1.com/img09/f7/09f7a6bbd0c26f9971969741a2702ea3/pa/MX38879_035ff263cd2e16c72acafd8057fd2784.jpg',
'https://img-pa.auto1.com/img09/f7/09f7a6bbd0c26f9971969741a2702ea3/pa/MX38879_dac90edd3998f9399a9cad31882dd7fa.jpg',
'https://img-pa.auto1.com/img09/f7/09f7a6bbd0c26f9971969741a2702ea3/pa/MX38879_07046b5e4d456ec53d59122639a2428d.jpg',
'https://img-pa.auto1.com/img09/f7/09f7a6bbd0c26f9971969741a2702ea3/pa/MX38879_e87fd135ebf4b840a008e3167b581965.jpg',
'https://img-pa.auto1.com/img09/f7/09f7a6bbd0c26f9971969741a2702ea3/pa/MX38879_789d7e03cf7c5fe2c54e8ba0497fb1d5.jpg',
'https://img-pa.auto1.com/img09/f7/09f7a6bbd0c26f9971969741a2702ea3/pa/MX38879_aff00f5fd06007795bf7f504e44ddb2c.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c996ff18-5de0-5c8a-8853-308d3e756f2f/c996ff18-5de0-5c8a-8853-308d3e756f2f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3695659,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img09/f7/09f7a6bbd0c26f9971969741a2702ea3/pa/MX38879_6b049bf9a54c0fed656c533b86e9977c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c996ff18-5de0-5c8a-8853-308d3e756f2f/c996ff18-5de0-5c8a-8853-308d3e756f2f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3729791,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img09/f7/09f7a6bbd0c26f9971969741a2702ea3/pa/MX38879_90d96cecbb47c7b71791a2d52fa67e21.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c996ff18-5de0-5c8a-8853-308d3e756f2f/c996ff18-5de0-5c8a-8853-308d3e756f2f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98203,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/f7/09f7a6bbd0c26f9971969741a2702ea3/pa/MX38879_f5a7b1a04a7b451a3e4316f1921a6851.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c996ff18-5de0-5c8a-8853-308d3e756f2f/c996ff18-5de0-5c8a-8853-308d3e756f2f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74201,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/f7/09f7a6bbd0c26f9971969741a2702ea3/pa/MX38879_66ca49c3b6bf73b8cd23305025f694f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c996ff18-5de0-5c8a-8853-308d3e756f2f/c996ff18-5de0-5c8a-8853-308d3e756f2f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3262654,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img09/f7/09f7a6bbd0c26f9971969741a2702ea3/pa/MX38879_035ff263cd2e16c72acafd8057fd2784.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c996ff18-5de0-5c8a-8853-308d3e756f2f/c996ff18-5de0-5c8a-8853-308d3e756f2f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71237,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/f7/09f7a6bbd0c26f9971969741a2702ea3/pa/MX38879_dac90edd3998f9399a9cad31882dd7fa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c996ff18-5de0-5c8a-8853-308d3e756f2f/c996ff18-5de0-5c8a-8853-308d3e756f2f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2448268,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img09/f7/09f7a6bbd0c26f9971969741a2702ea3/pa/MX38879_07046b5e4d456ec53d59122639a2428d.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c996ff18-5de0-5c8a-8853-308d3e756f2f/c996ff18-5de0-5c8a-8853-308d3e756f2f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2781087,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img09/f7/09f7a6bbd0c26f9971969741a2702ea3/pa/MX38879_e87fd135ebf4b840a008e3167b581965.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c996ff18-5de0-5c8a-8853-308d3e756f2f/c996ff18-5de0-5c8a-8853-308d3e756f2f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100487,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/f7/09f7a6bbd0c26f9971969741a2702ea3/pa/MX38879_789d7e03cf7c5fe2c54e8ba0497fb1d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c996ff18-5de0-5c8a-8853-308d3e756f2f/c996ff18-5de0-5c8a-8853-308d3e756f2f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88170,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img09/f7/09f7a6bbd0c26f9971969741a2702ea3/pa/MX38879_aff00f5fd06007795bf7f504e44ddb2c.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2012-06-18',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 250 CGI T BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'T BlueEfficiency Avantgarde',
'year': 2012}
2026-03-30 08:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX38879%27 HTTP/1.1" 200 None
2026-03-30 08:37:02 [auto1.be] INFO: Saving data for MX38879: {'created_time': 1774859822.792817, 'last_price_update_time': 1774859822.79283, 'auction_closing_time': 1774970331.0}
2026-03-30 08:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MX38879') HTTP/1.1" 204 0
2026-03-30 08:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a9e1f2e2-274b-5380-bab7-61c853c9a738 with identifier: BM50316
2026-03-30 08:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a9e1f2e2-274b-5380-bab7-61c853c9a738 with identifier: BM50316
2026-03-30 08:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a9e1f2e2-274b-5380-bab7-61c853c9a738 with identifier: BM50316 to the API
2026-03-30 08:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_4be88ea2908b8d7ca9fe31eb35eae3d0.jpg>
{'auction_title': '',
'c_o_2_emission_value': 131,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.5L',
'engine_horse_power': 130,
'expiration_date': '2026-03-31T15:27:10Z',
'fuel_type': 'diesel',
'id': 'a9e1f2e2-274b-5380-bab7-61c853c9a738',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM50316',
'listing': 'auction',
'location': 'BE, Ghislenghien',
'make': 'Peugeot',
'model': '308',
'odometer': 148799,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e1f2e2-274b-5380-bab7-61c853c9a738/a9e1f2e2-274b-5380-bab7-61c853c9a738_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69877,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_a0df79c6e32ecd34f0d839c3267cfcd7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e1f2e2-274b-5380-bab7-61c853c9a738/a9e1f2e2-274b-5380-bab7-61c853c9a738_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69838,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_41dc9e792ffbec67b5b8e09547a0121c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e1f2e2-274b-5380-bab7-61c853c9a738/a9e1f2e2-274b-5380-bab7-61c853c9a738_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64327,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_c4ba75d611b8bbfdb72e98b22e3c3217.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e1f2e2-274b-5380-bab7-61c853c9a738/a9e1f2e2-274b-5380-bab7-61c853c9a738_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61368,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_f9eaa7aab4de96303ad0bb9a8bcca780.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e1f2e2-274b-5380-bab7-61c853c9a738/a9e1f2e2-274b-5380-bab7-61c853c9a738_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65718,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_c29d0c17c13d28febe9ce51d7fb95107.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e1f2e2-274b-5380-bab7-61c853c9a738/a9e1f2e2-274b-5380-bab7-61c853c9a738_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61680,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_b4fc7eb1502fb79554d9dd3df5305c33.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e1f2e2-274b-5380-bab7-61c853c9a738/a9e1f2e2-274b-5380-bab7-61c853c9a738_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58747,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_1922f1a7c4f6ad1e816fe828acc68ab3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e1f2e2-274b-5380-bab7-61c853c9a738/a9e1f2e2-274b-5380-bab7-61c853c9a738_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69674,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_7bd17d6a501cb63b348d288718e508d2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e1f2e2-274b-5380-bab7-61c853c9a738/a9e1f2e2-274b-5380-bab7-61c853c9a738_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71954,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_479bb685b225b9d6f43d7fb8801f7262.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9e1f2e2-274b-5380-bab7-61c853c9a738/a9e1f2e2-274b-5380-bab7-61c853c9a738_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63806,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img77/54/7754074ffef72f8a61772e9a8b664b06/pa/BM50316_4be88ea2908b8d7ca9fe31eb35eae3d0.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-05-06',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.5 Blue-HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2019}
2026-03-30 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BM50316%27 HTTP/1.1" 200 None
2026-03-30 08:37:03 [auto1.be] INFO: Saving data for BM50316: {'created_time': 1774859823.239562, 'last_price_update_time': 1774859823.239574, 'auction_closing_time': 1774970830.0}
2026-03-30 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BM50316') HTTP/1.1" 204 0
2026-03-30 08:37:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:37:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd8648710>
2026-03-30 08:37:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:37:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:37:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:37:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cc07b45-d470-52bc-8587-132c5507cd9b/6cc07b45-d470-52bc-8587-132c5507cd9b_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F31%252F4231d26874e26ae0008d0ef761942aab%252Fpa%252FGG54325_ad5c0e8fa6ff349fe6d79544048eded2.jpg') HTTP/1.1" 204 0
2026-03-30 08:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_ad5c0e8fa6ff349fe6d79544048eded2.jpg saved to cache
2026-03-30 08:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6cc07b45-d470-52bc-8587-132c5507cd9b
2026-03-30 08:37:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6cc07b45-d470-52bc-8587-132c5507cd9b, skipping ID generation
2026-03-30 08:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cc07b45-d470-52bc-8587-132c5507cd9b with scrape type 1
2026-03-30 08:37:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6cc07b45-d470-52bc-8587-132c5507cd9b sending to next pipeline
2026-03-30 08:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6cc07b45-d470-52bc-8587-132c5507cd9b, identifier: GG54325
2026-03-30 08:37:03 [auto1.be] INFO: Found listing with ID: DX83468
2026-03-30 08:37:03 [auto1.be] INFO: Found listing with ID: ZY04103
2026-03-30 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY04103%27 HTTP/1.1" 200 None
2026-03-30 08:37:03 [auto1.be] INFO: Scrape type for ZY04103: 2
2026-03-30 08:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2266def0-435c-58c5-85f6-2de59ae5b344 with identifier: ZY04103
2026-03-30 08:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2266def0-435c-58c5-85f6-2de59ae5b344 with scrape type 2
2026-03-30 08:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2266def0-435c-58c5-85f6-2de59ae5b344 with scrape type 2
2026-03-30 08:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2266def0-435c-58c5-85f6-2de59ae5b344, identifier: ZY04103
2026-03-30 08:37:03 [auto1.be] INFO: Found listing with ID: PC06950
2026-03-30 08:37:03 [auto1.be] INFO: Found listing with ID: JN34238
2026-03-30 08:37:03 [auto1.be] INFO: Found listing with ID: KD33371
2026-03-30 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD33371%27 HTTP/1.1" 200 None
2026-03-30 08:37:03 [auto1.be] INFO: Scrape type for KD33371: 2
2026-03-30 08:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6899e96-7df5-529b-a091-c64597f15c78 with identifier: KD33371
2026-03-30 08:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6899e96-7df5-529b-a091-c64597f15c78 with scrape type 2
2026-03-30 08:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6899e96-7df5-529b-a091-c64597f15c78 with scrape type 2
2026-03-30 08:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f6899e96-7df5-529b-a091-c64597f15c78, identifier: KD33371
2026-03-30 08:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6cc07b45-d470-52bc-8587-132c5507cd9b with identifier: GG54325
2026-03-30 08:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6cc07b45-d470-52bc-8587-132c5507cd9b with identifier: GG54325
2026-03-30 08:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6cc07b45-d470-52bc-8587-132c5507cd9b with identifier: GG54325 to the API
2026-03-30 08:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_ad5c0e8fa6ff349fe6d79544048eded2.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-03-31T15:29:54Z',
'fuel_type': 'petrol',
'id': '6cc07b45-d470-52bc-8587-132c5507cd9b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG54325',
'listing': 'auction',
'location': 'BE',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 132518,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 22,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cc07b45-d470-52bc-8587-132c5507cd9b/6cc07b45-d470-52bc-8587-132c5507cd9b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65899,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_062d67f2ae3db07117ad34bbfb4f6c84.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cc07b45-d470-52bc-8587-132c5507cd9b/6cc07b45-d470-52bc-8587-132c5507cd9b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40536,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_cc84423598c4dd674123f379680227e4.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cc07b45-d470-52bc-8587-132c5507cd9b/6cc07b45-d470-52bc-8587-132c5507cd9b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70496,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_b327ca7eac625028827d7e72c2ffb4eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cc07b45-d470-52bc-8587-132c5507cd9b/6cc07b45-d470-52bc-8587-132c5507cd9b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40997,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_59339a06c941c9944f4dad206663bb12.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cc07b45-d470-52bc-8587-132c5507cd9b/6cc07b45-d470-52bc-8587-132c5507cd9b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41805,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_1ffdc57805a0cfe21e526d2d2c60a51b.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cc07b45-d470-52bc-8587-132c5507cd9b/6cc07b45-d470-52bc-8587-132c5507cd9b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41905,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_73da6b1aecc99a5953376a821acec775.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cc07b45-d470-52bc-8587-132c5507cd9b/6cc07b45-d470-52bc-8587-132c5507cd9b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45055,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_3411471eb4b1c43c904c66add968d92c.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cc07b45-d470-52bc-8587-132c5507cd9b/6cc07b45-d470-52bc-8587-132c5507cd9b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53865,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_ab83d8c2275254f955ca312c45d6cb85.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cc07b45-d470-52bc-8587-132c5507cd9b/6cc07b45-d470-52bc-8587-132c5507cd9b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40891,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_1962e32ed21277c2f25bc8ed6e3ee915.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cc07b45-d470-52bc-8587-132c5507cd9b/6cc07b45-d470-52bc-8587-132c5507cd9b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44307,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img42/31/4231d26874e26ae0008d0ef761942aab/pa/GG54325_ad5c0e8fa6ff349fe6d79544048eded2.jpg',
'Width': 450}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2019-06-20',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 220 AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2019}
2026-03-30 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG54325%27 HTTP/1.1" 200 None
2026-03-30 08:37:03 [auto1.be] INFO: Saving data for GG54325: {'created_time': 1774859823.985048, 'last_price_update_time': 1774859823.985059, 'auction_closing_time': 1774970994.0}
2026-03-30 08:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GG54325') HTTP/1.1" 204 0
2026-03-30 08:37:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2266def0-435c-58c5-85f6-2de59ae5b344 with identifier: ZY04103
2026-03-30 08:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2266def0-435c-58c5-85f6-2de59ae5b344 with identifier: ZY04103
2026-03-30 08:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2266def0-435c-58c5-85f6-2de59ae5b344 with identifier: ZY04103 to the API
2026-03-30 08:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:49:24Z',
'fuel_type': 'diesel',
'id': '2266def0-435c-58c5-85f6-2de59ae5b344',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY04103',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 341241,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-11-30',
'seller_name': None,
'title': 'BMW 3er 318d Advantage',
'transmission': 'manual',
'trim': 'Advantage',
'year': 2008}
2026-03-30 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZY04103%27 HTTP/1.1" 200 None
2026-03-30 08:37:04 [auto1.be] INFO: Saving data for ZY04103: {'auction_closing_time': 1774885764.0, 'created_time': 1773301663.880859, 'last_price_update_time': 1774859824.261123}
2026-03-30 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZY04103') HTTP/1.1" 204 0
2026-03-30 08:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f6899e96-7df5-529b-a091-c64597f15c78 with identifier: KD33371
2026-03-30 08:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f6899e96-7df5-529b-a091-c64597f15c78 with identifier: KD33371
2026-03-30 08:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f6899e96-7df5-529b-a091-c64597f15c78 with identifier: KD33371 to the API
2026-03-30 08:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:53:13Z',
'fuel_type': 'diesel',
'id': 'f6899e96-7df5-529b-a091-c64597f15c78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD33371',
'listing': 'auction',
'make': 'Citroen',
'model': 'Jumpy',
'odometer': 179035,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-22',
'seller_name': None,
'title': 'Citroen Jumpy 2.0 Blue-HDi Driver M',
'transmission': 'manual',
'trim': 'Driver M',
'year': 2018}
2026-03-30 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KD33371%27 HTTP/1.1" 200 None
2026-03-30 08:37:04 [auto1.be] INFO: Saving data for KD33371: {'auction_closing_time': 1774885993.0, 'created_time': 1774773353.276264, 'last_price_update_time': 1774859824.537298}
2026-03-30 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KD33371') HTTP/1.1" 204 0
2026-03-30 08:37:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:37:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febdaec8410>
2026-03-30 08:37:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:37:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:37:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:37:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7/6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7_image_9.jpg HTTP/1.1" 201 0
2026-03-30 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fc3%252F96c391410134c0ea3fcb98ff1b87be37%252Fpa%252FDA89043_b27e19cda54b83406ea55f5c965259dc.jpg') HTTP/1.1" 204 0
2026-03-30 08:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_b27e19cda54b83406ea55f5c965259dc.jpg saved to cache
2026-03-30 08:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7
2026-03-30 08:37:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:37:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd83bd410>
2026-03-30 08:37:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:37:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:37:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:37:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7/6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7_image_8.jpg HTTP/1.1" 201 0
2026-03-30 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fc3%252F96c391410134c0ea3fcb98ff1b87be37%252Fpa%252FDA89043_348f76193004a0f556e8c33dcd68db31.jpg') HTTP/1.1" 204 0
2026-03-30 08:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_348f76193004a0f556e8c33dcd68db31.jpg saved to cache
2026-03-30 08:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7
2026-03-30 08:37:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7, skipping ID generation
2026-03-30 08:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7 with scrape type 1
2026-03-30 08:37:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7 sending to next pipeline
2026-03-30 08:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7, identifier: DA89043
2026-03-30 08:37:04 [auto1.be] INFO: Found listing with ID: EP64027
2026-03-30 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP64027%27 HTTP/1.1" 200 None
2026-03-30 08:37:04 [auto1.be] INFO: Scrape type for EP64027: 2
2026-03-30 08:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a5e666b-8a01-5a9c-87e1-49a05638397e with identifier: EP64027
2026-03-30 08:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a5e666b-8a01-5a9c-87e1-49a05638397e with scrape type 2
2026-03-30 08:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a5e666b-8a01-5a9c-87e1-49a05638397e with scrape type 2
2026-03-30 08:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0a5e666b-8a01-5a9c-87e1-49a05638397e, identifier: EP64027
2026-03-30 08:37:04 [auto1.be] INFO: Found listing with ID: ZM02853
2026-03-30 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM02853%27 HTTP/1.1" 200 None
2026-03-30 08:37:04 [auto1.be] INFO: Scrape type for ZM02853: 2
2026-03-30 08:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8844db3f-1ebc-5003-becc-fc2258e1c876 with identifier: ZM02853
2026-03-30 08:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8844db3f-1ebc-5003-becc-fc2258e1c876 with scrape type 2
2026-03-30 08:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8844db3f-1ebc-5003-becc-fc2258e1c876 with scrape type 2
2026-03-30 08:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8844db3f-1ebc-5003-becc-fc2258e1c876, identifier: ZM02853
2026-03-30 08:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7 with identifier: DA89043
2026-03-30 08:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7 with identifier: DA89043
2026-03-30 08:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7 with identifier: DA89043 to the API
2026-03-30 08:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_348f76193004a0f556e8c33dcd68db31.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.1L',
'engine_horse_power': 135,
'expiration_date': '2026-03-31T15:34:04Z',
'fuel_type': 'diesel',
'id': '6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA89043',
'listing': 'auction',
'location': 'BE, Wauthier-Braine',
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 196103,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7/6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78203,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_69da97f54d40bd1268100b9cbd976e91.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7/6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75613,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_4c82a061fd7e98c3986445b10fde4923.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7/6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70157,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_abc36b034870a0a6c1ce4c0635851b0c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7/6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59023,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_22b5738fdff3738b0aef64f88b78948c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7/6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74322,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_91aeb9c7ee0fb08fb003b9521c157ade.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7/6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77281,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_51a3f3bc14465819febfba356e6049ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7/6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69650,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_f6a660a508a819f17951207fe1f63f1d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7/6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81519,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_5a4460ab5c3da91a9e3301244ae84d35.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7/6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81620,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_348f76193004a0f556e8c33dcd68db31.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7/6d4026f2-61ff-5a4a-9abc-ea0286d8bfc7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62780,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/c3/96c391410134c0ea3fcb98ff1b87be37/pa/DA89043_b27e19cda54b83406ea55f5c965259dc.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2016-10-13',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 200 Shooting Brake AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2016}
2026-03-30 08:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DA89043%27 HTTP/1.1" 200 None
2026-03-30 08:37:05 [auto1.be] INFO: Saving data for DA89043: {'created_time': 1774859825.340532, 'last_price_update_time': 1774859825.340543, 'auction_closing_time': 1774971244.0}
2026-03-30 08:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DA89043') HTTP/1.1" 204 0
2026-03-30 08:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0a5e666b-8a01-5a9c-87e1-49a05638397e with identifier: EP64027
2026-03-30 08:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0a5e666b-8a01-5a9c-87e1-49a05638397e with identifier: EP64027
2026-03-30 08:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0a5e666b-8a01-5a9c-87e1-49a05638397e with identifier: EP64027 to the API
2026-03-30 08:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:52:41Z',
'fuel_type': 'petrol',
'id': '0a5e666b-8a01-5a9c-87e1-49a05638397e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP64027',
'listing': 'auction',
'make': 'Volvo',
'model': 'V40',
'odometer': 151370,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '1998-03-31',
'seller_name': None,
'title': 'Volvo V40 1.8',
'transmission': 'manual',
'trim': '',
'year': 1998}
2026-03-30 08:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP64027%27 HTTP/1.1" 200 None
2026-03-30 08:37:05 [auto1.be] INFO: Saving data for EP64027: {'auction_closing_time': 1774885961.0, 'created_time': 1774557466.9029, 'last_price_update_time': 1774859825.624582}
2026-03-30 08:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EP64027') HTTP/1.1" 204 0
2026-03-30 08:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8844db3f-1ebc-5003-becc-fc2258e1c876 with identifier: ZM02853
2026-03-30 08:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8844db3f-1ebc-5003-becc-fc2258e1c876 with identifier: ZM02853
2026-03-30 08:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8844db3f-1ebc-5003-becc-fc2258e1c876 with identifier: ZM02853 to the API
2026-03-30 08:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:38:13Z',
'fuel_type': 'diesel',
'id': '8844db3f-1ebc-5003-becc-fc2258e1c876',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM02853',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'Vito',
'odometer': 163148,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-24',
'seller_name': None,
'title': 'Mercedes-Benz Vito 114 CDI FWD lang',
'transmission': 'automatic',
'trim': 'FWD lang',
'year': 2021}
2026-03-30 08:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM02853%27 HTTP/1.1" 200 None
2026-03-30 08:37:05 [auto1.be] INFO: Saving data for ZM02853: {'auction_closing_time': 1774885093.0, 'created_time': 1774773355.112354, 'last_price_update_time': 1774859825.925866}
2026-03-30 08:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZM02853') HTTP/1.1" 204 0
2026-03-30 08:37:05 [auto1.be] INFO: Found listing with ID: UR96395
2026-03-30 08:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR96395%27 HTTP/1.1" 200 None
2026-03-30 08:37:05 [auto1.be] INFO: Scrape type for UR96395: 2
2026-03-30 08:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc31ab03-abfe-5ea7-8fa8-df70e9489f69 with identifier: UR96395
2026-03-30 08:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc31ab03-abfe-5ea7-8fa8-df70e9489f69 with scrape type 2
2026-03-30 08:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc31ab03-abfe-5ea7-8fa8-df70e9489f69 with scrape type 2
2026-03-30 08:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: bc31ab03-abfe-5ea7-8fa8-df70e9489f69, identifier: UR96395
2026-03-30 08:37:06 [auto1.be] INFO: Found listing with ID: ZC87174
2026-03-30 08:37:06 [auto1.be] INFO: Found listing with ID: ZP04877
2026-03-30 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP04877%27 HTTP/1.1" 200 None
2026-03-30 08:37:06 [auto1.be] INFO: Scrape type for ZP04877: 2
2026-03-30 08:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 045a87dd-84e7-543c-b5bf-0a061b950637 with identifier: ZP04877
2026-03-30 08:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 045a87dd-84e7-543c-b5bf-0a061b950637 with scrape type 2
2026-03-30 08:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 045a87dd-84e7-543c-b5bf-0a061b950637 with scrape type 2
2026-03-30 08:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 045a87dd-84e7-543c-b5bf-0a061b950637, identifier: ZP04877
2026-03-30 08:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: bc31ab03-abfe-5ea7-8fa8-df70e9489f69 with identifier: UR96395
2026-03-30 08:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: bc31ab03-abfe-5ea7-8fa8-df70e9489f69 with identifier: UR96395
2026-03-30 08:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: bc31ab03-abfe-5ea7-8fa8-df70e9489f69 with identifier: UR96395 to the API
2026-03-30 08:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:49:22Z',
'fuel_type': 'diesel',
'id': 'bc31ab03-abfe-5ea7-8fa8-df70e9489f69',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR96395',
'listing': 'auction',
'make': 'Opel',
'model': 'Meriva',
'odometer': 109669,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-04-25',
'seller_name': None,
'title': 'Opel Meriva 1.3 CDTI Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2010}
2026-03-30 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR96395%27 HTTP/1.1" 200 None
2026-03-30 08:37:06 [auto1.be] INFO: Saving data for UR96395: {'auction_closing_time': 1774885762.0, 'created_time': 1774643857.348781, 'last_price_update_time': 1774859826.451815}
2026-03-30 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UR96395') HTTP/1.1" 204 0
2026-03-30 08:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 045a87dd-84e7-543c-b5bf-0a061b950637 with identifier: ZP04877
2026-03-30 08:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 045a87dd-84e7-543c-b5bf-0a061b950637 with identifier: ZP04877
2026-03-30 08:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 045a87dd-84e7-543c-b5bf-0a061b950637 with identifier: ZP04877 to the API
2026-03-30 08:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:18:07Z',
'fuel_type': 'petrol',
'id': '045a87dd-84e7-543c-b5bf-0a061b950637',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP04877',
'listing': 'auction',
'make': 'Renault',
'model': 'Grand Scenic',
'odometer': 162816,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-31',
'seller_name': None,
'title': 'Renault Grand Scenic 2.0 Exception',
'transmission': 'manual',
'trim': 'Exception',
'year': 2006}
2026-03-30 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP04877%27 HTTP/1.1" 200 None
2026-03-30 08:37:06 [auto1.be] INFO: Saving data for ZP04877: {'auction_closing_time': 1774883887.0, 'created_time': 1774125486.639898, 'last_price_update_time': 1774859826.913898}
2026-03-30 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZP04877') HTTP/1.1" 204 0
2026-03-30 08:37:06 [auto1.be] INFO: Found listing with ID: SD20873
2026-03-30 08:37:06 [auto1.be] INFO: Found listing with ID: EN78807
2026-03-30 08:37:06 [auto1.be] INFO: Found listing with ID: SD10160
2026-03-30 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD10160%27 HTTP/1.1" 200 None
2026-03-30 08:37:06 [auto1.be] INFO: Scrape type for SD10160: 2
2026-03-30 08:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5601b94a-f4b9-5abb-8972-f50d02ba47de with identifier: SD10160
2026-03-30 08:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5601b94a-f4b9-5abb-8972-f50d02ba47de with scrape type 2
2026-03-30 08:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5601b94a-f4b9-5abb-8972-f50d02ba47de with scrape type 2
2026-03-30 08:37:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5601b94a-f4b9-5abb-8972-f50d02ba47de, identifier: SD10160
2026-03-30 08:37:07 [auto1.be] INFO: Found listing with ID: BY53413
2026-03-30 08:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY53413%27 HTTP/1.1" 200 None
2026-03-30 08:37:07 [auto1.be] INFO: Scrape type for BY53413: 2
2026-03-30 08:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e579294-b980-5f5f-851b-9186d1f9638e with identifier: BY53413
2026-03-30 08:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e579294-b980-5f5f-851b-9186d1f9638e with scrape type 2
2026-03-30 08:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e579294-b980-5f5f-851b-9186d1f9638e with scrape type 2
2026-03-30 08:37:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7e579294-b980-5f5f-851b-9186d1f9638e, identifier: BY53413
2026-03-30 08:37:07 [scrapy.extensions.logstats] INFO: Crawled 93 pages (at 49 pages/min), scraped 133 items (at 77 items/min)
2026-03-30 08:37:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 182MiB
2026-03-30 08:37:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5601b94a-f4b9-5abb-8972-f50d02ba47de with identifier: SD10160
2026-03-30 08:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:37:07 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-30 08:37:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:37:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5601b94a-f4b9-5abb-8972-f50d02ba47de with identifier: SD10160
2026-03-30 08:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5601b94a-f4b9-5abb-8972-f50d02ba47de with identifier: SD10160 to the API
2026-03-30 08:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:50:06Z',
'fuel_type': 'petrol',
'id': '5601b94a-f4b9-5abb-8972-f50d02ba47de',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD10160',
'listing': 'auction',
'make': 'Citroen',
'model': 'Xsara',
'odometer': 113937,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-02-01',
'seller_name': None,
'title': 'Citroen Xsara 1.4 VTR',
'transmission': 'manual',
'trim': 'VTR',
'year': 2001}
2026-03-30 08:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD10160%27 HTTP/1.1" 200 None
2026-03-30 08:37:07 [auto1.be] INFO: Saving data for SD10160: {'auction_closing_time': 1774885806.0, 'created_time': 1773520770.234096, 'last_price_update_time': 1774859827.658331}
2026-03-30 08:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SD10160') HTTP/1.1" 204 0
2026-03-30 08:37:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7e579294-b980-5f5f-851b-9186d1f9638e with identifier: BY53413
2026-03-30 08:37:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7e579294-b980-5f5f-851b-9186d1f9638e with identifier: BY53413
2026-03-30 08:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7e579294-b980-5f5f-851b-9186d1f9638e with identifier: BY53413 to the API
2026-03-30 08:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:23:37Z',
'fuel_type': 'petrol',
'id': '7e579294-b980-5f5f-851b-9186d1f9638e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY53413',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 83734,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-21',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 Progressive',
'transmission': 'manual',
'trim': 'Progressive',
'year': 2021}
2026-03-30 08:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY53413%27 HTTP/1.1" 200 None
2026-03-30 08:37:07 [auto1.be] INFO: Saving data for BY53413: {'auction_closing_time': 1774884217.0, 'created_time': 1774773356.364231, 'last_price_update_time': 1774859827.947711}
2026-03-30 08:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BY53413') HTTP/1.1" 204 0
2026-03-30 08:37:07 [auto1.be] INFO: Found listing with ID: PZ32696
2026-03-30 08:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PZ32696%27 HTTP/1.1" 200 None
2026-03-30 08:37:07 [auto1.be] INFO: Scrape type for PZ32696: 2
2026-03-30 08:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7ec2bb4-5047-539b-9439-cd251ebe0630 with identifier: PZ32696
2026-03-30 08:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7ec2bb4-5047-539b-9439-cd251ebe0630 with scrape type 2
2026-03-30 08:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7ec2bb4-5047-539b-9439-cd251ebe0630 with scrape type 2
2026-03-30 08:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a7ec2bb4-5047-539b-9439-cd251ebe0630, identifier: PZ32696
2026-03-30 08:37:08 [auto1.be] INFO: Found listing with ID: GZ17047
2026-03-30 08:37:08 [auto1.be] INFO: Found listing with ID: TN87621
2026-03-30 08:37:08 [auto1.be] INFO: Found listing with ID: LY35485
2026-03-30 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY35485%27 HTTP/1.1" 200 None
2026-03-30 08:37:08 [auto1.be] INFO: Scrape type for LY35485: 2
2026-03-30 08:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76aece13-5887-5898-bffa-61f0719e5106 with identifier: LY35485
2026-03-30 08:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76aece13-5887-5898-bffa-61f0719e5106 with scrape type 2
2026-03-30 08:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76aece13-5887-5898-bffa-61f0719e5106 with scrape type 2
2026-03-30 08:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 76aece13-5887-5898-bffa-61f0719e5106, identifier: LY35485
2026-03-30 08:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a7ec2bb4-5047-539b-9439-cd251ebe0630 with identifier: PZ32696
2026-03-30 08:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 08:37:08 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-30 08:37:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 08:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a7ec2bb4-5047-539b-9439-cd251ebe0630 with identifier: PZ32696
2026-03-30 08:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a7ec2bb4-5047-539b-9439-cd251ebe0630 with identifier: PZ32696 to the API
2026-03-30 08:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 60,
'expiration_date': '2026-03-30T15:30:04Z',
'fuel_type': 'petrol',
'id': 'a7ec2bb4-5047-539b-9439-cd251ebe0630',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ32696',
'listing': 'auction',
'make': 'Fiat',
'model': 'Panda',
'odometer': 159363,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-02-04',
'seller_name': None,
'title': 'Fiat Panda 1.2 Dynamic',
'transmission': 'manual',
'trim': 'Dynamic',
'year': 2004}
2026-03-30 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PZ32696%27 HTTP/1.1" 200 None
2026-03-30 08:37:08 [auto1.be] INFO: Saving data for PZ32696: {'auction_closing_time': 1774884604.0, 'created_time': 1774557480.550812, 'last_price_update_time': 1774859828.546727}
2026-03-30 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PZ32696') HTTP/1.1" 204 0
2026-03-30 08:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 76aece13-5887-5898-bffa-61f0719e5106 with identifier: LY35485
2026-03-30 08:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 76aece13-5887-5898-bffa-61f0719e5106 with identifier: LY35485
2026-03-30 08:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 76aece13-5887-5898-bffa-61f0719e5106 with identifier: LY35485 to the API
2026-03-30 08:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 280,
'expiration_date': '2026-03-30T15:39:33Z',
'fuel_type': 'hybrid',
'id': '76aece13-5887-5898-bffa-61f0719e5106',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY35485',
'listing': 'auction',
'make': 'Alfa Romeo',
'model': 'Tonale',
'odometer': 45683,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-04-13',
'seller_name': None,
'title': 'Alfa Romeo Tonale 1.3 Plug-in Hybrid Veloce AWD',
'transmission': 'automatic',
'trim': 'Veloce AWD',
'year': 2023}
2026-03-30 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY35485%27 HTTP/1.1" 200 None
2026-03-30 08:37:08 [auto1.be] INFO: Saving data for LY35485: {'auction_closing_time': 1774885173.0, 'created_time': 1774773357.686434, 'last_price_update_time': 1774859828.862904}
2026-03-30 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LY35485') HTTP/1.1" 204 0
2026-03-30 08:37:08 [auto1.be] INFO: Found listing with ID: YA34487
2026-03-30 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA34487%27 HTTP/1.1" 200 None
2026-03-30 08:37:08 [auto1.be] INFO: Scrape type for YA34487: 2
2026-03-30 08:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e0ad950-0d11-54d2-a68f-6d6044c75d5d with identifier: YA34487
2026-03-30 08:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e0ad950-0d11-54d2-a68f-6d6044c75d5d with scrape type 2
2026-03-30 08:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e0ad950-0d11-54d2-a68f-6d6044c75d5d with scrape type 2
2026-03-30 08:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2e0ad950-0d11-54d2-a68f-6d6044c75d5d, identifier: YA34487
2026-03-30 08:37:08 [auto1.be] INFO: Found listing with ID: DP17314
2026-03-30 08:37:08 [auto1.be] INFO: Found listing with ID: KU68109
2026-03-30 08:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU68109%27 HTTP/1.1" 200 None
2026-03-30 08:37:09 [auto1.be] INFO: Scrape type for KU68109: 2
2026-03-30 08:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94bf3c81-26fd-5171-823f-591eb83e234e with identifier: KU68109
2026-03-30 08:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94bf3c81-26fd-5171-823f-591eb83e234e with scrape type 2
2026-03-30 08:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94bf3c81-26fd-5171-823f-591eb83e234e with scrape type 2
2026-03-30 08:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 94bf3c81-26fd-5171-823f-591eb83e234e, identifier: KU68109
2026-03-30 08:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2e0ad950-0d11-54d2-a68f-6d6044c75d5d with identifier: YA34487
2026-03-30 08:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2e0ad950-0d11-54d2-a68f-6d6044c75d5d with identifier: YA34487
2026-03-30 08:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2e0ad950-0d11-54d2-a68f-6d6044c75d5d with identifier: YA34487 to the API
2026-03-30 08:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:05:25Z',
'fuel_type': 'petrol',
'id': '2e0ad950-0d11-54d2-a68f-6d6044c75d5d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA34487',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 83635,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-13',
'seller_name': None,
'title': 'Skoda Octavia 1.5 TSI ACT Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2019}
2026-03-30 08:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA34487%27 HTTP/1.1" 200 None
2026-03-30 08:37:09 [auto1.be] INFO: Saving data for YA34487: {'auction_closing_time': 1774883125.0, 'created_time': 1774773358.644465, 'last_price_update_time': 1774859829.370599}
2026-03-30 08:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YA34487') HTTP/1.1" 204 0
2026-03-30 08:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 94bf3c81-26fd-5171-823f-591eb83e234e with identifier: KU68109
2026-03-30 08:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 94bf3c81-26fd-5171-823f-591eb83e234e with identifier: KU68109
2026-03-30 08:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 94bf3c81-26fd-5171-823f-591eb83e234e with identifier: KU68109 to the API
2026-03-30 08:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 241,
'expiration_date': '2026-03-30T15:26:15Z',
'fuel_type': 'hybrid',
'id': '94bf3c81-26fd-5171-823f-591eb83e234e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU68109',
'listing': 'auction',
'make': 'Jeep',
'model': 'Compass',
'odometer': 32625,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-30',
'seller_name': None,
'title': 'Jeep Compass 1.3 T4 4xe Plug-in Hybrid S',
'transmission': 'automatic',
'trim': 'S',
'year': 2022}
2026-03-30 08:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU68109%27 HTTP/1.1" 200 None
2026-03-30 08:37:09 [auto1.be] INFO: Saving data for KU68109: {'auction_closing_time': 1774884375.0, 'created_time': 1774773358.971387, 'last_price_update_time': 1774859829.762555}
2026-03-30 08:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KU68109') HTTP/1.1" 204 0
2026-03-30 08:37:09 [auto1.be] INFO: Found listing with ID: RC41327
2026-03-30 08:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC41327%27 HTTP/1.1" 200 None
2026-03-30 08:37:09 [auto1.be] INFO: Scrape type for RC41327: 2
2026-03-30 08:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1ad459a-231d-5464-adab-1d532dddb027 with identifier: RC41327
2026-03-30 08:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1ad459a-231d-5464-adab-1d532dddb027 with scrape type 2
2026-03-30 08:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1ad459a-231d-5464-adab-1d532dddb027 with scrape type 2
2026-03-30 08:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e1ad459a-231d-5464-adab-1d532dddb027, identifier: RC41327
2026-03-30 08:37:09 [auto1.be] INFO: Found listing with ID: WT61211
2026-03-30 08:37:09 [auto1.be] INFO: Found listing with ID: RG41014
2026-03-30 08:37:09 [auto1.be] INFO: Found listing with ID: VL25326
2026-03-30 08:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL25326%27 HTTP/1.1" 200 None
2026-03-30 08:37:09 [auto1.be] INFO: Scrape type for VL25326: 2
2026-03-30 08:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d98003c-f14a-5300-bd4a-0672a6e35e9a with identifier: VL25326
2026-03-30 08:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d98003c-f14a-5300-bd4a-0672a6e35e9a with scrape type 2
2026-03-30 08:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d98003c-f14a-5300-bd4a-0672a6e35e9a with scrape type 2
2026-03-30 08:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6d98003c-f14a-5300-bd4a-0672a6e35e9a, identifier: VL25326
2026-03-30 08:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e1ad459a-231d-5464-adab-1d532dddb027 with identifier: RC41327
2026-03-30 08:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e1ad459a-231d-5464-adab-1d532dddb027 with identifier: RC41327
2026-03-30 08:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e1ad459a-231d-5464-adab-1d532dddb027 with identifier: RC41327 to the API
2026-03-30 08:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 218,
'expiration_date': '2026-03-30T15:55:50Z',
'fuel_type': 'hybrid',
'id': 'e1ad459a-231d-5464-adab-1d532dddb027',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC41327',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 96672,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-09',
'seller_name': None,
'title': 'Skoda Superb 1.4 Plug-in Hybrid Ambition iV',
'transmission': 'automatic',
'trim': 'Ambition iV',
'year': 2021}
2026-03-30 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RC41327%27 HTTP/1.1" 200 None
2026-03-30 08:37:10 [auto1.be] INFO: Saving data for RC41327: {'auction_closing_time': 1774886150.0, 'created_time': 1774773350.644742, 'last_price_update_time': 1774859830.276227}
2026-03-30 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RC41327') HTTP/1.1" 204 0
2026-03-30 08:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6d98003c-f14a-5300-bd4a-0672a6e35e9a with identifier: VL25326
2026-03-30 08:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6d98003c-f14a-5300-bd4a-0672a6e35e9a with identifier: VL25326
2026-03-30 08:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6d98003c-f14a-5300-bd4a-0672a6e35e9a with identifier: VL25326 to the API
2026-03-30 08:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:49:40Z',
'fuel_type': 'petrol',
'id': '6d98003c-f14a-5300-bd4a-0672a6e35e9a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL25326',
'listing': 'auction',
'make': 'Ford',
'model': 'Fiesta',
'odometer': 292699,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-09-30',
'seller_name': None,
'title': 'Ford Fiesta 1.25 Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2012}
2026-03-30 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL25326%27 HTTP/1.1" 200 None
2026-03-30 08:37:10 [auto1.be] INFO: Saving data for VL25326: {'auction_closing_time': 1774885780.0, 'created_time': 1773134432.039913, 'last_price_update_time': 1774859830.568053}
2026-03-30 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VL25326') HTTP/1.1" 204 0
2026-03-30 08:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:37:10 [auto1.be] INFO: Found listing with ID: BL31735
2026-03-30 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BL31735%27 HTTP/1.1" 200 None
2026-03-30 08:37:10 [auto1.be] INFO: Scrape type for BL31735: 2
2026-03-30 08:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7847e46-28c7-5a5d-8e42-0afcb6b8ea88 with identifier: BL31735
2026-03-30 08:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7847e46-28c7-5a5d-8e42-0afcb6b8ea88 with scrape type 2
2026-03-30 08:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7847e46-28c7-5a5d-8e42-0afcb6b8ea88 with scrape type 2
2026-03-30 08:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d7847e46-28c7-5a5d-8e42-0afcb6b8ea88, identifier: BL31735
2026-03-30 08:37:10 [auto1.be] INFO: Found listing with ID: PH78267
2026-03-30 08:37:10 [auto1.be] INFO: Found listing with ID: GA47341
2026-03-30 08:37:10 [auto1.be] INFO: Found listing with ID: NL54460
2026-03-30 08:37:10 [auto1.be] INFO: Found listing with ID: RE30310
2026-03-30 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE30310%27 HTTP/1.1" 200 None
2026-03-30 08:37:10 [auto1.be] INFO: Scrape type for RE30310: 2
2026-03-30 08:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acfe35ad-0f16-5719-a748-009caf8a3395 with identifier: RE30310
2026-03-30 08:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acfe35ad-0f16-5719-a748-009caf8a3395 with scrape type 2
2026-03-30 08:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acfe35ad-0f16-5719-a748-009caf8a3395 with scrape type 2
2026-03-30 08:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: acfe35ad-0f16-5719-a748-009caf8a3395, identifier: RE30310
2026-03-30 08:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d7847e46-28c7-5a5d-8e42-0afcb6b8ea88 with identifier: BL31735
2026-03-30 08:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d7847e46-28c7-5a5d-8e42-0afcb6b8ea88 with identifier: BL31735
2026-03-30 08:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d7847e46-28c7-5a5d-8e42-0afcb6b8ea88 with identifier: BL31735 to the API
2026-03-30 08:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:32:44Z',
'fuel_type': 'diesel',
'id': 'd7847e46-28c7-5a5d-8e42-0afcb6b8ea88',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL31735',
'listing': 'auction',
'make': 'BMW',
'model': '3er',
'odometer': 170971,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-26',
'seller_name': None,
'title': 'BMW 3er 325d',
'transmission': 'automatic',
'trim': '',
'year': 2011}
2026-03-30 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BL31735%27 HTTP/1.1" 200 None
2026-03-30 08:37:11 [auto1.be] INFO: Saving data for BL31735: {'auction_closing_time': 1774884764.0, 'created_time': 1774773350.955364, 'last_price_update_time': 1774859831.073121}
2026-03-30 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BL31735') HTTP/1.1" 204 0
2026-03-30 08:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: acfe35ad-0f16-5719-a748-009caf8a3395 with identifier: RE30310
2026-03-30 08:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: acfe35ad-0f16-5719-a748-009caf8a3395 with identifier: RE30310
2026-03-30 08:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: acfe35ad-0f16-5719-a748-009caf8a3395 with identifier: RE30310 to the API
2026-03-30 08:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 258,
'expiration_date': '2026-03-30T15:28:52Z',
'fuel_type': 'petrol',
'id': 'acfe35ad-0f16-5719-a748-009caf8a3395',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE30310',
'listing': 'auction',
'make': 'BMW',
'model': '6er',
'odometer': 81117,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-12',
'seller_name': None,
'title': 'BMW 6er 630i GT M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2021}
2026-03-30 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE30310%27 HTTP/1.1" 200 None
2026-03-30 08:37:11 [auto1.be] INFO: Saving data for RE30310: {'auction_closing_time': 1774884532.0, 'created_time': 1773132260.356116, 'last_price_update_time': 1774859831.425703}
2026-03-30 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RE30310') HTTP/1.1" 204 0
2026-03-30 08:37:11 [auto1.be] INFO: Found listing with ID: PJ34917
2026-03-30 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ34917%27 HTTP/1.1" 200 None
2026-03-30 08:37:11 [auto1.be] INFO: Scrape type for PJ34917: 2
2026-03-30 08:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23300f72-152c-592a-bcf7-132b1de7d21a with identifier: PJ34917
2026-03-30 08:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23300f72-152c-592a-bcf7-132b1de7d21a with scrape type 2
2026-03-30 08:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23300f72-152c-592a-bcf7-132b1de7d21a with scrape type 2
2026-03-30 08:37:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 23300f72-152c-592a-bcf7-132b1de7d21a, identifier: PJ34917
2026-03-30 08:37:11 [auto1.be] INFO: Found listing with ID: MM05603
2026-03-30 08:37:11 [auto1.be] INFO: Found listing with ID: MT15926
2026-03-30 08:37:11 [auto1.be] INFO: Found listing with ID: RR05667
2026-03-30 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR05667%27 HTTP/1.1" 200 None
2026-03-30 08:37:11 [auto1.be] INFO: Scrape type for RR05667: 2
2026-03-30 08:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf95bcee-79ec-58ca-95a9-5c510f677def with identifier: RR05667
2026-03-30 08:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf95bcee-79ec-58ca-95a9-5c510f677def with scrape type 2
2026-03-30 08:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf95bcee-79ec-58ca-95a9-5c510f677def with scrape type 2
2026-03-30 08:37:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cf95bcee-79ec-58ca-95a9-5c510f677def, identifier: RR05667
2026-03-30 08:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 23300f72-152c-592a-bcf7-132b1de7d21a with identifier: PJ34917
2026-03-30 08:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 23300f72-152c-592a-bcf7-132b1de7d21a with identifier: PJ34917
2026-03-30 08:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 23300f72-152c-592a-bcf7-132b1de7d21a with identifier: PJ34917 to the API
2026-03-30 08:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 320,
'expiration_date': '2026-03-30T15:18:27Z',
'fuel_type': 'hybrid',
'id': '23300f72-152c-592a-bcf7-132b1de7d21a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ34917',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 186238,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-05-17',
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 350e 4Matic AMG Line',
'transmission': 'automatic',
'trim': '4Matic AMG Line',
'year': 2017}
2026-03-30 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ34917%27 HTTP/1.1" 200 None
2026-03-30 08:37:11 [auto1.be] INFO: Saving data for PJ34917: {'auction_closing_time': 1774883907.0, 'created_time': 1774773349.597583, 'last_price_update_time': 1774859831.923698}
2026-03-30 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PJ34917') HTTP/1.1" 204 0
2026-03-30 08:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cf95bcee-79ec-58ca-95a9-5c510f677def with identifier: RR05667
2026-03-30 08:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cf95bcee-79ec-58ca-95a9-5c510f677def with identifier: RR05667
2026-03-30 08:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cf95bcee-79ec-58ca-95a9-5c510f677def with identifier: RR05667 to the API
2026-03-30 08:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 230,
'expiration_date': '2026-03-30T15:11:54Z',
'fuel_type': 'petrol',
'id': 'cf95bcee-79ec-58ca-95a9-5c510f677def',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR05667',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 62351,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-11',
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TSI GTI BlueMotion',
'transmission': 'manual',
'trim': 'GTI BlueMotion',
'year': 2018}
2026-03-30 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR05667%27 HTTP/1.1" 200 None
2026-03-30 08:37:12 [auto1.be] INFO: Saving data for RR05667: {'auction_closing_time': 1774883514.0, 'created_time': 1774471142.833519, 'last_price_update_time': 1774859832.319583}
2026-03-30 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RR05667') HTTP/1.1" 204 0
2026-03-30 08:37:12 [auto1.be] INFO: Channel: 24h | Page: 10 | totalHits: 1502 | hits on page: 40
2026-03-30 08:37:12 [auto1.be] INFO: Found listing with ID: TM16461
2026-03-30 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM16461%27 HTTP/1.1" 200 None
2026-03-30 08:37:12 [auto1.be] INFO: Scrape type for TM16461: 2
2026-03-30 08:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da2b18a6-a949-5d5a-b92e-1aab4f2417d9 with identifier: TM16461
2026-03-30 08:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da2b18a6-a949-5d5a-b92e-1aab4f2417d9 with scrape type 2
2026-03-30 08:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da2b18a6-a949-5d5a-b92e-1aab4f2417d9 with scrape type 2
2026-03-30 08:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: da2b18a6-a949-5d5a-b92e-1aab4f2417d9, identifier: TM16461
2026-03-30 08:37:12 [auto1.be] INFO: Found listing with ID: RA52713
2026-03-30 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA52713%27 HTTP/1.1" 200 None
2026-03-30 08:37:12 [auto1.be] INFO: Scrape type for RA52713: 2
2026-03-30 08:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dff40a98-1a29-5a0c-bc27-394239566acc with identifier: RA52713
2026-03-30 08:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dff40a98-1a29-5a0c-bc27-394239566acc with scrape type 2
2026-03-30 08:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dff40a98-1a29-5a0c-bc27-394239566acc with scrape type 2
2026-03-30 08:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dff40a98-1a29-5a0c-bc27-394239566acc, identifier: RA52713
2026-03-30 08:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: da2b18a6-a949-5d5a-b92e-1aab4f2417d9 with identifier: TM16461
2026-03-30 08:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: da2b18a6-a949-5d5a-b92e-1aab4f2417d9 with identifier: TM16461
2026-03-30 08:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: da2b18a6-a949-5d5a-b92e-1aab4f2417d9 with identifier: TM16461 to the API
2026-03-30 08:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 116,
'expiration_date': '2026-03-30T15:57:26Z',
'fuel_type': 'diesel',
'id': 'da2b18a6-a949-5d5a-b92e-1aab4f2417d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM16461',
'listing': 'auction',
'make': 'Dacia',
'model': 'Duster',
'odometer': 113727,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-01',
'seller_name': None,
'title': 'Dacia Duster 1.5 Blue dCi Prestige',
'transmission': 'manual',
'trim': 'Prestige',
'year': 2021}
2026-03-30 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM16461%27 HTTP/1.1" 200 None
2026-03-30 08:37:12 [auto1.be] INFO: Saving data for TM16461: {'auction_closing_time': 1774886246.0, 'created_time': 1774773354.365425, 'last_price_update_time': 1774859832.842097}
2026-03-30 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TM16461') HTTP/1.1" 204 0
2026-03-30 08:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dff40a98-1a29-5a0c-bc27-394239566acc with identifier: RA52713
2026-03-30 08:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dff40a98-1a29-5a0c-bc27-394239566acc with identifier: RA52713
2026-03-30 08:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dff40a98-1a29-5a0c-bc27-394239566acc with identifier: RA52713 to the API
2026-03-30 08:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:43:37Z',
'fuel_type': 'diesel',
'id': 'dff40a98-1a29-5a0c-bc27-394239566acc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA52713',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 97098,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-08-03',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 d BlueTEC',
'transmission': 'automatic',
'trim': 'BlueTEC',
'year': 2015}
2026-03-30 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA52713%27 HTTP/1.1" 200 None
2026-03-30 08:37:13 [auto1.be] INFO: Saving data for RA52713: {'auction_closing_time': 1774885417.0, 'created_time': 1773134356.130771, 'last_price_update_time': 1774859833.123037}
2026-03-30 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RA52713') HTTP/1.1" 204 0
2026-03-30 08:37:13 [auto1.be] INFO: Found listing with ID: VM31149
2026-03-30 08:37:13 [auto1.be] INFO: Found listing with ID: JC67757
2026-03-30 08:37:13 [auto1.be] INFO: Found listing with ID: UA36767
2026-03-30 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA36767%27 HTTP/1.1" 200 None
2026-03-30 08:37:13 [auto1.be] INFO: Scrape type for UA36767: 2
2026-03-30 08:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea3a0f24-9c0d-50d2-a234-a7007900a850 with identifier: UA36767
2026-03-30 08:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea3a0f24-9c0d-50d2-a234-a7007900a850 with scrape type 2
2026-03-30 08:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea3a0f24-9c0d-50d2-a234-a7007900a850 with scrape type 2
2026-03-30 08:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ea3a0f24-9c0d-50d2-a234-a7007900a850, identifier: UA36767
2026-03-30 08:37:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:37:13 [auto1.be] INFO: Found listing with ID: XY08671
2026-03-30 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XY08671%27 HTTP/1.1" 200 None
2026-03-30 08:37:13 [auto1.be] INFO: Scrape type for XY08671: 2
2026-03-30 08:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d58fd6b-aa3c-50bf-abc0-31ac239c2679 with identifier: XY08671
2026-03-30 08:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d58fd6b-aa3c-50bf-abc0-31ac239c2679 with scrape type 2
2026-03-30 08:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d58fd6b-aa3c-50bf-abc0-31ac239c2679 with scrape type 2
2026-03-30 08:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 2d58fd6b-aa3c-50bf-abc0-31ac239c2679, identifier: XY08671
2026-03-30 08:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ea3a0f24-9c0d-50d2-a234-a7007900a850 with identifier: UA36767
2026-03-30 08:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ea3a0f24-9c0d-50d2-a234-a7007900a850 with identifier: UA36767
2026-03-30 08:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ea3a0f24-9c0d-50d2-a234-a7007900a850 with identifier: UA36767 to the API
2026-03-30 08:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:50:14Z',
'fuel_type': 'diesel',
'id': 'ea3a0f24-9c0d-50d2-a234-a7007900a850',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA36767',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 234001,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-10-02',
'seller_name': None,
'title': 'Hyundai Tucson 2.0 CRDi',
'transmission': 'manual',
'trim': '',
'year': 2008}
2026-03-30 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA36767%27 HTTP/1.1" 200 None
2026-03-30 08:37:13 [auto1.be] INFO: Saving data for UA36767: {'auction_closing_time': 1774885814.0, 'created_time': 1773137435.944325, 'last_price_update_time': 1774859833.634528}
2026-03-30 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UA36767') HTTP/1.1" 204 0
2026-03-30 08:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 2d58fd6b-aa3c-50bf-abc0-31ac239c2679 with identifier: XY08671
2026-03-30 08:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 2d58fd6b-aa3c-50bf-abc0-31ac239c2679 with identifier: XY08671
2026-03-30 08:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 2d58fd6b-aa3c-50bf-abc0-31ac239c2679 with identifier: XY08671 to the API
2026-03-30 08:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:34:20Z',
'fuel_type': 'petrol',
'id': '2d58fd6b-aa3c-50bf-abc0-31ac239c2679',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY08671',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 48063,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-15',
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2021}
2026-03-30 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XY08671%27 HTTP/1.1" 200 None
2026-03-30 08:37:13 [auto1.be] INFO: Saving data for XY08671: {'auction_closing_time': 1774884860.0, 'created_time': 1773132016.89486, 'last_price_update_time': 1774859833.970171}
2026-03-30 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XY08671') HTTP/1.1" 204 0
2026-03-30 08:37:13 [auto1.be] INFO: Found listing with ID: VE25219
2026-03-30 08:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE25219%27 HTTP/1.1" 200 None
2026-03-30 08:37:14 [auto1.be] INFO: Scrape type for VE25219: 2
2026-03-30 08:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cc247f5-8245-5670-8396-d87c43561ad5 with identifier: VE25219
2026-03-30 08:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cc247f5-8245-5670-8396-d87c43561ad5 with scrape type 2
2026-03-30 08:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cc247f5-8245-5670-8396-d87c43561ad5 with scrape type 2
2026-03-30 08:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3cc247f5-8245-5670-8396-d87c43561ad5, identifier: VE25219
2026-03-30 08:37:14 [auto1.be] INFO: Found listing with ID: GB86339
2026-03-30 08:37:14 [auto1.be] INFO: Found listing with ID: PW41553
2026-03-30 08:37:14 [auto1.be] INFO: Found listing with ID: FF69776
2026-03-30 08:37:14 [auto1.be] INFO: Found listing with ID: BY20726
2026-03-30 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY20726%27 HTTP/1.1" 200 None
2026-03-30 08:37:14 [auto1.be] INFO: Scrape type for BY20726: 2
2026-03-30 08:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbe78aa8-c585-5b99-952d-41d8762c17ee with identifier: BY20726
2026-03-30 08:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbe78aa8-c585-5b99-952d-41d8762c17ee with scrape type 2
2026-03-30 08:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbe78aa8-c585-5b99-952d-41d8762c17ee with scrape type 2
2026-03-30 08:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dbe78aa8-c585-5b99-952d-41d8762c17ee, identifier: BY20726
2026-03-30 08:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3cc247f5-8245-5670-8396-d87c43561ad5 with identifier: VE25219
2026-03-30 08:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3cc247f5-8245-5670-8396-d87c43561ad5 with identifier: VE25219
2026-03-30 08:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3cc247f5-8245-5670-8396-d87c43561ad5 with identifier: VE25219 to the API
2026-03-30 08:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:37:52Z',
'fuel_type': 'petrol',
'id': '3cc247f5-8245-5670-8396-d87c43561ad5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE25219',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan Allspace',
'odometer': 55598,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-31',
'seller_name': None,
'title': 'Volkswagen Tiguan Allspace 1.5 TSI ACT R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2022}
2026-03-30 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE25219%27 HTTP/1.1" 200 None
2026-03-30 08:37:14 [auto1.be] INFO: Saving data for VE25219: {'auction_closing_time': 1774885072.0, 'created_time': 1773239663.19014, 'last_price_update_time': 1774859834.502595}
2026-03-30 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VE25219') HTTP/1.1" 204 0
2026-03-30 08:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dbe78aa8-c585-5b99-952d-41d8762c17ee with identifier: BY20726
2026-03-30 08:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dbe78aa8-c585-5b99-952d-41d8762c17ee with identifier: BY20726
2026-03-30 08:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dbe78aa8-c585-5b99-952d-41d8762c17ee with identifier: BY20726 to the API
2026-03-30 08:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:26:24Z',
'fuel_type': 'diesel',
'id': 'dbe78aa8-c585-5b99-952d-41d8762c17ee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY20726',
'listing': 'auction',
'make': 'Renault',
'model': 'Trafic',
'odometer': 146559,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-03',
'seller_name': None,
'title': 'Renault Trafic 2.0 dCi L2H1 Doka 3,0t Komfort',
'transmission': 'manual',
'trim': 'L2H1 Doka 3,0t Komfort',
'year': 2020}
2026-03-30 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY20726%27 HTTP/1.1" 200 None
2026-03-30 08:37:14 [auto1.be] INFO: Saving data for BY20726: {'auction_closing_time': 1774884384.0, 'created_time': 1774773363.866313, 'last_price_update_time': 1774859834.983609}
2026-03-30 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BY20726') HTTP/1.1" 204 0
2026-03-30 08:37:15 [auto1.be] INFO: Found listing with ID: WA86347
2026-03-30 08:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA86347%27 HTTP/1.1" 200 None
2026-03-30 08:37:15 [auto1.be] INFO: Scrape type for WA86347: 2
2026-03-30 08:37:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 499739a2-91ec-56ba-9fc8-77d73743a9f1 with identifier: WA86347
2026-03-30 08:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 499739a2-91ec-56ba-9fc8-77d73743a9f1 with scrape type 2
2026-03-30 08:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 499739a2-91ec-56ba-9fc8-77d73743a9f1 with scrape type 2
2026-03-30 08:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 499739a2-91ec-56ba-9fc8-77d73743a9f1, identifier: WA86347
2026-03-30 08:37:15 [auto1.be] INFO: Found listing with ID: YH64614
2026-03-30 08:37:15 [auto1.be] INFO: Found listing with ID: KF56069
2026-03-30 08:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF56069%27 HTTP/1.1" 200 None
2026-03-30 08:37:15 [auto1.be] INFO: Scrape type for KF56069: 2
2026-03-30 08:37:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3c14c78-7b78-58dc-bee0-4e0668b92fe5 with identifier: KF56069
2026-03-30 08:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3c14c78-7b78-58dc-bee0-4e0668b92fe5 with scrape type 2
2026-03-30 08:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3c14c78-7b78-58dc-bee0-4e0668b92fe5 with scrape type 2
2026-03-30 08:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a3c14c78-7b78-58dc-bee0-4e0668b92fe5, identifier: KF56069
2026-03-30 08:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 499739a2-91ec-56ba-9fc8-77d73743a9f1 with identifier: WA86347
2026-03-30 08:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 499739a2-91ec-56ba-9fc8-77d73743a9f1 with identifier: WA86347
2026-03-30 08:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 499739a2-91ec-56ba-9fc8-77d73743a9f1 with identifier: WA86347 to the API
2026-03-30 08:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:45:06Z',
'fuel_type': 'diesel',
'id': '499739a2-91ec-56ba-9fc8-77d73743a9f1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA86347',
'listing': 'auction',
'make': 'Seat',
'model': 'Ibiza',
'odometer': 192311,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-06-30',
'seller_name': None,
'title': 'Seat Ibiza 1.6 TDI Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2009}
2026-03-30 08:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA86347%27 HTTP/1.1" 200 None
2026-03-30 08:37:15 [auto1.be] INFO: Saving data for WA86347: {'auction_closing_time': 1774885506.0, 'created_time': 1773132700.804933, 'last_price_update_time': 1774859835.505847}
2026-03-30 08:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WA86347') HTTP/1.1" 204 0
2026-03-30 08:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a3c14c78-7b78-58dc-bee0-4e0668b92fe5 with identifier: KF56069
2026-03-30 08:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a3c14c78-7b78-58dc-bee0-4e0668b92fe5 with identifier: KF56069
2026-03-30 08:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a3c14c78-7b78-58dc-bee0-4e0668b92fe5 with identifier: KF56069 to the API
2026-03-30 08:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:06:25Z',
'fuel_type': 'diesel',
'id': 'a3c14c78-7b78-58dc-bee0-4e0668b92fe5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF56069',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3 Sportback',
'odometer': 206778,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-31',
'seller_name': None,
'title': 'Audi Q3 Sportback 35 TDI S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2021}
2026-03-30 08:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF56069%27 HTTP/1.1" 200 None
2026-03-30 08:37:15 [auto1.be] INFO: Saving data for KF56069: {'auction_closing_time': 1774883185.0, 'created_time': 1774773356.034194, 'last_price_update_time': 1774859835.779536}
2026-03-30 08:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KF56069') HTTP/1.1" 204 0
2026-03-30 08:37:15 [auto1.be] INFO: Found listing with ID: PS31946
2026-03-30 08:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS31946%27 HTTP/1.1" 200 None
2026-03-30 08:37:15 [auto1.be] INFO: Scrape type for PS31946: 2
2026-03-30 08:37:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0769dfb4-f815-5797-8b01-50a9da6de20a with identifier: PS31946
2026-03-30 08:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0769dfb4-f815-5797-8b01-50a9da6de20a with scrape type 2
2026-03-30 08:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0769dfb4-f815-5797-8b01-50a9da6de20a with scrape type 2
2026-03-30 08:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0769dfb4-f815-5797-8b01-50a9da6de20a, identifier: PS31946
2026-03-30 08:37:16 [auto1.be] INFO: Found listing with ID: BT87712
2026-03-30 08:37:16 [auto1.be] INFO: Found listing with ID: BV02466
2026-03-30 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV02466%27 HTTP/1.1" 200 None
2026-03-30 08:37:16 [auto1.be] INFO: Scrape type for BV02466: 2
2026-03-30 08:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29117545-3de3-59e0-99ea-ad8357308098 with identifier: BV02466
2026-03-30 08:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29117545-3de3-59e0-99ea-ad8357308098 with scrape type 2
2026-03-30 08:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29117545-3de3-59e0-99ea-ad8357308098 with scrape type 2
2026-03-30 08:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 29117545-3de3-59e0-99ea-ad8357308098, identifier: BV02466
2026-03-30 08:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0769dfb4-f815-5797-8b01-50a9da6de20a with identifier: PS31946
2026-03-30 08:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0769dfb4-f815-5797-8b01-50a9da6de20a with identifier: PS31946
2026-03-30 08:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0769dfb4-f815-5797-8b01-50a9da6de20a with identifier: PS31946 to the API
2026-03-30 08:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:09:04Z',
'fuel_type': 'petrol',
'id': '0769dfb4-f815-5797-8b01-50a9da6de20a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS31946',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 106584,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-12-11',
'seller_name': None,
'title': 'Skoda Octavia 1.4 TSI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2014}
2026-03-30 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS31946%27 HTTP/1.1" 200 None
2026-03-30 08:37:16 [auto1.be] INFO: Saving data for PS31946: {'auction_closing_time': 1774883344.0, 'created_time': 1773237985.450705, 'last_price_update_time': 1774859836.457106}
2026-03-30 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PS31946') HTTP/1.1" 204 0
2026-03-30 08:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 29117545-3de3-59e0-99ea-ad8357308098 with identifier: BV02466
2026-03-30 08:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 29117545-3de3-59e0-99ea-ad8357308098 with identifier: BV02466
2026-03-30 08:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 29117545-3de3-59e0-99ea-ad8357308098 with identifier: BV02466 to the API
2026-03-30 08:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:47:51Z',
'fuel_type': 'petrol',
'id': '29117545-3de3-59e0-99ea-ad8357308098',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV02466',
'listing': 'auction',
'make': 'Citroen',
'model': 'C3',
'odometer': 40283,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-11',
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Feel Pack',
'transmission': 'manual',
'trim': 'Feel Pack',
'year': 2020}
2026-03-30 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV02466%27 HTTP/1.1" 200 None
2026-03-30 08:37:16 [auto1.be] INFO: Saving data for BV02466: {'auction_closing_time': 1774885671.0, 'created_time': 1773225123.553245, 'last_price_update_time': 1774859836.738976}
2026-03-30 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BV02466') HTTP/1.1" 204 0
2026-03-30 08:37:16 [auto1.be] INFO: Found listing with ID: DY35896
2026-03-30 08:37:16 [auto1.be] INFO: Found listing with ID: KZ95632
2026-03-30 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ95632%27 HTTP/1.1" 200 None
2026-03-30 08:37:16 [auto1.be] INFO: Scrape type for KZ95632: 2
2026-03-30 08:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa429584-98dd-52b8-ba87-dfdfb2bd2f40 with identifier: KZ95632
2026-03-30 08:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa429584-98dd-52b8-ba87-dfdfb2bd2f40 with scrape type 2
2026-03-30 08:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa429584-98dd-52b8-ba87-dfdfb2bd2f40 with scrape type 2
2026-03-30 08:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fa429584-98dd-52b8-ba87-dfdfb2bd2f40, identifier: KZ95632
2026-03-30 08:37:16 [auto1.be] INFO: Found listing with ID: SY52065
2026-03-30 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY52065%27 HTTP/1.1" 200 None
2026-03-30 08:37:16 [auto1.be] INFO: Scrape type for SY52065: 2
2026-03-30 08:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2cba265-bd81-544e-b139-66cfe0127b20 with identifier: SY52065
2026-03-30 08:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2cba265-bd81-544e-b139-66cfe0127b20 with scrape type 2
2026-03-30 08:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2cba265-bd81-544e-b139-66cfe0127b20 with scrape type 2
2026-03-30 08:37:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a2cba265-bd81-544e-b139-66cfe0127b20, identifier: SY52065
2026-03-30 08:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fa429584-98dd-52b8-ba87-dfdfb2bd2f40 with identifier: KZ95632
2026-03-30 08:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fa429584-98dd-52b8-ba87-dfdfb2bd2f40 with identifier: KZ95632
2026-03-30 08:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fa429584-98dd-52b8-ba87-dfdfb2bd2f40 with identifier: KZ95632 to the API
2026-03-30 08:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:33:17Z',
'fuel_type': 'petrol',
'id': 'fa429584-98dd-52b8-ba87-dfdfb2bd2f40',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ95632',
'listing': 'auction',
'make': 'Mazda',
'model': 'CX-3',
'odometer': 65099,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-05-05',
'seller_name': None,
'title': 'Mazda CX-3 2.0 Exclusive-Line',
'transmission': 'automatic',
'trim': 'Exclusive-Line',
'year': 2016}
2026-03-30 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ95632%27 HTTP/1.1" 200 None
2026-03-30 08:37:17 [auto1.be] INFO: Saving data for KZ95632: {'auction_closing_time': 1774884797.0, 'created_time': 1774298271.500588, 'last_price_update_time': 1774859837.343624}
2026-03-30 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KZ95632') HTTP/1.1" 204 0
2026-03-30 08:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a2cba265-bd81-544e-b139-66cfe0127b20 with identifier: SY52065
2026-03-30 08:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a2cba265-bd81-544e-b139-66cfe0127b20 with identifier: SY52065
2026-03-30 08:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a2cba265-bd81-544e-b139-66cfe0127b20 with identifier: SY52065 to the API
2026-03-30 08:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:55:17Z',
'fuel_type': 'petrol',
'id': 'a2cba265-bd81-544e-b139-66cfe0127b20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY52065',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20',
'odometer': 108090,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-02',
'seller_name': None,
'title': 'Hyundai i20 1.2 Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2013}
2026-03-30 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY52065%27 HTTP/1.1" 200 None
2026-03-30 08:37:17 [auto1.be] INFO: Saving data for SY52065: {'auction_closing_time': 1774886117.0, 'created_time': 1773135978.353718, 'last_price_update_time': 1774859837.647383}
2026-03-30 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SY52065') HTTP/1.1" 204 0
2026-03-30 08:37:17 [auto1.be] INFO: Found listing with ID: VM01272
2026-03-30 08:37:17 [auto1.be] INFO: Found listing with ID: KL42374
2026-03-30 08:37:17 [auto1.be] INFO: Found listing with ID: UF75491
2026-03-30 08:37:17 [auto1.be] INFO: Found listing with ID: ZP25114
2026-03-30 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP25114%27 HTTP/1.1" 200 None
2026-03-30 08:37:17 [auto1.be] INFO: Scrape type for ZP25114: 2
2026-03-30 08:37:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42940469-99fe-55df-bbf9-19e642712c9c with identifier: ZP25114
2026-03-30 08:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42940469-99fe-55df-bbf9-19e642712c9c with scrape type 2
2026-03-30 08:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42940469-99fe-55df-bbf9-19e642712c9c with scrape type 2
2026-03-30 08:37:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 42940469-99fe-55df-bbf9-19e642712c9c, identifier: ZP25114
2026-03-30 08:37:17 [auto1.be] INFO: Found listing with ID: NC51382
2026-03-30 08:37:17 [auto1.be] INFO: Found listing with ID: NG60197
2026-03-30 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG60197%27 HTTP/1.1" 200 None
2026-03-30 08:37:17 [auto1.be] INFO: Scrape type for NG60197: 2
2026-03-30 08:37:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63ffb45e-3ba5-55d8-96c0-6a0838581d18 with identifier: NG60197
2026-03-30 08:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63ffb45e-3ba5-55d8-96c0-6a0838581d18 with scrape type 2
2026-03-30 08:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63ffb45e-3ba5-55d8-96c0-6a0838581d18 with scrape type 2
2026-03-30 08:37:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 63ffb45e-3ba5-55d8-96c0-6a0838581d18, identifier: NG60197
2026-03-30 08:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 42940469-99fe-55df-bbf9-19e642712c9c with identifier: ZP25114
2026-03-30 08:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 42940469-99fe-55df-bbf9-19e642712c9c with identifier: ZP25114
2026-03-30 08:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 42940469-99fe-55df-bbf9-19e642712c9c with identifier: ZP25114 to the API
2026-03-30 08:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:12:22Z',
'fuel_type': 'diesel',
'id': '42940469-99fe-55df-bbf9-19e642712c9c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP25114',
'listing': 'auction',
'make': 'Ford',
'model': 'Grand Tourneo Connect',
'odometer': 188921,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-07-27',
'seller_name': None,
'title': 'Ford Grand Tourneo Connect 1.6 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2014}
2026-03-30 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP25114%27 HTTP/1.1" 200 None
2026-03-30 08:37:18 [auto1.be] INFO: Saving data for ZP25114: {'auction_closing_time': 1774883542.0, 'created_time': 1773301904.259899, 'last_price_update_time': 1774859838.154544}
2026-03-30 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZP25114') HTTP/1.1" 204 0
2026-03-30 08:37:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 63ffb45e-3ba5-55d8-96c0-6a0838581d18 with identifier: NG60197
2026-03-30 08:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 63ffb45e-3ba5-55d8-96c0-6a0838581d18 with identifier: NG60197
2026-03-30 08:37:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 63ffb45e-3ba5-55d8-96c0-6a0838581d18 with identifier: NG60197 to the API
2026-03-30 08:37:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:38:19Z',
'fuel_type': 'petrol',
'id': '63ffb45e-3ba5-55d8-96c0-6a0838581d18',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG60197',
'listing': 'auction',
'make': 'Kia',
'model': 'Sportage',
'odometer': 133609,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-10',
'seller_name': None,
'title': 'Kia Sportage 1.6 GDI Active 2WD',
'transmission': 'manual',
'trim': 'Active 2WD',
'year': 2015}
2026-03-30 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NG60197%27 HTTP/1.1" 200 None
2026-03-30 08:37:18 [auto1.be] INFO: Saving data for NG60197: {'auction_closing_time': 1774885099.0, 'created_time': 1773132744.258929, 'last_price_update_time': 1774859838.544185}
2026-03-30 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NG60197') HTTP/1.1" 204 0
2026-03-30 08:37:18 [auto1.be] INFO: Found listing with ID: FP22064
2026-03-30 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP22064%27 HTTP/1.1" 200 None
2026-03-30 08:37:18 [auto1.be] INFO: Scrape type for FP22064: 2
2026-03-30 08:37:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b634c0a-20c8-5733-91d8-e3b70cb6f8da with identifier: FP22064
2026-03-30 08:37:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b634c0a-20c8-5733-91d8-e3b70cb6f8da with scrape type 2
2026-03-30 08:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b634c0a-20c8-5733-91d8-e3b70cb6f8da with scrape type 2
2026-03-30 08:37:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9b634c0a-20c8-5733-91d8-e3b70cb6f8da, identifier: FP22064
2026-03-30 08:37:18 [auto1.be] INFO: Found listing with ID: XU40393
2026-03-30 08:37:18 [auto1.be] INFO: Found listing with ID: JU27695
2026-03-30 08:37:18 [auto1.be] INFO: Found listing with ID: YR77899
2026-03-30 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YR77899%27 HTTP/1.1" 200 None
2026-03-30 08:37:18 [auto1.be] INFO: Scrape type for YR77899: 2
2026-03-30 08:37:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a41fd37-f35c-5167-bed6-afec25a1a293 with identifier: YR77899
2026-03-30 08:37:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a41fd37-f35c-5167-bed6-afec25a1a293 with scrape type 2
2026-03-30 08:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a41fd37-f35c-5167-bed6-afec25a1a293 with scrape type 2
2026-03-30 08:37:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5a41fd37-f35c-5167-bed6-afec25a1a293, identifier: YR77899
2026-03-30 08:37:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9b634c0a-20c8-5733-91d8-e3b70cb6f8da with identifier: FP22064
2026-03-30 08:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9b634c0a-20c8-5733-91d8-e3b70cb6f8da with identifier: FP22064
2026-03-30 08:37:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9b634c0a-20c8-5733-91d8-e3b70cb6f8da with identifier: FP22064 to the API
2026-03-30 08:37:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:24:50Z',
'fuel_type': 'diesel',
'id': '9b634c0a-20c8-5733-91d8-e3b70cb6f8da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP22064',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 281023,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-04-01',
'seller_name': None,
'title': 'BMW 1er 116d EfficientDynamics Edition',
'transmission': 'manual',
'trim': 'EfficientDynamics Edition',
'year': 2014}
2026-03-30 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FP22064%27 HTTP/1.1" 200 None
2026-03-30 08:37:19 [auto1.be] INFO: Saving data for FP22064: {'auction_closing_time': 1774884290.0, 'created_time': 1774773390.658866, 'last_price_update_time': 1774859839.053302}
2026-03-30 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FP22064') HTTP/1.1" 204 0
2026-03-30 08:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5a41fd37-f35c-5167-bed6-afec25a1a293 with identifier: YR77899
2026-03-30 08:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5a41fd37-f35c-5167-bed6-afec25a1a293 with identifier: YR77899
2026-03-30 08:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5a41fd37-f35c-5167-bed6-afec25a1a293 with identifier: YR77899 to the API
2026-03-30 08:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:03:03Z',
'fuel_type': 'diesel',
'id': '5a41fd37-f35c-5167-bed6-afec25a1a293',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR77899',
'listing': 'auction',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 131554,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-01-28',
'seller_name': None,
'title': 'Citroen Berlingo 1.9 Diesel 600 Kasten',
'transmission': 'manual',
'trim': '600 Kasten',
'year': 2004}
2026-03-30 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YR77899%27 HTTP/1.1" 200 None
2026-03-30 08:37:19 [auto1.be] INFO: Saving data for YR77899: {'auction_closing_time': 1774882983.0, 'created_time': 1773240989.548451, 'last_price_update_time': 1774859839.351216}
2026-03-30 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YR77899') HTTP/1.1" 204 0
2026-03-30 08:37:19 [auto1.be] INFO: Found listing with ID: EL71552
2026-03-30 08:37:19 [auto1.be] INFO: Found listing with ID: SK78967
2026-03-30 08:37:19 [auto1.be] INFO: Found listing with ID: TG30379
2026-03-30 08:37:19 [auto1.be] INFO: Found listing with ID: MX26890
2026-03-30 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX26890%27 HTTP/1.1" 200 None
2026-03-30 08:37:19 [auto1.be] INFO: Scrape type for MX26890: 2
2026-03-30 08:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dbb4816-4c7f-5b89-84c4-36c8814b7af5 with identifier: MX26890
2026-03-30 08:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dbb4816-4c7f-5b89-84c4-36c8814b7af5 with scrape type 2
2026-03-30 08:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9dbb4816-4c7f-5b89-84c4-36c8814b7af5 with scrape type 2
2026-03-30 08:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9dbb4816-4c7f-5b89-84c4-36c8814b7af5, identifier: MX26890
2026-03-30 08:37:19 [auto1.be] INFO: Found listing with ID: FH50113
2026-03-30 08:37:19 [auto1.be] INFO: Found listing with ID: YU69949
2026-03-30 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU69949%27 HTTP/1.1" 200 None
2026-03-30 08:37:19 [auto1.be] INFO: Scrape type for YU69949: 2
2026-03-30 08:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb93a4ea-803b-569d-bc31-c83363dab30d with identifier: YU69949
2026-03-30 08:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb93a4ea-803b-569d-bc31-c83363dab30d with scrape type 2
2026-03-30 08:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb93a4ea-803b-569d-bc31-c83363dab30d with scrape type 2
2026-03-30 08:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fb93a4ea-803b-569d-bc31-c83363dab30d, identifier: YU69949
2026-03-30 08:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9dbb4816-4c7f-5b89-84c4-36c8814b7af5 with identifier: MX26890
2026-03-30 08:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9dbb4816-4c7f-5b89-84c4-36c8814b7af5 with identifier: MX26890
2026-03-30 08:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9dbb4816-4c7f-5b89-84c4-36c8814b7af5 with identifier: MX26890 to the API
2026-03-30 08:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 231,
'expiration_date': '2026-03-30T15:36:57Z',
'fuel_type': 'petrol',
'id': '9dbb4816-4c7f-5b89-84c4-36c8814b7af5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX26890',
'listing': 'auction',
'make': 'MINI',
'model': 'MINI',
'odometer': 90514,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-04',
'seller_name': None,
'title': 'MINI John Cooper Works',
'transmission': 'automatic',
'trim': '',
'year': 2021}
2026-03-30 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX26890%27 HTTP/1.1" 200 None
2026-03-30 08:37:19 [auto1.be] INFO: Saving data for MX26890: {'auction_closing_time': 1774885017.0, 'created_time': 1773137472.010623, 'last_price_update_time': 1774859839.884137}
2026-03-30 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MX26890') HTTP/1.1" 204 0
2026-03-30 08:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fb93a4ea-803b-569d-bc31-c83363dab30d with identifier: YU69949
2026-03-30 08:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fb93a4ea-803b-569d-bc31-c83363dab30d with identifier: YU69949
2026-03-30 08:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fb93a4ea-803b-569d-bc31-c83363dab30d with identifier: YU69949 to the API
2026-03-30 08:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 249,
'expiration_date': '2026-03-30T15:09:09Z',
'fuel_type': 'diesel',
'id': 'fb93a4ea-803b-569d-bc31-c83363dab30d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU69949',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC90',
'odometer': 70496,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-12',
'seller_name': None,
'title': 'Volvo XC90 2.0 B5 Diesel Mild-Hybrid Inscription AWD',
'transmission': 'automatic',
'trim': 'Inscription AWD',
'year': 2021}
2026-03-30 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU69949%27 HTTP/1.1" 200 None
2026-03-30 08:37:20 [auto1.be] INFO: Saving data for YU69949: {'auction_closing_time': 1774883349.0, 'created_time': 1774643857.676458, 'last_price_update_time': 1774859840.172775}
2026-03-30 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YU69949') HTTP/1.1" 204 0
2026-03-30 08:37:20 [auto1.be] INFO: Found listing with ID: DB21184
2026-03-30 08:37:20 [auto1.be] INFO: Found listing with ID: ZX91910
2026-03-30 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX91910%27 HTTP/1.1" 200 None
2026-03-30 08:37:20 [auto1.be] INFO: Scrape type for ZX91910: 2
2026-03-30 08:37:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8339274d-c6a2-5f32-9851-1f9516d45de0 with identifier: ZX91910
2026-03-30 08:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8339274d-c6a2-5f32-9851-1f9516d45de0 with scrape type 2
2026-03-30 08:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8339274d-c6a2-5f32-9851-1f9516d45de0 with scrape type 2
2026-03-30 08:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8339274d-c6a2-5f32-9851-1f9516d45de0, identifier: ZX91910
2026-03-30 08:37:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8339274d-c6a2-5f32-9851-1f9516d45de0 with identifier: ZX91910
2026-03-30 08:37:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8339274d-c6a2-5f32-9851-1f9516d45de0 with identifier: ZX91910
2026-03-30 08:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8339274d-c6a2-5f32-9851-1f9516d45de0 with identifier: ZX91910 to the API
2026-03-30 08:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:34:34Z',
'fuel_type': 'diesel',
'id': '8339274d-c6a2-5f32-9851-1f9516d45de0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX91910',
'listing': 'auction',
'make': 'Renault',
'model': 'Trafic',
'odometer': 39745,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-19',
'seller_name': None,
'title': 'Renault Trafic 2.0 BLUE dCi L2H1 3,0t Komfort',
'transmission': 'automatic',
'trim': 'L2H1 3,0t Komfort',
'year': 2022}
2026-03-30 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX91910%27 HTTP/1.1" 200 None
2026-03-30 08:37:20 [auto1.be] INFO: Saving data for ZX91910: {'auction_closing_time': 1774884874.0, 'created_time': 1773137643.772233, 'last_price_update_time': 1774859840.571243}
2026-03-30 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZX91910') HTTP/1.1" 204 0
2026-03-30 08:37:20 [auto1.be] INFO: Found listing with ID: LU53556
2026-03-30 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU53556%27 HTTP/1.1" 200 None
2026-03-30 08:37:20 [auto1.be] INFO: Scrape type for LU53556: 2
2026-03-30 08:37:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7adbbda1-1630-5553-aed9-d33cff5a901f with identifier: LU53556
2026-03-30 08:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7adbbda1-1630-5553-aed9-d33cff5a901f with scrape type 2
2026-03-30 08:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7adbbda1-1630-5553-aed9-d33cff5a901f with scrape type 2
2026-03-30 08:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7adbbda1-1630-5553-aed9-d33cff5a901f, identifier: LU53556
2026-03-30 08:37:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:37:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7adbbda1-1630-5553-aed9-d33cff5a901f with identifier: LU53556
2026-03-30 08:37:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7adbbda1-1630-5553-aed9-d33cff5a901f with identifier: LU53556
2026-03-30 08:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7adbbda1-1630-5553-aed9-d33cff5a901f with identifier: LU53556 to the API
2026-03-30 08:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 340,
'expiration_date': '2026-03-30T15:08:47Z',
'fuel_type': 'petrol',
'id': '7adbbda1-1630-5553-aed9-d33cff5a901f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU53556',
'listing': 'auction',
'make': 'BMW',
'model': '1er',
'odometer': 68333,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-27',
'seller_name': None,
'title': 'BMW 1er M140i Special Edition',
'transmission': 'automatic',
'trim': 'Special Edition',
'year': 2019}
2026-03-30 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU53556%27 HTTP/1.1" 200 None
2026-03-30 08:37:21 [auto1.be] INFO: Saving data for LU53556: {'auction_closing_time': 1774883327.0, 'created_time': 1773133730.700751, 'last_price_update_time': 1774859841.081482}
2026-03-30 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LU53556') HTTP/1.1" 204 0
2026-03-30 08:37:21 [auto1.be] INFO: Found listing with ID: TT03576
2026-03-30 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT03576%27 HTTP/1.1" 200 None
2026-03-30 08:37:21 [auto1.be] INFO: Scrape type for TT03576: 2
2026-03-30 08:37:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae18b013-7ea4-5fc8-b1d1-80276f7770d7 with identifier: TT03576
2026-03-30 08:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae18b013-7ea4-5fc8-b1d1-80276f7770d7 with scrape type 2
2026-03-30 08:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae18b013-7ea4-5fc8-b1d1-80276f7770d7 with scrape type 2
2026-03-30 08:37:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ae18b013-7ea4-5fc8-b1d1-80276f7770d7, identifier: TT03576
2026-03-30 08:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ae18b013-7ea4-5fc8-b1d1-80276f7770d7 with identifier: TT03576
2026-03-30 08:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ae18b013-7ea4-5fc8-b1d1-80276f7770d7 with identifier: TT03576
2026-03-30 08:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ae18b013-7ea4-5fc8-b1d1-80276f7770d7 with identifier: TT03576 to the API
2026-03-30 08:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:28:28Z',
'fuel_type': 'petrol',
'id': 'ae18b013-7ea4-5fc8-b1d1-80276f7770d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT03576',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20',
'odometer': 30038,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-31',
'seller_name': None,
'title': 'Hyundai i20 1.2 Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2015}
2026-03-30 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TT03576%27 HTTP/1.1" 200 None
2026-03-30 08:37:21 [auto1.be] INFO: Saving data for TT03576: {'auction_closing_time': 1774884508.0, 'created_time': 1774773360.487307, 'last_price_update_time': 1774859841.48472}
2026-03-30 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TT03576') HTTP/1.1" 204 0
2026-03-30 08:37:21 [auto1.be] INFO: Found listing with ID: BD95571
2026-03-30 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD95571%27 HTTP/1.1" 200 None
2026-03-30 08:37:21 [auto1.be] INFO: Scrape type for BD95571: 2
2026-03-30 08:37:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efb9e4e0-3076-56c9-a209-f06e6b24a6d9 with identifier: BD95571
2026-03-30 08:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efb9e4e0-3076-56c9-a209-f06e6b24a6d9 with scrape type 2
2026-03-30 08:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efb9e4e0-3076-56c9-a209-f06e6b24a6d9 with scrape type 2
2026-03-30 08:37:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: efb9e4e0-3076-56c9-a209-f06e6b24a6d9, identifier: BD95571
2026-03-30 08:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: efb9e4e0-3076-56c9-a209-f06e6b24a6d9 with identifier: BD95571
2026-03-30 08:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: efb9e4e0-3076-56c9-a209-f06e6b24a6d9 with identifier: BD95571
2026-03-30 08:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: efb9e4e0-3076-56c9-a209-f06e6b24a6d9 with identifier: BD95571 to the API
2026-03-30 08:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:13:22Z',
'fuel_type': 'petrol',
'id': 'efb9e4e0-3076-56c9-a209-f06e6b24a6d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD95571',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 35981,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-27',
'seller_name': None,
'title': 'Volkswagen Tiguan 1.5 TSI ACT R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2023}
2026-03-30 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BD95571%27 HTTP/1.1" 200 None
2026-03-30 08:37:21 [auto1.be] INFO: Saving data for BD95571: {'auction_closing_time': 1774883602.0, 'created_time': 1773136854.979983, 'last_price_update_time': 1774859841.891259}
2026-03-30 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BD95571') HTTP/1.1" 204 0
2026-03-30 08:37:21 [auto1.be] INFO: Channel: 24h | Page: 11 | totalHits: 1502 | hits on page: 40
2026-03-30 08:37:21 [auto1.be] INFO: Found listing with ID: TC19196
2026-03-30 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC19196%27 HTTP/1.1" 200 None
2026-03-30 08:37:21 [auto1.be] INFO: Scrape type for TC19196: 2
2026-03-30 08:37:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77902958-9672-5cc1-9fff-811befb56fcc with identifier: TC19196
2026-03-30 08:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77902958-9672-5cc1-9fff-811befb56fcc with scrape type 2
2026-03-30 08:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77902958-9672-5cc1-9fff-811befb56fcc with scrape type 2
2026-03-30 08:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 77902958-9672-5cc1-9fff-811befb56fcc, identifier: TC19196
2026-03-30 08:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 77902958-9672-5cc1-9fff-811befb56fcc with identifier: TC19196
2026-03-30 08:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 77902958-9672-5cc1-9fff-811befb56fcc with identifier: TC19196
2026-03-30 08:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 77902958-9672-5cc1-9fff-811befb56fcc with identifier: TC19196 to the API
2026-03-30 08:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 300,
'expiration_date': '2026-03-30T15:48:31Z',
'fuel_type': 'diesel',
'id': '77902958-9672-5cc1-9fff-811befb56fcc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC19196',
'listing': 'auction',
'make': 'Jaguar',
'model': 'XJ',
'odometer': 174112,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-10',
'seller_name': None,
'title': 'Jaguar XJ 3.0 D V6 Portfolio',
'transmission': 'automatic',
'trim': 'Portfolio',
'year': 2021}
2026-03-30 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC19196%27 HTTP/1.1" 200 None
2026-03-30 08:37:22 [auto1.be] INFO: Saving data for TC19196: {'auction_closing_time': 1774885711.0, 'created_time': 1774643870.70738, 'last_price_update_time': 1774859842.292576}
2026-03-30 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TC19196') HTTP/1.1" 204 0
2026-03-30 08:37:22 [auto1.be] INFO: Found listing with ID: EK47235
2026-03-30 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK47235%27 HTTP/1.1" 200 None
2026-03-30 08:37:22 [auto1.be] INFO: Scrape type for EK47235: 2
2026-03-30 08:37:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98fc0584-d070-5dd9-9091-9d493915b03e with identifier: EK47235
2026-03-30 08:37:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98fc0584-d070-5dd9-9091-9d493915b03e with scrape type 2
2026-03-30 08:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98fc0584-d070-5dd9-9091-9d493915b03e with scrape type 2
2026-03-30 08:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 98fc0584-d070-5dd9-9091-9d493915b03e, identifier: EK47235
2026-03-30 08:37:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:37:22 [auto1.be] INFO: Found listing with ID: EA40127
2026-03-30 08:37:22 [auto1.be] INFO: Found listing with ID: DF78239
2026-03-30 08:37:22 [auto1.be] INFO: Found listing with ID: CM14446
2026-03-30 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM14446%27 HTTP/1.1" 200 None
2026-03-30 08:37:22 [auto1.be] INFO: Scrape type for CM14446: 2
2026-03-30 08:37:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9b760a7-a7ff-59ea-ab7b-53438ef994b1 with identifier: CM14446
2026-03-30 08:37:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9b760a7-a7ff-59ea-ab7b-53438ef994b1 with scrape type 2
2026-03-30 08:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9b760a7-a7ff-59ea-ab7b-53438ef994b1 with scrape type 2
2026-03-30 08:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e9b760a7-a7ff-59ea-ab7b-53438ef994b1, identifier: CM14446
2026-03-30 08:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 98fc0584-d070-5dd9-9091-9d493915b03e with identifier: EK47235
2026-03-30 08:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 98fc0584-d070-5dd9-9091-9d493915b03e with identifier: EK47235
2026-03-30 08:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 98fc0584-d070-5dd9-9091-9d493915b03e with identifier: EK47235 to the API
2026-03-30 08:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:12:29Z',
'fuel_type': 'diesel',
'id': '98fc0584-d070-5dd9-9091-9d493915b03e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK47235',
'listing': 'auction',
'make': 'Renault',
'model': 'Captur',
'odometer': 94999,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-20',
'seller_name': None,
'title': 'Renault Captur 1.5 dCi Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2015}
2026-03-30 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK47235%27 HTTP/1.1" 200 None
2026-03-30 08:37:22 [auto1.be] INFO: Saving data for EK47235: {'auction_closing_time': 1774883549.0, 'created_time': 1774773361.694434, 'last_price_update_time': 1774859842.834804}
2026-03-30 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EK47235') HTTP/1.1" 204 0
2026-03-30 08:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e9b760a7-a7ff-59ea-ab7b-53438ef994b1 with identifier: CM14446
2026-03-30 08:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e9b760a7-a7ff-59ea-ab7b-53438ef994b1 with identifier: CM14446
2026-03-30 08:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e9b760a7-a7ff-59ea-ab7b-53438ef994b1 with identifier: CM14446 to the API
2026-03-30 08:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:36:39Z',
'fuel_type': 'diesel',
'id': 'e9b760a7-a7ff-59ea-ab7b-53438ef994b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM14446',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 278852,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-15',
'seller_name': None,
'title': 'Skoda Superb 2.0 TDI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2017}
2026-03-30 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM14446%27 HTTP/1.1" 200 None
2026-03-30 08:37:23 [auto1.be] INFO: Saving data for CM14446: {'auction_closing_time': 1774884999.0, 'created_time': 1774773361.37178, 'last_price_update_time': 1774859843.205605}
2026-03-30 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CM14446') HTTP/1.1" 204 0
2026-03-30 08:37:23 [auto1.be] INFO: Found listing with ID: SJ26894
2026-03-30 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ26894%27 HTTP/1.1" 200 None
2026-03-30 08:37:23 [auto1.be] INFO: Scrape type for SJ26894: 2
2026-03-30 08:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9292186-a00f-57a4-bfcf-5aeb81d47889 with identifier: SJ26894
2026-03-30 08:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9292186-a00f-57a4-bfcf-5aeb81d47889 with scrape type 2
2026-03-30 08:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9292186-a00f-57a4-bfcf-5aeb81d47889 with scrape type 2
2026-03-30 08:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a9292186-a00f-57a4-bfcf-5aeb81d47889, identifier: SJ26894
2026-03-30 08:37:23 [auto1.be] INFO: Found listing with ID: VE29498
2026-03-30 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE29498%27 HTTP/1.1" 200 None
2026-03-30 08:37:23 [auto1.be] INFO: Scrape type for VE29498: 2
2026-03-30 08:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4424a2c-0a18-5ba4-a76e-7e49c49c31fb with identifier: VE29498
2026-03-30 08:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4424a2c-0a18-5ba4-a76e-7e49c49c31fb with scrape type 2
2026-03-30 08:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4424a2c-0a18-5ba4-a76e-7e49c49c31fb with scrape type 2
2026-03-30 08:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c4424a2c-0a18-5ba4-a76e-7e49c49c31fb, identifier: VE29498
2026-03-30 08:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a9292186-a00f-57a4-bfcf-5aeb81d47889 with identifier: SJ26894
2026-03-30 08:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a9292186-a00f-57a4-bfcf-5aeb81d47889 with identifier: SJ26894
2026-03-30 08:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a9292186-a00f-57a4-bfcf-5aeb81d47889 with identifier: SJ26894 to the API
2026-03-30 08:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 92,
'expiration_date': '2026-03-30T15:36:37Z',
'fuel_type': 'diesel',
'id': 'a9292186-a00f-57a4-bfcf-5aeb81d47889',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ26894',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 119376,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-30',
'seller_name': None,
'title': 'Peugeot 208 1.6 HDi Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2014}
2026-03-30 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ26894%27 HTTP/1.1" 200 None
2026-03-30 08:37:23 [auto1.be] INFO: Saving data for SJ26894: {'auction_closing_time': 1774884997.0, 'created_time': 1774773379.111647, 'last_price_update_time': 1774859843.717317}
2026-03-30 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SJ26894') HTTP/1.1" 204 0
2026-03-30 08:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c4424a2c-0a18-5ba4-a76e-7e49c49c31fb with identifier: VE29498
2026-03-30 08:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c4424a2c-0a18-5ba4-a76e-7e49c49c31fb with identifier: VE29498
2026-03-30 08:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c4424a2c-0a18-5ba4-a76e-7e49c49c31fb with identifier: VE29498 to the API
2026-03-30 08:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:08:54Z',
'fuel_type': 'petrol',
'id': 'c4424a2c-0a18-5ba4-a76e-7e49c49c31fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE29498',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 113299,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-12-22',
'seller_name': None,
'title': 'Peugeot 207 1.4 VTi Tendance',
'transmission': 'manual',
'trim': 'Tendance',
'year': 2011}
2026-03-30 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE29498%27 HTTP/1.1" 200 None
2026-03-30 08:37:23 [auto1.be] INFO: Saving data for VE29498: {'auction_closing_time': 1774883334.0, 'created_time': 1773136218.190234, 'last_price_update_time': 1774859843.989756}
2026-03-30 08:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VE29498') HTTP/1.1" 204 0
2026-03-30 08:37:24 [auto1.be] INFO: Found listing with ID: VP06293
2026-03-30 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP06293%27 HTTP/1.1" 200 None
2026-03-30 08:37:24 [auto1.be] INFO: Scrape type for VP06293: 2
2026-03-30 08:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b21a6d9-a757-5b64-ba63-7c51e8ff72c0 with identifier: VP06293
2026-03-30 08:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b21a6d9-a757-5b64-ba63-7c51e8ff72c0 with scrape type 2
2026-03-30 08:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b21a6d9-a757-5b64-ba63-7c51e8ff72c0 with scrape type 2
2026-03-30 08:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8b21a6d9-a757-5b64-ba63-7c51e8ff72c0, identifier: VP06293
2026-03-30 08:37:24 [auto1.be] INFO: Found listing with ID: BE62996
2026-03-30 08:37:24 [auto1.be] INFO: Found listing with ID: AM49333
2026-03-30 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM49333%27 HTTP/1.1" 200 None
2026-03-30 08:37:24 [auto1.be] INFO: Scrape type for AM49333: 2
2026-03-30 08:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4da4b34-3834-5f77-853a-501355717ab8 with identifier: AM49333
2026-03-30 08:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4da4b34-3834-5f77-853a-501355717ab8 with scrape type 2
2026-03-30 08:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4da4b34-3834-5f77-853a-501355717ab8 with scrape type 2
2026-03-30 08:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b4da4b34-3834-5f77-853a-501355717ab8, identifier: AM49333
2026-03-30 08:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8b21a6d9-a757-5b64-ba63-7c51e8ff72c0 with identifier: VP06293
2026-03-30 08:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8b21a6d9-a757-5b64-ba63-7c51e8ff72c0 with identifier: VP06293
2026-03-30 08:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8b21a6d9-a757-5b64-ba63-7c51e8ff72c0 with identifier: VP06293 to the API
2026-03-30 08:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:57:04Z',
'fuel_type': 'diesel',
'id': '8b21a6d9-a757-5b64-ba63-7c51e8ff72c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP06293',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 352678,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-15',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 CDI T BlueEfficiency Avantgarde',
'transmission': 'automatic',
'trim': 'T BlueEfficiency Avantgarde',
'year': 2013}
2026-03-30 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP06293%27 HTTP/1.1" 200 None
2026-03-30 08:37:24 [auto1.be] INFO: Saving data for VP06293: {'auction_closing_time': 1774886224.0, 'created_time': 1774773367.054977, 'last_price_update_time': 1774859844.517778}
2026-03-30 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VP06293') HTTP/1.1" 204 0
2026-03-30 08:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b4da4b34-3834-5f77-853a-501355717ab8 with identifier: AM49333
2026-03-30 08:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b4da4b34-3834-5f77-853a-501355717ab8 with identifier: AM49333
2026-03-30 08:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b4da4b34-3834-5f77-853a-501355717ab8 with identifier: AM49333 to the API
2026-03-30 08:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:46:26Z',
'fuel_type': 'diesel',
'id': 'b4da4b34-3834-5f77-853a-501355717ab8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM49333',
'listing': 'auction',
'make': 'Skoda',
'model': 'Superb',
'odometer': 231615,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-20',
'seller_name': None,
'title': 'Skoda Superb 1.6 TDI Ambition',
'transmission': 'manual',
'trim': 'Ambition',
'year': 2017}
2026-03-30 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AM49333%27 HTTP/1.1" 200 None
2026-03-30 08:37:24 [auto1.be] INFO: Saving data for AM49333: {'auction_closing_time': 1774885586.0, 'created_time': 1773384049.774807, 'last_price_update_time': 1774859844.965011}
2026-03-30 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='AM49333') HTTP/1.1" 204 0
2026-03-30 08:37:24 [auto1.be] INFO: Found listing with ID: CC34063
2026-03-30 08:37:24 [auto1.be] INFO: Found listing with ID: LD32822
2026-03-30 08:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LD32822%27 HTTP/1.1" 200 None
2026-03-30 08:37:25 [auto1.be] INFO: Scrape type for LD32822: 2
2026-03-30 08:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8266e880-6d4b-514d-ad90-cc5d371771a3 with identifier: LD32822
2026-03-30 08:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8266e880-6d4b-514d-ad90-cc5d371771a3 with scrape type 2
2026-03-30 08:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8266e880-6d4b-514d-ad90-cc5d371771a3 with scrape type 2
2026-03-30 08:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8266e880-6d4b-514d-ad90-cc5d371771a3, identifier: LD32822
2026-03-30 08:37:25 [auto1.be] INFO: Found listing with ID: EL91929
2026-03-30 08:37:25 [auto1.be] INFO: Found listing with ID: FC05247
2026-03-30 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC05247%27 HTTP/1.1" 200 None
2026-03-30 08:37:25 [auto1.be] INFO: Scrape type for FC05247: 2
2026-03-30 08:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1701abc-dc4b-55f3-bb73-db53af5c457c with identifier: FC05247
2026-03-30 08:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1701abc-dc4b-55f3-bb73-db53af5c457c with scrape type 2
2026-03-30 08:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1701abc-dc4b-55f3-bb73-db53af5c457c with scrape type 2
2026-03-30 08:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d1701abc-dc4b-55f3-bb73-db53af5c457c, identifier: FC05247
2026-03-30 08:37:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8266e880-6d4b-514d-ad90-cc5d371771a3 with identifier: LD32822
2026-03-30 08:37:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8266e880-6d4b-514d-ad90-cc5d371771a3 with identifier: LD32822
2026-03-30 08:37:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8266e880-6d4b-514d-ad90-cc5d371771a3 with identifier: LD32822 to the API
2026-03-30 08:37:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 179,
'expiration_date': '2026-03-30T15:33:20Z',
'fuel_type': 'diesel',
'id': '8266e880-6d4b-514d-ad90-cc5d371771a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD32822',
'listing': 'auction',
'make': 'Peugeot',
'model': 'Expert',
'odometer': 131722,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-08-10',
'seller_name': None,
'title': 'Peugeot Expert 2.0 Blue-HDi Premium TwinCab Edition L3',
'transmission': 'automatic',
'trim': 'Premium TwinCab Edition L3',
'year': 2021}
2026-03-30 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LD32822%27 HTTP/1.1" 200 None
2026-03-30 08:37:25 [auto1.be] INFO: Saving data for LD32822: {'auction_closing_time': 1774884800.0, 'created_time': 1773384630.488052, 'last_price_update_time': 1774859845.497955}
2026-03-30 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LD32822') HTTP/1.1" 204 0
2026-03-30 08:37:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d1701abc-dc4b-55f3-bb73-db53af5c457c with identifier: FC05247
2026-03-30 08:37:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d1701abc-dc4b-55f3-bb73-db53af5c457c with identifier: FC05247
2026-03-30 08:37:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d1701abc-dc4b-55f3-bb73-db53af5c457c with identifier: FC05247 to the API
2026-03-30 08:37:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:03:26Z',
'fuel_type': 'petrol',
'id': 'd1701abc-dc4b-55f3-bb73-db53af5c457c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC05247',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Tiguan Allspace',
'odometer': 94550,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-03-16',
'seller_name': None,
'title': 'Volkswagen Tiguan Allspace 2.0 TSI Highline 4Motion',
'transmission': 'automatic',
'trim': 'Highline 4Motion',
'year': 2020}
2026-03-30 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC05247%27 HTTP/1.1" 200 None
2026-03-30 08:37:25 [auto1.be] INFO: Saving data for FC05247: {'auction_closing_time': 1774883006.0, 'created_time': 1774773387.893056, 'last_price_update_time': 1774859845.790928}
2026-03-30 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FC05247') HTTP/1.1" 204 0
2026-03-30 08:37:25 [auto1.be] INFO: Found listing with ID: DH17925
2026-03-30 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH17925%27 HTTP/1.1" 200 None
2026-03-30 08:37:25 [auto1.be] INFO: Scrape type for DH17925: 2
2026-03-30 08:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d5aacbd-4ddd-551b-8988-a55e75dda84b with identifier: DH17925
2026-03-30 08:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d5aacbd-4ddd-551b-8988-a55e75dda84b with scrape type 2
2026-03-30 08:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d5aacbd-4ddd-551b-8988-a55e75dda84b with scrape type 2
2026-03-30 08:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8d5aacbd-4ddd-551b-8988-a55e75dda84b, identifier: DH17925
2026-03-30 08:37:25 [auto1.be] INFO: Found listing with ID: NC38410
2026-03-30 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC38410%27 HTTP/1.1" 200 None
2026-03-30 08:37:25 [auto1.be] INFO: Scrape type for NC38410: 2
2026-03-30 08:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f712844a-dcff-5ddb-aa90-705b45ea9a54 with identifier: NC38410
2026-03-30 08:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f712844a-dcff-5ddb-aa90-705b45ea9a54 with scrape type 2
2026-03-30 08:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f712844a-dcff-5ddb-aa90-705b45ea9a54 with scrape type 2
2026-03-30 08:37:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f712844a-dcff-5ddb-aa90-705b45ea9a54, identifier: NC38410
2026-03-30 08:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8d5aacbd-4ddd-551b-8988-a55e75dda84b with identifier: DH17925
2026-03-30 08:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8d5aacbd-4ddd-551b-8988-a55e75dda84b with identifier: DH17925
2026-03-30 08:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8d5aacbd-4ddd-551b-8988-a55e75dda84b with identifier: DH17925 to the API
2026-03-30 08:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:39:06Z',
'fuel_type': 'petrol',
'id': '8d5aacbd-4ddd-551b-8988-a55e75dda84b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH17925',
'listing': 'auction',
'make': 'Fiat',
'model': '500',
'odometer': 15030,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-28',
'seller_name': None,
'title': 'Fiat 500 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2018}
2026-03-30 08:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH17925%27 HTTP/1.1" 200 None
2026-03-30 08:37:26 [auto1.be] INFO: Saving data for DH17925: {'auction_closing_time': 1774885146.0, 'created_time': 1773131983.706885, 'last_price_update_time': 1774859846.322758}
2026-03-30 08:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DH17925') HTTP/1.1" 204 0
2026-03-30 08:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f712844a-dcff-5ddb-aa90-705b45ea9a54 with identifier: NC38410
2026-03-30 08:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f712844a-dcff-5ddb-aa90-705b45ea9a54 with identifier: NC38410
2026-03-30 08:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f712844a-dcff-5ddb-aa90-705b45ea9a54 with identifier: NC38410 to the API
2026-03-30 08:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:16:15Z',
'fuel_type': 'diesel',
'id': 'f712844a-dcff-5ddb-aa90-705b45ea9a54',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC38410',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 259231,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-07-04',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 CDI Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2002}
2026-03-30 08:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC38410%27 HTTP/1.1" 200 None
2026-03-30 08:37:26 [auto1.be] INFO: Saving data for NC38410: {'auction_closing_time': 1774883775.0, 'created_time': 1774773367.584151, 'last_price_update_time': 1774859846.862368}
2026-03-30 08:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NC38410') HTTP/1.1" 204 0
2026-03-30 08:37:26 [auto1.be] INFO: Found listing with ID: UX89863
2026-03-30 08:37:26 [auto1.be] INFO: Found listing with ID: UX80051
2026-03-30 08:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX80051%27 HTTP/1.1" 200 None
2026-03-30 08:37:26 [auto1.be] INFO: Scrape type for UX80051: 2
2026-03-30 08:37:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6947e2e-d104-5494-92f0-6325a4a0ae6e with identifier: UX80051
2026-03-30 08:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6947e2e-d104-5494-92f0-6325a4a0ae6e with scrape type 2
2026-03-30 08:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6947e2e-d104-5494-92f0-6325a4a0ae6e with scrape type 2
2026-03-30 08:37:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f6947e2e-d104-5494-92f0-6325a4a0ae6e, identifier: UX80051
2026-03-30 08:37:26 [auto1.be] INFO: Found listing with ID: LE91648
2026-03-30 08:37:26 [auto1.be] INFO: Found listing with ID: ZZ00486
2026-03-30 08:37:26 [auto1.be] INFO: Found listing with ID: TX69988
2026-03-30 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX69988%27 HTTP/1.1" 200 None
2026-03-30 08:37:27 [auto1.be] INFO: Scrape type for TX69988: 2
2026-03-30 08:37:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c38fb94f-553b-5f9b-a384-07a2ce35879f with identifier: TX69988
2026-03-30 08:37:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c38fb94f-553b-5f9b-a384-07a2ce35879f with scrape type 2
2026-03-30 08:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c38fb94f-553b-5f9b-a384-07a2ce35879f with scrape type 2
2026-03-30 08:37:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c38fb94f-553b-5f9b-a384-07a2ce35879f, identifier: TX69988
2026-03-30 08:37:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f6947e2e-d104-5494-92f0-6325a4a0ae6e with identifier: UX80051
2026-03-30 08:37:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f6947e2e-d104-5494-92f0-6325a4a0ae6e with identifier: UX80051
2026-03-30 08:37:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f6947e2e-d104-5494-92f0-6325a4a0ae6e with identifier: UX80051 to the API
2026-03-30 08:37:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:32:03Z',
'fuel_type': 'diesel',
'id': 'f6947e2e-d104-5494-92f0-6325a4a0ae6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX80051',
'listing': 'auction',
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 133158,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-28',
'seller_name': None,
'title': 'Nissan Qashqai 1.5 Turbodiesel 360',
'transmission': 'manual',
'trim': '360',
'year': 2017}
2026-03-30 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UX80051%27 HTTP/1.1" 200 None
2026-03-30 08:37:27 [auto1.be] INFO: Saving data for UX80051: {'auction_closing_time': 1774884723.0, 'created_time': 1773137443.089192, 'last_price_update_time': 1774859847.399303}
2026-03-30 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UX80051') HTTP/1.1" 204 0
2026-03-30 08:37:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c38fb94f-553b-5f9b-a384-07a2ce35879f with identifier: TX69988
2026-03-30 08:37:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c38fb94f-553b-5f9b-a384-07a2ce35879f with identifier: TX69988
2026-03-30 08:37:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c38fb94f-553b-5f9b-a384-07a2ce35879f with identifier: TX69988 to the API
2026-03-30 08:37:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:20:30Z',
'fuel_type': 'diesel',
'id': 'c38fb94f-553b-5f9b-a384-07a2ce35879f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX69988',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 197330,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-09-24',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 CDI BlueEfficiency Avantgarde',
'transmission': 'manual',
'trim': 'BlueEfficiency Avantgarde',
'year': 2013}
2026-03-30 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX69988%27 HTTP/1.1" 200 None
2026-03-30 08:37:27 [auto1.be] INFO: Saving data for TX69988: {'auction_closing_time': 1774884030.0, 'created_time': 1774773366.410223, 'last_price_update_time': 1774859847.780373}
2026-03-30 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TX69988') HTTP/1.1" 204 0
2026-03-30 08:37:27 [auto1.be] INFO: Found listing with ID: MG99487
2026-03-30 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG99487%27 HTTP/1.1" 200 None
2026-03-30 08:37:27 [auto1.be] INFO: Scrape type for MG99487: 2
2026-03-30 08:37:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dce4a6ec-3b7f-52a1-acc4-59a620260b77 with identifier: MG99487
2026-03-30 08:37:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dce4a6ec-3b7f-52a1-acc4-59a620260b77 with scrape type 2
2026-03-30 08:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dce4a6ec-3b7f-52a1-acc4-59a620260b77 with scrape type 2
2026-03-30 08:37:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dce4a6ec-3b7f-52a1-acc4-59a620260b77, identifier: MG99487
2026-03-30 08:37:27 [auto1.be] INFO: Found listing with ID: HK94342
2026-03-30 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK94342%27 HTTP/1.1" 200 None
2026-03-30 08:37:27 [auto1.be] INFO: Scrape type for HK94342: 2
2026-03-30 08:37:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8a1a118-5725-5b08-b241-db1b099168ec with identifier: HK94342
2026-03-30 08:37:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8a1a118-5725-5b08-b241-db1b099168ec with scrape type 2
2026-03-30 08:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8a1a118-5725-5b08-b241-db1b099168ec with scrape type 2
2026-03-30 08:37:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: a8a1a118-5725-5b08-b241-db1b099168ec, identifier: HK94342
2026-03-30 08:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dce4a6ec-3b7f-52a1-acc4-59a620260b77 with identifier: MG99487
2026-03-30 08:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dce4a6ec-3b7f-52a1-acc4-59a620260b77 with identifier: MG99487
2026-03-30 08:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dce4a6ec-3b7f-52a1-acc4-59a620260b77 with identifier: MG99487 to the API
2026-03-30 08:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 88,
'expiration_date': '2026-03-30T15:43:10Z',
'fuel_type': 'petrol',
'id': 'dce4a6ec-3b7f-52a1-acc4-59a620260b77',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG99487',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4',
'odometer': 111028,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-03-05',
'seller_name': None,
'title': 'Citroen C4 1.4 Advance',
'transmission': 'manual',
'trim': 'Advance',
'year': 2009}
2026-03-30 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG99487%27 HTTP/1.1" 200 None
2026-03-30 08:37:28 [auto1.be] INFO: Saving data for MG99487: {'auction_closing_time': 1774885390.0, 'created_time': 1774773366.733442, 'last_price_update_time': 1774859848.287065}
2026-03-30 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='MG99487') HTTP/1.1" 204 0
2026-03-30 08:37:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: a8a1a118-5725-5b08-b241-db1b099168ec with identifier: HK94342
2026-03-30 08:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: a8a1a118-5725-5b08-b241-db1b099168ec with identifier: HK94342
2026-03-30 08:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: a8a1a118-5725-5b08-b241-db1b099168ec with identifier: HK94342 to the API
2026-03-30 08:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 101,
'expiration_date': '2026-03-30T15:41:29Z',
'fuel_type': 'petrol',
'id': 'a8a1a118-5725-5b08-b241-db1b099168ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK94342',
'listing': 'auction',
'make': 'Fiat',
'model': 'Tipo',
'odometer': 138533,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-20',
'seller_name': None,
'title': 'Fiat Tipo 1.0 City Cross',
'transmission': 'manual',
'trim': 'City Cross',
'year': 2021}
2026-03-30 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK94342%27 HTTP/1.1" 200 None
2026-03-30 08:37:28 [auto1.be] INFO: Saving data for HK94342: {'auction_closing_time': 1774885289.0, 'created_time': 1773238214.548595, 'last_price_update_time': 1774859848.571}
2026-03-30 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HK94342') HTTP/1.1" 204 0
2026-03-30 08:37:28 [auto1.be] INFO: Found listing with ID: AJ87899
2026-03-30 08:37:28 [auto1.be] INFO: Found listing with ID: RL01911
2026-03-30 08:37:28 [auto1.be] INFO: Found listing with ID: FG10633
2026-03-30 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG10633%27 HTTP/1.1" 200 None
2026-03-30 08:37:28 [auto1.be] INFO: Scrape type for FG10633: 2
2026-03-30 08:37:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7f2a8a4-f020-5a4f-ab88-eabb5ddda350 with identifier: FG10633
2026-03-30 08:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7f2a8a4-f020-5a4f-ab88-eabb5ddda350 with scrape type 2
2026-03-30 08:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7f2a8a4-f020-5a4f-ab88-eabb5ddda350 with scrape type 2
2026-03-30 08:37:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c7f2a8a4-f020-5a4f-ab88-eabb5ddda350, identifier: FG10633
2026-03-30 08:37:28 [auto1.be] INFO: Found listing with ID: YK14398
2026-03-30 08:37:28 [auto1.be] INFO: Found listing with ID: FC68971
2026-03-30 08:37:28 [auto1.be] INFO: Found listing with ID: SL05027
2026-03-30 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL05027%27 HTTP/1.1" 200 None
2026-03-30 08:37:28 [auto1.be] INFO: Scrape type for SL05027: 2
2026-03-30 08:37:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f173e45-09e9-5fc0-ab20-7b77c6d52c97 with identifier: SL05027
2026-03-30 08:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f173e45-09e9-5fc0-ab20-7b77c6d52c97 with scrape type 2
2026-03-30 08:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f173e45-09e9-5fc0-ab20-7b77c6d52c97 with scrape type 2
2026-03-30 08:37:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4f173e45-09e9-5fc0-ab20-7b77c6d52c97, identifier: SL05027
2026-03-30 08:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c7f2a8a4-f020-5a4f-ab88-eabb5ddda350 with identifier: FG10633
2026-03-30 08:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c7f2a8a4-f020-5a4f-ab88-eabb5ddda350 with identifier: FG10633
2026-03-30 08:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c7f2a8a4-f020-5a4f-ab88-eabb5ddda350 with identifier: FG10633 to the API
2026-03-30 08:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 82,
'expiration_date': '2026-03-30T15:21:37Z',
'fuel_type': 'petrol',
'id': 'c7f2a8a4-f020-5a4f-ab88-eabb5ddda350',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG10633',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 72809,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-17',
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Signature',
'transmission': 'manual',
'trim': 'Signature',
'year': 2019}
2026-03-30 08:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG10633%27 HTTP/1.1" 200 None
2026-03-30 08:37:29 [auto1.be] INFO: Saving data for FG10633: {'auction_closing_time': 1774884097.0, 'created_time': 1774773369.246395, 'last_price_update_time': 1774859849.098883}
2026-03-30 08:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FG10633') HTTP/1.1" 204 0
2026-03-30 08:37:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4f173e45-09e9-5fc0-ab20-7b77c6d52c97 with identifier: SL05027
2026-03-30 08:37:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4f173e45-09e9-5fc0-ab20-7b77c6d52c97 with identifier: SL05027
2026-03-30 08:37:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4f173e45-09e9-5fc0-ab20-7b77c6d52c97 with identifier: SL05027 to the API
2026-03-30 08:37:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:58:01Z',
'fuel_type': 'petrol',
'id': '4f173e45-09e9-5fc0-ab20-7b77c6d52c97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL05027',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 44112,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-02-06',
'seller_name': None,
'title': 'Skoda Octavia 1.2 TSI Classic',
'transmission': 'manual',
'trim': 'Classic',
'year': 2011}
2026-03-30 08:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL05027%27 HTTP/1.1" 200 None
2026-03-30 08:37:29 [auto1.be] INFO: Saving data for SL05027: {'auction_closing_time': 1774886281.0, 'created_time': 1773132780.283558, 'last_price_update_time': 1774859849.395808}
2026-03-30 08:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SL05027') HTTP/1.1" 204 0
2026-03-30 08:37:29 [auto1.be] INFO: Found listing with ID: KE27400
2026-03-30 08:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE27400%27 HTTP/1.1" 200 None
2026-03-30 08:37:29 [auto1.be] INFO: Scrape type for KE27400: 2
2026-03-30 08:37:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e2e3e2c-7830-5294-a766-013450d4de2e with identifier: KE27400
2026-03-30 08:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e2e3e2c-7830-5294-a766-013450d4de2e with scrape type 2
2026-03-30 08:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e2e3e2c-7830-5294-a766-013450d4de2e with scrape type 2
2026-03-30 08:37:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5e2e3e2c-7830-5294-a766-013450d4de2e, identifier: KE27400
2026-03-30 08:37:29 [auto1.be] INFO: Found listing with ID: TE49371
2026-03-30 08:37:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5e2e3e2c-7830-5294-a766-013450d4de2e with identifier: KE27400
2026-03-30 08:37:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5e2e3e2c-7830-5294-a766-013450d4de2e with identifier: KE27400
2026-03-30 08:37:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5e2e3e2c-7830-5294-a766-013450d4de2e with identifier: KE27400 to the API
2026-03-30 08:37:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 285,
'expiration_date': '2026-03-30T15:54:52Z',
'fuel_type': 'diesel',
'id': '5e2e3e2c-7830-5294-a766-013450d4de2e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE27400',
'listing': 'auction',
'make': 'BMW',
'model': '6er',
'odometer': 245019,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-06-21',
'seller_name': None,
'title': 'BMW 6er 635d',
'transmission': 'automatic',
'trim': '',
'year': 2009}
2026-03-30 08:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE27400%27 HTTP/1.1" 200 None
2026-03-30 08:37:29 [auto1.be] INFO: Saving data for KE27400: {'auction_closing_time': 1774886092.0, 'created_time': 1773866404.606123, 'last_price_update_time': 1774859849.783593}
2026-03-30 08:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KE27400') HTTP/1.1" 204 0
2026-03-30 08:37:29 [auto1.be] INFO: Channel: 24h | Page: 12 | totalHits: 1502 | hits on page: 40
2026-03-30 08:37:29 [auto1.be] INFO: Found listing with ID: JV95971
2026-03-30 08:37:29 [auto1.be] INFO: Found listing with ID: LK25886
2026-03-30 08:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK25886%27 HTTP/1.1" 200 None
2026-03-30 08:37:29 [auto1.be] INFO: Scrape type for LK25886: 2
2026-03-30 08:37:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71e014ce-426b-58c5-ae20-9af7a54bf9b3 with identifier: LK25886
2026-03-30 08:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71e014ce-426b-58c5-ae20-9af7a54bf9b3 with scrape type 2
2026-03-30 08:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71e014ce-426b-58c5-ae20-9af7a54bf9b3 with scrape type 2
2026-03-30 08:37:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 71e014ce-426b-58c5-ae20-9af7a54bf9b3, identifier: LK25886
2026-03-30 08:37:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 71e014ce-426b-58c5-ae20-9af7a54bf9b3 with identifier: LK25886
2026-03-30 08:37:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 71e014ce-426b-58c5-ae20-9af7a54bf9b3 with identifier: LK25886
2026-03-30 08:37:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 71e014ce-426b-58c5-ae20-9af7a54bf9b3 with identifier: LK25886 to the API
2026-03-30 08:37:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 401,
'expiration_date': '2026-03-30T15:48:58Z',
'fuel_type': 'petrol',
'id': '71e014ce-426b-58c5-ae20-9af7a54bf9b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK25886',
'listing': 'auction',
'make': 'Dodge',
'model': 'Ram 1500',
'odometer': 183575,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-04-04',
'seller_name': None,
'title': 'Dodge Ram 1500 5.7 V8 4x4',
'transmission': 'automatic',
'trim': '4x4',
'year': 2017}
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK25886%27 HTTP/1.1" 200 None
2026-03-30 08:37:30 [auto1.be] INFO: Saving data for LK25886: {'auction_closing_time': 1774885738.0, 'created_time': 1774298167.967428, 'last_price_update_time': 1774859850.176252}
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LK25886') HTTP/1.1" 204 0
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: AK19302
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK19302%27 HTTP/1.1" 200 None
2026-03-30 08:37:30 [auto1.be] INFO: Scrape type for AK19302: 0
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: EZ00027
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: PD85961
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: NR82041
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR82041%27 HTTP/1.1" 200 None
2026-03-30 08:37:30 [auto1.be] INFO: Scrape type for NR82041: 0
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: HU84368
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU84368%27 HTTP/1.1" 200 None
2026-03-30 08:37:30 [auto1.be] INFO: Scrape type for HU84368: 0
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: CC85070
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC85070%27 HTTP/1.1" 200 None
2026-03-30 08:37:30 [auto1.be] INFO: Scrape type for CC85070: 0
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: EA25293
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: KE26750
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: SP00889
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP00889%27 HTTP/1.1" 200 None
2026-03-30 08:37:30 [auto1.be] INFO: Scrape type for SP00889: 2
2026-03-30 08:37:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40a4eaee-0660-5744-8f58-06aebbe7d68e with identifier: SP00889
2026-03-30 08:37:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40a4eaee-0660-5744-8f58-06aebbe7d68e with scrape type 2
2026-03-30 08:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40a4eaee-0660-5744-8f58-06aebbe7d68e with scrape type 2
2026-03-30 08:37:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 40a4eaee-0660-5744-8f58-06aebbe7d68e, identifier: SP00889
2026-03-30 08:37:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: SB67636
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: ZU13483
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU13483%27 HTTP/1.1" 200 None
2026-03-30 08:37:30 [auto1.be] INFO: Scrape type for ZU13483: 0
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: CE14127
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: KA88762
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: ML65590
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML65590%27 HTTP/1.1" 200 None
2026-03-30 08:37:30 [auto1.be] INFO: Scrape type for ML65590: 0
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: GG74067
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: HN37913
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: YU22338
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YU22338%27 HTTP/1.1" 200 None
2026-03-30 08:37:30 [auto1.be] INFO: Scrape type for YU22338: 0
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: SW98803
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW98803%27 HTTP/1.1" 200 None
2026-03-30 08:37:30 [auto1.be] INFO: Scrape type for SW98803: 0
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: LP50838
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP50838%27 HTTP/1.1" 200 None
2026-03-30 08:37:30 [auto1.be] INFO: Scrape type for LP50838: 0
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: NH43704
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: MW29844
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW29844%27 HTTP/1.1" 200 None
2026-03-30 08:37:30 [auto1.be] INFO: Scrape type for MW29844: 0
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: FH45476
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FH45476%27 HTTP/1.1" 200 None
2026-03-30 08:37:30 [auto1.be] INFO: Scrape type for FH45476: 0
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: NP55006
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP55006%27 HTTP/1.1" 200 None
2026-03-30 08:37:30 [auto1.be] INFO: Scrape type for NP55006: 0
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: XM15621
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: DP40243
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP40243%27 HTTP/1.1" 200 None
2026-03-30 08:37:30 [auto1.be] INFO: Scrape type for DP40243: 0
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: BR63185
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR63185%27 HTTP/1.1" 200 None
2026-03-30 08:37:30 [auto1.be] INFO: Scrape type for BR63185: 0
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: FM14350
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: WL66260
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: FY63763
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: CD50133
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: SZ16034
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: FP25504
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: BX88810
2026-03-30 08:37:30 [auto1.be] INFO: Found listing with ID: EJ45470
2026-03-30 08:37:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 40a4eaee-0660-5744-8f58-06aebbe7d68e with identifier: SP00889
2026-03-30 08:37:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 40a4eaee-0660-5744-8f58-06aebbe7d68e with identifier: SP00889
2026-03-30 08:37:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 40a4eaee-0660-5744-8f58-06aebbe7d68e with identifier: SP00889 to the API
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:59:29Z',
'fuel_type': 'diesel',
'id': '40a4eaee-0660-5744-8f58-06aebbe7d68e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP00889',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 145219,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-17',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 180 CDI Urban',
'transmission': 'automatic',
'trim': 'Urban',
'year': 2018}
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SP00889%27 HTTP/1.1" 200 None
2026-03-30 08:37:30 [auto1.be] INFO: Saving data for SP00889: {'auction_closing_time': 1774886369.0, 'created_time': 1774557543.095385, 'last_price_update_time': 1774859850.97118}
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SP00889') HTTP/1.1" 204 0
2026-03-30 08:37:31 [auto1.be] INFO: Found listing with ID: XU03064
2026-03-30 08:37:31 [auto1.be] INFO: Found listing with ID: SR49598
2026-03-30 08:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR49598%27 HTTP/1.1" 200 None
2026-03-30 08:37:31 [auto1.be] INFO: Scrape type for SR49598: 0
2026-03-30 08:37:31 [auto1.be] INFO: Found listing with ID: NN99297
2026-03-30 08:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN99297%27 HTTP/1.1" 200 None
2026-03-30 08:37:31 [auto1.be] INFO: Scrape type for NN99297: 2
2026-03-30 08:37:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bd6770b-a75a-5710-a004-ebad33427a3e with identifier: NN99297
2026-03-30 08:37:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bd6770b-a75a-5710-a004-ebad33427a3e with scrape type 2
2026-03-30 08:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bd6770b-a75a-5710-a004-ebad33427a3e with scrape type 2
2026-03-30 08:37:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9bd6770b-a75a-5710-a004-ebad33427a3e, identifier: NN99297
2026-03-30 08:37:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9bd6770b-a75a-5710-a004-ebad33427a3e with identifier: NN99297
2026-03-30 08:37:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9bd6770b-a75a-5710-a004-ebad33427a3e with identifier: NN99297
2026-03-30 08:37:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9bd6770b-a75a-5710-a004-ebad33427a3e with identifier: NN99297 to the API
2026-03-30 08:37:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:51:47Z',
'fuel_type': 'petrol',
'id': '9bd6770b-a75a-5710-a004-ebad33427a3e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN99297',
'listing': 'auction',
'make': 'Hyundai',
'model': 'i20',
'odometer': 41663,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-08',
'seller_name': None,
'title': 'Hyundai i20 1.2 Go',
'transmission': 'manual',
'trim': 'Go',
'year': 2015}
2026-03-30 08:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN99297%27 HTTP/1.1" 200 None
2026-03-30 08:37:31 [auto1.be] INFO: Saving data for NN99297: {'auction_closing_time': 1774885907.0, 'created_time': 1774557520.503704, 'last_price_update_time': 1774859851.977679}
2026-03-30 08:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='NN99297') HTTP/1.1" 204 0
2026-03-30 08:37:32 [auto1.be] INFO: Found listing with ID: UX94260
2026-03-30 08:37:32 [auto1.be] INFO: Found listing with ID: YW61664
2026-03-30 08:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW61664%27 HTTP/1.1" 200 None
2026-03-30 08:37:32 [auto1.be] INFO: Scrape type for YW61664: 0
2026-03-30 08:37:32 [auto1.be] INFO: Found listing with ID: JS18374
2026-03-30 08:37:32 [auto1.be] INFO: Found listing with ID: YW00445
2026-03-30 08:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW00445%27 HTTP/1.1" 200 None
2026-03-30 08:37:32 [auto1.be] INFO: Scrape type for YW00445: 2
2026-03-30 08:37:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee789807-2656-5a8d-ab6c-7ecd3f0a44cd with identifier: YW00445
2026-03-30 08:37:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee789807-2656-5a8d-ab6c-7ecd3f0a44cd with scrape type 2
2026-03-30 08:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee789807-2656-5a8d-ab6c-7ecd3f0a44cd with scrape type 2
2026-03-30 08:37:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ee789807-2656-5a8d-ab6c-7ecd3f0a44cd, identifier: YW00445
2026-03-30 08:37:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ee789807-2656-5a8d-ab6c-7ecd3f0a44cd with identifier: YW00445
2026-03-30 08:37:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ee789807-2656-5a8d-ab6c-7ecd3f0a44cd with identifier: YW00445
2026-03-30 08:37:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ee789807-2656-5a8d-ab6c-7ecd3f0a44cd with identifier: YW00445 to the API
2026-03-30 08:37:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 73,
'expiration_date': '2026-03-30T15:37:04Z',
'fuel_type': 'petrol',
'id': 'ee789807-2656-5a8d-ab6c-7ecd3f0a44cd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW00445',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 129627,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-08-29',
'seller_name': None,
'title': 'Renault Clio 1.2 Life',
'transmission': 'manual',
'trim': 'Life',
'year': 2017}
2026-03-30 08:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW00445%27 HTTP/1.1" 200 None
2026-03-30 08:37:32 [auto1.be] INFO: Saving data for YW00445: {'auction_closing_time': 1774885024.0, 'created_time': 1774557576.594724, 'last_price_update_time': 1774859852.374501}
2026-03-30 08:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YW00445') HTTP/1.1" 204 0
2026-03-30 08:37:32 [auto1.be] INFO: Found listing with ID: TX45109
2026-03-30 08:37:32 [auto1.be] INFO: Found listing with ID: JD01885
2026-03-30 08:37:32 [auto1.be] INFO: Found listing with ID: GK88228
2026-03-30 08:37:32 [auto1.be] INFO: Found listing with ID: XZ48466
2026-03-30 08:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XZ48466%27 HTTP/1.1" 200 None
2026-03-30 08:37:32 [auto1.be] INFO: Scrape type for XZ48466: 0
2026-03-30 08:37:32 [auto1.be] INFO: Found listing with ID: RP30975
2026-03-30 08:37:32 [auto1.be] INFO: Found listing with ID: DW61635
2026-03-30 08:37:32 [auto1.be] INFO: Found listing with ID: TV92859
2026-03-30 08:37:32 [auto1.be] INFO: Found listing with ID: XZ54371
2026-03-30 08:37:32 [auto1.be] INFO: Found listing with ID: BT09121
2026-03-30 08:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT09121%27 HTTP/1.1" 200 None
2026-03-30 08:37:32 [auto1.be] INFO: Scrape type for BT09121: 0
2026-03-30 08:37:32 [auto1.be] INFO: Found listing with ID: GT11330
2026-03-30 08:37:32 [auto1.be] INFO: Found listing with ID: CX99155
2026-03-30 08:37:32 [auto1.be] INFO: Found listing with ID: CX21788
2026-03-30 08:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX21788%27 HTTP/1.1" 200 None
2026-03-30 08:37:32 [auto1.be] INFO: Scrape type for CX21788: 2
2026-03-30 08:37:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 465c9300-8ddd-5bc8-8016-823cfd813a08 with identifier: CX21788
2026-03-30 08:37:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 465c9300-8ddd-5bc8-8016-823cfd813a08 with scrape type 2
2026-03-30 08:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 465c9300-8ddd-5bc8-8016-823cfd813a08 with scrape type 2
2026-03-30 08:37:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 465c9300-8ddd-5bc8-8016-823cfd813a08, identifier: CX21788
2026-03-30 08:37:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 465c9300-8ddd-5bc8-8016-823cfd813a08 with identifier: CX21788
2026-03-30 08:37:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 465c9300-8ddd-5bc8-8016-823cfd813a08 with identifier: CX21788
2026-03-30 08:37:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 465c9300-8ddd-5bc8-8016-823cfd813a08 with identifier: CX21788 to the API
2026-03-30 08:37:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:14:38Z',
'fuel_type': 'diesel',
'id': '465c9300-8ddd-5bc8-8016-823cfd813a08',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX21788',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 291166,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-05-10',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 CDI BlueEfficiency Elegance',
'transmission': 'manual',
'trim': 'BlueEfficiency Elegance',
'year': 2011}
2026-03-30 08:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX21788%27 HTTP/1.1" 200 None
2026-03-30 08:37:32 [auto1.be] INFO: Saving data for CX21788: {'auction_closing_time': 1774883678.0, 'created_time': 1774557583.177437, 'last_price_update_time': 1774859852.852201}
2026-03-30 08:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CX21788') HTTP/1.1" 204 0
2026-03-30 08:37:32 [auto1.be] INFO: Found listing with ID: WE70666
2026-03-30 08:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE70666%27 HTTP/1.1" 200 None
2026-03-30 08:37:32 [auto1.be] INFO: Scrape type for WE70666: 0
2026-03-30 08:37:32 [auto1.be] INFO: Found listing with ID: KX60472
2026-03-30 08:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KX60472%27 HTTP/1.1" 200 None
2026-03-30 08:37:32 [auto1.be] INFO: Scrape type for KX60472: 0
2026-03-30 08:37:32 [auto1.be] INFO: Found listing with ID: LZ48262
2026-03-30 08:37:32 [auto1.be] INFO: Found listing with ID: HS59761
2026-03-30 08:37:32 [auto1.be] INFO: Found listing with ID: ML85388
2026-03-30 08:37:32 [auto1.be] INFO: Found listing with ID: RM46702
2026-03-30 08:37:32 [auto1.be] INFO: Found listing with ID: AJ68637
2026-03-30 08:37:32 [auto1.be] INFO: Found listing with ID: CT30439
2026-03-30 08:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CT30439%27 HTTP/1.1" 200 None
2026-03-30 08:37:33 [auto1.be] INFO: Scrape type for CT30439: 0
2026-03-30 08:37:33 [auto1.be] INFO: Found listing with ID: HW95173
2026-03-30 08:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW95173%27 HTTP/1.1" 200 None
2026-03-30 08:37:33 [auto1.be] INFO: Scrape type for HW95173: 0
2026-03-30 08:37:33 [auto1.be] INFO: Found listing with ID: HY77866
2026-03-30 08:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY77866%27 HTTP/1.1" 200 None
2026-03-30 08:37:33 [auto1.be] INFO: Scrape type for HY77866: 0
2026-03-30 08:37:33 [auto1.be] INFO: Found listing with ID: SW90596
2026-03-30 08:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW90596%27 HTTP/1.1" 200 None
2026-03-30 08:37:33 [auto1.be] INFO: Scrape type for SW90596: 2
2026-03-30 08:37:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7bd75cc-3f75-5907-b9e9-ffdf9172b0c6 with identifier: SW90596
2026-03-30 08:37:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7bd75cc-3f75-5907-b9e9-ffdf9172b0c6 with scrape type 2
2026-03-30 08:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7bd75cc-3f75-5907-b9e9-ffdf9172b0c6 with scrape type 2
2026-03-30 08:37:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d7bd75cc-3f75-5907-b9e9-ffdf9172b0c6, identifier: SW90596
2026-03-30 08:37:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d7bd75cc-3f75-5907-b9e9-ffdf9172b0c6 with identifier: SW90596
2026-03-30 08:37:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d7bd75cc-3f75-5907-b9e9-ffdf9172b0c6 with identifier: SW90596
2026-03-30 08:37:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d7bd75cc-3f75-5907-b9e9-ffdf9172b0c6 with identifier: SW90596 to the API
2026-03-30 08:37:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:42:37Z',
'fuel_type': 'diesel',
'id': 'd7bd75cc-3f75-5907-b9e9-ffdf9172b0c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW90596',
'listing': 'auction',
'make': 'Infiniti',
'model': 'Q30',
'odometer': 221519,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-05-07',
'seller_name': None,
'title': 'Infiniti Q30 1.5 Diesel Premium',
'transmission': 'automatic',
'trim': 'Premium',
'year': 2018}
2026-03-30 08:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW90596%27 HTTP/1.1" 200 None
2026-03-30 08:37:33 [auto1.be] INFO: Saving data for SW90596: {'auction_closing_time': 1774885357.0, 'created_time': 1774557515.519916, 'last_price_update_time': 1774859853.469228}
2026-03-30 08:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SW90596') HTTP/1.1" 204 0
2026-03-30 08:37:33 [auto1.be] INFO: Found listing with ID: BD10300
2026-03-30 08:37:33 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (10485760) in request <GET https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_8149f62d164b251d029071cf0ce01d67.jpg>.
2026-03-30 08:37:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_8149f62d164b251d029071cf0ce01d67.jpg> (referer: https://www.auto1.com/)
2026-03-30 08:37:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-30 08:37:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 08:37:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-30 08:37:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-30 08:37:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-30 08:37:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 08:37:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7febd90ec250>
2026-03-30 08:37:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 08:37:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 08:37:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 08:37:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39971d1d-c827-5ed3-8836-2132277dbc44/39971d1d-c827-5ed3-8836-2132277dbc44_image_0.jpg HTTP/1.1" 201 0
2026-03-30 08:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.be',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbf%252Fa2bfd8f3786744ab7c444eaeaa62f88d%252Fpa%252FBC23498_8149f62d164b251d029071cf0ce01d67.jpg') HTTP/1.1" 204 0
2026-03-30 08:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_8149f62d164b251d029071cf0ce01d67.jpg saved to cache
2026-03-30 08:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 39971d1d-c827-5ed3-8836-2132277dbc44
2026-03-30 08:37:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 39971d1d-c827-5ed3-8836-2132277dbc44, skipping ID generation
2026-03-30 08:37:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39971d1d-c827-5ed3-8836-2132277dbc44 with scrape type 1
2026-03-30 08:37:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 39971d1d-c827-5ed3-8836-2132277dbc44 sending to next pipeline
2026-03-30 08:37:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 39971d1d-c827-5ed3-8836-2132277dbc44, identifier: BC23498
2026-03-30 08:37:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 39971d1d-c827-5ed3-8836-2132277dbc44 with identifier: BC23498
2026-03-30 08:37:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 39971d1d-c827-5ed3-8836-2132277dbc44 with identifier: BC23498
2026-03-30 08:37:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 39971d1d-c827-5ed3-8836-2132277dbc44 with identifier: BC23498 to the API
2026-03-30 08:37:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_8149f62d164b251d029071cf0ce01d67.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 4',
'engine': '1.1L',
'engine_horse_power': 75,
'expiration_date': '2026-03-31T15:30:10Z',
'fuel_type': 'petrol',
'id': '39971d1d-c827-5ed3-8836-2132277dbc44',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC23498',
'listing': 'auction',
'location': 'BE',
'make': 'Renault',
'model': 'Clio',
'odometer': 67605,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 40,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39971d1d-c827-5ed3-8836-2132277dbc44/39971d1d-c827-5ed3-8836-2132277dbc44_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 11963973,
'Height': 4032,
'OriginUrl': 'https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_8149f62d164b251d029071cf0ce01d67.jpg',
'Width': 3024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39971d1d-c827-5ed3-8836-2132277dbc44/39971d1d-c827-5ed3-8836-2132277dbc44_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77545,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_0f1edc4b10bdbb3ae9120c5a0e46b5d9.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39971d1d-c827-5ed3-8836-2132277dbc44/39971d1d-c827-5ed3-8836-2132277dbc44_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65246,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_d9c2f2507a0506904a3ebec7928b3797.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39971d1d-c827-5ed3-8836-2132277dbc44/39971d1d-c827-5ed3-8836-2132277dbc44_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68233,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_a82c578ec9e25713878e6290178a129a.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39971d1d-c827-5ed3-8836-2132277dbc44/39971d1d-c827-5ed3-8836-2132277dbc44_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64244,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_95464b33a8ba287f3bcfeaf98088c0d2.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39971d1d-c827-5ed3-8836-2132277dbc44/39971d1d-c827-5ed3-8836-2132277dbc44_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65517,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_17ce90e8275d88809b27bbb703ce602a.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39971d1d-c827-5ed3-8836-2132277dbc44/39971d1d-c827-5ed3-8836-2132277dbc44_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74110,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_364f88fc039370bf5369cf9572f807fa.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39971d1d-c827-5ed3-8836-2132277dbc44/39971d1d-c827-5ed3-8836-2132277dbc44_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50936,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_4eb70f7d37d90fea370d03145d881c52.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39971d1d-c827-5ed3-8836-2132277dbc44/39971d1d-c827-5ed3-8836-2132277dbc44_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58122,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_37fb8e98ecdbf6075367ad79d4477d5d.jpg',
'Width': 450},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39971d1d-c827-5ed3-8836-2132277dbc44/39971d1d-c827-5ed3-8836-2132277dbc44_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72695,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/bf/a2bfd8f3786744ab7c444eaeaa62f88d/pa/BC23498_23ad2ad59334999ef1d012029a6a21fb.jpg',
'Width': 800}],
'price': 0,
'price_includes_vat': True,
'registration_date': '2009-07-29',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Clio 1.2 Expression',
'transmission': 'manual',
'trim': 'Expression',
'year': 2009}
2026-03-30 08:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC23498%27 HTTP/1.1" 200 None
2026-03-30 08:37:35 [auto1.be] INFO: Saving data for BC23498: {'created_time': 1774859855.043859, 'last_price_update_time': 1774859855.043869, 'auction_closing_time': 1774971010.0}
2026-03-30 08:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BC23498') HTTP/1.1" 204 0
2026-03-30 08:37:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:37:37 [auto1.be] INFO: Channel: 24h | Page: 13 | totalHits: 1502 | hits on page: 40
2026-03-30 08:37:37 [auto1.be] INFO: Found listing with ID: JW86952
2026-03-30 08:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW86952%27 HTTP/1.1" 200 None
2026-03-30 08:37:37 [auto1.be] INFO: Scrape type for JW86952: 2
2026-03-30 08:37:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3530de6-400f-5adc-933c-f0269a7613a1 with identifier: JW86952
2026-03-30 08:37:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3530de6-400f-5adc-933c-f0269a7613a1 with scrape type 2
2026-03-30 08:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3530de6-400f-5adc-933c-f0269a7613a1 with scrape type 2
2026-03-30 08:37:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d3530de6-400f-5adc-933c-f0269a7613a1, identifier: JW86952
2026-03-30 08:37:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d3530de6-400f-5adc-933c-f0269a7613a1 with identifier: JW86952
2026-03-30 08:37:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d3530de6-400f-5adc-933c-f0269a7613a1 with identifier: JW86952
2026-03-30 08:37:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d3530de6-400f-5adc-933c-f0269a7613a1 with identifier: JW86952 to the API
2026-03-30 08:37:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:57:38Z',
'fuel_type': 'petrol',
'id': 'd3530de6-400f-5adc-933c-f0269a7613a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW86952',
'listing': 'auction',
'make': 'Peugeot',
'model': '208',
'odometer': 115260,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-17',
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2019}
2026-03-30 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW86952%27 HTTP/1.1" 200 None
2026-03-30 08:37:38 [auto1.be] INFO: Saving data for JW86952: {'auction_closing_time': 1774886258.0, 'created_time': 1774557463.944303, 'last_price_update_time': 1774859858.035633}
2026-03-30 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JW86952') HTTP/1.1" 204 0
2026-03-30 08:37:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:37:38 [auto1.be] INFO: Found listing with ID: RK79502
2026-03-30 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK79502%27 HTTP/1.1" 200 None
2026-03-30 08:37:38 [auto1.be] INFO: Scrape type for RK79502: 0
2026-03-30 08:37:38 [auto1.be] INFO: Found listing with ID: RK12486
2026-03-30 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK12486%27 HTTP/1.1" 200 None
2026-03-30 08:37:38 [auto1.be] INFO: Scrape type for RK12486: 0
2026-03-30 08:37:38 [auto1.be] INFO: Found listing with ID: ZS70359
2026-03-30 08:37:38 [auto1.be] INFO: Found listing with ID: SE23508
2026-03-30 08:37:38 [auto1.be] INFO: Found listing with ID: SN78128
2026-03-30 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN78128%27 HTTP/1.1" 200 None
2026-03-30 08:37:38 [auto1.be] INFO: Scrape type for SN78128: 2
2026-03-30 08:37:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46e50a49-ca63-5701-9f1e-73ae9e786a27 with identifier: SN78128
2026-03-30 08:37:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46e50a49-ca63-5701-9f1e-73ae9e786a27 with scrape type 2
2026-03-30 08:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46e50a49-ca63-5701-9f1e-73ae9e786a27 with scrape type 2
2026-03-30 08:37:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 46e50a49-ca63-5701-9f1e-73ae9e786a27, identifier: SN78128
2026-03-30 08:37:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 46e50a49-ca63-5701-9f1e-73ae9e786a27 with identifier: SN78128
2026-03-30 08:37:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 46e50a49-ca63-5701-9f1e-73ae9e786a27 with identifier: SN78128
2026-03-30 08:37:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 46e50a49-ca63-5701-9f1e-73ae9e786a27 with identifier: SN78128 to the API
2026-03-30 08:37:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:45:34Z',
'fuel_type': 'diesel',
'id': '46e50a49-ca63-5701-9f1e-73ae9e786a27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN78128',
'listing': 'auction',
'make': 'Toyota',
'model': 'ProAce',
'odometer': 158900,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-04',
'seller_name': None,
'title': 'Toyota ProAce 1.6 D-4D L1H1 Kasten',
'transmission': 'manual',
'trim': 'L1H1 Kasten',
'year': 2016}
2026-03-30 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SN78128%27 HTTP/1.1" 200 None
2026-03-30 08:37:38 [auto1.be] INFO: Saving data for SN78128: {'auction_closing_time': 1774885534.0, 'created_time': 1774557436.84309, 'last_price_update_time': 1774859858.468814}
2026-03-30 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SN78128') HTTP/1.1" 204 0
2026-03-30 08:37:38 [auto1.be] INFO: Found listing with ID: WW99205
2026-03-30 08:37:38 [auto1.be] INFO: Found listing with ID: VM12927
2026-03-30 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM12927%27 HTTP/1.1" 200 None
2026-03-30 08:37:38 [auto1.be] INFO: Scrape type for VM12927: 0
2026-03-30 08:37:38 [auto1.be] INFO: Found listing with ID: LH25651
2026-03-30 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH25651%27 HTTP/1.1" 200 None
2026-03-30 08:37:38 [auto1.be] INFO: Scrape type for LH25651: 0
2026-03-30 08:37:38 [auto1.be] INFO: Found listing with ID: SD77902
2026-03-30 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD77902%27 HTTP/1.1" 200 None
2026-03-30 08:37:38 [auto1.be] INFO: Scrape type for SD77902: 0
2026-03-30 08:37:38 [auto1.be] INFO: Found listing with ID: EK72945
2026-03-30 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK72945%27 HTTP/1.1" 200 None
2026-03-30 08:37:38 [auto1.be] INFO: Scrape type for EK72945: 0
2026-03-30 08:37:38 [auto1.be] INFO: Found listing with ID: LK16000
2026-03-30 08:37:38 [auto1.be] INFO: Found listing with ID: WA10715
2026-03-30 08:37:38 [auto1.be] INFO: Found listing with ID: EB09170
2026-03-30 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB09170%27 HTTP/1.1" 200 None
2026-03-30 08:37:38 [auto1.be] INFO: Scrape type for EB09170: 2
2026-03-30 08:37:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ed6c349-0194-50a2-9b7e-f83c48f59907 with identifier: EB09170
2026-03-30 08:37:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ed6c349-0194-50a2-9b7e-f83c48f59907 with scrape type 2
2026-03-30 08:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ed6c349-0194-50a2-9b7e-f83c48f59907 with scrape type 2
2026-03-30 08:37:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0ed6c349-0194-50a2-9b7e-f83c48f59907, identifier: EB09170
2026-03-30 08:37:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0ed6c349-0194-50a2-9b7e-f83c48f59907 with identifier: EB09170
2026-03-30 08:37:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0ed6c349-0194-50a2-9b7e-f83c48f59907 with identifier: EB09170
2026-03-30 08:37:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0ed6c349-0194-50a2-9b7e-f83c48f59907 with identifier: EB09170 to the API
2026-03-30 08:37:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 341,
'expiration_date': '2026-03-30T15:32:16Z',
'fuel_type': 'hybrid',
'id': '0ed6c349-0194-50a2-9b7e-f83c48f59907',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB09170',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC60',
'odometer': 47398,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-24',
'seller_name': None,
'title': 'Volvo XC60 2.0 T6 Plug-in Hybrid Inscription Expression AWD',
'transmission': 'automatic',
'trim': 'Inscription Expression AWD',
'year': 2021}
2026-03-30 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB09170%27 HTTP/1.1" 200 None
2026-03-30 08:37:38 [auto1.be] INFO: Saving data for EB09170: {'auction_closing_time': 1774884736.0, 'created_time': 1774557528.012438, 'last_price_update_time': 1774859858.982317}
2026-03-30 08:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EB09170') HTTP/1.1" 204 0
2026-03-30 08:37:39 [auto1.be] INFO: Found listing with ID: XN92471
2026-03-30 08:37:39 [auto1.be] INFO: Found listing with ID: NB03494
2026-03-30 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB03494%27 HTTP/1.1" 200 None
2026-03-30 08:37:39 [auto1.be] INFO: Scrape type for NB03494: 0
2026-03-30 08:37:39 [auto1.be] INFO: Found listing with ID: WJ85942
2026-03-30 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ85942%27 HTTP/1.1" 200 None
2026-03-30 08:37:39 [auto1.be] INFO: Scrape type for WJ85942: 0
2026-03-30 08:37:39 [auto1.be] INFO: Found listing with ID: CK14854
2026-03-30 08:37:39 [auto1.be] INFO: Found listing with ID: ZL62218
2026-03-30 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL62218%27 HTTP/1.1" 200 None
2026-03-30 08:37:39 [auto1.be] INFO: Scrape type for ZL62218: 0
2026-03-30 08:37:39 [auto1.be] INFO: Found listing with ID: KG55279
2026-03-30 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG55279%27 HTTP/1.1" 200 None
2026-03-30 08:37:39 [auto1.be] INFO: Scrape type for KG55279: 2
2026-03-30 08:37:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8960310-7c5d-51c0-b05a-5286b81cbb22 with identifier: KG55279
2026-03-30 08:37:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8960310-7c5d-51c0-b05a-5286b81cbb22 with scrape type 2
2026-03-30 08:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8960310-7c5d-51c0-b05a-5286b81cbb22 with scrape type 2
2026-03-30 08:37:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d8960310-7c5d-51c0-b05a-5286b81cbb22, identifier: KG55279
2026-03-30 08:37:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d8960310-7c5d-51c0-b05a-5286b81cbb22 with identifier: KG55279
2026-03-30 08:37:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d8960310-7c5d-51c0-b05a-5286b81cbb22 with identifier: KG55279
2026-03-30 08:37:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d8960310-7c5d-51c0-b05a-5286b81cbb22 with identifier: KG55279 to the API
2026-03-30 08:37:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:59:15Z',
'fuel_type': 'petrol',
'id': 'd8960310-7c5d-51c0-b05a-5286b81cbb22',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG55279',
'listing': 'auction',
'make': 'Opel',
'model': 'Meriva',
'odometer': 107056,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-09-28',
'seller_name': None,
'title': 'Opel Meriva 1.4 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2008}
2026-03-30 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG55279%27 HTTP/1.1" 200 None
2026-03-30 08:37:39 [auto1.be] INFO: Saving data for KG55279: {'auction_closing_time': 1774886355.0, 'created_time': 1774557544.726713, 'last_price_update_time': 1774859859.522059}
2026-03-30 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KG55279') HTTP/1.1" 204 0
2026-03-30 08:37:39 [auto1.be] INFO: Found listing with ID: JS91211
2026-03-30 08:37:39 [auto1.be] INFO: Found listing with ID: EX56301
2026-03-30 08:37:39 [auto1.be] INFO: Found listing with ID: DL13581
2026-03-30 08:37:39 [auto1.be] INFO: Found listing with ID: EL84394
2026-03-30 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL84394%27 HTTP/1.1" 200 None
2026-03-30 08:37:39 [auto1.be] INFO: Scrape type for EL84394: 0
2026-03-30 08:37:39 [auto1.be] INFO: Found listing with ID: WG23357
2026-03-30 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG23357%27 HTTP/1.1" 200 None
2026-03-30 08:37:39 [auto1.be] INFO: Scrape type for WG23357: 0
2026-03-30 08:37:39 [auto1.be] INFO: Found listing with ID: HP15544
2026-03-30 08:37:39 [auto1.be] INFO: Found listing with ID: PB67516
2026-03-30 08:37:39 [auto1.be] INFO: Found listing with ID: XB95573
2026-03-30 08:37:39 [auto1.be] INFO: Found listing with ID: ND89972
2026-03-30 08:37:39 [auto1.be] INFO: Found listing with ID: LG37246
2026-03-30 08:37:39 [auto1.be] INFO: Found listing with ID: JB70681
2026-03-30 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB70681%27 HTTP/1.1" 200 None
2026-03-30 08:37:39 [auto1.be] INFO: Scrape type for JB70681: 0
2026-03-30 08:37:39 [auto1.be] INFO: Found listing with ID: JS91755
2026-03-30 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JS91755%27 HTTP/1.1" 200 None
2026-03-30 08:37:39 [auto1.be] INFO: Scrape type for JS91755: 0
2026-03-30 08:37:39 [auto1.be] INFO: Found listing with ID: EV46077
2026-03-30 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV46077%27 HTTP/1.1" 200 None
2026-03-30 08:37:39 [auto1.be] INFO: Scrape type for EV46077: 0
2026-03-30 08:37:39 [auto1.be] INFO: Found listing with ID: FB34577
2026-03-30 08:37:39 [auto1.be] INFO: Found listing with ID: JV80966
2026-03-30 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV80966%27 HTTP/1.1" 200 None
2026-03-30 08:37:39 [auto1.be] INFO: Scrape type for JV80966: 2
2026-03-30 08:37:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb7558e3-2cb4-5a8b-adea-0384455187d7 with identifier: JV80966
2026-03-30 08:37:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb7558e3-2cb4-5a8b-adea-0384455187d7 with scrape type 2
2026-03-30 08:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb7558e3-2cb4-5a8b-adea-0384455187d7 with scrape type 2
2026-03-30 08:37:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: fb7558e3-2cb4-5a8b-adea-0384455187d7, identifier: JV80966
2026-03-30 08:37:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: fb7558e3-2cb4-5a8b-adea-0384455187d7 with identifier: JV80966
2026-03-30 08:37:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: fb7558e3-2cb4-5a8b-adea-0384455187d7 with identifier: JV80966
2026-03-30 08:37:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: fb7558e3-2cb4-5a8b-adea-0384455187d7 with identifier: JV80966 to the API
2026-03-30 08:37:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:59:28Z',
'fuel_type': 'diesel',
'id': 'fb7558e3-2cb4-5a8b-adea-0384455187d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV80966',
'listing': 'auction',
'make': 'Ford',
'model': 'Focus',
'odometer': 118060,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-26',
'seller_name': None,
'title': 'Ford Focus 1.5 EcoBlue TDCi Cool&Connect',
'transmission': 'manual',
'trim': 'Cool&Connect',
'year': 2020}
2026-03-30 08:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV80966%27 HTTP/1.1" 200 None
2026-03-30 08:37:40 [auto1.be] INFO: Saving data for JV80966: {'auction_closing_time': 1774886368.0, 'created_time': 1774557583.917276, 'last_price_update_time': 1774859860.162442}
2026-03-30 08:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='JV80966') HTTP/1.1" 204 0
2026-03-30 08:37:40 [auto1.be] INFO: Found listing with ID: GR79063
2026-03-30 08:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GR79063%27 HTTP/1.1" 200 None
2026-03-30 08:37:40 [auto1.be] INFO: Scrape type for GR79063: 0
2026-03-30 08:37:40 [auto1.be] INFO: Found listing with ID: PR27183
2026-03-30 08:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR27183%27 HTTP/1.1" 200 None
2026-03-30 08:37:40 [auto1.be] INFO: Scrape type for PR27183: 2
2026-03-30 08:37:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f65751a-a9b9-53be-b964-58a154fdbf52 with identifier: PR27183
2026-03-30 08:37:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f65751a-a9b9-53be-b964-58a154fdbf52 with scrape type 2
2026-03-30 08:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f65751a-a9b9-53be-b964-58a154fdbf52 with scrape type 2
2026-03-30 08:37:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5f65751a-a9b9-53be-b964-58a154fdbf52, identifier: PR27183
2026-03-30 08:37:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5f65751a-a9b9-53be-b964-58a154fdbf52 with identifier: PR27183
2026-03-30 08:37:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5f65751a-a9b9-53be-b964-58a154fdbf52 with identifier: PR27183
2026-03-30 08:37:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5f65751a-a9b9-53be-b964-58a154fdbf52 with identifier: PR27183 to the API
2026-03-30 08:37:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:04:47Z',
'fuel_type': 'diesel',
'id': '5f65751a-a9b9-53be-b964-58a154fdbf52',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR27183',
'listing': 'auction',
'make': 'Citroen',
'model': 'Jumpy',
'odometer': 162236,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-06',
'seller_name': None,
'title': 'Citroen Jumpy 1.6 HDi L1H1 27 Kasten',
'transmission': 'manual',
'trim': 'L1H1 27 Kasten',
'year': 2016}
2026-03-30 08:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PR27183%27 HTTP/1.1" 200 None
2026-03-30 08:37:40 [auto1.be] INFO: Saving data for PR27183: {'auction_closing_time': 1774883087.0, 'created_time': 1774557473.251058, 'last_price_update_time': 1774859860.693007}
2026-03-30 08:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PR27183') HTTP/1.1" 204 0
2026-03-30 08:37:40 [auto1.be] INFO: Found listing with ID: KP74596
2026-03-30 08:37:40 [auto1.be] INFO: Found listing with ID: TL70885
2026-03-30 08:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL70885%27 HTTP/1.1" 200 None
2026-03-30 08:37:40 [auto1.be] INFO: Scrape type for TL70885: 2
2026-03-30 08:37:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73ca0251-7234-5965-976e-1562d61880cc with identifier: TL70885
2026-03-30 08:37:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73ca0251-7234-5965-976e-1562d61880cc with scrape type 2
2026-03-30 08:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73ca0251-7234-5965-976e-1562d61880cc with scrape type 2
2026-03-30 08:37:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 73ca0251-7234-5965-976e-1562d61880cc, identifier: TL70885
2026-03-30 08:37:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 73ca0251-7234-5965-976e-1562d61880cc with identifier: TL70885
2026-03-30 08:37:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 73ca0251-7234-5965-976e-1562d61880cc with identifier: TL70885
2026-03-30 08:37:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 73ca0251-7234-5965-976e-1562d61880cc with identifier: TL70885 to the API
2026-03-30 08:37:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 73,
'expiration_date': '2026-03-30T15:05:27Z',
'fuel_type': 'petrol',
'id': '73ca0251-7234-5965-976e-1562d61880cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL70885',
'listing': 'auction',
'make': 'Peugeot',
'model': '207',
'odometer': 118945,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-07-14',
'seller_name': None,
'title': 'Peugeot 207 1.4 Tendance',
'transmission': 'manual',
'trim': 'Tendance',
'year': 2009}
2026-03-30 08:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL70885%27 HTTP/1.1" 200 None
2026-03-30 08:37:41 [auto1.be] INFO: Saving data for TL70885: {'auction_closing_time': 1774883127.0, 'created_time': 1774557549.57697, 'last_price_update_time': 1774859861.163627}
2026-03-30 08:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TL70885') HTTP/1.1" 204 0
2026-03-30 08:37:41 [auto1.be] INFO: Found listing with ID: JW06840
2026-03-30 08:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW06840%27 HTTP/1.1" 200 None
2026-03-30 08:37:41 [auto1.be] INFO: Scrape type for JW06840: 0
2026-03-30 08:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:37:41 [auto1.be] INFO: Channel: 24h | Page: 14 | totalHits: 1502 | hits on page: 40
2026-03-30 08:37:41 [auto1.be] INFO: Found listing with ID: RR43173
2026-03-30 08:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RR43173%27 HTTP/1.1" 200 None
2026-03-30 08:37:41 [auto1.be] INFO: Scrape type for RR43173: 0
2026-03-30 08:37:41 [auto1.be] INFO: Found listing with ID: BN63741
2026-03-30 08:37:41 [auto1.be] INFO: Found listing with ID: NV81106
2026-03-30 08:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV81106%27 HTTP/1.1" 200 None
2026-03-30 08:37:41 [auto1.be] INFO: Scrape type for NV81106: 0
2026-03-30 08:37:41 [auto1.be] INFO: Found listing with ID: GL29646
2026-03-30 08:37:41 [auto1.be] INFO: Found listing with ID: ZG73435
2026-03-30 08:37:41 [auto1.be] INFO: Found listing with ID: HS23763
2026-03-30 08:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS23763%27 HTTP/1.1" 200 None
2026-03-30 08:37:41 [auto1.be] INFO: Scrape type for HS23763: 2
2026-03-30 08:37:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63c6c41d-00f3-5167-bdf6-b847dc50bb63 with identifier: HS23763
2026-03-30 08:37:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63c6c41d-00f3-5167-bdf6-b847dc50bb63 with scrape type 2
2026-03-30 08:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63c6c41d-00f3-5167-bdf6-b847dc50bb63 with scrape type 2
2026-03-30 08:37:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 63c6c41d-00f3-5167-bdf6-b847dc50bb63, identifier: HS23763
2026-03-30 08:37:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 63c6c41d-00f3-5167-bdf6-b847dc50bb63 with identifier: HS23763
2026-03-30 08:37:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 63c6c41d-00f3-5167-bdf6-b847dc50bb63 with identifier: HS23763
2026-03-30 08:37:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 63c6c41d-00f3-5167-bdf6-b847dc50bb63 with identifier: HS23763 to the API
2026-03-30 08:37:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:26:28Z',
'fuel_type': 'diesel',
'id': '63c6c41d-00f3-5167-bdf6-b847dc50bb63',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS23763',
'listing': 'auction',
'make': 'Renault',
'model': 'Megane',
'odometer': 162430,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-08',
'seller_name': None,
'title': 'Renault Megane 1.5 dCi Energy BOSE-Edition',
'transmission': 'automatic',
'trim': 'BOSE-Edition',
'year': 2017}
2026-03-30 08:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS23763%27 HTTP/1.1" 200 None
2026-03-30 08:37:41 [auto1.be] INFO: Saving data for HS23763: {'auction_closing_time': 1774884388.0, 'created_time': 1774557458.303033, 'last_price_update_time': 1774859861.743687}
2026-03-30 08:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HS23763') HTTP/1.1" 204 0
2026-03-30 08:37:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:37:41 [auto1.be] INFO: Found listing with ID: RA46458
2026-03-30 08:37:41 [auto1.be] INFO: Found listing with ID: VE53331
2026-03-30 08:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE53331%27 HTTP/1.1" 200 None
2026-03-30 08:37:41 [auto1.be] INFO: Scrape type for VE53331: 2
2026-03-30 08:37:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3998579b-cd59-553e-b52c-f4016f7450c0 with identifier: VE53331
2026-03-30 08:37:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3998579b-cd59-553e-b52c-f4016f7450c0 with scrape type 2
2026-03-30 08:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3998579b-cd59-553e-b52c-f4016f7450c0 with scrape type 2
2026-03-30 08:37:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3998579b-cd59-553e-b52c-f4016f7450c0, identifier: VE53331
2026-03-30 08:37:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3998579b-cd59-553e-b52c-f4016f7450c0 with identifier: VE53331
2026-03-30 08:37:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3998579b-cd59-553e-b52c-f4016f7450c0 with identifier: VE53331
2026-03-30 08:37:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3998579b-cd59-553e-b52c-f4016f7450c0 with identifier: VE53331 to the API
2026-03-30 08:37:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 132,
'expiration_date': '2026-03-30T15:23:38Z',
'fuel_type': 'petrol',
'id': '3998579b-cd59-553e-b52c-f4016f7450c0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE53331',
'listing': 'auction',
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 146236,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-16',
'seller_name': None,
'title': 'Hyundai Tucson 1.6 Comfort 2WD',
'transmission': 'manual',
'trim': 'Comfort 2WD',
'year': 2018}
2026-03-30 08:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE53331%27 HTTP/1.1" 200 None
2026-03-30 08:37:42 [auto1.be] INFO: Saving data for VE53331: {'auction_closing_time': 1774884218.0, 'created_time': 1774557580.403077, 'last_price_update_time': 1774859862.238048}
2026-03-30 08:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VE53331') HTTP/1.1" 204 0
2026-03-30 08:37:42 [auto1.be] INFO: Found listing with ID: HD23270
2026-03-30 08:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HD23270%27 HTTP/1.1" 200 None
2026-03-30 08:37:42 [auto1.be] INFO: Scrape type for HD23270: 0
2026-03-30 08:37:42 [auto1.be] INFO: Found listing with ID: HP14917
2026-03-30 08:37:42 [auto1.be] INFO: Found listing with ID: WK92284
2026-03-30 08:37:42 [auto1.be] INFO: Found listing with ID: GX61337
2026-03-30 08:37:42 [auto1.be] INFO: Found listing with ID: UL34611
2026-03-30 08:37:42 [auto1.be] INFO: Found listing with ID: MW76341
2026-03-30 08:37:42 [auto1.be] INFO: Found listing with ID: AA49507
2026-03-30 08:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AA49507%27 HTTP/1.1" 200 None
2026-03-30 08:37:42 [auto1.be] INFO: Scrape type for AA49507: 0
2026-03-30 08:37:42 [auto1.be] INFO: Found listing with ID: EZ55101
2026-03-30 08:37:42 [auto1.be] INFO: Found listing with ID: TH53375
2026-03-30 08:37:42 [auto1.be] INFO: Found listing with ID: LE66186
2026-03-30 08:37:42 [auto1.be] INFO: Found listing with ID: RH88749
2026-03-30 08:37:42 [auto1.be] INFO: Found listing with ID: RK42644
2026-03-30 08:37:42 [auto1.be] INFO: Found listing with ID: AP73624
2026-03-30 08:37:42 [auto1.be] INFO: Found listing with ID: JV18684
2026-03-30 08:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JV18684%27 HTTP/1.1" 200 None
2026-03-30 08:37:42 [auto1.be] INFO: Scrape type for JV18684: 0
2026-03-30 08:37:42 [auto1.be] INFO: Found listing with ID: DF44974
2026-03-30 08:37:42 [auto1.be] INFO: Found listing with ID: DW87206
2026-03-30 08:37:42 [auto1.be] INFO: Found listing with ID: NY99560
2026-03-30 08:37:42 [auto1.be] INFO: Found listing with ID: NC25574
2026-03-30 08:37:42 [auto1.be] INFO: Found listing with ID: ZM46816
2026-03-30 08:37:42 [auto1.be] INFO: Found listing with ID: RY85405
2026-03-30 08:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY85405%27 HTTP/1.1" 200 None
2026-03-30 08:37:42 [auto1.be] INFO: Scrape type for RY85405: 0
2026-03-30 08:37:42 [auto1.be] INFO: Found listing with ID: BA52354
2026-03-30 08:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BA52354%27 HTTP/1.1" 200 None
2026-03-30 08:37:42 [auto1.be] INFO: Scrape type for BA52354: 0
2026-03-30 08:37:42 [auto1.be] INFO: Found listing with ID: NG50909
2026-03-30 08:37:42 [auto1.be] INFO: Found listing with ID: TU47744
2026-03-30 08:37:42 [auto1.be] INFO: Found listing with ID: GD11285
2026-03-30 08:37:42 [auto1.be] INFO: Found listing with ID: UC23117
2026-03-30 08:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC23117%27 HTTP/1.1" 200 None
2026-03-30 08:37:42 [auto1.be] INFO: Scrape type for UC23117: 0
2026-03-30 08:37:42 [auto1.be] INFO: Found listing with ID: RS46918
2026-03-30 08:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS46918%27 HTTP/1.1" 200 None
2026-03-30 08:37:42 [auto1.be] INFO: Scrape type for RS46918: 0
2026-03-30 08:37:42 [auto1.be] INFO: Found listing with ID: GF24104
2026-03-30 08:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF24104%27 HTTP/1.1" 200 None
2026-03-30 08:37:42 [auto1.be] INFO: Scrape type for GF24104: 0
2026-03-30 08:37:42 [auto1.be] INFO: Found listing with ID: NG90127
2026-03-30 08:37:42 [auto1.be] INFO: Found listing with ID: PJ82537
2026-03-30 08:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ82537%27 HTTP/1.1" 200 None
2026-03-30 08:37:42 [auto1.be] INFO: Scrape type for PJ82537: 0
2026-03-30 08:37:42 [auto1.be] INFO: Found listing with ID: BT94428
2026-03-30 08:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT94428%27 HTTP/1.1" 200 None
2026-03-30 08:37:42 [auto1.be] INFO: Scrape type for BT94428: 0
2026-03-30 08:37:42 [auto1.be] INFO: Found listing with ID: WC55286
2026-03-30 08:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC55286%27 HTTP/1.1" 200 None
2026-03-30 08:37:42 [auto1.be] INFO: Scrape type for WC55286: 0
2026-03-30 08:37:42 [auto1.be] INFO: Found listing with ID: CC17071
2026-03-30 08:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:37:43 [auto1.be] INFO: Channel: 24h | Page: 15 | totalHits: 1502 | hits on page: 40
2026-03-30 08:37:43 [auto1.be] INFO: Found listing with ID: KH63709
2026-03-30 08:37:43 [auto1.be] INFO: Found listing with ID: YN02015
2026-03-30 08:37:43 [auto1.be] INFO: Found listing with ID: MG81689
2026-03-30 08:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG81689%27 HTTP/1.1" 200 None
2026-03-30 08:37:43 [auto1.be] INFO: Scrape type for MG81689: 0
2026-03-30 08:37:43 [auto1.be] INFO: Found listing with ID: VW32861
2026-03-30 08:37:43 [auto1.be] INFO: Found listing with ID: PE83293
2026-03-30 08:37:43 [auto1.be] INFO: Found listing with ID: WA92632
2026-03-30 08:37:43 [auto1.be] INFO: Found listing with ID: ZL15279
2026-03-30 08:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZL15279%27 HTTP/1.1" 200 None
2026-03-30 08:37:43 [auto1.be] INFO: Scrape type for ZL15279: 0
2026-03-30 08:37:43 [auto1.be] INFO: Found listing with ID: RW14221
2026-03-30 08:37:43 [auto1.be] INFO: Found listing with ID: WV47829
2026-03-30 08:37:43 [auto1.be] INFO: Found listing with ID: AK54797
2026-03-30 08:37:43 [auto1.be] INFO: Found listing with ID: LK29098
2026-03-30 08:37:43 [auto1.be] INFO: Found listing with ID: YP74524
2026-03-30 08:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YP74524%27 HTTP/1.1" 200 None
2026-03-30 08:37:43 [auto1.be] INFO: Scrape type for YP74524: 0
2026-03-30 08:37:43 [auto1.be] INFO: Found listing with ID: DY69036
2026-03-30 08:37:43 [auto1.be] INFO: Found listing with ID: YG22909
2026-03-30 08:37:43 [auto1.be] INFO: Found listing with ID: RZ47312
2026-03-30 08:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ47312%27 HTTP/1.1" 200 None
2026-03-30 08:37:43 [auto1.be] INFO: Scrape type for RZ47312: 2
2026-03-30 08:37:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 522ac188-a2f0-54c8-8094-c7986a060761 with identifier: RZ47312
2026-03-30 08:37:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 522ac188-a2f0-54c8-8094-c7986a060761 with scrape type 2
2026-03-30 08:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 522ac188-a2f0-54c8-8094-c7986a060761 with scrape type 2
2026-03-30 08:37:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 522ac188-a2f0-54c8-8094-c7986a060761, identifier: RZ47312
2026-03-30 08:37:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 522ac188-a2f0-54c8-8094-c7986a060761 with identifier: RZ47312
2026-03-30 08:37:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 522ac188-a2f0-54c8-8094-c7986a060761 with identifier: RZ47312
2026-03-30 08:37:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 522ac188-a2f0-54c8-8094-c7986a060761 with identifier: RZ47312 to the API
2026-03-30 08:37:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:10:30Z',
'fuel_type': 'petrol',
'id': '522ac188-a2f0-54c8-8094-c7986a060761',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ47312',
'listing': 'auction',
'make': 'Renault',
'model': 'Clio',
'odometer': 153502,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-10-23',
'seller_name': None,
'title': 'Renault Clio 0.9 Iconic',
'transmission': 'manual',
'trim': 'Iconic',
'year': 2016}
2026-03-30 08:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RZ47312%27 HTTP/1.1" 200 None
2026-03-30 08:37:44 [auto1.be] INFO: Saving data for RZ47312: {'auction_closing_time': 1774883430.0, 'created_time': 1774557528.859222, 'last_price_update_time': 1774859864.513315}
2026-03-30 08:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RZ47312') HTTP/1.1" 204 0
2026-03-30 08:37:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:37:44 [auto1.be] INFO: Found listing with ID: BP14655
2026-03-30 08:37:44 [auto1.be] INFO: Found listing with ID: ND78338
2026-03-30 08:37:44 [auto1.be] INFO: Found listing with ID: LK55982
2026-03-30 08:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK55982%27 HTTP/1.1" 200 None
2026-03-30 08:37:44 [auto1.be] INFO: Scrape type for LK55982: 0
2026-03-30 08:37:44 [auto1.be] INFO: Found listing with ID: DW77345
2026-03-30 08:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DW77345%27 HTTP/1.1" 200 None
2026-03-30 08:37:44 [auto1.be] INFO: Scrape type for DW77345: 0
2026-03-30 08:37:44 [auto1.be] INFO: Found listing with ID: NN42853
2026-03-30 08:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN42853%27 HTTP/1.1" 200 None
2026-03-30 08:37:44 [auto1.be] INFO: Scrape type for NN42853: 0
2026-03-30 08:37:44 [auto1.be] INFO: Found listing with ID: CS90165
2026-03-30 08:37:44 [auto1.be] INFO: Found listing with ID: LA76788
2026-03-30 08:37:44 [auto1.be] INFO: Found listing with ID: HB19534
2026-03-30 08:37:44 [auto1.be] INFO: Found listing with ID: AY47657
2026-03-30 08:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AY47657%27 HTTP/1.1" 200 None
2026-03-30 08:37:44 [auto1.be] INFO: Scrape type for AY47657: 0
2026-03-30 08:37:44 [auto1.be] INFO: Found listing with ID: BU27000
2026-03-30 08:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU27000%27 HTTP/1.1" 200 None
2026-03-30 08:37:44 [auto1.be] INFO: Scrape type for BU27000: 0
2026-03-30 08:37:44 [auto1.be] INFO: Found listing with ID: PL61351
2026-03-30 08:37:44 [auto1.be] INFO: Found listing with ID: AE13452
2026-03-30 08:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE13452%27 HTTP/1.1" 200 None
2026-03-30 08:37:44 [auto1.be] INFO: Scrape type for AE13452: 0
2026-03-30 08:37:44 [auto1.be] INFO: Found listing with ID: FG26500
2026-03-30 08:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FG26500%27 HTTP/1.1" 200 None
2026-03-30 08:37:44 [auto1.be] INFO: Scrape type for FG26500: 0
2026-03-30 08:37:44 [auto1.be] INFO: Found listing with ID: WP32655
2026-03-30 08:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP32655%27 HTTP/1.1" 200 None
2026-03-30 08:37:44 [auto1.be] INFO: Scrape type for WP32655: 0
2026-03-30 08:37:44 [auto1.be] INFO: Found listing with ID: MC44479
2026-03-30 08:37:44 [auto1.be] INFO: Found listing with ID: SC04496
2026-03-30 08:37:44 [auto1.be] INFO: Found listing with ID: CC56747
2026-03-30 08:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC56747%27 HTTP/1.1" 200 None
2026-03-30 08:37:44 [auto1.be] INFO: Scrape type for CC56747: 2
2026-03-30 08:37:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79a1b969-fbb5-57df-a009-0ca297dac6f2 with identifier: CC56747
2026-03-30 08:37:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79a1b969-fbb5-57df-a009-0ca297dac6f2 with scrape type 2
2026-03-30 08:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79a1b969-fbb5-57df-a009-0ca297dac6f2 with scrape type 2
2026-03-30 08:37:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 79a1b969-fbb5-57df-a009-0ca297dac6f2, identifier: CC56747
2026-03-30 08:37:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 79a1b969-fbb5-57df-a009-0ca297dac6f2 with identifier: CC56747
2026-03-30 08:37:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 79a1b969-fbb5-57df-a009-0ca297dac6f2 with identifier: CC56747
2026-03-30 08:37:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 79a1b969-fbb5-57df-a009-0ca297dac6f2 with identifier: CC56747 to the API
2026-03-30 08:37:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:44:55Z',
'fuel_type': 'diesel',
'id': '79a1b969-fbb5-57df-a009-0ca297dac6f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC56747',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Touran',
'odometer': 152936,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-04',
'seller_name': None,
'title': 'Volkswagen Touran 2.0 TDI Highline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Highline BlueMotion Tech',
'year': 2016}
2026-03-30 08:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CC56747%27 HTTP/1.1" 200 None
2026-03-30 08:37:45 [auto1.be] INFO: Saving data for CC56747: {'auction_closing_time': 1774885495.0, 'created_time': 1774557540.286488, 'last_price_update_time': 1774859865.170248}
2026-03-30 08:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CC56747') HTTP/1.1" 204 0
2026-03-30 08:37:45 [auto1.be] INFO: Found listing with ID: XJ47711
2026-03-30 08:37:45 [auto1.be] INFO: Found listing with ID: CK49467
2026-03-30 08:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CK49467%27 HTTP/1.1" 200 None
2026-03-30 08:37:45 [auto1.be] INFO: Scrape type for CK49467: 0
2026-03-30 08:37:45 [auto1.be] INFO: Found listing with ID: JA34397
2026-03-30 08:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JA34397%27 HTTP/1.1" 200 None
2026-03-30 08:37:45 [auto1.be] INFO: Scrape type for JA34397: 0
2026-03-30 08:37:45 [auto1.be] INFO: Found listing with ID: XC31503
2026-03-30 08:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC31503%27 HTTP/1.1" 200 None
2026-03-30 08:37:45 [auto1.be] INFO: Scrape type for XC31503: 2
2026-03-30 08:37:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20fb55a4-bc54-58df-bbe8-bd3234b9e464 with identifier: XC31503
2026-03-30 08:37:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20fb55a4-bc54-58df-bbe8-bd3234b9e464 with scrape type 2
2026-03-30 08:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20fb55a4-bc54-58df-bbe8-bd3234b9e464 with scrape type 2
2026-03-30 08:37:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 20fb55a4-bc54-58df-bbe8-bd3234b9e464, identifier: XC31503
2026-03-30 08:37:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 20fb55a4-bc54-58df-bbe8-bd3234b9e464 with identifier: XC31503
2026-03-30 08:37:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 20fb55a4-bc54-58df-bbe8-bd3234b9e464 with identifier: XC31503
2026-03-30 08:37:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 20fb55a4-bc54-58df-bbe8-bd3234b9e464 with identifier: XC31503 to the API
2026-03-30 08:37:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 155,
'expiration_date': '2026-03-30T15:19:43Z',
'fuel_type': 'petrol',
'id': '20fb55a4-bc54-58df-bbe8-bd3234b9e464',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC31503',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 130320,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-09-12',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 180 AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2018}
2026-03-30 08:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC31503%27 HTTP/1.1" 200 None
2026-03-30 08:37:45 [auto1.be] INFO: Saving data for XC31503: {'auction_closing_time': 1774883983.0, 'created_time': 1774557558.5286, 'last_price_update_time': 1774859865.721426}
2026-03-30 08:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XC31503') HTTP/1.1" 204 0
2026-03-30 08:37:45 [auto1.be] INFO: Found listing with ID: LE58292
2026-03-30 08:37:45 [auto1.be] INFO: Found listing with ID: DL17322
2026-03-30 08:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DL17322%27 HTTP/1.1" 200 None
2026-03-30 08:37:45 [auto1.be] INFO: Scrape type for DL17322: 0
2026-03-30 08:37:45 [auto1.be] INFO: Found listing with ID: SE12861
2026-03-30 08:37:45 [auto1.be] INFO: Found listing with ID: BJ27729
2026-03-30 08:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ27729%27 HTTP/1.1" 200 None
2026-03-30 08:37:45 [auto1.be] INFO: Scrape type for BJ27729: 0
2026-03-30 08:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:37:46 [auto1.be] INFO: Channel: 24h | Page: 16 | totalHits: 1502 | hits on page: 40
2026-03-30 08:37:46 [auto1.be] INFO: Found listing with ID: YM63500
2026-03-30 08:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM63500%27 HTTP/1.1" 200 None
2026-03-30 08:37:46 [auto1.be] INFO: Scrape type for YM63500: 0
2026-03-30 08:37:46 [auto1.be] INFO: Found listing with ID: DP96573
2026-03-30 08:37:46 [auto1.be] INFO: Found listing with ID: EN18719
2026-03-30 08:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EN18719%27 HTTP/1.1" 200 None
2026-03-30 08:37:46 [auto1.be] INFO: Scrape type for EN18719: 0
2026-03-30 08:37:46 [auto1.be] INFO: Found listing with ID: WH07577
2026-03-30 08:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH07577%27 HTTP/1.1" 200 None
2026-03-30 08:37:46 [auto1.be] INFO: Scrape type for WH07577: 2
2026-03-30 08:37:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7da79ca0-21e1-5e34-bca8-668ba4bbcf64 with identifier: WH07577
2026-03-30 08:37:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7da79ca0-21e1-5e34-bca8-668ba4bbcf64 with scrape type 2
2026-03-30 08:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7da79ca0-21e1-5e34-bca8-668ba4bbcf64 with scrape type 2
2026-03-30 08:37:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7da79ca0-21e1-5e34-bca8-668ba4bbcf64, identifier: WH07577
2026-03-30 08:37:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7da79ca0-21e1-5e34-bca8-668ba4bbcf64 with identifier: WH07577
2026-03-30 08:37:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7da79ca0-21e1-5e34-bca8-668ba4bbcf64 with identifier: WH07577
2026-03-30 08:37:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7da79ca0-21e1-5e34-bca8-668ba4bbcf64 with identifier: WH07577 to the API
2026-03-30 08:37:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:54:10Z',
'fuel_type': 'petrol',
'id': '7da79ca0-21e1-5e34-bca8-668ba4bbcf64',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH07577',
'listing': 'auction',
'make': 'Audi',
'model': 'Q3 Sportback',
'odometer': 91621,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-01',
'seller_name': None,
'title': 'Audi Q3 Sportback 35 TFSI Mild-Hybrid ACT',
'transmission': 'automatic',
'trim': 'ACT',
'year': 2022}
2026-03-30 08:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH07577%27 HTTP/1.1" 200 None
2026-03-30 08:37:47 [auto1.be] INFO: Saving data for WH07577: {'auction_closing_time': 1774886050.0, 'created_time': 1774557541.521377, 'last_price_update_time': 1774859867.256504}
2026-03-30 08:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WH07577') HTTP/1.1" 204 0
2026-03-30 08:37:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:37:47 [auto1.be] INFO: Found listing with ID: LJ91533
2026-03-30 08:37:47 [auto1.be] INFO: Found listing with ID: TY52799
2026-03-30 08:37:47 [auto1.be] INFO: Found listing with ID: EM18277
2026-03-30 08:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EM18277%27 HTTP/1.1" 200 None
2026-03-30 08:37:47 [auto1.be] INFO: Scrape type for EM18277: 0
2026-03-30 08:37:47 [auto1.be] INFO: Found listing with ID: XJ49438
2026-03-30 08:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ49438%27 HTTP/1.1" 200 None
2026-03-30 08:37:47 [auto1.be] INFO: Scrape type for XJ49438: 0
2026-03-30 08:37:47 [auto1.be] INFO: Found listing with ID: ZB59407
2026-03-30 08:37:47 [auto1.be] INFO: Found listing with ID: YW29468
2026-03-30 08:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW29468%27 HTTP/1.1" 200 None
2026-03-30 08:37:47 [auto1.be] INFO: Scrape type for YW29468: 0
2026-03-30 08:37:47 [auto1.be] INFO: Found listing with ID: NU46591
2026-03-30 08:37:47 [auto1.be] INFO: Found listing with ID: AS01915
2026-03-30 08:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AS01915%27 HTTP/1.1" 200 None
2026-03-30 08:37:47 [auto1.be] INFO: Scrape type for AS01915: 0
2026-03-30 08:37:47 [auto1.be] INFO: Found listing with ID: AB44644
2026-03-30 08:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB44644%27 HTTP/1.1" 200 None
2026-03-30 08:37:47 [auto1.be] INFO: Scrape type for AB44644: 0
2026-03-30 08:37:47 [auto1.be] INFO: Found listing with ID: XM93272
2026-03-30 08:37:47 [auto1.be] INFO: Found listing with ID: TL07516
2026-03-30 08:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL07516%27 HTTP/1.1" 200 None
2026-03-30 08:37:47 [auto1.be] INFO: Scrape type for TL07516: 2
2026-03-30 08:37:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64d1b045-7053-5402-a147-86c043a03d45 with identifier: TL07516
2026-03-30 08:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64d1b045-7053-5402-a147-86c043a03d45 with scrape type 2
2026-03-30 08:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64d1b045-7053-5402-a147-86c043a03d45 with scrape type 2
2026-03-30 08:37:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 64d1b045-7053-5402-a147-86c043a03d45, identifier: TL07516
2026-03-30 08:37:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 64d1b045-7053-5402-a147-86c043a03d45 with identifier: TL07516
2026-03-30 08:37:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 64d1b045-7053-5402-a147-86c043a03d45 with identifier: TL07516
2026-03-30 08:37:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 64d1b045-7053-5402-a147-86c043a03d45 with identifier: TL07516 to the API
2026-03-30 08:37:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 55,
'expiration_date': '2026-03-30T15:41:40Z',
'fuel_type': 'petrol',
'id': '64d1b045-7053-5402-a147-86c043a03d45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL07516',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 126427,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-04-15',
'seller_name': None,
'title': 'Volkswagen Polo 1.2 Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2007}
2026-03-30 08:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TL07516%27 HTTP/1.1" 200 None
2026-03-30 08:37:47 [auto1.be] INFO: Saving data for TL07516: {'auction_closing_time': 1774885300.0, 'created_time': 1774557554.058786, 'last_price_update_time': 1774859867.848017}
2026-03-30 08:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TL07516') HTTP/1.1" 204 0
2026-03-30 08:37:47 [auto1.be] INFO: Found listing with ID: CS76215
2026-03-30 08:37:47 [auto1.be] INFO: Found listing with ID: JK00802
2026-03-30 08:37:47 [auto1.be] INFO: Found listing with ID: WD81319
2026-03-30 08:37:47 [auto1.be] INFO: Found listing with ID: WA82695
2026-03-30 08:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WA82695%27 HTTP/1.1" 200 None
2026-03-30 08:37:47 [auto1.be] INFO: Scrape type for WA82695: 0
2026-03-30 08:37:47 [auto1.be] INFO: Found listing with ID: ZM54310
2026-03-30 08:37:47 [auto1.be] INFO: Found listing with ID: AF68960
2026-03-30 08:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AF68960%27 HTTP/1.1" 200 None
2026-03-30 08:37:47 [auto1.be] INFO: Scrape type for AF68960: 0
2026-03-30 08:37:47 [auto1.be] INFO: Found listing with ID: RW94228
2026-03-30 08:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW94228%27 HTTP/1.1" 200 None
2026-03-30 08:37:48 [auto1.be] INFO: Scrape type for RW94228: 0
2026-03-30 08:37:48 [auto1.be] INFO: Found listing with ID: FE52220
2026-03-30 08:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE52220%27 HTTP/1.1" 200 None
2026-03-30 08:37:48 [auto1.be] INFO: Scrape type for FE52220: 0
2026-03-30 08:37:48 [auto1.be] INFO: Found listing with ID: MZ83142
2026-03-30 08:37:48 [auto1.be] INFO: Found listing with ID: YG62523
2026-03-30 08:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YG62523%27 HTTP/1.1" 200 None
2026-03-30 08:37:48 [auto1.be] INFO: Scrape type for YG62523: 0
2026-03-30 08:37:48 [auto1.be] INFO: Found listing with ID: CA72484
2026-03-30 08:37:48 [auto1.be] INFO: Found listing with ID: XK61886
2026-03-30 08:37:48 [auto1.be] INFO: Found listing with ID: VU61418
2026-03-30 08:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU61418%27 HTTP/1.1" 200 None
2026-03-30 08:37:48 [auto1.be] INFO: Scrape type for VU61418: 0
2026-03-30 08:37:48 [auto1.be] INFO: Found listing with ID: XC82229
2026-03-30 08:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC82229%27 HTTP/1.1" 200 None
2026-03-30 08:37:48 [auto1.be] INFO: Scrape type for XC82229: 0
2026-03-30 08:37:48 [auto1.be] INFO: Found listing with ID: ZF47475
2026-03-30 08:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF47475%27 HTTP/1.1" 200 None
2026-03-30 08:37:48 [auto1.be] INFO: Scrape type for ZF47475: 0
2026-03-30 08:37:48 [auto1.be] INFO: Found listing with ID: SD60477
2026-03-30 08:37:48 [auto1.be] INFO: Found listing with ID: PP48497
2026-03-30 08:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PP48497%27 HTTP/1.1" 200 None
2026-03-30 08:37:48 [auto1.be] INFO: Scrape type for PP48497: 0
2026-03-30 08:37:48 [auto1.be] INFO: Found listing with ID: YB47559
2026-03-30 08:37:48 [auto1.be] INFO: Found listing with ID: PT26763
2026-03-30 08:37:48 [auto1.be] INFO: Found listing with ID: PN18532
2026-03-30 08:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN18532%27 HTTP/1.1" 200 None
2026-03-30 08:37:48 [auto1.be] INFO: Scrape type for PN18532: 0
2026-03-30 08:37:48 [auto1.be] INFO: Found listing with ID: DH81993
2026-03-30 08:37:48 [auto1.be] INFO: Found listing with ID: VD09174
2026-03-30 08:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VD09174%27 HTTP/1.1" 200 None
2026-03-30 08:37:48 [auto1.be] INFO: Scrape type for VD09174: 0
2026-03-30 08:37:48 [auto1.be] INFO: Found listing with ID: FY33898
2026-03-30 08:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY33898%27 HTTP/1.1" 200 None
2026-03-30 08:37:48 [auto1.be] INFO: Scrape type for FY33898: 0
2026-03-30 08:37:48 [auto1.be] INFO: Found listing with ID: ST89131
2026-03-30 08:37:48 [auto1.be] INFO: Found listing with ID: TU68669
2026-03-30 08:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TU68669%27 HTTP/1.1" 200 None
2026-03-30 08:37:48 [auto1.be] INFO: Scrape type for TU68669: 0
2026-03-30 08:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:37:49 [auto1.be] INFO: Channel: 24h | Page: 17 | totalHits: 1502 | hits on page: 40
2026-03-30 08:37:49 [auto1.be] INFO: Found listing with ID: PC96861
2026-03-30 08:37:49 [auto1.be] INFO: Found listing with ID: PH64665
2026-03-30 08:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PH64665%27 HTTP/1.1" 200 None
2026-03-30 08:37:49 [auto1.be] INFO: Scrape type for PH64665: 0
2026-03-30 08:37:49 [auto1.be] INFO: Found listing with ID: RH07818
2026-03-30 08:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH07818%27 HTTP/1.1" 200 None
2026-03-30 08:37:49 [auto1.be] INFO: Scrape type for RH07818: 0
2026-03-30 08:37:49 [auto1.be] INFO: Found listing with ID: LT97220
2026-03-30 08:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT97220%27 HTTP/1.1" 200 None
2026-03-30 08:37:49 [auto1.be] INFO: Scrape type for LT97220: 0
2026-03-30 08:37:49 [auto1.be] INFO: Found listing with ID: ML35155
2026-03-30 08:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ML35155%27 HTTP/1.1" 200 None
2026-03-30 08:37:49 [auto1.be] INFO: Scrape type for ML35155: 0
2026-03-30 08:37:49 [auto1.be] INFO: Found listing with ID: UB84637
2026-03-30 08:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB84637%27 HTTP/1.1" 200 None
2026-03-30 08:37:49 [auto1.be] INFO: Scrape type for UB84637: 2
2026-03-30 08:37:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68da693b-5610-5786-addd-9fe7fcbc7473 with identifier: UB84637
2026-03-30 08:37:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68da693b-5610-5786-addd-9fe7fcbc7473 with scrape type 2
2026-03-30 08:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68da693b-5610-5786-addd-9fe7fcbc7473 with scrape type 2
2026-03-30 08:37:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 68da693b-5610-5786-addd-9fe7fcbc7473, identifier: UB84637
2026-03-30 08:37:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 68da693b-5610-5786-addd-9fe7fcbc7473 with identifier: UB84637
2026-03-30 08:37:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 68da693b-5610-5786-addd-9fe7fcbc7473 with identifier: UB84637
2026-03-30 08:37:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 68da693b-5610-5786-addd-9fe7fcbc7473 with identifier: UB84637 to the API
2026-03-30 08:37:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 174,
'expiration_date': '2026-03-30T15:15:58Z',
'fuel_type': 'diesel',
'id': '68da693b-5610-5786-addd-9fe7fcbc7473',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB84637',
'listing': 'auction',
'make': 'Opel',
'model': 'Insignia Grand Sport',
'odometer': 49845,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-21',
'seller_name': None,
'title': 'Opel Insignia Grand Sport 2.0 CDTI Ultimate',
'transmission': 'automatic',
'trim': 'Ultimate',
'year': 2021}
2026-03-30 08:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UB84637%27 HTTP/1.1" 200 None
2026-03-30 08:37:49 [auto1.be] INFO: Saving data for UB84637: {'auction_closing_time': 1774883758.0, 'created_time': 1774557581.440424, 'last_price_update_time': 1774859869.538009}
2026-03-30 08:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UB84637') HTTP/1.1" 204 0
2026-03-30 08:37:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:37:49 [auto1.be] INFO: Found listing with ID: YV36261
2026-03-30 08:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV36261%27 HTTP/1.1" 200 None
2026-03-30 08:37:49 [auto1.be] INFO: Scrape type for YV36261: 0
2026-03-30 08:37:49 [auto1.be] INFO: Found listing with ID: XJ82974
2026-03-30 08:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ82974%27 HTTP/1.1" 200 None
2026-03-30 08:37:49 [auto1.be] INFO: Scrape type for XJ82974: 2
2026-03-30 08:37:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1742d93-7462-576b-bc9f-40c1ddd0ac02 with identifier: XJ82974
2026-03-30 08:37:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1742d93-7462-576b-bc9f-40c1ddd0ac02 with scrape type 2
2026-03-30 08:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1742d93-7462-576b-bc9f-40c1ddd0ac02 with scrape type 2
2026-03-30 08:37:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d1742d93-7462-576b-bc9f-40c1ddd0ac02, identifier: XJ82974
2026-03-30 08:37:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d1742d93-7462-576b-bc9f-40c1ddd0ac02 with identifier: XJ82974
2026-03-30 08:37:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d1742d93-7462-576b-bc9f-40c1ddd0ac02 with identifier: XJ82974
2026-03-30 08:37:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d1742d93-7462-576b-bc9f-40c1ddd0ac02 with identifier: XJ82974 to the API
2026-03-30 08:37:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:33:38Z',
'fuel_type': 'petrol',
'id': 'd1742d93-7462-576b-bc9f-40c1ddd0ac02',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ82974',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 80186,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-27',
'seller_name': None,
'title': 'Peugeot 2008 1.2 PureTech Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2016}
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XJ82974%27 HTTP/1.1" 200 None
2026-03-30 08:37:50 [auto1.be] INFO: Saving data for XJ82974: {'auction_closing_time': 1774884818.0, 'created_time': 1774557500.710287, 'last_price_update_time': 1774859870.046134}
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XJ82974') HTTP/1.1" 204 0
2026-03-30 08:37:50 [auto1.be] INFO: Found listing with ID: MB19665
2026-03-30 08:37:50 [auto1.be] INFO: Found listing with ID: SJ78748
2026-03-30 08:37:50 [auto1.be] INFO: Found listing with ID: UM90025
2026-03-30 08:37:50 [auto1.be] INFO: Found listing with ID: NC04706
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC04706%27 HTTP/1.1" 200 None
2026-03-30 08:37:50 [auto1.be] INFO: Scrape type for NC04706: 0
2026-03-30 08:37:50 [auto1.be] INFO: Found listing with ID: CD06973
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD06973%27 HTTP/1.1" 200 None
2026-03-30 08:37:50 [auto1.be] INFO: Scrape type for CD06973: 0
2026-03-30 08:37:50 [auto1.be] INFO: Found listing with ID: LW74134
2026-03-30 08:37:50 [auto1.be] INFO: Found listing with ID: WE68493
2026-03-30 08:37:50 [auto1.be] INFO: Found listing with ID: AM54260
2026-03-30 08:37:50 [auto1.be] INFO: Found listing with ID: WP77061
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WP77061%27 HTTP/1.1" 200 None
2026-03-30 08:37:50 [auto1.be] INFO: Scrape type for WP77061: 0
2026-03-30 08:37:50 [auto1.be] INFO: Found listing with ID: TK93480
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK93480%27 HTTP/1.1" 200 None
2026-03-30 08:37:50 [auto1.be] INFO: Scrape type for TK93480: 0
2026-03-30 08:37:50 [auto1.be] INFO: Found listing with ID: ZJ47299
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ47299%27 HTTP/1.1" 200 None
2026-03-30 08:37:50 [auto1.be] INFO: Scrape type for ZJ47299: 0
2026-03-30 08:37:50 [auto1.be] INFO: Found listing with ID: JJ10339
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ10339%27 HTTP/1.1" 200 None
2026-03-30 08:37:50 [auto1.be] INFO: Scrape type for JJ10339: 0
2026-03-30 08:37:50 [auto1.be] INFO: Found listing with ID: KD31542
2026-03-30 08:37:50 [auto1.be] INFO: Found listing with ID: RW29034
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW29034%27 HTTP/1.1" 200 None
2026-03-30 08:37:50 [auto1.be] INFO: Scrape type for RW29034: 2
2026-03-30 08:37:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: deeb25f1-968c-59fd-a3b3-4e95be57668e with identifier: RW29034
2026-03-30 08:37:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item deeb25f1-968c-59fd-a3b3-4e95be57668e with scrape type 2
2026-03-30 08:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item deeb25f1-968c-59fd-a3b3-4e95be57668e with scrape type 2
2026-03-30 08:37:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: deeb25f1-968c-59fd-a3b3-4e95be57668e, identifier: RW29034
2026-03-30 08:37:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: deeb25f1-968c-59fd-a3b3-4e95be57668e with identifier: RW29034
2026-03-30 08:37:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: deeb25f1-968c-59fd-a3b3-4e95be57668e with identifier: RW29034
2026-03-30 08:37:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: deeb25f1-968c-59fd-a3b3-4e95be57668e with identifier: RW29034 to the API
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:52:04Z',
'fuel_type': 'diesel',
'id': 'deeb25f1-968c-59fd-a3b3-4e95be57668e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW29034',
'listing': 'auction',
'make': 'Fiat',
'model': 'Doblo',
'odometer': 33539,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-14',
'seller_name': None,
'title': 'Fiat Doblo 1.3 JTD Basis Kasten',
'transmission': 'manual',
'trim': 'Basis Kasten',
'year': 2011}
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW29034%27 HTTP/1.1" 200 None
2026-03-30 08:37:50 [auto1.be] INFO: Saving data for RW29034: {'auction_closing_time': 1774885924.0, 'created_time': 1774557528.288267, 'last_price_update_time': 1774859870.580323}
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RW29034') HTTP/1.1" 204 0
2026-03-30 08:37:50 [auto1.be] INFO: Found listing with ID: FV97066
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV97066%27 HTTP/1.1" 200 None
2026-03-30 08:37:50 [auto1.be] INFO: Scrape type for FV97066: 0
2026-03-30 08:37:50 [auto1.be] INFO: Found listing with ID: DW89258
2026-03-30 08:37:50 [auto1.be] INFO: Found listing with ID: RA68631
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA68631%27 HTTP/1.1" 200 None
2026-03-30 08:37:50 [auto1.be] INFO: Scrape type for RA68631: 0
2026-03-30 08:37:50 [auto1.be] INFO: Found listing with ID: AU32211
2026-03-30 08:37:50 [auto1.be] INFO: Found listing with ID: HA88594
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HA88594%27 HTTP/1.1" 200 None
2026-03-30 08:37:50 [auto1.be] INFO: Scrape type for HA88594: 0
2026-03-30 08:37:50 [auto1.be] INFO: Found listing with ID: DB63111
2026-03-30 08:37:50 [auto1.be] INFO: Found listing with ID: JZ16543
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ16543%27 HTTP/1.1" 200 None
2026-03-30 08:37:50 [auto1.be] INFO: Scrape type for JZ16543: 0
2026-03-30 08:37:50 [auto1.be] INFO: Found listing with ID: SX32022
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX32022%27 HTTP/1.1" 200 None
2026-03-30 08:37:50 [auto1.be] INFO: Scrape type for SX32022: 0
2026-03-30 08:37:50 [auto1.be] INFO: Found listing with ID: NP17382
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP17382%27 HTTP/1.1" 200 None
2026-03-30 08:37:50 [auto1.be] INFO: Scrape type for NP17382: 0
2026-03-30 08:37:50 [auto1.be] INFO: Found listing with ID: TF03002
2026-03-30 08:37:50 [auto1.be] INFO: Found listing with ID: KK24955
2026-03-30 08:37:50 [auto1.be] INFO: Found listing with ID: BA13225
2026-03-30 08:37:50 [auto1.be] INFO: Found listing with ID: TE72836
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TE72836%27 HTTP/1.1" 200 None
2026-03-30 08:37:50 [auto1.be] INFO: Scrape type for TE72836: 0
2026-03-30 08:37:50 [auto1.be] INFO: Found listing with ID: HY58683
2026-03-30 08:37:50 [auto1.be] INFO: Found listing with ID: ZJ76170
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ76170%27 HTTP/1.1" 200 None
2026-03-30 08:37:50 [auto1.be] INFO: Scrape type for ZJ76170: 0
2026-03-30 08:37:50 [auto1.be] INFO: Found listing with ID: XK75143
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XK75143%27 HTTP/1.1" 200 None
2026-03-30 08:37:50 [auto1.be] INFO: Scrape type for XK75143: 0
2026-03-30 08:37:50 [auto1.be] INFO: Found listing with ID: SS18683
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SS18683%27 HTTP/1.1" 200 None
2026-03-30 08:37:50 [auto1.be] INFO: Scrape type for SS18683: 0
2026-03-30 08:37:50 [auto1.be] INFO: Found listing with ID: XC12599
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC12599%27 HTTP/1.1" 200 None
2026-03-30 08:37:50 [auto1.be] INFO: Scrape type for XC12599: 0
2026-03-30 08:37:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:37:51 [auto1.be] INFO: Channel: 24h | Page: 18 | totalHits: 1502 | hits on page: 40
2026-03-30 08:37:51 [auto1.be] INFO: Found listing with ID: NP23299
2026-03-30 08:37:51 [auto1.be] INFO: Found listing with ID: UA98228
2026-03-30 08:37:51 [auto1.be] INFO: Found listing with ID: VT00410
2026-03-30 08:37:51 [auto1.be] INFO: Found listing with ID: ZH69808
2026-03-30 08:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZH69808%27 HTTP/1.1" 200 None
2026-03-30 08:37:51 [auto1.be] INFO: Scrape type for ZH69808: 0
2026-03-30 08:37:51 [auto1.be] INFO: Found listing with ID: WJ68976
2026-03-30 08:37:51 [auto1.be] INFO: Found listing with ID: TH19224
2026-03-30 08:37:51 [auto1.be] INFO: Found listing with ID: CS08088
2026-03-30 08:37:51 [auto1.be] INFO: Found listing with ID: XE73160
2026-03-30 08:37:51 [auto1.be] INFO: Found listing with ID: VH38978
2026-03-30 08:37:51 [auto1.be] INFO: Found listing with ID: DY96127
2026-03-30 08:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DY96127%27 HTTP/1.1" 200 None
2026-03-30 08:37:51 [auto1.be] INFO: Scrape type for DY96127: 0
2026-03-30 08:37:51 [auto1.be] INFO: Found listing with ID: HT10085
2026-03-30 08:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT10085%27 HTTP/1.1" 200 None
2026-03-30 08:37:51 [auto1.be] INFO: Scrape type for HT10085: 0
2026-03-30 08:37:51 [auto1.be] INFO: Found listing with ID: BB40778
2026-03-30 08:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB40778%27 HTTP/1.1" 200 None
2026-03-30 08:37:51 [auto1.be] INFO: Scrape type for BB40778: 0
2026-03-30 08:37:51 [auto1.be] INFO: Found listing with ID: DP96261
2026-03-30 08:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP96261%27 HTTP/1.1" 200 None
2026-03-30 08:37:51 [auto1.be] INFO: Scrape type for DP96261: 0
2026-03-30 08:37:51 [auto1.be] INFO: Found listing with ID: DK43204
2026-03-30 08:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK43204%27 HTTP/1.1" 200 None
2026-03-30 08:37:51 [auto1.be] INFO: Scrape type for DK43204: 0
2026-03-30 08:37:51 [auto1.be] INFO: Found listing with ID: WH41445
2026-03-30 08:37:51 [auto1.be] INFO: Found listing with ID: MD04738
2026-03-30 08:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MD04738%27 HTTP/1.1" 200 None
2026-03-30 08:37:51 [auto1.be] INFO: Scrape type for MD04738: 0
2026-03-30 08:37:51 [auto1.be] INFO: Found listing with ID: WG62431
2026-03-30 08:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG62431%27 HTTP/1.1" 200 None
2026-03-30 08:37:51 [auto1.be] INFO: Scrape type for WG62431: 0
2026-03-30 08:37:51 [auto1.be] INFO: Found listing with ID: CB86664
2026-03-30 08:37:51 [auto1.be] INFO: Found listing with ID: NW54949
2026-03-30 08:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NW54949%27 HTTP/1.1" 200 None
2026-03-30 08:37:51 [auto1.be] INFO: Scrape type for NW54949: 0
2026-03-30 08:37:51 [auto1.be] INFO: Found listing with ID: ZK51965
2026-03-30 08:37:51 [auto1.be] INFO: Found listing with ID: TT75307
2026-03-30 08:37:51 [auto1.be] INFO: Found listing with ID: EP09858
2026-03-30 08:37:51 [auto1.be] INFO: Found listing with ID: CW40114
2026-03-30 08:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CW40114%27 HTTP/1.1" 200 None
2026-03-30 08:37:51 [auto1.be] INFO: Scrape type for CW40114: 0
2026-03-30 08:37:51 [auto1.be] INFO: Found listing with ID: DH21315
2026-03-30 08:37:51 [auto1.be] INFO: Found listing with ID: EW63431
2026-03-30 08:37:51 [auto1.be] INFO: Found listing with ID: GH94077
2026-03-30 08:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH94077%27 HTTP/1.1" 200 None
2026-03-30 08:37:52 [auto1.be] INFO: Scrape type for GH94077: 0
2026-03-30 08:37:52 [auto1.be] INFO: Found listing with ID: RG44645
2026-03-30 08:37:52 [auto1.be] INFO: Found listing with ID: DS23322
2026-03-30 08:37:52 [auto1.be] INFO: Found listing with ID: LU38585
2026-03-30 08:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LU38585%27 HTTP/1.1" 200 None
2026-03-30 08:37:52 [auto1.be] INFO: Scrape type for LU38585: 0
2026-03-30 08:37:52 [auto1.be] INFO: Found listing with ID: GW63299
2026-03-30 08:37:52 [auto1.be] INFO: Found listing with ID: JF41683
2026-03-30 08:37:52 [auto1.be] INFO: Found listing with ID: GJ23391
2026-03-30 08:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GJ23391%27 HTTP/1.1" 200 None
2026-03-30 08:37:52 [auto1.be] INFO: Scrape type for GJ23391: 0
2026-03-30 08:37:52 [auto1.be] INFO: Found listing with ID: VM57702
2026-03-30 08:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM57702%27 HTTP/1.1" 200 None
2026-03-30 08:37:52 [auto1.be] INFO: Scrape type for VM57702: 0
2026-03-30 08:37:52 [auto1.be] INFO: Found listing with ID: FT96499
2026-03-30 08:37:52 [auto1.be] INFO: Found listing with ID: XR84470
2026-03-30 08:37:52 [auto1.be] INFO: Found listing with ID: FL46625
2026-03-30 08:37:52 [auto1.be] INFO: Found listing with ID: AX12673
2026-03-30 08:37:52 [auto1.be] INFO: Found listing with ID: JH02802
2026-03-30 08:37:52 [auto1.be] INFO: Found listing with ID: GF63829
2026-03-30 08:37:52 [auto1.be] INFO: Found listing with ID: KG19380
2026-03-30 08:37:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:37:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:37:53 [auto1.be] INFO: Channel: 24h | Page: 19 | totalHits: 1502 | hits on page: 40
2026-03-30 08:37:53 [auto1.be] INFO: Found listing with ID: HH24769
2026-03-30 08:37:53 [auto1.be] INFO: Found listing with ID: CA55783
2026-03-30 08:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA55783%27 HTTP/1.1" 200 None
2026-03-30 08:37:53 [auto1.be] INFO: Scrape type for CA55783: 2
2026-03-30 08:37:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b96d2813-0fc5-5472-9bd6-a85f0326fd17 with identifier: CA55783
2026-03-30 08:37:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b96d2813-0fc5-5472-9bd6-a85f0326fd17 with scrape type 2
2026-03-30 08:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b96d2813-0fc5-5472-9bd6-a85f0326fd17 with scrape type 2
2026-03-30 08:37:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b96d2813-0fc5-5472-9bd6-a85f0326fd17, identifier: CA55783
2026-03-30 08:37:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b96d2813-0fc5-5472-9bd6-a85f0326fd17 with identifier: CA55783
2026-03-30 08:37:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b96d2813-0fc5-5472-9bd6-a85f0326fd17 with identifier: CA55783
2026-03-30 08:37:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b96d2813-0fc5-5472-9bd6-a85f0326fd17 with identifier: CA55783 to the API
2026-03-30 08:37:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 130,
'expiration_date': '2026-03-30T15:22:46Z',
'fuel_type': 'petrol',
'id': 'b96d2813-0fc5-5472-9bd6-a85f0326fd17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA55783',
'listing': 'auction',
'make': 'Renault',
'model': 'Kadjar',
'odometer': 127030,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-23',
'seller_name': None,
'title': 'Renault Kadjar 1.2 TCe Energy Bose Edition',
'transmission': 'manual',
'trim': 'Bose Edition',
'year': 2018}
2026-03-30 08:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA55783%27 HTTP/1.1" 200 None
2026-03-30 08:37:53 [auto1.be] INFO: Saving data for CA55783: {'auction_closing_time': 1774884166.0, 'created_time': 1774557428.492931, 'last_price_update_time': 1774859873.434447}
2026-03-30 08:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CA55783') HTTP/1.1" 204 0
2026-03-30 08:37:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:37:53 [auto1.be] INFO: Found listing with ID: EP14144
2026-03-30 08:37:53 [auto1.be] INFO: Found listing with ID: HP74170
2026-03-30 08:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HP74170%27 HTTP/1.1" 200 None
2026-03-30 08:37:53 [auto1.be] INFO: Scrape type for HP74170: 0
2026-03-30 08:37:53 [auto1.be] INFO: Found listing with ID: EG14798
2026-03-30 08:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG14798%27 HTTP/1.1" 200 None
2026-03-30 08:37:53 [auto1.be] INFO: Scrape type for EG14798: 0
2026-03-30 08:37:53 [auto1.be] INFO: Found listing with ID: YN26679
2026-03-30 08:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YN26679%27 HTTP/1.1" 200 None
2026-03-30 08:37:53 [auto1.be] INFO: Scrape type for YN26679: 0
2026-03-30 08:37:53 [auto1.be] INFO: Found listing with ID: HX42019
2026-03-30 08:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX42019%27 HTTP/1.1" 200 None
2026-03-30 08:37:53 [auto1.be] INFO: Scrape type for HX42019: 0
2026-03-30 08:37:53 [auto1.be] INFO: Found listing with ID: JW58136
2026-03-30 08:37:53 [auto1.be] INFO: Found listing with ID: RM51088
2026-03-30 08:37:53 [auto1.be] INFO: Found listing with ID: KW38150
2026-03-30 08:37:53 [auto1.be] INFO: Found listing with ID: JC96921
2026-03-30 08:37:53 [auto1.be] INFO: Found listing with ID: SV05686
2026-03-30 08:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV05686%27 HTTP/1.1" 200 None
2026-03-30 08:37:53 [auto1.be] INFO: Scrape type for SV05686: 0
2026-03-30 08:37:53 [auto1.be] INFO: Found listing with ID: CS46874
2026-03-30 08:37:53 [auto1.be] INFO: Found listing with ID: GG55355
2026-03-30 08:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GG55355%27 HTTP/1.1" 200 None
2026-03-30 08:37:53 [auto1.be] INFO: Scrape type for GG55355: 0
2026-03-30 08:37:53 [auto1.be] INFO: Found listing with ID: TK63545
2026-03-30 08:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK63545%27 HTTP/1.1" 200 None
2026-03-30 08:37:53 [auto1.be] INFO: Scrape type for TK63545: 2
2026-03-30 08:37:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 681647e4-ce55-599e-a8ac-87af81fae583 with identifier: TK63545
2026-03-30 08:37:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 681647e4-ce55-599e-a8ac-87af81fae583 with scrape type 2
2026-03-30 08:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 681647e4-ce55-599e-a8ac-87af81fae583 with scrape type 2
2026-03-30 08:37:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 681647e4-ce55-599e-a8ac-87af81fae583, identifier: TK63545
2026-03-30 08:37:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 681647e4-ce55-599e-a8ac-87af81fae583 with identifier: TK63545
2026-03-30 08:37:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 681647e4-ce55-599e-a8ac-87af81fae583 with identifier: TK63545
2026-03-30 08:37:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 681647e4-ce55-599e-a8ac-87af81fae583 with identifier: TK63545 to the API
2026-03-30 08:37:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 85,
'expiration_date': '2026-03-30T15:59:32Z',
'fuel_type': 'diesel',
'id': '681647e4-ce55-599e-a8ac-87af81fae583',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK63545',
'listing': 'auction',
'make': 'Renault',
'model': 'Grand Modus',
'odometer': 49012,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-06-30',
'seller_name': None,
'title': 'Renault Grand Modus 1.5 dCi Lafuma',
'transmission': 'automatic',
'trim': 'Lafuma',
'year': 2010}
2026-03-30 08:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TK63545%27 HTTP/1.1" 200 None
2026-03-30 08:37:54 [auto1.be] INFO: Saving data for TK63545: {'auction_closing_time': 1774886372.0, 'created_time': 1774557507.935121, 'last_price_update_time': 1774859874.023329}
2026-03-30 08:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TK63545') HTTP/1.1" 204 0
2026-03-30 08:37:54 [auto1.be] INFO: Found listing with ID: MP28046
2026-03-30 08:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MP28046%27 HTTP/1.1" 200 None
2026-03-30 08:37:54 [auto1.be] INFO: Scrape type for MP28046: 0
2026-03-30 08:37:54 [auto1.be] INFO: Found listing with ID: HG61894
2026-03-30 08:37:54 [auto1.be] INFO: Found listing with ID: RB98158
2026-03-30 08:37:54 [auto1.be] INFO: Found listing with ID: WA78577
2026-03-30 08:37:54 [auto1.be] INFO: Found listing with ID: NP75657
2026-03-30 08:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP75657%27 HTTP/1.1" 200 None
2026-03-30 08:37:54 [auto1.be] INFO: Scrape type for NP75657: 0
2026-03-30 08:37:54 [auto1.be] INFO: Found listing with ID: BC49055
2026-03-30 08:37:54 [auto1.be] INFO: Found listing with ID: JJ27182
2026-03-30 08:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JJ27182%27 HTTP/1.1" 200 None
2026-03-30 08:37:54 [auto1.be] INFO: Scrape type for JJ27182: 0
2026-03-30 08:37:54 [auto1.be] INFO: Found listing with ID: EG19315
2026-03-30 08:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EG19315%27 HTTP/1.1" 200 None
2026-03-30 08:37:54 [auto1.be] INFO: Scrape type for EG19315: 0
2026-03-30 08:37:54 [auto1.be] INFO: Found listing with ID: KN88676
2026-03-30 08:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KN88676%27 HTTP/1.1" 200 None
2026-03-30 08:37:54 [auto1.be] INFO: Scrape type for KN88676: 0
2026-03-30 08:37:54 [auto1.be] INFO: Found listing with ID: CD53749
2026-03-30 08:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD53749%27 HTTP/1.1" 200 None
2026-03-30 08:37:54 [auto1.be] INFO: Scrape type for CD53749: 0
2026-03-30 08:37:54 [auto1.be] INFO: Found listing with ID: RX75304
2026-03-30 08:37:54 [auto1.be] INFO: Found listing with ID: DG02903
2026-03-30 08:37:54 [auto1.be] INFO: Found listing with ID: WU67286
2026-03-30 08:37:54 [auto1.be] INFO: Found listing with ID: LL08256
2026-03-30 08:37:54 [auto1.be] INFO: Found listing with ID: AV28567
2026-03-30 08:37:54 [auto1.be] INFO: Found listing with ID: CG84069
2026-03-30 08:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG84069%27 HTTP/1.1" 200 None
2026-03-30 08:37:54 [auto1.be] INFO: Scrape type for CG84069: 0
2026-03-30 08:37:54 [auto1.be] INFO: Found listing with ID: WB95668
2026-03-30 08:37:54 [auto1.be] INFO: Found listing with ID: FS62191
2026-03-30 08:37:54 [auto1.be] INFO: Found listing with ID: WU43595
2026-03-30 08:37:54 [auto1.be] INFO: Found listing with ID: HK81119
2026-03-30 08:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK81119%27 HTTP/1.1" 200 None
2026-03-30 08:37:54 [auto1.be] INFO: Scrape type for HK81119: 0
2026-03-30 08:37:54 [auto1.be] INFO: Found listing with ID: ZJ33794
2026-03-30 08:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZJ33794%27 HTTP/1.1" 200 None
2026-03-30 08:37:54 [auto1.be] INFO: Scrape type for ZJ33794: 0
2026-03-30 08:37:54 [auto1.be] INFO: Found listing with ID: VF88831
2026-03-30 08:37:54 [auto1.be] INFO: Found listing with ID: VK66376
2026-03-30 08:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VK66376%27 HTTP/1.1" 200 None
2026-03-30 08:37:54 [auto1.be] INFO: Scrape type for VK66376: 0
2026-03-30 08:37:54 [auto1.be] INFO: Found listing with ID: RA11008
2026-03-30 08:37:54 [auto1.be] INFO: Found listing with ID: KV01738
2026-03-30 08:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KV01738%27 HTTP/1.1" 200 None
2026-03-30 08:37:54 [auto1.be] INFO: Scrape type for KV01738: 0
2026-03-30 08:37:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:37:55 [auto1.be] INFO: Channel: 24h | Page: 20 | totalHits: 1502 | hits on page: 40
2026-03-30 08:37:55 [auto1.be] INFO: Found listing with ID: EE45657
2026-03-30 08:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EE45657%27 HTTP/1.1" 200 None
2026-03-30 08:37:55 [auto1.be] INFO: Scrape type for EE45657: 2
2026-03-30 08:37:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1adca9e0-0bbf-5cb5-9425-dd1ea75e826c with identifier: EE45657
2026-03-30 08:37:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1adca9e0-0bbf-5cb5-9425-dd1ea75e826c with scrape type 2
2026-03-30 08:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1adca9e0-0bbf-5cb5-9425-dd1ea75e826c with scrape type 2
2026-03-30 08:37:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 1adca9e0-0bbf-5cb5-9425-dd1ea75e826c, identifier: EE45657
2026-03-30 08:37:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 1adca9e0-0bbf-5cb5-9425-dd1ea75e826c with identifier: EE45657
2026-03-30 08:37:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 1adca9e0-0bbf-5cb5-9425-dd1ea75e826c with identifier: EE45657
2026-03-30 08:37:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 1adca9e0-0bbf-5cb5-9425-dd1ea75e826c with identifier: EE45657 to the API
2026-03-30 08:37:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:46:36Z',
'fuel_type': 'diesel',
'id': '1adca9e0-0bbf-5cb5-9425-dd1ea75e826c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE45657',
'listing': 'auction',
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 138780,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-14',
'seller_name': None,
'title': 'Land Rover Evoque 2.0 ed4 Pure',
'transmission': 'manual',
'trim': 'Pure',
'year': 2015}
2026-03-30 08:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EE45657%27 HTTP/1.1" 200 None
2026-03-30 08:37:55 [auto1.be] INFO: Saving data for EE45657: {'auction_closing_time': 1774885596.0, 'created_time': 1774557522.339571, 'last_price_update_time': 1774859875.787603}
2026-03-30 08:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EE45657') HTTP/1.1" 204 0
2026-03-30 08:37:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:37:55 [auto1.be] INFO: Found listing with ID: PS61885
2026-03-30 08:37:55 [auto1.be] INFO: Found listing with ID: UW52037
2026-03-30 08:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW52037%27 HTTP/1.1" 200 None
2026-03-30 08:37:55 [auto1.be] INFO: Scrape type for UW52037: 0
2026-03-30 08:37:55 [auto1.be] INFO: Found listing with ID: YW15851
2026-03-30 08:37:55 [auto1.be] INFO: Found listing with ID: NS97708
2026-03-30 08:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NS97708%27 HTTP/1.1" 200 None
2026-03-30 08:37:55 [auto1.be] INFO: Scrape type for NS97708: 0
2026-03-30 08:37:55 [auto1.be] INFO: Found listing with ID: MB15455
2026-03-30 08:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MB15455%27 HTTP/1.1" 200 None
2026-03-30 08:37:55 [auto1.be] INFO: Scrape type for MB15455: 0
2026-03-30 08:37:55 [auto1.be] INFO: Found listing with ID: RY14212
2026-03-30 08:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY14212%27 HTTP/1.1" 200 None
2026-03-30 08:37:55 [auto1.be] INFO: Scrape type for RY14212: 0
2026-03-30 08:37:55 [auto1.be] INFO: Found listing with ID: PB96026
2026-03-30 08:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PB96026%27 HTTP/1.1" 200 None
2026-03-30 08:37:55 [auto1.be] INFO: Scrape type for PB96026: 0
2026-03-30 08:37:55 [auto1.be] INFO: Found listing with ID: EL33380
2026-03-30 08:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EL33380%27 HTTP/1.1" 200 None
2026-03-30 08:37:56 [auto1.be] INFO: Scrape type for EL33380: 0
2026-03-30 08:37:56 [auto1.be] INFO: Found listing with ID: UH14890
2026-03-30 08:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UH14890%27 HTTP/1.1" 200 None
2026-03-30 08:37:56 [auto1.be] INFO: Scrape type for UH14890: 0
2026-03-30 08:37:56 [auto1.be] INFO: Found listing with ID: YK73361
2026-03-30 08:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK73361%27 HTTP/1.1" 200 None
2026-03-30 08:37:56 [auto1.be] INFO: Scrape type for YK73361: 0
2026-03-30 08:37:56 [auto1.be] INFO: Found listing with ID: FF99790
2026-03-30 08:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FF99790%27 HTTP/1.1" 200 None
2026-03-30 08:37:56 [auto1.be] INFO: Scrape type for FF99790: 0
2026-03-30 08:37:56 [auto1.be] INFO: Found listing with ID: DP88518
2026-03-30 08:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DP88518%27 HTTP/1.1" 200 None
2026-03-30 08:37:56 [auto1.be] INFO: Scrape type for DP88518: 0
2026-03-30 08:37:56 [auto1.be] INFO: Found listing with ID: XL26167
2026-03-30 08:37:56 [auto1.be] INFO: Found listing with ID: YJ00240
2026-03-30 08:37:56 [auto1.be] INFO: Found listing with ID: NB09051
2026-03-30 08:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB09051%27 HTTP/1.1" 200 None
2026-03-30 08:37:56 [auto1.be] INFO: Scrape type for NB09051: 0
2026-03-30 08:37:56 [auto1.be] INFO: Found listing with ID: GF65026
2026-03-30 08:37:56 [auto1.be] INFO: Found listing with ID: HS49836
2026-03-30 08:37:56 [auto1.be] INFO: Found listing with ID: CU87114
2026-03-30 08:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU87114%27 HTTP/1.1" 200 None
2026-03-30 08:37:56 [auto1.be] INFO: Scrape type for CU87114: 0
2026-03-30 08:37:56 [auto1.be] INFO: Found listing with ID: UX15937
2026-03-30 08:37:56 [auto1.be] INFO: Found listing with ID: RU19747
2026-03-30 08:37:56 [auto1.be] INFO: Found listing with ID: BV41613
2026-03-30 08:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV41613%27 HTTP/1.1" 200 None
2026-03-30 08:37:56 [auto1.be] INFO: Scrape type for BV41613: 0
2026-03-30 08:37:56 [auto1.be] INFO: Found listing with ID: ZS27075
2026-03-30 08:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZS27075%27 HTTP/1.1" 200 None
2026-03-30 08:37:56 [auto1.be] INFO: Scrape type for ZS27075: 0
2026-03-30 08:37:56 [auto1.be] INFO: Found listing with ID: UA67521
2026-03-30 08:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA67521%27 HTTP/1.1" 200 None
2026-03-30 08:37:56 [auto1.be] INFO: Scrape type for UA67521: 2
2026-03-30 08:37:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d784d92e-8b86-579c-9fd5-fe2688df45fa with identifier: UA67521
2026-03-30 08:37:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d784d92e-8b86-579c-9fd5-fe2688df45fa with scrape type 2
2026-03-30 08:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d784d92e-8b86-579c-9fd5-fe2688df45fa with scrape type 2
2026-03-30 08:37:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: d784d92e-8b86-579c-9fd5-fe2688df45fa, identifier: UA67521
2026-03-30 08:37:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: d784d92e-8b86-579c-9fd5-fe2688df45fa with identifier: UA67521
2026-03-30 08:37:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: d784d92e-8b86-579c-9fd5-fe2688df45fa with identifier: UA67521
2026-03-30 08:37:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: d784d92e-8b86-579c-9fd5-fe2688df45fa with identifier: UA67521 to the API
2026-03-30 08:37:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 114,
'expiration_date': '2026-03-30T15:40:28Z',
'fuel_type': 'petrol',
'id': 'd784d92e-8b86-579c-9fd5-fe2688df45fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA67521',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Caddy',
'odometer': 14527,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-26',
'seller_name': None,
'title': 'Volkswagen Caddy 1.5 TSI',
'transmission': 'manual',
'trim': '',
'year': 2023}
2026-03-30 08:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA67521%27 HTTP/1.1" 200 None
2026-03-30 08:37:56 [auto1.be] INFO: Saving data for UA67521: {'auction_closing_time': 1774885228.0, 'created_time': 1774557565.107562, 'last_price_update_time': 1774859876.533754}
2026-03-30 08:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UA67521') HTTP/1.1" 204 0
2026-03-30 08:37:56 [auto1.be] INFO: Found listing with ID: CS20047
2026-03-30 08:37:56 [auto1.be] INFO: Found listing with ID: MK30308
2026-03-30 08:37:56 [auto1.be] INFO: Found listing with ID: YA85838
2026-03-30 08:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA85838%27 HTTP/1.1" 200 None
2026-03-30 08:37:56 [auto1.be] INFO: Scrape type for YA85838: 0
2026-03-30 08:37:56 [auto1.be] INFO: Found listing with ID: FA61625
2026-03-30 08:37:56 [auto1.be] INFO: Found listing with ID: RL24593
2026-03-30 08:37:56 [auto1.be] INFO: Found listing with ID: PJ20685
2026-03-30 08:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ20685%27 HTTP/1.1" 200 None
2026-03-30 08:37:56 [auto1.be] INFO: Scrape type for PJ20685: 0
2026-03-30 08:37:56 [auto1.be] INFO: Found listing with ID: XV14848
2026-03-30 08:37:56 [auto1.be] INFO: Found listing with ID: DY20434
2026-03-30 08:37:56 [auto1.be] INFO: Found listing with ID: CH15764
2026-03-30 08:37:56 [auto1.be] INFO: Found listing with ID: HY35953
2026-03-30 08:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY35953%27 HTTP/1.1" 200 None
2026-03-30 08:37:56 [auto1.be] INFO: Scrape type for HY35953: 2
2026-03-30 08:37:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f1ea3d3-760e-53b2-a424-c38729b313d2 with identifier: HY35953
2026-03-30 08:37:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f1ea3d3-760e-53b2-a424-c38729b313d2 with scrape type 2
2026-03-30 08:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f1ea3d3-760e-53b2-a424-c38729b313d2 with scrape type 2
2026-03-30 08:37:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 5f1ea3d3-760e-53b2-a424-c38729b313d2, identifier: HY35953
2026-03-30 08:37:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 5f1ea3d3-760e-53b2-a424-c38729b313d2 with identifier: HY35953
2026-03-30 08:37:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 5f1ea3d3-760e-53b2-a424-c38729b313d2 with identifier: HY35953
2026-03-30 08:37:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 5f1ea3d3-760e-53b2-a424-c38729b313d2 with identifier: HY35953 to the API
2026-03-30 08:37:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 95,
'expiration_date': '2026-03-30T15:09:52Z',
'fuel_type': 'petrol',
'id': '5f1ea3d3-760e-53b2-a424-c38729b313d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY35953',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'B-Klasse',
'odometer': 174399,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-04-13',
'seller_name': None,
'title': 'Mercedes-Benz B-Klasse B 160',
'transmission': 'manual',
'trim': '',
'year': 2010}
2026-03-30 08:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY35953%27 HTTP/1.1" 200 None
2026-03-30 08:37:57 [auto1.be] INFO: Saving data for HY35953: {'auction_closing_time': 1774883392.0, 'created_time': 1774557579.471235, 'last_price_update_time': 1774859877.263221}
2026-03-30 08:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HY35953') HTTP/1.1" 204 0
2026-03-30 08:37:57 [auto1.be] INFO: Found listing with ID: AX58227
2026-03-30 08:37:57 [auto1.be] INFO: Found listing with ID: HM69306
2026-03-30 08:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM69306%27 HTTP/1.1" 200 None
2026-03-30 08:37:57 [auto1.be] INFO: Scrape type for HM69306: 0
2026-03-30 08:37:57 [auto1.be] INFO: Found listing with ID: GG92230
2026-03-30 08:37:57 [auto1.be] INFO: Found listing with ID: XC97675
2026-03-30 08:37:57 [auto1.be] INFO: Found listing with ID: LE04651
2026-03-30 08:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE04651%27 HTTP/1.1" 200 None
2026-03-30 08:37:57 [auto1.be] INFO: Scrape type for LE04651: 0
2026-03-30 08:37:57 [auto1.be] INFO: Found listing with ID: XZ27909
2026-03-30 08:37:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:37:58 [auto1.be] INFO: Channel: 24h | Page: 21 | totalHits: 1502 | hits on page: 40
2026-03-30 08:37:58 [auto1.be] INFO: Found listing with ID: CV26650
2026-03-30 08:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CV26650%27 HTTP/1.1" 200 None
2026-03-30 08:37:58 [auto1.be] INFO: Scrape type for CV26650: 0
2026-03-30 08:37:58 [auto1.be] INFO: Found listing with ID: XH41981
2026-03-30 08:37:58 [auto1.be] INFO: Found listing with ID: SV23823
2026-03-30 08:37:58 [auto1.be] INFO: Found listing with ID: HW65369
2026-03-30 08:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HW65369%27 HTTP/1.1" 200 None
2026-03-30 08:37:58 [auto1.be] INFO: Scrape type for HW65369: 0
2026-03-30 08:37:58 [auto1.be] INFO: Found listing with ID: YC48670
2026-03-30 08:37:58 [auto1.be] INFO: Found listing with ID: MK11042
2026-03-30 08:37:58 [auto1.be] INFO: Found listing with ID: SZ23077
2026-03-30 08:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ23077%27 HTTP/1.1" 200 None
2026-03-30 08:37:58 [auto1.be] INFO: Scrape type for SZ23077: 2
2026-03-30 08:37:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96a43030-c3fb-5bec-8db5-534207806117 with identifier: SZ23077
2026-03-30 08:37:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96a43030-c3fb-5bec-8db5-534207806117 with scrape type 2
2026-03-30 08:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96a43030-c3fb-5bec-8db5-534207806117 with scrape type 2
2026-03-30 08:37:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 96a43030-c3fb-5bec-8db5-534207806117, identifier: SZ23077
2026-03-30 08:37:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 96a43030-c3fb-5bec-8db5-534207806117 with identifier: SZ23077
2026-03-30 08:37:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 96a43030-c3fb-5bec-8db5-534207806117 with identifier: SZ23077
2026-03-30 08:37:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 96a43030-c3fb-5bec-8db5-534207806117 with identifier: SZ23077 to the API
2026-03-30 08:37:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:37:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:37:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 136,
'expiration_date': '2026-03-30T15:46:00Z',
'fuel_type': 'petrol',
'id': '96a43030-c3fb-5bec-8db5-534207806117',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ23077',
'listing': 'auction',
'make': 'BMW',
'model': '2er',
'odometer': 137354,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-05',
'seller_name': None,
'title': 'BMW 2er 218i Gran Coupe Advantage',
'transmission': 'automatic',
'trim': 'Advantage',
'year': 2021}
2026-03-30 08:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SZ23077%27 HTTP/1.1" 200 None
2026-03-30 08:37:59 [auto1.be] INFO: Saving data for SZ23077: {'auction_closing_time': 1774885560.0, 'created_time': 1774557494.015964, 'last_price_update_time': 1774859879.637244}
2026-03-30 08:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SZ23077') HTTP/1.1" 204 0
2026-03-30 08:37:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:37:59 [auto1.be] INFO: Found listing with ID: TS47815
2026-03-30 08:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS47815%27 HTTP/1.1" 200 None
2026-03-30 08:37:59 [auto1.be] INFO: Scrape type for TS47815: 0
2026-03-30 08:37:59 [auto1.be] INFO: Found listing with ID: RU10603
2026-03-30 08:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU10603%27 HTTP/1.1" 200 None
2026-03-30 08:37:59 [auto1.be] INFO: Scrape type for RU10603: 0
2026-03-30 08:37:59 [auto1.be] INFO: Found listing with ID: AX51995
2026-03-30 08:37:59 [auto1.be] INFO: Found listing with ID: SX30605
2026-03-30 08:37:59 [auto1.be] INFO: Found listing with ID: KW80684
2026-03-30 08:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW80684%27 HTTP/1.1" 200 None
2026-03-30 08:37:59 [auto1.be] INFO: Scrape type for KW80684: 0
2026-03-30 08:37:59 [auto1.be] INFO: Found listing with ID: LF90651
2026-03-30 08:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF90651%27 HTTP/1.1" 200 None
2026-03-30 08:37:59 [auto1.be] INFO: Scrape type for LF90651: 0
2026-03-30 08:37:59 [auto1.be] INFO: Found listing with ID: ZJ26609
2026-03-30 08:37:59 [auto1.be] INFO: Found listing with ID: TH79553
2026-03-30 08:37:59 [auto1.be] INFO: Found listing with ID: BV36868
2026-03-30 08:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV36868%27 HTTP/1.1" 200 None
2026-03-30 08:37:59 [auto1.be] INFO: Scrape type for BV36868: 0
2026-03-30 08:37:59 [auto1.be] INFO: Found listing with ID: EK41744
2026-03-30 08:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK41744%27 HTTP/1.1" 200 None
2026-03-30 08:37:59 [auto1.be] INFO: Scrape type for EK41744: 0
2026-03-30 08:37:59 [auto1.be] INFO: Found listing with ID: JB98140
2026-03-30 08:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JB98140%27 HTTP/1.1" 200 None
2026-03-30 08:37:59 [auto1.be] INFO: Scrape type for JB98140: 0
2026-03-30 08:37:59 [auto1.be] INFO: Found listing with ID: ED70069
2026-03-30 08:37:59 [auto1.be] INFO: Found listing with ID: RM32931
2026-03-30 08:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RM32931%27 HTTP/1.1" 200 None
2026-03-30 08:37:59 [auto1.be] INFO: Scrape type for RM32931: 0
2026-03-30 08:37:59 [auto1.be] INFO: Found listing with ID: SK81997
2026-03-30 08:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SK81997%27 HTTP/1.1" 200 None
2026-03-30 08:37:59 [auto1.be] INFO: Scrape type for SK81997: 0
2026-03-30 08:37:59 [auto1.be] INFO: Found listing with ID: XE15288
2026-03-30 08:37:59 [auto1.be] INFO: Found listing with ID: PJ31589
2026-03-30 08:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ31589%27 HTTP/1.1" 200 None
2026-03-30 08:37:59 [auto1.be] INFO: Scrape type for PJ31589: 0
2026-03-30 08:37:59 [auto1.be] INFO: Found listing with ID: MN41841
2026-03-30 08:37:59 [auto1.be] INFO: Found listing with ID: TV22564
2026-03-30 08:37:59 [auto1.be] INFO: Found listing with ID: UF59925
2026-03-30 08:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF59925%27 HTTP/1.1" 200 None
2026-03-30 08:37:59 [auto1.be] INFO: Scrape type for UF59925: 0
2026-03-30 08:37:59 [auto1.be] INFO: Found listing with ID: UA82763
2026-03-30 08:37:59 [auto1.be] INFO: Found listing with ID: YX48939
2026-03-30 08:37:59 [auto1.be] INFO: Found listing with ID: RA81540
2026-03-30 08:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA81540%27 HTTP/1.1" 200 None
2026-03-30 08:37:59 [auto1.be] INFO: Scrape type for RA81540: 0
2026-03-30 08:37:59 [auto1.be] INFO: Found listing with ID: LW38679
2026-03-30 08:37:59 [auto1.be] INFO: Found listing with ID: RW15578
2026-03-30 08:37:59 [auto1.be] INFO: Found listing with ID: WG20951
2026-03-30 08:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG20951%27 HTTP/1.1" 200 None
2026-03-30 08:37:59 [auto1.be] INFO: Scrape type for WG20951: 2
2026-03-30 08:37:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18e3f3b6-e72f-5ee3-99d7-0aef4708b08d with identifier: WG20951
2026-03-30 08:37:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18e3f3b6-e72f-5ee3-99d7-0aef4708b08d with scrape type 2
2026-03-30 08:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18e3f3b6-e72f-5ee3-99d7-0aef4708b08d with scrape type 2
2026-03-30 08:38:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 18e3f3b6-e72f-5ee3-99d7-0aef4708b08d, identifier: WG20951
2026-03-30 08:38:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 18e3f3b6-e72f-5ee3-99d7-0aef4708b08d with identifier: WG20951
2026-03-30 08:38:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 18e3f3b6-e72f-5ee3-99d7-0aef4708b08d with identifier: WG20951
2026-03-30 08:38:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 18e3f3b6-e72f-5ee3-99d7-0aef4708b08d with identifier: WG20951 to the API
2026-03-30 08:38:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:38:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:38:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:29:53Z',
'fuel_type': 'diesel',
'id': '18e3f3b6-e72f-5ee3-99d7-0aef4708b08d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG20951',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 94341,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-22',
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 d AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2020}
2026-03-30 08:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG20951%27 HTTP/1.1" 200 None
2026-03-30 08:38:00 [auto1.be] INFO: Saving data for WG20951: {'auction_closing_time': 1774884593.0, 'created_time': 1774557537.788328, 'last_price_update_time': 1774859880.417042}
2026-03-30 08:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WG20951') HTTP/1.1" 204 0
2026-03-30 08:38:00 [auto1.be] INFO: Found listing with ID: UW21644
2026-03-30 08:38:00 [auto1.be] INFO: Found listing with ID: AG87445
2026-03-30 08:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG87445%27 HTTP/1.1" 200 None
2026-03-30 08:38:00 [auto1.be] INFO: Scrape type for AG87445: 0
2026-03-30 08:38:00 [auto1.be] INFO: Found listing with ID: LX45606
2026-03-30 08:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LX45606%27 HTTP/1.1" 200 None
2026-03-30 08:38:00 [auto1.be] INFO: Scrape type for LX45606: 0
2026-03-30 08:38:00 [auto1.be] INFO: Found listing with ID: DE21401
2026-03-30 08:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE21401%27 HTTP/1.1" 200 None
2026-03-30 08:38:00 [auto1.be] INFO: Scrape type for DE21401: 0
2026-03-30 08:38:00 [auto1.be] INFO: Found listing with ID: MJ77172
2026-03-30 08:38:00 [auto1.be] INFO: Found listing with ID: RK68346
2026-03-30 08:38:00 [auto1.be] INFO: Found listing with ID: VE52917
2026-03-30 08:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VE52917%27 HTTP/1.1" 200 None
2026-03-30 08:38:00 [auto1.be] INFO: Scrape type for VE52917: 0
2026-03-30 08:38:00 [auto1.be] INFO: Found listing with ID: GC03502
2026-03-30 08:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GC03502%27 HTTP/1.1" 200 None
2026-03-30 08:38:00 [auto1.be] INFO: Scrape type for GC03502: 0
2026-03-30 08:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:38:01 [auto1.be] INFO: Channel: 24h | Page: 22 | totalHits: 1502 | hits on page: 40
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: JX04101
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: YA14339
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YA14339%27 HTTP/1.1" 200 None
2026-03-30 08:38:01 [auto1.be] INFO: Scrape type for YA14339: 0
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: SD15124
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: RR03336
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: JZ92177
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ92177%27 HTTP/1.1" 200 None
2026-03-30 08:38:01 [auto1.be] INFO: Scrape type for JZ92177: 0
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: PF95077
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: WE56106
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: BC32945
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC32945%27 HTTP/1.1" 200 None
2026-03-30 08:38:01 [auto1.be] INFO: Scrape type for BC32945: 0
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: NB71425
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NB71425%27 HTTP/1.1" 200 None
2026-03-30 08:38:01 [auto1.be] INFO: Scrape type for NB71425: 0
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: HJ67440
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HJ67440%27 HTTP/1.1" 200 None
2026-03-30 08:38:01 [auto1.be] INFO: Scrape type for HJ67440: 0
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: SF89359
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SF89359%27 HTTP/1.1" 200 None
2026-03-30 08:38:01 [auto1.be] INFO: Scrape type for SF89359: 0
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: EF70909
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EF70909%27 HTTP/1.1" 200 None
2026-03-30 08:38:01 [auto1.be] INFO: Scrape type for EF70909: 0
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: PN62826
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PN62826%27 HTTP/1.1" 200 None
2026-03-30 08:38:01 [auto1.be] INFO: Scrape type for PN62826: 0
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: ZP07177
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: FC28046
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: FP68376
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: VL69873
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VL69873%27 HTTP/1.1" 200 None
2026-03-30 08:38:01 [auto1.be] INFO: Scrape type for VL69873: 0
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: FR21473
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR21473%27 HTTP/1.1" 200 None
2026-03-30 08:38:01 [auto1.be] INFO: Scrape type for FR21473: 0
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: FK29667
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK29667%27 HTTP/1.1" 200 None
2026-03-30 08:38:01 [auto1.be] INFO: Scrape type for FK29667: 0
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: AF71611
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: AV34296
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AV34296%27 HTTP/1.1" 200 None
2026-03-30 08:38:01 [auto1.be] INFO: Scrape type for AV34296: 0
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: FG88533
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: ET09366
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: SB45161
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB45161%27 HTTP/1.1" 200 None
2026-03-30 08:38:01 [auto1.be] INFO: Scrape type for SB45161: 0
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: YF28674
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YF28674%27 HTTP/1.1" 200 None
2026-03-30 08:38:01 [auto1.be] INFO: Scrape type for YF28674: 0
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: SR34780
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: NK56969
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK56969%27 HTTP/1.1" 200 None
2026-03-30 08:38:01 [auto1.be] INFO: Scrape type for NK56969: 0
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: MT09894
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MT09894%27 HTTP/1.1" 200 None
2026-03-30 08:38:01 [auto1.be] INFO: Scrape type for MT09894: 0
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: ZF81780
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF81780%27 HTTP/1.1" 200 None
2026-03-30 08:38:01 [auto1.be] INFO: Scrape type for ZF81780: 0
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: JZ88652
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: WB76864
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WB76864%27 HTTP/1.1" 200 None
2026-03-30 08:38:01 [auto1.be] INFO: Scrape type for WB76864: 0
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: UV91092
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: JX62848
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: BS55977
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS55977%27 HTTP/1.1" 200 None
2026-03-30 08:38:01 [auto1.be] INFO: Scrape type for BS55977: 0
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: ET18736
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET18736%27 HTTP/1.1" 200 None
2026-03-30 08:38:01 [auto1.be] INFO: Scrape type for ET18736: 0
2026-03-30 08:38:01 [auto1.be] INFO: Found listing with ID: MA69424
2026-03-30 08:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MA69424%27 HTTP/1.1" 200 None
2026-03-30 08:38:02 [auto1.be] INFO: Scrape type for MA69424: 0
2026-03-30 08:38:02 [auto1.be] INFO: Found listing with ID: VW08902
2026-03-30 08:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW08902%27 HTTP/1.1" 200 None
2026-03-30 08:38:02 [auto1.be] INFO: Scrape type for VW08902: 0
2026-03-30 08:38:02 [auto1.be] INFO: Found listing with ID: ZR45530
2026-03-30 08:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR45530%27 HTTP/1.1" 200 None
2026-03-30 08:38:02 [auto1.be] INFO: Scrape type for ZR45530: 0
2026-03-30 08:38:02 [auto1.be] INFO: Found listing with ID: FS38787
2026-03-30 08:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FS38787%27 HTTP/1.1" 200 None
2026-03-30 08:38:02 [auto1.be] INFO: Scrape type for FS38787: 0
2026-03-30 08:38:02 [auto1.be] INFO: Found listing with ID: HT09098
2026-03-30 08:38:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:38:03 [auto1.be] INFO: Channel: 24h | Page: 23 | totalHits: 1502 | hits on page: 40
2026-03-30 08:38:03 [auto1.be] INFO: Found listing with ID: KP16038
2026-03-30 08:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KP16038%27 HTTP/1.1" 200 None
2026-03-30 08:38:03 [auto1.be] INFO: Scrape type for KP16038: 0
2026-03-30 08:38:03 [auto1.be] INFO: Found listing with ID: KC19835
2026-03-30 08:38:03 [auto1.be] INFO: Found listing with ID: VU16052
2026-03-30 08:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VU16052%27 HTTP/1.1" 200 None
2026-03-30 08:38:03 [auto1.be] INFO: Scrape type for VU16052: 0
2026-03-30 08:38:03 [auto1.be] INFO: Found listing with ID: HM47736
2026-03-30 08:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HM47736%27 HTTP/1.1" 200 None
2026-03-30 08:38:03 [auto1.be] INFO: Scrape type for HM47736: 0
2026-03-30 08:38:03 [auto1.be] INFO: Found listing with ID: GF03232
2026-03-30 08:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF03232%27 HTTP/1.1" 200 None
2026-03-30 08:38:03 [auto1.be] INFO: Scrape type for GF03232: 0
2026-03-30 08:38:03 [auto1.be] INFO: Found listing with ID: UC56570
2026-03-30 08:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC56570%27 HTTP/1.1" 200 None
2026-03-30 08:38:03 [auto1.be] INFO: Scrape type for UC56570: 0
2026-03-30 08:38:03 [auto1.be] INFO: Found listing with ID: NN67810
2026-03-30 08:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN67810%27 HTTP/1.1" 200 None
2026-03-30 08:38:03 [auto1.be] INFO: Scrape type for NN67810: 0
2026-03-30 08:38:03 [auto1.be] INFO: Found listing with ID: ZM54686
2026-03-30 08:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZM54686%27 HTTP/1.1" 200 None
2026-03-30 08:38:03 [auto1.be] INFO: Scrape type for ZM54686: 0
2026-03-30 08:38:03 [auto1.be] INFO: Found listing with ID: FE88671
2026-03-30 08:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE88671%27 HTTP/1.1" 200 None
2026-03-30 08:38:03 [auto1.be] INFO: Scrape type for FE88671: 0
2026-03-30 08:38:03 [auto1.be] INFO: Found listing with ID: GR78986
2026-03-30 08:38:03 [auto1.be] INFO: Found listing with ID: CP42003
2026-03-30 08:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP42003%27 HTTP/1.1" 200 None
2026-03-30 08:38:03 [auto1.be] INFO: Scrape type for CP42003: 0
2026-03-30 08:38:03 [auto1.be] INFO: Found listing with ID: RN56335
2026-03-30 08:38:03 [auto1.be] INFO: Found listing with ID: RF80171
2026-03-30 08:38:03 [auto1.be] INFO: Found listing with ID: ZF78419
2026-03-30 08:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZF78419%27 HTTP/1.1" 200 None
2026-03-30 08:38:03 [auto1.be] INFO: Scrape type for ZF78419: 0
2026-03-30 08:38:03 [auto1.be] INFO: Found listing with ID: DT24627
2026-03-30 08:38:03 [auto1.be] INFO: Found listing with ID: YM99739
2026-03-30 08:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YM99739%27 HTTP/1.1" 200 None
2026-03-30 08:38:03 [auto1.be] INFO: Scrape type for YM99739: 0
2026-03-30 08:38:03 [auto1.be] INFO: Found listing with ID: CH83928
2026-03-30 08:38:03 [auto1.be] INFO: Found listing with ID: BC69430
2026-03-30 08:38:03 [auto1.be] INFO: Found listing with ID: BU90061
2026-03-30 08:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU90061%27 HTTP/1.1" 200 None
2026-03-30 08:38:03 [auto1.be] INFO: Scrape type for BU90061: 0
2026-03-30 08:38:03 [auto1.be] INFO: Found listing with ID: EV01420
2026-03-30 08:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV01420%27 HTTP/1.1" 200 None
2026-03-30 08:38:03 [auto1.be] INFO: Scrape type for EV01420: 2
2026-03-30 08:38:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5c5eadd-3797-54fb-a3b8-7ec3624c6765 with identifier: EV01420
2026-03-30 08:38:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5c5eadd-3797-54fb-a3b8-7ec3624c6765 with scrape type 2
2026-03-30 08:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5c5eadd-3797-54fb-a3b8-7ec3624c6765 with scrape type 2
2026-03-30 08:38:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b5c5eadd-3797-54fb-a3b8-7ec3624c6765, identifier: EV01420
2026-03-30 08:38:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b5c5eadd-3797-54fb-a3b8-7ec3624c6765 with identifier: EV01420
2026-03-30 08:38:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b5c5eadd-3797-54fb-a3b8-7ec3624c6765 with identifier: EV01420
2026-03-30 08:38:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b5c5eadd-3797-54fb-a3b8-7ec3624c6765 with identifier: EV01420 to the API
2026-03-30 08:38:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:38:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:38:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 122,
'expiration_date': '2026-03-30T15:56:06Z',
'fuel_type': 'hybrid',
'id': 'b5c5eadd-3797-54fb-a3b8-7ec3624c6765',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV01420',
'listing': 'auction',
'make': 'Toyota',
'model': 'C-HR',
'odometer': 121300,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-21',
'seller_name': None,
'title': 'Toyota C-HR 1.8 Hybrid Active',
'transmission': 'automatic',
'trim': 'Active',
'year': 2018}
2026-03-30 08:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV01420%27 HTTP/1.1" 200 None
2026-03-30 08:38:03 [auto1.be] INFO: Saving data for EV01420: {'auction_closing_time': 1774886166.0, 'created_time': 1774557545.352942, 'last_price_update_time': 1774859883.969925}
2026-03-30 08:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='EV01420') HTTP/1.1" 204 0
2026-03-30 08:38:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:38:04 [auto1.be] INFO: Found listing with ID: PS72966
2026-03-30 08:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PS72966%27 HTTP/1.1" 200 None
2026-03-30 08:38:04 [auto1.be] INFO: Scrape type for PS72966: 0
2026-03-30 08:38:04 [auto1.be] INFO: Found listing with ID: CR22525
2026-03-30 08:38:04 [auto1.be] INFO: Found listing with ID: HF54985
2026-03-30 08:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HF54985%27 HTTP/1.1" 200 None
2026-03-30 08:38:04 [auto1.be] INFO: Scrape type for HF54985: 0
2026-03-30 08:38:04 [auto1.be] INFO: Found listing with ID: GH94733
2026-03-30 08:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH94733%27 HTTP/1.1" 200 None
2026-03-30 08:38:04 [auto1.be] INFO: Scrape type for GH94733: 0
2026-03-30 08:38:04 [auto1.be] INFO: Found listing with ID: CP91123
2026-03-30 08:38:04 [auto1.be] INFO: Found listing with ID: FA30680
2026-03-30 08:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FA30680%27 HTTP/1.1" 200 None
2026-03-30 08:38:04 [auto1.be] INFO: Scrape type for FA30680: 0
2026-03-30 08:38:04 [auto1.be] INFO: Found listing with ID: WL65720
2026-03-30 08:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WL65720%27 HTTP/1.1" 200 None
2026-03-30 08:38:04 [auto1.be] INFO: Scrape type for WL65720: 0
2026-03-30 08:38:04 [auto1.be] INFO: Found listing with ID: KM67426
2026-03-30 08:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM67426%27 HTTP/1.1" 200 None
2026-03-30 08:38:04 [auto1.be] INFO: Scrape type for KM67426: 0
2026-03-30 08:38:04 [auto1.be] INFO: Found listing with ID: DM52841
2026-03-30 08:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DM52841%27 HTTP/1.1" 200 None
2026-03-30 08:38:04 [auto1.be] INFO: Scrape type for DM52841: 0
2026-03-30 08:38:04 [auto1.be] INFO: Found listing with ID: YH09444
2026-03-30 08:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH09444%27 HTTP/1.1" 200 None
2026-03-30 08:38:04 [auto1.be] INFO: Scrape type for YH09444: 0
2026-03-30 08:38:04 [auto1.be] INFO: Found listing with ID: JP67733
2026-03-30 08:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JP67733%27 HTTP/1.1" 200 None
2026-03-30 08:38:04 [auto1.be] INFO: Scrape type for JP67733: 0
2026-03-30 08:38:04 [auto1.be] INFO: Found listing with ID: RB53949
2026-03-30 08:38:04 [auto1.be] INFO: Found listing with ID: XD36076
2026-03-30 08:38:04 [auto1.be] INFO: Found listing with ID: RK05604
2026-03-30 08:38:04 [auto1.be] INFO: Found listing with ID: WA39171
2026-03-30 08:38:04 [auto1.be] INFO: Found listing with ID: AL21659
2026-03-30 08:38:04 [auto1.be] INFO: Found listing with ID: DC47068
2026-03-30 08:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC47068%27 HTTP/1.1" 200 None
2026-03-30 08:38:04 [auto1.be] INFO: Scrape type for DC47068: 0
2026-03-30 08:38:04 [auto1.be] INFO: Found listing with ID: ES19550
2026-03-30 08:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES19550%27 HTTP/1.1" 200 None
2026-03-30 08:38:04 [auto1.be] INFO: Scrape type for ES19550: 0
2026-03-30 08:38:04 [auto1.be] INFO: Found listing with ID: ZH14429
2026-03-30 08:38:04 [auto1.be] INFO: Found listing with ID: VV25356
2026-03-30 08:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VV25356%27 HTTP/1.1" 200 None
2026-03-30 08:38:04 [auto1.be] INFO: Scrape type for VV25356: 0
2026-03-30 08:38:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:38:05 [auto1.be] INFO: Channel: 24h | Page: 24 | totalHits: 1502 | hits on page: 40
2026-03-30 08:38:05 [auto1.be] INFO: Found listing with ID: GS99704
2026-03-30 08:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS99704%27 HTTP/1.1" 200 None
2026-03-30 08:38:05 [auto1.be] INFO: Scrape type for GS99704: 0
2026-03-30 08:38:05 [auto1.be] INFO: Found listing with ID: UD97693
2026-03-30 08:38:05 [auto1.be] INFO: Found listing with ID: YJ44532
2026-03-30 08:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YJ44532%27 HTTP/1.1" 200 None
2026-03-30 08:38:05 [auto1.be] INFO: Scrape type for YJ44532: 0
2026-03-30 08:38:05 [auto1.be] INFO: Found listing with ID: VM79296
2026-03-30 08:38:05 [auto1.be] INFO: Found listing with ID: YF30387
2026-03-30 08:38:05 [auto1.be] INFO: Found listing with ID: NU98421
2026-03-30 08:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NU98421%27 HTTP/1.1" 200 None
2026-03-30 08:38:05 [auto1.be] INFO: Scrape type for NU98421: 0
2026-03-30 08:38:05 [auto1.be] INFO: Found listing with ID: DY95002
2026-03-30 08:38:05 [auto1.be] INFO: Found listing with ID: HL95749
2026-03-30 08:38:05 [auto1.be] INFO: Found listing with ID: SA79242
2026-03-30 08:38:05 [auto1.be] INFO: Found listing with ID: KF81819
2026-03-30 08:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF81819%27 HTTP/1.1" 200 None
2026-03-30 08:38:05 [auto1.be] INFO: Scrape type for KF81819: 0
2026-03-30 08:38:05 [auto1.be] INFO: Found listing with ID: WC10504
2026-03-30 08:38:05 [auto1.be] INFO: Found listing with ID: KU12802
2026-03-30 08:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU12802%27 HTTP/1.1" 200 None
2026-03-30 08:38:05 [auto1.be] INFO: Scrape type for KU12802: 2
2026-03-30 08:38:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a1c80e8-a996-510d-963b-0b20f35b4714 with identifier: KU12802
2026-03-30 08:38:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a1c80e8-a996-510d-963b-0b20f35b4714 with scrape type 2
2026-03-30 08:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a1c80e8-a996-510d-963b-0b20f35b4714 with scrape type 2
2026-03-30 08:38:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0a1c80e8-a996-510d-963b-0b20f35b4714, identifier: KU12802
2026-03-30 08:38:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0a1c80e8-a996-510d-963b-0b20f35b4714 with identifier: KU12802
2026-03-30 08:38:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0a1c80e8-a996-510d-963b-0b20f35b4714 with identifier: KU12802
2026-03-30 08:38:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0a1c80e8-a996-510d-963b-0b20f35b4714 with identifier: KU12802 to the API
2026-03-30 08:38:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:38:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:38:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:53:41Z',
'fuel_type': 'diesel',
'id': '0a1c80e8-a996-510d-963b-0b20f35b4714',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU12802',
'listing': 'auction',
'make': 'Dacia',
'model': 'Lodgy',
'odometer': 221022,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-05-16',
'seller_name': None,
'title': 'Dacia Lodgy 1.5 dCi Diesel Laureate',
'transmission': 'manual',
'trim': 'Laureate',
'year': 2013}
2026-03-30 08:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU12802%27 HTTP/1.1" 200 None
2026-03-30 08:38:05 [auto1.be] INFO: Saving data for KU12802: {'auction_closing_time': 1774886021.0, 'created_time': 1774557492.564324, 'last_price_update_time': 1774859885.662291}
2026-03-30 08:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KU12802') HTTP/1.1" 204 0
2026-03-30 08:38:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:38:05 [auto1.be] INFO: Found listing with ID: CE58685
2026-03-30 08:38:05 [auto1.be] INFO: Found listing with ID: YH98972
2026-03-30 08:38:05 [auto1.be] INFO: Found listing with ID: BJ55526
2026-03-30 08:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BJ55526%27 HTTP/1.1" 200 None
2026-03-30 08:38:05 [auto1.be] INFO: Scrape type for BJ55526: 0
2026-03-30 08:38:05 [auto1.be] INFO: Found listing with ID: GP50240
2026-03-30 08:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GP50240%27 HTTP/1.1" 200 None
2026-03-30 08:38:05 [auto1.be] INFO: Scrape type for GP50240: 0
2026-03-30 08:38:05 [auto1.be] INFO: Found listing with ID: SR93497
2026-03-30 08:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SR93497%27 HTTP/1.1" 200 None
2026-03-30 08:38:05 [auto1.be] INFO: Scrape type for SR93497: 0
2026-03-30 08:38:05 [auto1.be] INFO: Found listing with ID: TW22956
2026-03-30 08:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW22956%27 HTTP/1.1" 200 None
2026-03-30 08:38:05 [auto1.be] INFO: Scrape type for TW22956: 2
2026-03-30 08:38:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6284fe65-c9e2-5fba-8b4b-9a82be49dc51 with identifier: TW22956
2026-03-30 08:38:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6284fe65-c9e2-5fba-8b4b-9a82be49dc51 with scrape type 2
2026-03-30 08:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6284fe65-c9e2-5fba-8b4b-9a82be49dc51 with scrape type 2
2026-03-30 08:38:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 6284fe65-c9e2-5fba-8b4b-9a82be49dc51, identifier: TW22956
2026-03-30 08:38:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 6284fe65-c9e2-5fba-8b4b-9a82be49dc51 with identifier: TW22956
2026-03-30 08:38:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 6284fe65-c9e2-5fba-8b4b-9a82be49dc51 with identifier: TW22956
2026-03-30 08:38:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 6284fe65-c9e2-5fba-8b4b-9a82be49dc51 with identifier: TW22956 to the API
2026-03-30 08:38:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:38:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:38:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 283,
'expiration_date': '2026-03-30T15:05:05Z',
'fuel_type': 'hybrid',
'id': '6284fe65-c9e2-5fba-8b4b-9a82be49dc51',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW22956',
'listing': 'auction',
'make': 'Volvo',
'model': 'V60',
'odometer': 228232,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-06-03',
'seller_name': None,
'title': 'Volvo V60 2.4 D6 Plug-in Hybrid Summum AWD',
'transmission': 'automatic',
'trim': 'Summum AWD',
'year': 2014}
2026-03-30 08:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TW22956%27 HTTP/1.1" 200 None
2026-03-30 08:38:06 [auto1.be] INFO: Saving data for TW22956: {'auction_closing_time': 1774883105.0, 'created_time': 1774557567.67692, 'last_price_update_time': 1774859886.190582}
2026-03-30 08:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TW22956') HTTP/1.1" 204 0
2026-03-30 08:38:06 [auto1.be] INFO: Found listing with ID: GN45273
2026-03-30 08:38:06 [auto1.be] INFO: Found listing with ID: AE23838
2026-03-30 08:38:06 [auto1.be] INFO: Found listing with ID: WD60187
2026-03-30 08:38:06 [auto1.be] INFO: Found listing with ID: MF96479
2026-03-30 08:38:06 [auto1.be] INFO: Found listing with ID: KF59500
2026-03-30 08:38:06 [auto1.be] INFO: Found listing with ID: ZT52703
2026-03-30 08:38:06 [auto1.be] INFO: Found listing with ID: GP69185
2026-03-30 08:38:06 [auto1.be] INFO: Found listing with ID: ZR52684
2026-03-30 08:38:06 [auto1.be] INFO: Found listing with ID: LY80968
2026-03-30 08:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY80968%27 HTTP/1.1" 200 None
2026-03-30 08:38:06 [auto1.be] INFO: Scrape type for LY80968: 0
2026-03-30 08:38:06 [auto1.be] INFO: Found listing with ID: CN47453
2026-03-30 08:38:06 [auto1.be] INFO: Found listing with ID: DF09339
2026-03-30 08:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DF09339%27 HTTP/1.1" 200 None
2026-03-30 08:38:06 [auto1.be] INFO: Scrape type for DF09339: 0
2026-03-30 08:38:06 [auto1.be] INFO: Found listing with ID: BX96549
2026-03-30 08:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BX96549%27 HTTP/1.1" 200 None
2026-03-30 08:38:06 [auto1.be] INFO: Scrape type for BX96549: 0
2026-03-30 08:38:06 [auto1.be] INFO: Found listing with ID: LM94739
2026-03-30 08:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM94739%27 HTTP/1.1" 200 None
2026-03-30 08:38:06 [auto1.be] INFO: Scrape type for LM94739: 2
2026-03-30 08:38:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4aeb3cc8-f65d-5432-b1f8-532bac2ed33b with identifier: LM94739
2026-03-30 08:38:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4aeb3cc8-f65d-5432-b1f8-532bac2ed33b with scrape type 2
2026-03-30 08:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4aeb3cc8-f65d-5432-b1f8-532bac2ed33b with scrape type 2
2026-03-30 08:38:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4aeb3cc8-f65d-5432-b1f8-532bac2ed33b, identifier: LM94739
2026-03-30 08:38:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4aeb3cc8-f65d-5432-b1f8-532bac2ed33b with identifier: LM94739
2026-03-30 08:38:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4aeb3cc8-f65d-5432-b1f8-532bac2ed33b with identifier: LM94739
2026-03-30 08:38:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4aeb3cc8-f65d-5432-b1f8-532bac2ed33b with identifier: LM94739 to the API
2026-03-30 08:38:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:38:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:38:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:42:35Z',
'fuel_type': 'diesel',
'id': '4aeb3cc8-f65d-5432-b1f8-532bac2ed33b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM94739',
'listing': 'auction',
'make': 'Citroen',
'model': 'Jumpy',
'odometer': 93719,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-04-13',
'seller_name': None,
'title': 'Citroen Jumpy 1.6 HDi L1H1 27 Kasten',
'transmission': 'manual',
'trim': 'L1H1 27 Kasten',
'year': 2016}
2026-03-30 08:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM94739%27 HTTP/1.1" 200 None
2026-03-30 08:38:06 [auto1.be] INFO: Saving data for LM94739: {'auction_closing_time': 1774885355.0, 'created_time': 1774557493.226975, 'last_price_update_time': 1774859886.650738}
2026-03-30 08:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LM94739') HTTP/1.1" 204 0
2026-03-30 08:38:06 [auto1.be] INFO: Found listing with ID: KW15988
2026-03-30 08:38:06 [auto1.be] INFO: Found listing with ID: ZR23499
2026-03-30 08:38:06 [auto1.be] INFO: Found listing with ID: UT35373
2026-03-30 08:38:06 [auto1.be] INFO: Found listing with ID: YR29884
2026-03-30 08:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YR29884%27 HTTP/1.1" 200 None
2026-03-30 08:38:06 [auto1.be] INFO: Scrape type for YR29884: 0
2026-03-30 08:38:06 [auto1.be] INFO: Found listing with ID: NK28391
2026-03-30 08:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NK28391%27 HTTP/1.1" 200 None
2026-03-30 08:38:06 [auto1.be] INFO: Scrape type for NK28391: 0
2026-03-30 08:38:06 [auto1.be] INFO: Found listing with ID: KF50538
2026-03-30 08:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF50538%27 HTTP/1.1" 200 None
2026-03-30 08:38:06 [auto1.be] INFO: Scrape type for KF50538: 0
2026-03-30 08:38:06 [auto1.be] INFO: Found listing with ID: MA06269
2026-03-30 08:38:06 [auto1.be] INFO: Found listing with ID: ZR56949
2026-03-30 08:38:06 [auto1.be] INFO: Found listing with ID: VZ78935
2026-03-30 08:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ78935%27 HTTP/1.1" 200 None
2026-03-30 08:38:06 [auto1.be] INFO: Scrape type for VZ78935: 0
2026-03-30 08:38:07 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 15 pages/min), scraped 220 items (at 87 items/min)
2026-03-30 08:38:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 182MiB
2026-03-30 08:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:38:08 [auto1.be] INFO: Channel: 24h | Page: 25 | totalHits: 1502 | hits on page: 40
2026-03-30 08:38:08 [auto1.be] INFO: Found listing with ID: YU72813
2026-03-30 08:38:08 [auto1.be] INFO: Found listing with ID: CB53563
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CB53563%27 HTTP/1.1" 200 None
2026-03-30 08:38:08 [auto1.be] INFO: Scrape type for CB53563: 0
2026-03-30 08:38:08 [auto1.be] INFO: Found listing with ID: NR94896
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NR94896%27 HTTP/1.1" 200 None
2026-03-30 08:38:08 [auto1.be] INFO: Scrape type for NR94896: 0
2026-03-30 08:38:08 [auto1.be] INFO: Found listing with ID: GW69223
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW69223%27 HTTP/1.1" 200 None
2026-03-30 08:38:08 [auto1.be] INFO: Scrape type for GW69223: 2
2026-03-30 08:38:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79a5edd5-90b6-58cc-ad3f-f133d9393958 with identifier: GW69223
2026-03-30 08:38:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79a5edd5-90b6-58cc-ad3f-f133d9393958 with scrape type 2
2026-03-30 08:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79a5edd5-90b6-58cc-ad3f-f133d9393958 with scrape type 2
2026-03-30 08:38:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 79a5edd5-90b6-58cc-ad3f-f133d9393958, identifier: GW69223
2026-03-30 08:38:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 79a5edd5-90b6-58cc-ad3f-f133d9393958 with identifier: GW69223
2026-03-30 08:38:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 79a5edd5-90b6-58cc-ad3f-f133d9393958 with identifier: GW69223
2026-03-30 08:38:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 79a5edd5-90b6-58cc-ad3f-f133d9393958 with identifier: GW69223 to the API
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:38:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:47:33Z',
'fuel_type': 'petrol',
'id': '79a5edd5-90b6-58cc-ad3f-f133d9393958',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW69223',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 70481,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-15',
'seller_name': None,
'title': 'Skoda Octavia 1.5 TSI ACT Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2019}
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GW69223%27 HTTP/1.1" 200 None
2026-03-30 08:38:08 [auto1.be] INFO: Saving data for GW69223: {'auction_closing_time': 1774885653.0, 'created_time': 1774557564.216653, 'last_price_update_time': 1774859888.681906}
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='GW69223') HTTP/1.1" 204 0
2026-03-30 08:38:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:38:08 [auto1.be] INFO: Found listing with ID: BV56621
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BV56621%27 HTTP/1.1" 200 None
2026-03-30 08:38:08 [auto1.be] INFO: Scrape type for BV56621: 0
2026-03-30 08:38:08 [auto1.be] INFO: Found listing with ID: CM40127
2026-03-30 08:38:08 [auto1.be] INFO: Found listing with ID: HT96077
2026-03-30 08:38:08 [auto1.be] INFO: Found listing with ID: UB84592
2026-03-30 08:38:08 [auto1.be] INFO: Found listing with ID: LE55631
2026-03-30 08:38:08 [auto1.be] INFO: Found listing with ID: AK84541
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AK84541%27 HTTP/1.1" 200 None
2026-03-30 08:38:08 [auto1.be] INFO: Scrape type for AK84541: 0
2026-03-30 08:38:08 [auto1.be] INFO: Found listing with ID: PM96543
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PM96543%27 HTTP/1.1" 200 None
2026-03-30 08:38:08 [auto1.be] INFO: Scrape type for PM96543: 0
2026-03-30 08:38:08 [auto1.be] INFO: Found listing with ID: KF52558
2026-03-30 08:38:08 [auto1.be] INFO: Found listing with ID: NM84060
2026-03-30 08:38:08 [auto1.be] INFO: Found listing with ID: TW64249
2026-03-30 08:38:08 [auto1.be] INFO: Found listing with ID: XE64009
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XE64009%27 HTTP/1.1" 200 None
2026-03-30 08:38:08 [auto1.be] INFO: Scrape type for XE64009: 0
2026-03-30 08:38:08 [auto1.be] INFO: Found listing with ID: KU26204
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KU26204%27 HTTP/1.1" 200 None
2026-03-30 08:38:08 [auto1.be] INFO: Scrape type for KU26204: 0
2026-03-30 08:38:08 [auto1.be] INFO: Found listing with ID: ZN66630
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN66630%27 HTTP/1.1" 200 None
2026-03-30 08:38:08 [auto1.be] INFO: Scrape type for ZN66630: 0
2026-03-30 08:38:08 [auto1.be] INFO: Found listing with ID: ZG50395
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG50395%27 HTTP/1.1" 200 None
2026-03-30 08:38:08 [auto1.be] INFO: Scrape type for ZG50395: 0
2026-03-30 08:38:08 [auto1.be] INFO: Found listing with ID: PY81659
2026-03-30 08:38:08 [auto1.be] INFO: Found listing with ID: TM97404
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM97404%27 HTTP/1.1" 200 None
2026-03-30 08:38:08 [auto1.be] INFO: Scrape type for TM97404: 0
2026-03-30 08:38:08 [auto1.be] INFO: Found listing with ID: UV50609
2026-03-30 08:38:08 [auto1.be] INFO: Found listing with ID: ZZ47044
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ47044%27 HTTP/1.1" 200 None
2026-03-30 08:38:08 [auto1.be] INFO: Scrape type for ZZ47044: 0
2026-03-30 08:38:08 [auto1.be] INFO: Found listing with ID: UT04463
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UT04463%27 HTTP/1.1" 200 None
2026-03-30 08:38:08 [auto1.be] INFO: Scrape type for UT04463: 0
2026-03-30 08:38:08 [auto1.be] INFO: Found listing with ID: WE53696
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WE53696%27 HTTP/1.1" 200 None
2026-03-30 08:38:08 [auto1.be] INFO: Scrape type for WE53696: 0
2026-03-30 08:38:08 [auto1.be] INFO: Found listing with ID: WK14396
2026-03-30 08:38:08 [auto1.be] INFO: Found listing with ID: RW49064
2026-03-30 08:38:08 [auto1.be] INFO: Found listing with ID: NP69529
2026-03-30 08:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NP69529%27 HTTP/1.1" 200 None
2026-03-30 08:38:09 [auto1.be] INFO: Scrape type for NP69529: 0
2026-03-30 08:38:09 [auto1.be] INFO: Found listing with ID: WU38196
2026-03-30 08:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WU38196%27 HTTP/1.1" 200 None
2026-03-30 08:38:09 [auto1.be] INFO: Scrape type for WU38196: 0
2026-03-30 08:38:09 [auto1.be] INFO: Found listing with ID: ZL81412
2026-03-30 08:38:09 [auto1.be] INFO: Found listing with ID: KC69840
2026-03-30 08:38:09 [auto1.be] INFO: Found listing with ID: FC74189
2026-03-30 08:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC74189%27 HTTP/1.1" 200 None
2026-03-30 08:38:09 [auto1.be] INFO: Scrape type for FC74189: 0
2026-03-30 08:38:09 [auto1.be] INFO: Found listing with ID: CS98471
2026-03-30 08:38:09 [auto1.be] INFO: Found listing with ID: BR84638
2026-03-30 08:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR84638%27 HTTP/1.1" 200 None
2026-03-30 08:38:09 [auto1.be] INFO: Scrape type for BR84638: 0
2026-03-30 08:38:09 [auto1.be] INFO: Found listing with ID: FE56390
2026-03-30 08:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FE56390%27 HTTP/1.1" 200 None
2026-03-30 08:38:09 [auto1.be] INFO: Scrape type for FE56390: 0
2026-03-30 08:38:09 [auto1.be] INFO: Found listing with ID: ZR84759
2026-03-30 08:38:09 [auto1.be] INFO: Found listing with ID: WG89987
2026-03-30 08:38:09 [auto1.be] INFO: Found listing with ID: WC98842
2026-03-30 08:38:09 [auto1.be] INFO: Found listing with ID: TS87931
2026-03-30 08:38:09 [auto1.be] INFO: Found listing with ID: VM06685
2026-03-30 08:38:09 [auto1.be] INFO: Found listing with ID: UL72077
2026-03-30 08:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UL72077%27 HTTP/1.1" 200 None
2026-03-30 08:38:09 [auto1.be] INFO: Scrape type for UL72077: 0
2026-03-30 08:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:38:10 [auto1.be] INFO: Channel: 24h | Page: 26 | totalHits: 1502 | hits on page: 40
2026-03-30 08:38:10 [auto1.be] INFO: Found listing with ID: VZ08217
2026-03-30 08:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ08217%27 HTTP/1.1" 200 None
2026-03-30 08:38:10 [auto1.be] INFO: Scrape type for VZ08217: 0
2026-03-30 08:38:10 [auto1.be] INFO: Found listing with ID: SZ60181
2026-03-30 08:38:10 [auto1.be] INFO: Found listing with ID: UJ89543
2026-03-30 08:38:10 [auto1.be] INFO: Found listing with ID: JZ97752
2026-03-30 08:38:10 [auto1.be] INFO: Found listing with ID: YL00049
2026-03-30 08:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YL00049%27 HTTP/1.1" 200 None
2026-03-30 08:38:10 [auto1.be] INFO: Scrape type for YL00049: 0
2026-03-30 08:38:10 [auto1.be] INFO: Found listing with ID: CG91643
2026-03-30 08:38:10 [auto1.be] INFO: Found listing with ID: SF38570
2026-03-30 08:38:10 [auto1.be] INFO: Found listing with ID: CP13942
2026-03-30 08:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CP13942%27 HTTP/1.1" 200 None
2026-03-30 08:38:10 [auto1.be] INFO: Scrape type for CP13942: 0
2026-03-30 08:38:10 [auto1.be] INFO: Found listing with ID: RE48196
2026-03-30 08:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE48196%27 HTTP/1.1" 200 None
2026-03-30 08:38:10 [auto1.be] INFO: Scrape type for RE48196: 2
2026-03-30 08:38:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd237f58-eccc-50ed-b36d-78cba6c28d6a with identifier: RE48196
2026-03-30 08:38:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd237f58-eccc-50ed-b36d-78cba6c28d6a with scrape type 2
2026-03-30 08:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd237f58-eccc-50ed-b36d-78cba6c28d6a with scrape type 2
2026-03-30 08:38:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dd237f58-eccc-50ed-b36d-78cba6c28d6a, identifier: RE48196
2026-03-30 08:38:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dd237f58-eccc-50ed-b36d-78cba6c28d6a with identifier: RE48196
2026-03-30 08:38:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dd237f58-eccc-50ed-b36d-78cba6c28d6a with identifier: RE48196
2026-03-30 08:38:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dd237f58-eccc-50ed-b36d-78cba6c28d6a with identifier: RE48196 to the API
2026-03-30 08:38:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:38:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:38:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:21:32Z',
'fuel_type': 'diesel',
'id': 'dd237f58-eccc-50ed-b36d-78cba6c28d6a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE48196',
'listing': 'auction',
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 206620,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-21',
'seller_name': None,
'title': 'Citroen Berlingo 1.6 HDi Attraction',
'transmission': 'manual',
'trim': 'Attraction',
'year': 2013}
2026-03-30 08:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RE48196%27 HTTP/1.1" 200 None
2026-03-30 08:38:10 [auto1.be] INFO: Saving data for RE48196: {'auction_closing_time': 1774884092.0, 'created_time': 1774557447.875121, 'last_price_update_time': 1774859890.850574}
2026-03-30 08:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RE48196') HTTP/1.1" 204 0
2026-03-30 08:38:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:38:10 [auto1.be] INFO: Found listing with ID: MS23670
2026-03-30 08:38:10 [auto1.be] INFO: Found listing with ID: CU40853
2026-03-30 08:38:10 [auto1.be] INFO: Found listing with ID: VA59143
2026-03-30 08:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA59143%27 HTTP/1.1" 200 None
2026-03-30 08:38:10 [auto1.be] INFO: Scrape type for VA59143: 0
2026-03-30 08:38:10 [auto1.be] INFO: Found listing with ID: PR31064
2026-03-30 08:38:10 [auto1.be] INFO: Found listing with ID: KC33551
2026-03-30 08:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KC33551%27 HTTP/1.1" 200 None
2026-03-30 08:38:11 [auto1.be] INFO: Scrape type for KC33551: 0
2026-03-30 08:38:11 [auto1.be] INFO: Found listing with ID: CE65833
2026-03-30 08:38:11 [auto1.be] INFO: Found listing with ID: VA87646
2026-03-30 08:38:11 [auto1.be] INFO: Found listing with ID: RA65802
2026-03-30 08:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA65802%27 HTTP/1.1" 200 None
2026-03-30 08:38:11 [auto1.be] INFO: Scrape type for RA65802: 0
2026-03-30 08:38:11 [auto1.be] INFO: Found listing with ID: MJ08102
2026-03-30 08:38:11 [auto1.be] INFO: Found listing with ID: CF04837
2026-03-30 08:38:11 [auto1.be] INFO: Found listing with ID: TS87416
2026-03-30 08:38:11 [auto1.be] INFO: Found listing with ID: JM27578
2026-03-30 08:38:11 [auto1.be] INFO: Found listing with ID: YB94076
2026-03-30 08:38:11 [auto1.be] INFO: Found listing with ID: VJ27978
2026-03-30 08:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VJ27978%27 HTTP/1.1" 200 None
2026-03-30 08:38:11 [auto1.be] INFO: Scrape type for VJ27978: 0
2026-03-30 08:38:11 [auto1.be] INFO: Found listing with ID: ZA01438
2026-03-30 08:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZA01438%27 HTTP/1.1" 200 None
2026-03-30 08:38:11 [auto1.be] INFO: Scrape type for ZA01438: 0
2026-03-30 08:38:11 [auto1.be] INFO: Found listing with ID: DF96327
2026-03-30 08:38:11 [auto1.be] INFO: Found listing with ID: MC94265
2026-03-30 08:38:11 [auto1.be] INFO: Found listing with ID: VP90118
2026-03-30 08:38:11 [auto1.be] INFO: Found listing with ID: PK93774
2026-03-30 08:38:11 [auto1.be] INFO: Found listing with ID: PY58607
2026-03-30 08:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY58607%27 HTTP/1.1" 200 None
2026-03-30 08:38:11 [auto1.be] INFO: Scrape type for PY58607: 0
2026-03-30 08:38:11 [auto1.be] INFO: Found listing with ID: BT72678
2026-03-30 08:38:11 [auto1.be] INFO: Found listing with ID: VP91071
2026-03-30 08:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP91071%27 HTTP/1.1" 200 None
2026-03-30 08:38:11 [auto1.be] INFO: Scrape type for VP91071: 2
2026-03-30 08:38:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fe4da8e-e9ba-5e9f-b32e-cd0cde767e0a with identifier: VP91071
2026-03-30 08:38:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fe4da8e-e9ba-5e9f-b32e-cd0cde767e0a with scrape type 2
2026-03-30 08:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fe4da8e-e9ba-5e9f-b32e-cd0cde767e0a with scrape type 2
2026-03-30 08:38:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9fe4da8e-e9ba-5e9f-b32e-cd0cde767e0a, identifier: VP91071
2026-03-30 08:38:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9fe4da8e-e9ba-5e9f-b32e-cd0cde767e0a with identifier: VP91071
2026-03-30 08:38:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9fe4da8e-e9ba-5e9f-b32e-cd0cde767e0a with identifier: VP91071
2026-03-30 08:38:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9fe4da8e-e9ba-5e9f-b32e-cd0cde767e0a with identifier: VP91071 to the API
2026-03-30 08:38:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:38:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:38:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'silver',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 75,
'expiration_date': '2026-03-30T15:17:58Z',
'fuel_type': 'petrol',
'id': '9fe4da8e-e9ba-5e9f-b32e-cd0cde767e0a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP91071',
'listing': 'auction',
'make': 'Peugeot',
'model': '206',
'odometer': 129499,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-05-26',
'seller_name': None,
'title': 'Peugeot 206 1.4 Generation',
'transmission': 'manual',
'trim': 'Generation',
'year': 2008}
2026-03-30 08:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VP91071%27 HTTP/1.1" 200 None
2026-03-30 08:38:11 [auto1.be] INFO: Saving data for VP91071: {'auction_closing_time': 1774883878.0, 'created_time': 1774557465.388795, 'last_price_update_time': 1774859891.449317}
2026-03-30 08:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VP91071') HTTP/1.1" 204 0
2026-03-30 08:38:11 [auto1.be] INFO: Found listing with ID: TK06008
2026-03-30 08:38:11 [auto1.be] INFO: Found listing with ID: NM63028
2026-03-30 08:38:11 [auto1.be] INFO: Found listing with ID: JY53618
2026-03-30 08:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY53618%27 HTTP/1.1" 200 None
2026-03-30 08:38:11 [auto1.be] INFO: Scrape type for JY53618: 0
2026-03-30 08:38:11 [auto1.be] INFO: Found listing with ID: VB55746
2026-03-30 08:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VB55746%27 HTTP/1.1" 200 None
2026-03-30 08:38:11 [auto1.be] INFO: Scrape type for VB55746: 0
2026-03-30 08:38:11 [auto1.be] INFO: Found listing with ID: GS48835
2026-03-30 08:38:11 [auto1.be] INFO: Found listing with ID: FA63464
2026-03-30 08:38:11 [auto1.be] INFO: Found listing with ID: XA29570
2026-03-30 08:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XA29570%27 HTTP/1.1" 200 None
2026-03-30 08:38:11 [auto1.be] INFO: Scrape type for XA29570: 0
2026-03-30 08:38:11 [auto1.be] INFO: Found listing with ID: MG12074
2026-03-30 08:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MG12074%27 HTTP/1.1" 200 None
2026-03-30 08:38:11 [auto1.be] INFO: Scrape type for MG12074: 0
2026-03-30 08:38:11 [auto1.be] INFO: Found listing with ID: YD21406
2026-03-30 08:38:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:38:12 [auto1.be] INFO: Channel: 24h | Page: 27 | totalHits: 1502 | hits on page: 40
2026-03-30 08:38:12 [auto1.be] INFO: Found listing with ID: XJ95743
2026-03-30 08:38:12 [auto1.be] INFO: Found listing with ID: DB02418
2026-03-30 08:38:12 [auto1.be] INFO: Found listing with ID: XT36171
2026-03-30 08:38:12 [auto1.be] INFO: Found listing with ID: MC66522
2026-03-30 08:38:12 [auto1.be] INFO: Found listing with ID: ZK00678
2026-03-30 08:38:12 [auto1.be] INFO: Found listing with ID: DE33834
2026-03-30 08:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE33834%27 HTTP/1.1" 200 None
2026-03-30 08:38:12 [auto1.be] INFO: Scrape type for DE33834: 2
2026-03-30 08:38:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0346a38f-a7f7-5f29-800a-bb81ada4be6b with identifier: DE33834
2026-03-30 08:38:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0346a38f-a7f7-5f29-800a-bb81ada4be6b with scrape type 2
2026-03-30 08:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0346a38f-a7f7-5f29-800a-bb81ada4be6b with scrape type 2
2026-03-30 08:38:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0346a38f-a7f7-5f29-800a-bb81ada4be6b, identifier: DE33834
2026-03-30 08:38:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0346a38f-a7f7-5f29-800a-bb81ada4be6b with identifier: DE33834
2026-03-30 08:38:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0346a38f-a7f7-5f29-800a-bb81ada4be6b with identifier: DE33834
2026-03-30 08:38:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0346a38f-a7f7-5f29-800a-bb81ada4be6b with identifier: DE33834 to the API
2026-03-30 08:38:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:38:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:38:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:11:41Z',
'fuel_type': 'petrol',
'id': '0346a38f-a7f7-5f29-800a-bb81ada4be6b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE33834',
'listing': 'auction',
'make': 'Lancia',
'model': 'Ypsilon',
'odometer': 93865,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-04-19',
'seller_name': None,
'title': 'Lancia Ypsilon 1.2 Platino',
'transmission': 'manual',
'trim': 'Platino',
'year': 2011}
2026-03-30 08:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DE33834%27 HTTP/1.1" 200 None
2026-03-30 08:38:12 [auto1.be] INFO: Saving data for DE33834: {'auction_closing_time': 1774883501.0, 'created_time': 1774557563.91213, 'last_price_update_time': 1774859892.94495}
2026-03-30 08:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='DE33834') HTTP/1.1" 204 0
2026-03-30 08:38:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: HH62001
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: WF76478
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: SC59712
2026-03-30 08:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC59712%27 HTTP/1.1" 200 None
2026-03-30 08:38:13 [auto1.be] INFO: Scrape type for SC59712: 0
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: SU72836
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: ME81448
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: XH49609
2026-03-30 08:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH49609%27 HTTP/1.1" 200 None
2026-03-30 08:38:13 [auto1.be] INFO: Scrape type for XH49609: 0
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: GV27154
2026-03-30 08:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GV27154%27 HTTP/1.1" 200 None
2026-03-30 08:38:13 [auto1.be] INFO: Scrape type for GV27154: 0
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: GA09150
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: JS25395
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: XC10139
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: RL32581
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: CR21244
2026-03-30 08:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CR21244%27 HTTP/1.1" 200 None
2026-03-30 08:38:13 [auto1.be] INFO: Scrape type for CR21244: 0
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: FY43318
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: FR80699
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: NM33768
2026-03-30 08:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NM33768%27 HTTP/1.1" 200 None
2026-03-30 08:38:13 [auto1.be] INFO: Scrape type for NM33768: 0
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: ZX33086
2026-03-30 08:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX33086%27 HTTP/1.1" 200 None
2026-03-30 08:38:13 [auto1.be] INFO: Scrape type for ZX33086: 0
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: BP38818
2026-03-30 08:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BP38818%27 HTTP/1.1" 200 None
2026-03-30 08:38:13 [auto1.be] INFO: Scrape type for BP38818: 0
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: XT87195
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: KP16725
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: GS68920
2026-03-30 08:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GS68920%27 HTTP/1.1" 200 None
2026-03-30 08:38:13 [auto1.be] INFO: Scrape type for GS68920: 0
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: WP21428
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: XC64567
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: NJ59863
2026-03-30 08:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NJ59863%27 HTTP/1.1" 200 None
2026-03-30 08:38:13 [auto1.be] INFO: Scrape type for NJ59863: 0
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: AU41446
2026-03-30 08:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AU41446%27 HTTP/1.1" 200 None
2026-03-30 08:38:13 [auto1.be] INFO: Scrape type for AU41446: 0
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: EX63844
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: VA07887
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: FJ79675
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: XB11874
2026-03-30 08:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XB11874%27 HTTP/1.1" 200 None
2026-03-30 08:38:13 [auto1.be] INFO: Scrape type for XB11874: 0
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: XT90325
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: CS46585
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: MX90898
2026-03-30 08:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MX90898%27 HTTP/1.1" 200 None
2026-03-30 08:38:13 [auto1.be] INFO: Scrape type for MX90898: 0
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: CG39340
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: LP39108
2026-03-30 08:38:13 [auto1.be] INFO: Found listing with ID: NZ84501
2026-03-30 08:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ84501%27 HTTP/1.1" 200 None
2026-03-30 08:38:13 [auto1.be] INFO: Scrape type for NZ84501: 0
2026-03-30 08:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:38:14 [auto1.be] INFO: Channel: 24h | Page: 28 | totalHits: 1502 | hits on page: 40
2026-03-30 08:38:14 [auto1.be] INFO: Found listing with ID: LM00165
2026-03-30 08:38:14 [auto1.be] INFO: Found listing with ID: LF23330
2026-03-30 08:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF23330%27 HTTP/1.1" 200 None
2026-03-30 08:38:14 [auto1.be] INFO: Scrape type for LF23330: 0
2026-03-30 08:38:14 [auto1.be] INFO: Found listing with ID: GH45635
2026-03-30 08:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GH45635%27 HTTP/1.1" 200 None
2026-03-30 08:38:14 [auto1.be] INFO: Scrape type for GH45635: 0
2026-03-30 08:38:14 [auto1.be] INFO: Found listing with ID: SC36479
2026-03-30 08:38:14 [auto1.be] INFO: Found listing with ID: AB25804
2026-03-30 08:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB25804%27 HTTP/1.1" 200 None
2026-03-30 08:38:14 [auto1.be] INFO: Scrape type for AB25804: 0
2026-03-30 08:38:14 [auto1.be] INFO: Found listing with ID: TX85632
2026-03-30 08:38:14 [auto1.be] INFO: Found listing with ID: AD33980
2026-03-30 08:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AD33980%27 HTTP/1.1" 200 None
2026-03-30 08:38:14 [auto1.be] INFO: Scrape type for AD33980: 0
2026-03-30 08:38:14 [auto1.be] INFO: Found listing with ID: CH34151
2026-03-30 08:38:14 [auto1.be] INFO: Found listing with ID: VP78411
2026-03-30 08:38:14 [auto1.be] INFO: Found listing with ID: DM43787
2026-03-30 08:38:14 [auto1.be] INFO: Found listing with ID: SA37733
2026-03-30 08:38:14 [auto1.be] INFO: Found listing with ID: ED59297
2026-03-30 08:38:14 [auto1.be] INFO: Found listing with ID: SL51907
2026-03-30 08:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL51907%27 HTTP/1.1" 200 None
2026-03-30 08:38:14 [auto1.be] INFO: Scrape type for SL51907: 0
2026-03-30 08:38:14 [auto1.be] INFO: Found listing with ID: DU38710
2026-03-30 08:38:14 [auto1.be] INFO: Found listing with ID: JC93215
2026-03-30 08:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC93215%27 HTTP/1.1" 200 None
2026-03-30 08:38:14 [auto1.be] INFO: Scrape type for JC93215: 0
2026-03-30 08:38:14 [auto1.be] INFO: Found listing with ID: TD70367
2026-03-30 08:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TD70367%27 HTTP/1.1" 200 None
2026-03-30 08:38:14 [auto1.be] INFO: Scrape type for TD70367: 0
2026-03-30 08:38:14 [auto1.be] INFO: Found listing with ID: YK80434
2026-03-30 08:38:14 [auto1.be] INFO: Found listing with ID: VZ63754
2026-03-30 08:38:14 [auto1.be] INFO: Found listing with ID: TU11660
2026-03-30 08:38:14 [auto1.be] INFO: Found listing with ID: JW78855
2026-03-30 08:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JW78855%27 HTTP/1.1" 200 None
2026-03-30 08:38:14 [auto1.be] INFO: Scrape type for JW78855: 0
2026-03-30 08:38:14 [auto1.be] INFO: Found listing with ID: RX86056
2026-03-30 08:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RX86056%27 HTTP/1.1" 200 None
2026-03-30 08:38:14 [auto1.be] INFO: Scrape type for RX86056: 0
2026-03-30 08:38:14 [auto1.be] INFO: Found listing with ID: LP07116
2026-03-30 08:38:14 [auto1.be] INFO: Found listing with ID: LP97900
2026-03-30 08:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LP97900%27 HTTP/1.1" 200 None
2026-03-30 08:38:14 [auto1.be] INFO: Scrape type for LP97900: 0
2026-03-30 08:38:14 [auto1.be] INFO: Found listing with ID: BK01349
2026-03-30 08:38:14 [auto1.be] INFO: Found listing with ID: AW74184
2026-03-30 08:38:14 [auto1.be] INFO: Found listing with ID: XL43279
2026-03-30 08:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL43279%27 HTTP/1.1" 200 None
2026-03-30 08:38:14 [auto1.be] INFO: Scrape type for XL43279: 2
2026-03-30 08:38:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e61ddf2-108f-51dd-b934-ef49eda36b47 with identifier: XL43279
2026-03-30 08:38:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e61ddf2-108f-51dd-b934-ef49eda36b47 with scrape type 2
2026-03-30 08:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e61ddf2-108f-51dd-b934-ef49eda36b47 with scrape type 2
2026-03-30 08:38:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9e61ddf2-108f-51dd-b934-ef49eda36b47, identifier: XL43279
2026-03-30 08:38:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9e61ddf2-108f-51dd-b934-ef49eda36b47 with identifier: XL43279
2026-03-30 08:38:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9e61ddf2-108f-51dd-b934-ef49eda36b47 with identifier: XL43279
2026-03-30 08:38:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9e61ddf2-108f-51dd-b934-ef49eda36b47 with identifier: XL43279 to the API
2026-03-30 08:38:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:38:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:38:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 110,
'expiration_date': '2026-03-30T15:58:51Z',
'fuel_type': 'diesel',
'id': '9e61ddf2-108f-51dd-b934-ef49eda36b47',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL43279',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 204240,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-15',
'seller_name': None,
'title': 'Skoda Octavia 1.6 TDI GreenLine',
'transmission': 'manual',
'trim': 'GreenLine',
'year': 2016}
2026-03-30 08:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL43279%27 HTTP/1.1" 200 None
2026-03-30 08:38:15 [auto1.be] INFO: Saving data for XL43279: {'auction_closing_time': 1774886331.0, 'created_time': 1774557431.051864, 'last_price_update_time': 1774859895.136347}
2026-03-30 08:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XL43279') HTTP/1.1" 204 0
2026-03-30 08:38:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:38:15 [auto1.be] INFO: Found listing with ID: SC85120
2026-03-30 08:38:15 [auto1.be] INFO: Found listing with ID: BA37972
2026-03-30 08:38:15 [auto1.be] INFO: Found listing with ID: TW09601
2026-03-30 08:38:15 [auto1.be] INFO: Found listing with ID: TZ99758
2026-03-30 08:38:15 [auto1.be] INFO: Found listing with ID: RH32729
2026-03-30 08:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RH32729%27 HTTP/1.1" 200 None
2026-03-30 08:38:15 [auto1.be] INFO: Scrape type for RH32729: 0
2026-03-30 08:38:15 [auto1.be] INFO: Found listing with ID: LT47332
2026-03-30 08:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LT47332%27 HTTP/1.1" 200 None
2026-03-30 08:38:15 [auto1.be] INFO: Scrape type for LT47332: 0
2026-03-30 08:38:15 [auto1.be] INFO: Found listing with ID: DY28234
2026-03-30 08:38:15 [auto1.be] INFO: Found listing with ID: UU12218
2026-03-30 08:38:15 [auto1.be] INFO: Found listing with ID: WS04459
2026-03-30 08:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WS04459%27 HTTP/1.1" 200 None
2026-03-30 08:38:15 [auto1.be] INFO: Scrape type for WS04459: 0
2026-03-30 08:38:15 [auto1.be] INFO: Found listing with ID: PB25162
2026-03-30 08:38:15 [auto1.be] INFO: Found listing with ID: KS43499
2026-03-30 08:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KS43499%27 HTTP/1.1" 200 None
2026-03-30 08:38:15 [auto1.be] INFO: Scrape type for KS43499: 0
2026-03-30 08:38:15 [auto1.be] INFO: Found listing with ID: UA44051
2026-03-30 08:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA44051%27 HTTP/1.1" 200 None
2026-03-30 08:38:15 [auto1.be] INFO: Scrape type for UA44051: 0
2026-03-30 08:38:15 [auto1.be] INFO: Found listing with ID: BZ65544
2026-03-30 08:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ65544%27 HTTP/1.1" 200 None
2026-03-30 08:38:15 [auto1.be] INFO: Scrape type for BZ65544: 0
2026-03-30 08:38:15 [auto1.be] INFO: Found listing with ID: HZ19238
2026-03-30 08:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ19238%27 HTTP/1.1" 200 None
2026-03-30 08:38:15 [auto1.be] INFO: Scrape type for HZ19238: 0
2026-03-30 08:38:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:38:46 [auto1.be] INFO: Channel: 24h | Page: 29 | totalHits: 1502 | hits on page: 40
2026-03-30 08:38:46 [auto1.be] INFO: Found listing with ID: KU11213
2026-03-30 08:38:46 [auto1.be] INFO: Found listing with ID: PY12122
2026-03-30 08:38:46 [auto1.be] INFO: Found listing with ID: DC17534
2026-03-30 08:38:46 [auto1.be] INFO: Found listing with ID: AT20959
2026-03-30 08:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AT20959%27 HTTP/1.1" 200 None
2026-03-30 08:38:46 [auto1.be] INFO: Scrape type for AT20959: 0
2026-03-30 08:38:46 [auto1.be] INFO: Found listing with ID: WP69561
2026-03-30 08:38:46 [auto1.be] INFO: Found listing with ID: JM34078
2026-03-30 08:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM34078%27 HTTP/1.1" 200 None
2026-03-30 08:38:46 [auto1.be] INFO: Scrape type for JM34078: 0
2026-03-30 08:38:46 [auto1.be] INFO: Found listing with ID: YS56392
2026-03-30 08:38:46 [auto1.be] INFO: Found listing with ID: VB04696
2026-03-30 08:38:46 [auto1.be] INFO: Found listing with ID: RR89556
2026-03-30 08:38:46 [auto1.be] INFO: Found listing with ID: RS45224
2026-03-30 08:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RS45224%27 HTTP/1.1" 200 None
2026-03-30 08:38:46 [auto1.be] INFO: Scrape type for RS45224: 0
2026-03-30 08:38:46 [auto1.be] INFO: Found listing with ID: UW48678
2026-03-30 08:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UW48678%27 HTTP/1.1" 200 None
2026-03-30 08:38:46 [auto1.be] INFO: Scrape type for UW48678: 0
2026-03-30 08:38:46 [auto1.be] INFO: Found listing with ID: XM10489
2026-03-30 08:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XM10489%27 HTTP/1.1" 200 None
2026-03-30 08:38:46 [auto1.be] INFO: Scrape type for XM10489: 0
2026-03-30 08:38:46 [auto1.be] INFO: Found listing with ID: SZ65946
2026-03-30 08:38:46 [auto1.be] INFO: Found listing with ID: FH97290
2026-03-30 08:38:46 [auto1.be] INFO: Found listing with ID: MV82025
2026-03-30 08:38:46 [auto1.be] INFO: Found listing with ID: MZ51776
2026-03-30 08:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ51776%27 HTTP/1.1" 200 None
2026-03-30 08:38:46 [auto1.be] INFO: Scrape type for MZ51776: 0
2026-03-30 08:38:46 [auto1.be] INFO: Found listing with ID: HU58936
2026-03-30 08:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU58936%27 HTTP/1.1" 200 None
2026-03-30 08:38:46 [auto1.be] INFO: Scrape type for HU58936: 0
2026-03-30 08:38:46 [auto1.be] INFO: Found listing with ID: WH33984
2026-03-30 08:38:46 [auto1.be] INFO: Found listing with ID: ET79377
2026-03-30 08:38:46 [auto1.be] INFO: Found listing with ID: UR44884
2026-03-30 08:38:46 [auto1.be] INFO: Found listing with ID: HM84114
2026-03-30 08:38:46 [auto1.be] INFO: Found listing with ID: FN16517
2026-03-30 08:38:46 [auto1.be] INFO: Found listing with ID: LC46636
2026-03-30 08:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LC46636%27 HTTP/1.1" 200 None
2026-03-30 08:38:46 [auto1.be] INFO: Scrape type for LC46636: 0
2026-03-30 08:38:46 [auto1.be] INFO: Found listing with ID: SC73086
2026-03-30 08:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC73086%27 HTTP/1.1" 200 None
2026-03-30 08:38:46 [auto1.be] INFO: Scrape type for SC73086: 0
2026-03-30 08:38:46 [auto1.be] INFO: Found listing with ID: UF35860
2026-03-30 08:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF35860%27 HTTP/1.1" 200 None
2026-03-30 08:38:46 [auto1.be] INFO: Scrape type for UF35860: 2
2026-03-30 08:38:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cae05e32-fe1d-51b7-ad9a-9a527d456b92 with identifier: UF35860
2026-03-30 08:38:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cae05e32-fe1d-51b7-ad9a-9a527d456b92 with scrape type 2
2026-03-30 08:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cae05e32-fe1d-51b7-ad9a-9a527d456b92 with scrape type 2
2026-03-30 08:38:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cae05e32-fe1d-51b7-ad9a-9a527d456b92, identifier: UF35860
2026-03-30 08:38:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cae05e32-fe1d-51b7-ad9a-9a527d456b92 with identifier: UF35860
2026-03-30 08:38:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cae05e32-fe1d-51b7-ad9a-9a527d456b92 with identifier: UF35860
2026-03-30 08:38:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cae05e32-fe1d-51b7-ad9a-9a527d456b92 with identifier: UF35860 to the API
2026-03-30 08:38:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:38:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 100,
'expiration_date': '2026-03-30T15:42:15Z',
'fuel_type': 'diesel',
'id': 'cae05e32-fe1d-51b7-ad9a-9a527d456b92',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF35860',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 88536,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-06-29',
'seller_name': None,
'title': 'Peugeot 308 1.6 Blue-HDi Access',
'transmission': 'manual',
'trim': 'Access',
'year': 2016}
2026-03-30 08:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UF35860%27 HTTP/1.1" 200 None
2026-03-30 08:38:47 [auto1.be] INFO: Saving data for UF35860: {'auction_closing_time': 1774885335.0, 'created_time': 1774557539.934275, 'last_price_update_time': 1774859927.2521}
2026-03-30 08:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UF35860') HTTP/1.1" 204 0
2026-03-30 08:38:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:38:47 [auto1.be] INFO: Found listing with ID: PR84870
2026-03-30 08:38:47 [auto1.be] INFO: Found listing with ID: NN69701
2026-03-30 08:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NN69701%27 HTTP/1.1" 200 None
2026-03-30 08:38:47 [auto1.be] INFO: Scrape type for NN69701: 0
2026-03-30 08:38:47 [auto1.be] INFO: Found listing with ID: KG53590
2026-03-30 08:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG53590%27 HTTP/1.1" 200 None
2026-03-30 08:38:47 [auto1.be] INFO: Scrape type for KG53590: 0
2026-03-30 08:38:47 [auto1.be] INFO: Found listing with ID: WK50026
2026-03-30 08:38:47 [auto1.be] INFO: Found listing with ID: ZX32272
2026-03-30 08:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZX32272%27 HTTP/1.1" 200 None
2026-03-30 08:38:47 [auto1.be] INFO: Scrape type for ZX32272: 0
2026-03-30 08:38:47 [auto1.be] INFO: Found listing with ID: MK20825
2026-03-30 08:38:47 [auto1.be] INFO: Found listing with ID: YS48127
2026-03-30 08:38:47 [auto1.be] INFO: Found listing with ID: RF74485
2026-03-30 08:38:47 [auto1.be] INFO: Found listing with ID: NC57966
2026-03-30 08:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC57966%27 HTTP/1.1" 200 None
2026-03-30 08:38:47 [auto1.be] INFO: Scrape type for NC57966: 0
2026-03-30 08:38:47 [auto1.be] INFO: Found listing with ID: FU04844
2026-03-30 08:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FU04844%27 HTTP/1.1" 200 None
2026-03-30 08:38:47 [auto1.be] INFO: Scrape type for FU04844: 0
2026-03-30 08:38:47 [auto1.be] INFO: Found listing with ID: FC28385
2026-03-30 08:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC28385%27 HTTP/1.1" 200 None
2026-03-30 08:38:47 [auto1.be] INFO: Scrape type for FC28385: 0
2026-03-30 08:38:47 [auto1.be] INFO: Found listing with ID: MU18005
2026-03-30 08:38:47 [auto1.be] INFO: Found listing with ID: UM95648
2026-03-30 08:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UM95648%27 HTTP/1.1" 200 None
2026-03-30 08:38:47 [auto1.be] INFO: Scrape type for UM95648: 0
2026-03-30 08:38:47 [auto1.be] INFO: Found listing with ID: KV94769
2026-03-30 08:38:47 [auto1.be] INFO: Found listing with ID: VA32651
2026-03-30 08:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA32651%27 HTTP/1.1" 200 None
2026-03-30 08:38:47 [auto1.be] INFO: Scrape type for VA32651: 0
2026-03-30 08:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:38:48 [auto1.be] INFO: Channel: 24h | Page: 30 | totalHits: 1502 | hits on page: 40
2026-03-30 08:38:48 [auto1.be] INFO: Found listing with ID: ZC67013
2026-03-30 08:38:48 [auto1.be] INFO: Found listing with ID: LG02466
2026-03-30 08:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG02466%27 HTTP/1.1" 200 None
2026-03-30 08:38:48 [auto1.be] INFO: Scrape type for LG02466: 0
2026-03-30 08:38:48 [auto1.be] INFO: Found listing with ID: MZ96160
2026-03-30 08:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MZ96160%27 HTTP/1.1" 200 None
2026-03-30 08:38:48 [auto1.be] INFO: Scrape type for MZ96160: 0
2026-03-30 08:38:48 [auto1.be] INFO: Found listing with ID: DD08232
2026-03-30 08:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD08232%27 HTTP/1.1" 200 None
2026-03-30 08:38:48 [auto1.be] INFO: Scrape type for DD08232: 0
2026-03-30 08:38:48 [auto1.be] INFO: Found listing with ID: ZK51287
2026-03-30 08:38:48 [auto1.be] INFO: Found listing with ID: JX00156
2026-03-30 08:38:48 [auto1.be] INFO: Found listing with ID: UN77217
2026-03-30 08:38:48 [auto1.be] INFO: Found listing with ID: VA33507
2026-03-30 08:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VA33507%27 HTTP/1.1" 200 None
2026-03-30 08:38:48 [auto1.be] INFO: Scrape type for VA33507: 0
2026-03-30 08:38:48 [auto1.be] INFO: Found listing with ID: FM00077
2026-03-30 08:38:48 [auto1.be] INFO: Found listing with ID: NS73936
2026-03-30 08:38:48 [auto1.be] INFO: Found listing with ID: LY58233
2026-03-30 08:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY58233%27 HTTP/1.1" 200 None
2026-03-30 08:38:48 [auto1.be] INFO: Scrape type for LY58233: 0
2026-03-30 08:38:48 [auto1.be] INFO: Found listing with ID: XH30316
2026-03-30 08:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XH30316%27 HTTP/1.1" 200 None
2026-03-30 08:38:48 [auto1.be] INFO: Scrape type for XH30316: 0
2026-03-30 08:38:48 [auto1.be] INFO: Found listing with ID: RK82839
2026-03-30 08:38:48 [auto1.be] INFO: Found listing with ID: LE69229
2026-03-30 08:38:48 [auto1.be] INFO: Found listing with ID: CN29269
2026-03-30 08:38:48 [auto1.be] INFO: Found listing with ID: HE95946
2026-03-30 08:38:48 [auto1.be] INFO: Found listing with ID: BY25509
2026-03-30 08:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BY25509%27 HTTP/1.1" 200 None
2026-03-30 08:38:48 [auto1.be] INFO: Scrape type for BY25509: 0
2026-03-30 08:38:48 [auto1.be] INFO: Found listing with ID: ZN76480
2026-03-30 08:38:48 [auto1.be] INFO: Found listing with ID: TR87241
2026-03-30 08:38:48 [auto1.be] INFO: Found listing with ID: PU90284
2026-03-30 08:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PU90284%27 HTTP/1.1" 200 None
2026-03-30 08:38:48 [auto1.be] INFO: Scrape type for PU90284: 0
2026-03-30 08:38:48 [auto1.be] INFO: Found listing with ID: VC92856
2026-03-30 08:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VC92856%27 HTTP/1.1" 200 None
2026-03-30 08:38:49 [auto1.be] INFO: Scrape type for VC92856: 2
2026-03-30 08:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 170033d5-e694-5b56-85da-656784e780ca with identifier: VC92856
2026-03-30 08:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 170033d5-e694-5b56-85da-656784e780ca with scrape type 2
2026-03-30 08:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 170033d5-e694-5b56-85da-656784e780ca with scrape type 2
2026-03-30 08:38:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 170033d5-e694-5b56-85da-656784e780ca, identifier: VC92856
2026-03-30 08:38:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 170033d5-e694-5b56-85da-656784e780ca with identifier: VC92856
2026-03-30 08:38:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 170033d5-e694-5b56-85da-656784e780ca with identifier: VC92856
2026-03-30 08:38:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 170033d5-e694-5b56-85da-656784e780ca with identifier: VC92856 to the API
2026-03-30 08:38:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:38:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:38:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 401,
'expiration_date': '2026-03-30T15:49:59Z',
'fuel_type': 'petrol',
'id': '170033d5-e694-5b56-85da-656784e780ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC92856',
'listing': 'auction',
'make': 'Dodge',
'model': 'Ram 1500',
'odometer': 132361,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-16',
'seller_name': None,
'title': 'Dodge Ram 1500 5.7 V8 4x4',
'transmission': 'automatic',
'trim': '4x4',
'year': 2019}
2026-03-30 08:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VC92856%27 HTTP/1.1" 200 None
2026-03-30 08:38:49 [auto1.be] INFO: Saving data for VC92856: {'auction_closing_time': 1774885799.0, 'created_time': 1774471416.187323, 'last_price_update_time': 1774859929.40628}
2026-03-30 08:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VC92856') HTTP/1.1" 204 0
2026-03-30 08:38:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:38:49 [auto1.be] INFO: Found listing with ID: DJ08738
2026-03-30 08:38:49 [auto1.be] INFO: Found listing with ID: FN69818
2026-03-30 08:38:49 [auto1.be] INFO: Found listing with ID: XB17770
2026-03-30 08:38:49 [auto1.be] INFO: Found listing with ID: MV28568
2026-03-30 08:38:49 [auto1.be] INFO: Found listing with ID: SN22557
2026-03-30 08:38:49 [auto1.be] INFO: Found listing with ID: FW88759
2026-03-30 08:38:49 [auto1.be] INFO: Found listing with ID: FZ81347
2026-03-30 08:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FZ81347%27 HTTP/1.1" 200 None
2026-03-30 08:38:49 [auto1.be] INFO: Scrape type for FZ81347: 0
2026-03-30 08:38:49 [auto1.be] INFO: Found listing with ID: CX83686
2026-03-30 08:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CX83686%27 HTTP/1.1" 200 None
2026-03-30 08:38:49 [auto1.be] INFO: Scrape type for CX83686: 0
2026-03-30 08:38:49 [auto1.be] INFO: Found listing with ID: FR50529
2026-03-30 08:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FR50529%27 HTTP/1.1" 200 None
2026-03-30 08:38:49 [auto1.be] INFO: Scrape type for FR50529: 0
2026-03-30 08:38:49 [auto1.be] INFO: Found listing with ID: PS82481
2026-03-30 08:38:49 [auto1.be] INFO: Found listing with ID: UU07035
2026-03-30 08:38:49 [auto1.be] INFO: Found listing with ID: WL68728
2026-03-30 08:38:49 [auto1.be] INFO: Found listing with ID: MR51068
2026-03-30 08:38:49 [auto1.be] INFO: Found listing with ID: PY41942
2026-03-30 08:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PY41942%27 HTTP/1.1" 200 None
2026-03-30 08:38:49 [auto1.be] INFO: Scrape type for PY41942: 0
2026-03-30 08:38:49 [auto1.be] INFO: Found listing with ID: TP16646
2026-03-30 08:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TP16646%27 HTTP/1.1" 200 None
2026-03-30 08:38:49 [auto1.be] INFO: Scrape type for TP16646: 0
2026-03-30 08:38:49 [auto1.be] INFO: Found listing with ID: AZ39903
2026-03-30 08:38:49 [auto1.be] INFO: Found listing with ID: HB98543
2026-03-30 08:38:49 [auto1.be] INFO: Found listing with ID: RU48742
2026-03-30 08:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RU48742%27 HTTP/1.1" 200 None
2026-03-30 08:38:49 [auto1.be] INFO: Scrape type for RU48742: 0
2026-03-30 08:38:49 [auto1.be] INFO: Found listing with ID: DK63787
2026-03-30 08:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK63787%27 HTTP/1.1" 200 None
2026-03-30 08:38:49 [auto1.be] INFO: Scrape type for DK63787: 0
2026-03-30 08:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:38:50 [auto1.be] INFO: Channel: 24h | Page: 31 | totalHits: 1503 | hits on page: 40
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: DK63787
2026-03-30 08:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DK63787%27 HTTP/1.1" 200 None
2026-03-30 08:38:50 [auto1.be] INFO: Scrape type for DK63787: 0
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: KG87325
2026-03-30 08:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KG87325%27 HTTP/1.1" 200 None
2026-03-30 08:38:50 [auto1.be] INFO: Scrape type for KG87325: 0
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: HU17820
2026-03-30 08:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HU17820%27 HTTP/1.1" 200 None
2026-03-30 08:38:50 [auto1.be] INFO: Scrape type for HU17820: 0
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: NL83155
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: NV75936
2026-03-30 08:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV75936%27 HTTP/1.1" 200 None
2026-03-30 08:38:50 [auto1.be] INFO: Scrape type for NV75936: 0
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: AW25378
2026-03-30 08:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AW25378%27 HTTP/1.1" 200 None
2026-03-30 08:38:50 [auto1.be] INFO: Scrape type for AW25378: 0
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: PF94112
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: XT95399
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: NT98676
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: ZA12378
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: LS82290
2026-03-30 08:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LS82290%27 HTTP/1.1" 200 None
2026-03-30 08:38:50 [auto1.be] INFO: Scrape type for LS82290: 0
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: FJ54867
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: CM51817
2026-03-30 08:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CM51817%27 HTTP/1.1" 200 None
2026-03-30 08:38:50 [auto1.be] INFO: Scrape type for CM51817: 0
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: KD88013
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: YY44687
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: BX66623
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: DM24490
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: PM87207
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: RD23593
2026-03-30 08:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD23593%27 HTTP/1.1" 200 None
2026-03-30 08:38:50 [auto1.be] INFO: Scrape type for RD23593: 0
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: XW30503
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: GD95033
2026-03-30 08:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GD95033%27 HTTP/1.1" 200 None
2026-03-30 08:38:50 [auto1.be] INFO: Scrape type for GD95033: 0
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: UE36464
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: ER02883
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: LG99308
2026-03-30 08:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LG99308%27 HTTP/1.1" 200 None
2026-03-30 08:38:50 [auto1.be] INFO: Scrape type for LG99308: 0
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: KW17867
2026-03-30 08:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KW17867%27 HTTP/1.1" 200 None
2026-03-30 08:38:50 [auto1.be] INFO: Scrape type for KW17867: 0
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: HT18059
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: PE64709
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: HS15781
2026-03-30 08:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HS15781%27 HTTP/1.1" 200 None
2026-03-30 08:38:50 [auto1.be] INFO: Scrape type for HS15781: 0
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: HT80629
2026-03-30 08:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HT80629%27 HTTP/1.1" 200 None
2026-03-30 08:38:50 [auto1.be] INFO: Scrape type for HT80629: 0
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: FT23017
2026-03-30 08:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT23017%27 HTTP/1.1" 200 None
2026-03-30 08:38:50 [auto1.be] INFO: Scrape type for FT23017: 0
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: ZM05640
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: KT01454
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: AC59433
2026-03-30 08:38:50 [auto1.be] INFO: Found listing with ID: MY75694
2026-03-30 08:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MY75694%27 HTTP/1.1" 200 None
2026-03-30 08:38:51 [auto1.be] INFO: Scrape type for MY75694: 0
2026-03-30 08:38:51 [auto1.be] INFO: Found listing with ID: LH19076
2026-03-30 08:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LH19076%27 HTTP/1.1" 200 None
2026-03-30 08:38:51 [auto1.be] INFO: Scrape type for LH19076: 0
2026-03-30 08:38:51 [auto1.be] INFO: Found listing with ID: GM68229
2026-03-30 08:38:51 [auto1.be] INFO: Found listing with ID: LK30146
2026-03-30 08:38:51 [auto1.be] INFO: Found listing with ID: TF49476
2026-03-30 08:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF49476%27 HTTP/1.1" 200 None
2026-03-30 08:38:51 [auto1.be] INFO: Scrape type for TF49476: 0
2026-03-30 08:38:51 [auto1.be] INFO: Found listing with ID: FT86060
2026-03-30 08:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FT86060%27 HTTP/1.1" 200 None
2026-03-30 08:38:51 [auto1.be] INFO: Scrape type for FT86060: 0
2026-03-30 08:38:51 [auto1.be] INFO: Found listing with ID: JT63704
2026-03-30 08:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JT63704%27 HTTP/1.1" 200 None
2026-03-30 08:38:51 [auto1.be] INFO: Scrape type for JT63704: 0
2026-03-30 08:38:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:38:52 [auto1.be] INFO: Channel: 24h | Page: 32 | totalHits: 1503 | hits on page: 40
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: UA37218
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: SX16585
2026-03-30 08:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX16585%27 HTTP/1.1" 200 None
2026-03-30 08:38:52 [auto1.be] INFO: Scrape type for SX16585: 0
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: TF43790
2026-03-30 08:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF43790%27 HTTP/1.1" 200 None
2026-03-30 08:38:52 [auto1.be] INFO: Scrape type for TF43790: 0
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: NZ75648
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: ER91021
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: LF44164
2026-03-30 08:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LF44164%27 HTTP/1.1" 200 None
2026-03-30 08:38:52 [auto1.be] INFO: Scrape type for LF44164: 0
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: SV00163
2026-03-30 08:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV00163%27 HTTP/1.1" 200 None
2026-03-30 08:38:52 [auto1.be] INFO: Scrape type for SV00163: 0
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: EM88075
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: VM07385
2026-03-30 08:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VM07385%27 HTTP/1.1" 200 None
2026-03-30 08:38:52 [auto1.be] INFO: Scrape type for VM07385: 0
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: WC19794
2026-03-30 08:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WC19794%27 HTTP/1.1" 200 None
2026-03-30 08:38:52 [auto1.be] INFO: Scrape type for WC19794: 0
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: UV16393
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: AY92488
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: SB51494
2026-03-30 08:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SB51494%27 HTTP/1.1" 200 None
2026-03-30 08:38:52 [auto1.be] INFO: Scrape type for SB51494: 0
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: KM81672
2026-03-30 08:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KM81672%27 HTTP/1.1" 200 None
2026-03-30 08:38:52 [auto1.be] INFO: Scrape type for KM81672: 0
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: JC37428
2026-03-30 08:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JC37428%27 HTTP/1.1" 200 None
2026-03-30 08:38:52 [auto1.be] INFO: Scrape type for JC37428: 0
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: RL22884
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: WH35268
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: DZ29736
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: BT48733
2026-03-30 08:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BT48733%27 HTTP/1.1" 200 None
2026-03-30 08:38:52 [auto1.be] INFO: Scrape type for BT48733: 0
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: JM52918
2026-03-30 08:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JM52918%27 HTTP/1.1" 200 None
2026-03-30 08:38:52 [auto1.be] INFO: Scrape type for JM52918: 0
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: PJ47204
2026-03-30 08:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PJ47204%27 HTTP/1.1" 200 None
2026-03-30 08:38:52 [auto1.be] INFO: Scrape type for PJ47204: 0
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: WV93881
2026-03-30 08:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV93881%27 HTTP/1.1" 200 None
2026-03-30 08:38:52 [auto1.be] INFO: Scrape type for WV93881: 0
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: ZN30582
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: DW89604
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: WV93759
2026-03-30 08:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV93759%27 HTTP/1.1" 200 None
2026-03-30 08:38:52 [auto1.be] INFO: Scrape type for WV93759: 0
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: JB30712
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: XK23104
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: SG83875
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: UM29446
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: XS20349
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: TA24587
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: MM51411
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: EM05161
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: HZ76034
2026-03-30 08:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HZ76034%27 HTTP/1.1" 200 None
2026-03-30 08:38:52 [auto1.be] INFO: Scrape type for HZ76034: 0
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: US61524
2026-03-30 08:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27US61524%27 HTTP/1.1" 200 None
2026-03-30 08:38:52 [auto1.be] INFO: Scrape type for US61524: 0
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: DP44577
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: KU92863
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: XU79591
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: LM11563
2026-03-30 08:38:52 [auto1.be] INFO: Found listing with ID: VZ26705
2026-03-30 08:38:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:38:54 [auto1.be] INFO: Channel: 24h | Page: 33 | totalHits: 1503 | hits on page: 40
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: GW19918
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: UY14877
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: WJ93890
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WJ93890%27 HTTP/1.1" 200 None
2026-03-30 08:38:54 [auto1.be] INFO: Scrape type for WJ93890: 0
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: DN00999
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DN00999%27 HTTP/1.1" 200 None
2026-03-30 08:38:54 [auto1.be] INFO: Scrape type for DN00999: 0
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: GN49517
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: BE30988
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: ZW40078
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZW40078%27 HTTP/1.1" 200 None
2026-03-30 08:38:54 [auto1.be] INFO: Scrape type for ZW40078: 0
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: YW96446
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YW96446%27 HTTP/1.1" 200 None
2026-03-30 08:38:54 [auto1.be] INFO: Scrape type for YW96446: 0
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: LA99224
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: UE64828
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UE64828%27 HTTP/1.1" 200 None
2026-03-30 08:38:54 [auto1.be] INFO: Scrape type for UE64828: 0
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: GJ36560
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: KF94293
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KF94293%27 HTTP/1.1" 200 None
2026-03-30 08:38:54 [auto1.be] INFO: Scrape type for KF94293: 0
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: ER36240
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: SD86163
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: LM13926
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LM13926%27 HTTP/1.1" 200 None
2026-03-30 08:38:54 [auto1.be] INFO: Scrape type for LM13926: 0
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: AE63964
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AE63964%27 HTTP/1.1" 200 None
2026-03-30 08:38:54 [auto1.be] INFO: Scrape type for AE63964: 0
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: SL57288
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SL57288%27 HTTP/1.1" 200 None
2026-03-30 08:38:54 [auto1.be] INFO: Scrape type for SL57288: 0
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: BT92464
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: RK43455
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RK43455%27 HTTP/1.1" 200 None
2026-03-30 08:38:54 [auto1.be] INFO: Scrape type for RK43455: 0
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: KG93945
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: FB93927
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FB93927%27 HTTP/1.1" 200 None
2026-03-30 08:38:54 [auto1.be] INFO: Scrape type for FB93927: 0
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: SV46049
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SV46049%27 HTTP/1.1" 200 None
2026-03-30 08:38:54 [auto1.be] INFO: Scrape type for SV46049: 0
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: WV65314
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV65314%27 HTTP/1.1" 200 None
2026-03-30 08:38:54 [auto1.be] INFO: Scrape type for WV65314: 0
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: FM81572
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FM81572%27 HTTP/1.1" 200 None
2026-03-30 08:38:54 [auto1.be] INFO: Scrape type for FM81572: 0
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: HJ19751
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: MW50956
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27MW50956%27 HTTP/1.1" 200 None
2026-03-30 08:38:54 [auto1.be] INFO: Scrape type for MW50956: 0
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: JJ70860
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: DN28044
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DN28044%27 HTTP/1.1" 200 None
2026-03-30 08:38:54 [auto1.be] INFO: Scrape type for DN28044: 0
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: WG38275
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WG38275%27 HTTP/1.1" 200 None
2026-03-30 08:38:54 [auto1.be] INFO: Scrape type for WG38275: 0
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: NC08569
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NC08569%27 HTTP/1.1" 200 None
2026-03-30 08:38:54 [auto1.be] INFO: Scrape type for NC08569: 0
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: JR09444
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: CF30779
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CF30779%27 HTTP/1.1" 200 None
2026-03-30 08:38:54 [auto1.be] INFO: Scrape type for CF30779: 0
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: WT53046
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WT53046%27 HTTP/1.1" 200 None
2026-03-30 08:38:54 [auto1.be] INFO: Scrape type for WT53046: 0
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: DR48094
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DR48094%27 HTTP/1.1" 200 None
2026-03-30 08:38:54 [auto1.be] INFO: Scrape type for DR48094: 0
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: JZ34939
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JZ34939%27 HTTP/1.1" 200 None
2026-03-30 08:38:54 [auto1.be] INFO: Scrape type for JZ34939: 0
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: TX04561
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TX04561%27 HTTP/1.1" 200 None
2026-03-30 08:38:54 [auto1.be] INFO: Scrape type for TX04561: 0
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: ET82729
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: BC33060
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BC33060%27 HTTP/1.1" 200 None
2026-03-30 08:38:54 [auto1.be] INFO: Scrape type for BC33060: 0
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: HL00392
2026-03-30 08:38:54 [auto1.be] INFO: Found listing with ID: EP00364
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EP00364%27 HTTP/1.1" 200 None
2026-03-30 08:38:54 [auto1.be] INFO: Scrape type for EP00364: 0
2026-03-30 08:38:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:38:55 [auto1.be] INFO: Channel: 24h | Page: 34 | totalHits: 1503 | hits on page: 40
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: AU29077
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: FL05782
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: HB59214
2026-03-30 08:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HB59214%27 HTTP/1.1" 200 None
2026-03-30 08:38:55 [auto1.be] INFO: Scrape type for HB59214: 0
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: SX95001
2026-03-30 08:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SX95001%27 HTTP/1.1" 200 None
2026-03-30 08:38:55 [auto1.be] INFO: Scrape type for SX95001: 0
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: UR33188
2026-03-30 08:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UR33188%27 HTTP/1.1" 200 None
2026-03-30 08:38:55 [auto1.be] INFO: Scrape type for UR33188: 0
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: UY27001
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: CM21252
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: SU85893
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: DT20121
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: VM76060
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: FJ57746
2026-03-30 08:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FJ57746%27 HTTP/1.1" 200 None
2026-03-30 08:38:55 [auto1.be] INFO: Scrape type for FJ57746: 0
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: KZ05274
2026-03-30 08:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KZ05274%27 HTTP/1.1" 200 None
2026-03-30 08:38:55 [auto1.be] INFO: Scrape type for KZ05274: 0
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: TJ00131
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: VY36246
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: MJ04907
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: YG03175
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: HK87235
2026-03-30 08:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HK87235%27 HTTP/1.1" 200 None
2026-03-30 08:38:55 [auto1.be] INFO: Scrape type for HK87235: 0
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: UG65181
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: KT35610
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: CD22470
2026-03-30 08:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CD22470%27 HTTP/1.1" 200 None
2026-03-30 08:38:55 [auto1.be] INFO: Scrape type for CD22470: 0
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: SJ05954
2026-03-30 08:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SJ05954%27 HTTP/1.1" 200 None
2026-03-30 08:38:55 [auto1.be] INFO: Scrape type for SJ05954: 0
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: GH80996
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: ZY24236
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: FV90992
2026-03-30 08:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FV90992%27 HTTP/1.1" 200 None
2026-03-30 08:38:55 [auto1.be] INFO: Scrape type for FV90992: 0
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: PG48700
2026-03-30 08:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PG48700%27 HTTP/1.1" 200 None
2026-03-30 08:38:55 [auto1.be] INFO: Scrape type for PG48700: 0
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: ZZ74713
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: XD67660
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: DT55223
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: EL95031
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: DC62563
2026-03-30 08:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DC62563%27 HTTP/1.1" 200 None
2026-03-30 08:38:55 [auto1.be] INFO: Scrape type for DC62563: 0
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: UX01518
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: ZP95092
2026-03-30 08:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZP95092%27 HTTP/1.1" 200 None
2026-03-30 08:38:55 [auto1.be] INFO: Scrape type for ZP95092: 0
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: ZR35447
2026-03-30 08:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZR35447%27 HTTP/1.1" 200 None
2026-03-30 08:38:55 [auto1.be] INFO: Scrape type for ZR35447: 0
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: EK14732
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: CA54828
2026-03-30 08:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CA54828%27 HTTP/1.1" 200 None
2026-03-30 08:38:55 [auto1.be] INFO: Scrape type for CA54828: 0
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: UR02836
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: XK01311
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: FW70524
2026-03-30 08:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FW70524%27 HTTP/1.1" 200 None
2026-03-30 08:38:55 [auto1.be] INFO: Scrape type for FW70524: 0
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: ED41371
2026-03-30 08:38:55 [auto1.be] INFO: Found listing with ID: VX51166
2026-03-30 08:38:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:38:56 [auto1.be] INFO: Channel: 24h | Page: 35 | totalHits: 1503 | hits on page: 40
2026-03-30 08:38:56 [auto1.be] INFO: Found listing with ID: BD29807
2026-03-30 08:38:56 [auto1.be] INFO: Found listing with ID: NZ74768
2026-03-30 08:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NZ74768%27 HTTP/1.1" 200 None
2026-03-30 08:38:56 [auto1.be] INFO: Scrape type for NZ74768: 0
2026-03-30 08:38:56 [auto1.be] INFO: Found listing with ID: AC55620
2026-03-30 08:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AC55620%27 HTTP/1.1" 200 None
2026-03-30 08:38:56 [auto1.be] INFO: Scrape type for AC55620: 0
2026-03-30 08:38:56 [auto1.be] INFO: Found listing with ID: ZJ26009
2026-03-30 08:38:56 [auto1.be] INFO: Found listing with ID: LR36013
2026-03-30 08:38:56 [auto1.be] INFO: Found listing with ID: YZ92764
2026-03-30 08:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YZ92764%27 HTTP/1.1" 200 None
2026-03-30 08:38:56 [auto1.be] INFO: Scrape type for YZ92764: 0
2026-03-30 08:38:56 [auto1.be] INFO: Found listing with ID: ZZ63767
2026-03-30 08:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ63767%27 HTTP/1.1" 200 None
2026-03-30 08:38:56 [auto1.be] INFO: Scrape type for ZZ63767: 0
2026-03-30 08:38:56 [auto1.be] INFO: Found listing with ID: VW23905
2026-03-30 08:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VW23905%27 HTTP/1.1" 200 None
2026-03-30 08:38:56 [auto1.be] INFO: Scrape type for VW23905: 0
2026-03-30 08:38:56 [auto1.be] INFO: Found listing with ID: BZ70123
2026-03-30 08:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ70123%27 HTTP/1.1" 200 None
2026-03-30 08:38:56 [auto1.be] INFO: Scrape type for BZ70123: 0
2026-03-30 08:38:56 [auto1.be] INFO: Found listing with ID: TX50404
2026-03-30 08:38:56 [auto1.be] INFO: Found listing with ID: XC95069
2026-03-30 08:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XC95069%27 HTTP/1.1" 200 None
2026-03-30 08:38:56 [auto1.be] INFO: Scrape type for XC95069: 0
2026-03-30 08:38:56 [auto1.be] INFO: Found listing with ID: BS70441
2026-03-30 08:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BS70441%27 HTTP/1.1" 200 None
2026-03-30 08:38:57 [auto1.be] INFO: Scrape type for BS70441: 0
2026-03-30 08:38:57 [auto1.be] INFO: Found listing with ID: GM14941
2026-03-30 08:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GM14941%27 HTTP/1.1" 200 None
2026-03-30 08:38:57 [auto1.be] INFO: Scrape type for GM14941: 0
2026-03-30 08:38:57 [auto1.be] INFO: Found listing with ID: SY87797
2026-03-30 08:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SY87797%27 HTTP/1.1" 200 None
2026-03-30 08:38:57 [auto1.be] INFO: Scrape type for SY87797: 0
2026-03-30 08:38:57 [auto1.be] INFO: Found listing with ID: WV78161
2026-03-30 08:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WV78161%27 HTTP/1.1" 200 None
2026-03-30 08:38:57 [auto1.be] INFO: Scrape type for WV78161: 0
2026-03-30 08:38:57 [auto1.be] INFO: Found listing with ID: ZV95387
2026-03-30 08:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZV95387%27 HTTP/1.1" 200 None
2026-03-30 08:38:57 [auto1.be] INFO: Scrape type for ZV95387: 0
2026-03-30 08:38:57 [auto1.be] INFO: Found listing with ID: HR69689
2026-03-30 08:38:57 [auto1.be] INFO: Found listing with ID: KB40459
2026-03-30 08:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KB40459%27 HTTP/1.1" 200 None
2026-03-30 08:38:57 [auto1.be] INFO: Scrape type for KB40459: 0
2026-03-30 08:38:57 [auto1.be] INFO: Found listing with ID: FC15884
2026-03-30 08:38:57 [auto1.be] INFO: Found listing with ID: KX73156
2026-03-30 08:38:57 [auto1.be] INFO: Found listing with ID: ZZ39097
2026-03-30 08:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZZ39097%27 HTTP/1.1" 200 None
2026-03-30 08:38:57 [auto1.be] INFO: Scrape type for ZZ39097: 0
2026-03-30 08:38:57 [auto1.be] INFO: Found listing with ID: SZ00073
2026-03-30 08:38:57 [auto1.be] INFO: Found listing with ID: SC10935
2026-03-30 08:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SC10935%27 HTTP/1.1" 200 None
2026-03-30 08:38:57 [auto1.be] INFO: Scrape type for SC10935: 0
2026-03-30 08:38:57 [auto1.be] INFO: Found listing with ID: BU18930
2026-03-30 08:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BU18930%27 HTTP/1.1" 200 None
2026-03-30 08:38:57 [auto1.be] INFO: Scrape type for BU18930: 0
2026-03-30 08:38:57 [auto1.be] INFO: Found listing with ID: CA73486
2026-03-30 08:38:57 [auto1.be] INFO: Found listing with ID: NU74968
2026-03-30 08:38:57 [auto1.be] INFO: Found listing with ID: WX14373
2026-03-30 08:38:57 [auto1.be] INFO: Found listing with ID: YK61845
2026-03-30 08:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YK61845%27 HTTP/1.1" 200 None
2026-03-30 08:38:57 [auto1.be] INFO: Scrape type for YK61845: 0
2026-03-30 08:38:57 [auto1.be] INFO: Found listing with ID: CN37182
2026-03-30 08:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CN37182%27 HTTP/1.1" 200 None
2026-03-30 08:38:57 [auto1.be] INFO: Scrape type for CN37182: 0
2026-03-30 08:38:57 [auto1.be] INFO: Found listing with ID: EK79460
2026-03-30 08:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EK79460%27 HTTP/1.1" 200 None
2026-03-30 08:38:57 [auto1.be] INFO: Scrape type for EK79460: 0
2026-03-30 08:38:57 [auto1.be] INFO: Found listing with ID: SW60531
2026-03-30 08:38:57 [auto1.be] INFO: Found listing with ID: KE51169
2026-03-30 08:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KE51169%27 HTTP/1.1" 200 None
2026-03-30 08:38:57 [auto1.be] INFO: Scrape type for KE51169: 0
2026-03-30 08:38:57 [auto1.be] INFO: Found listing with ID: KH65741
2026-03-30 08:38:57 [auto1.be] INFO: Found listing with ID: JJ51820
2026-03-30 08:38:57 [auto1.be] INFO: Found listing with ID: CV58665
2026-03-30 08:38:57 [auto1.be] INFO: Found listing with ID: NE94103
2026-03-30 08:38:57 [auto1.be] INFO: Found listing with ID: RC51689
2026-03-30 08:38:57 [auto1.be] INFO: Found listing with ID: XS76018
2026-03-30 08:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XS76018%27 HTTP/1.1" 200 None
2026-03-30 08:38:57 [auto1.be] INFO: Scrape type for XS76018: 0
2026-03-30 08:38:57 [auto1.be] INFO: Found listing with ID: UY92003
2026-03-30 08:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UY92003%27 HTTP/1.1" 200 None
2026-03-30 08:38:57 [auto1.be] INFO: Scrape type for UY92003: 0
2026-03-30 08:38:57 [auto1.be] INFO: Found listing with ID: NV64774
2026-03-30 08:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27NV64774%27 HTTP/1.1" 200 None
2026-03-30 08:38:57 [auto1.be] INFO: Scrape type for NV64774: 0
2026-03-30 08:38:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:38:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:38:58 [auto1.be] INFO: Channel: 24h | Page: 36 | totalHits: 1503 | hits on page: 40
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: KB41449
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: ET88330
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ET88330%27 HTTP/1.1" 200 None
2026-03-30 08:38:58 [auto1.be] INFO: Scrape type for ET88330: 0
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: KT00341
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KT00341%27 HTTP/1.1" 200 None
2026-03-30 08:38:58 [auto1.be] INFO: Scrape type for KT00341: 0
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: YH90615
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YH90615%27 HTTP/1.1" 200 None
2026-03-30 08:38:58 [auto1.be] INFO: Scrape type for YH90615: 0
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: CU35051
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CU35051%27 HTTP/1.1" 200 None
2026-03-30 08:38:58 [auto1.be] INFO: Scrape type for CU35051: 0
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: JU94491
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: PK02246
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PK02246%27 HTTP/1.1" 200 None
2026-03-30 08:38:58 [auto1.be] INFO: Scrape type for PK02246: 0
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: PU93740
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: LY17098
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LY17098%27 HTTP/1.1" 200 None
2026-03-30 08:38:58 [auto1.be] INFO: Scrape type for LY17098: 0
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: FC78029
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FC78029%27 HTTP/1.1" 200 None
2026-03-30 08:38:58 [auto1.be] INFO: Scrape type for FC78029: 0
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: EH00335
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EH00335%27 HTTP/1.1" 200 None
2026-03-30 08:38:58 [auto1.be] INFO: Scrape type for EH00335: 0
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: WH49963
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WH49963%27 HTTP/1.1" 200 None
2026-03-30 08:38:58 [auto1.be] INFO: Scrape type for WH49963: 0
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: XG70738
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: KL53758
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KL53758%27 HTTP/1.1" 200 None
2026-03-30 08:38:58 [auto1.be] INFO: Scrape type for KL53758: 0
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: GV92885
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: RA73981
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RA73981%27 HTTP/1.1" 200 None
2026-03-30 08:38:58 [auto1.be] INFO: Scrape type for RA73981: 0
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: EJ96142
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EJ96142%27 HTTP/1.1" 200 None
2026-03-30 08:38:58 [auto1.be] INFO: Scrape type for EJ96142: 0
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: HE39793
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HE39793%27 HTTP/1.1" 200 None
2026-03-30 08:38:58 [auto1.be] INFO: Scrape type for HE39793: 0
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: DD83263
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DD83263%27 HTTP/1.1" 200 None
2026-03-30 08:38:58 [auto1.be] INFO: Scrape type for DD83263: 0
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: DV83163
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: SW21472
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SW21472%27 HTTP/1.1" 200 None
2026-03-30 08:38:58 [auto1.be] INFO: Scrape type for SW21472: 0
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: AF15006
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: JY19882
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: EY57880
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EY57880%27 HTTP/1.1" 200 None
2026-03-30 08:38:58 [auto1.be] INFO: Scrape type for EY57880: 0
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: JZ80953
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: TL44110
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: ZN56944
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZN56944%27 HTTP/1.1" 200 None
2026-03-30 08:38:58 [auto1.be] INFO: Scrape type for ZN56944: 0
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: FC31614
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: HX50025
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HX50025%27 HTTP/1.1" 200 None
2026-03-30 08:38:58 [auto1.be] INFO: Scrape type for HX50025: 0
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: DH53723
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DH53723%27 HTTP/1.1" 200 None
2026-03-30 08:38:58 [auto1.be] INFO: Scrape type for DH53723: 0
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: CU06988
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: RD62823
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RD62823%27 HTTP/1.1" 200 None
2026-03-30 08:38:58 [auto1.be] INFO: Scrape type for RD62823: 0
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: KH04328
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: GN32494
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: ZG72967
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZG72967%27 HTTP/1.1" 200 None
2026-03-30 08:38:58 [auto1.be] INFO: Scrape type for ZG72967: 0
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: LA84805
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: UH00217
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UH00217%27 HTTP/1.1" 200 None
2026-03-30 08:38:58 [auto1.be] INFO: Scrape type for UH00217: 0
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: RX31058
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: BB55914
2026-03-30 08:38:58 [auto1.be] INFO: Found listing with ID: EU75132
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EU75132%27 HTTP/1.1" 200 None
2026-03-30 08:38:58 [auto1.be] INFO: Scrape type for EU75132: 0
2026-03-30 08:38:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:38:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:38:59 [auto1.be] INFO: Channel: 24h | Page: 37 | totalHits: 1503 | hits on page: 40
2026-03-30 08:38:59 [auto1.be] INFO: Found listing with ID: JY01361
2026-03-30 08:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27JY01361%27 HTTP/1.1" 200 None
2026-03-30 08:39:00 [auto1.be] INFO: Scrape type for JY01361: 0
2026-03-30 08:39:00 [auto1.be] INFO: Found listing with ID: KC67497
2026-03-30 08:39:00 [auto1.be] INFO: Found listing with ID: FK09845
2026-03-30 08:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FK09845%27 HTTP/1.1" 200 None
2026-03-30 08:39:00 [auto1.be] INFO: Scrape type for FK09845: 0
2026-03-30 08:39:00 [auto1.be] INFO: Found listing with ID: EB31921
2026-03-30 08:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EB31921%27 HTTP/1.1" 200 None
2026-03-30 08:39:00 [auto1.be] INFO: Scrape type for EB31921: 0
2026-03-30 08:39:00 [auto1.be] INFO: Found listing with ID: DJ63605
2026-03-30 08:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27DJ63605%27 HTTP/1.1" 200 None
2026-03-30 08:39:00 [auto1.be] INFO: Scrape type for DJ63605: 0
2026-03-30 08:39:00 [auto1.be] INFO: Found listing with ID: US61346
2026-03-30 08:39:00 [auto1.be] INFO: Found listing with ID: SY12350
2026-03-30 08:39:00 [auto1.be] INFO: Found listing with ID: ST29091
2026-03-30 08:39:00 [auto1.be] INFO: Found listing with ID: TV57254
2026-03-30 08:39:00 [auto1.be] INFO: Found listing with ID: TC61218
2026-03-30 08:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TC61218%27 HTTP/1.1" 200 None
2026-03-30 08:39:00 [auto1.be] INFO: Scrape type for TC61218: 0
2026-03-30 08:39:00 [auto1.be] INFO: Found listing with ID: PP72448
2026-03-30 08:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PP72448%27 HTTP/1.1" 200 None
2026-03-30 08:39:00 [auto1.be] INFO: Scrape type for PP72448: 0
2026-03-30 08:39:00 [auto1.be] INFO: Found listing with ID: EV21741
2026-03-30 08:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27EV21741%27 HTTP/1.1" 200 None
2026-03-30 08:39:00 [auto1.be] INFO: Scrape type for EV21741: 0
2026-03-30 08:39:00 [auto1.be] INFO: Found listing with ID: RF01360
2026-03-30 08:39:00 [auto1.be] INFO: Found listing with ID: UU14069
2026-03-30 08:39:00 [auto1.be] INFO: Found listing with ID: BZ95673
2026-03-30 08:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BZ95673%27 HTTP/1.1" 200 None
2026-03-30 08:39:00 [auto1.be] INFO: Scrape type for BZ95673: 0
2026-03-30 08:39:00 [auto1.be] INFO: Found listing with ID: AG16412
2026-03-30 08:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AG16412%27 HTTP/1.1" 200 None
2026-03-30 08:39:00 [auto1.be] INFO: Scrape type for AG16412: 0
2026-03-30 08:39:00 [auto1.be] INFO: Found listing with ID: TM16327
2026-03-30 08:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TM16327%27 HTTP/1.1" 200 None
2026-03-30 08:39:00 [auto1.be] INFO: Scrape type for TM16327: 0
2026-03-30 08:39:00 [auto1.be] INFO: Found listing with ID: UC18604
2026-03-30 08:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UC18604%27 HTTP/1.1" 200 None
2026-03-30 08:39:00 [auto1.be] INFO: Scrape type for UC18604: 0
2026-03-30 08:39:00 [auto1.be] INFO: Found listing with ID: TF70513
2026-03-30 08:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF70513%27 HTTP/1.1" 200 None
2026-03-30 08:39:00 [auto1.be] INFO: Scrape type for TF70513: 2
2026-03-30 08:39:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b3b949e-44a0-59d0-a8b1-c64894673dc1 with identifier: TF70513
2026-03-30 08:39:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b3b949e-44a0-59d0-a8b1-c64894673dc1 with scrape type 2
2026-03-30 08:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b3b949e-44a0-59d0-a8b1-c64894673dc1 with scrape type 2
2026-03-30 08:39:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9b3b949e-44a0-59d0-a8b1-c64894673dc1, identifier: TF70513
2026-03-30 08:39:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9b3b949e-44a0-59d0-a8b1-c64894673dc1 with identifier: TF70513
2026-03-30 08:39:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9b3b949e-44a0-59d0-a8b1-c64894673dc1 with identifier: TF70513
2026-03-30 08:39:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9b3b949e-44a0-59d0-a8b1-c64894673dc1 with identifier: TF70513 to the API
2026-03-30 08:39:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:39:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:39:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 190,
'expiration_date': '2026-03-30T15:08:48Z',
'fuel_type': 'diesel',
'id': '9b3b949e-44a0-59d0-a8b1-c64894673dc1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF70513',
'listing': 'auction',
'make': 'Audi',
'model': 'A6',
'odometer': 281912,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-06-25',
'seller_name': None,
'title': 'Audi A6 2.0 TDI Ultra',
'transmission': 'automatic',
'trim': 'Ultra',
'year': 2015}
2026-03-30 08:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TF70513%27 HTTP/1.1" 200 None
2026-03-30 08:39:01 [auto1.be] INFO: Saving data for TF70513: {'auction_closing_time': 1774883328.0, 'created_time': 1774686941.957169, 'last_price_update_time': 1774859941.093159}
2026-03-30 08:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TF70513') HTTP/1.1" 204 0
2026-03-30 08:39:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:39:01 [auto1.be] INFO: Found listing with ID: ZD95004
2026-03-30 08:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZD95004%27 HTTP/1.1" 200 None
2026-03-30 08:39:01 [auto1.be] INFO: Scrape type for ZD95004: 2
2026-03-30 08:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289 with identifier: ZD95004
2026-03-30 08:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289 with scrape type 2
2026-03-30 08:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289 with scrape type 2
2026-03-30 08:39:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289, identifier: ZD95004
2026-03-30 08:39:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289 with identifier: ZD95004
2026-03-30 08:39:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289 with identifier: ZD95004
2026-03-30 08:39:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3d2d86d1-d7da-5fd4-b70f-8cdc28dca289 with identifier: ZD95004 to the API
2026-03-30 08:39:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:39:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:39:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 135,
'expiration_date': '2026-03-30T15:34:04Z',
'fuel_type': 'diesel',
'id': '3d2d86d1-d7da-5fd4-b70f-8cdc28dca289',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD95004',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 109596,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-13',
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 200 CDI Avantgarde',
'transmission': 'automatic',
'trim': 'Avantgarde',
'year': 2009}
2026-03-30 08:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZD95004%27 HTTP/1.1" 200 None
2026-03-30 08:39:01 [auto1.be] INFO: Saving data for ZD95004: {'auction_closing_time': 1774884844.0, 'created_time': 1774686946.518636, 'last_price_update_time': 1774859941.657012}
2026-03-30 08:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZD95004') HTTP/1.1" 204 0
2026-03-30 08:39:01 [auto1.be] INFO: Found listing with ID: ES25967
2026-03-30 08:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES25967%27 HTTP/1.1" 200 None
2026-03-30 08:39:01 [auto1.be] INFO: Scrape type for ES25967: 2
2026-03-30 08:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9d3289d-eb7b-5545-b43e-8b22e2c78374 with identifier: ES25967
2026-03-30 08:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9d3289d-eb7b-5545-b43e-8b22e2c78374 with scrape type 2
2026-03-30 08:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9d3289d-eb7b-5545-b43e-8b22e2c78374 with scrape type 2
2026-03-30 08:39:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b9d3289d-eb7b-5545-b43e-8b22e2c78374, identifier: ES25967
2026-03-30 08:39:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b9d3289d-eb7b-5545-b43e-8b22e2c78374 with identifier: ES25967
2026-03-30 08:39:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b9d3289d-eb7b-5545-b43e-8b22e2c78374 with identifier: ES25967
2026-03-30 08:39:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b9d3289d-eb7b-5545-b43e-8b22e2c78374 with identifier: ES25967 to the API
2026-03-30 08:39:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:39:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:39:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 120,
'expiration_date': '2026-03-30T15:06:00Z',
'fuel_type': 'petrol',
'id': 'b9d3289d-eb7b-5545-b43e-8b22e2c78374',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES25967',
'listing': 'auction',
'make': 'Peugeot',
'model': '308',
'odometer': 140598,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-10-25',
'seller_name': None,
'title': 'Peugeot 308 1.6 Sport Plus',
'transmission': 'manual',
'trim': 'Sport Plus',
'year': 2007}
2026-03-30 08:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ES25967%27 HTTP/1.1" 200 None
2026-03-30 08:39:02 [auto1.be] INFO: Saving data for ES25967: {'auction_closing_time': 1774883160.0, 'created_time': 1774557498.524283, 'last_price_update_time': 1774859942.077178}
2026-03-30 08:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ES25967') HTTP/1.1" 204 0
2026-03-30 08:39:02 [auto1.be] INFO: Found listing with ID: PC01829
2026-03-30 08:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC01829%27 HTTP/1.1" 200 None
2026-03-30 08:39:02 [auto1.be] INFO: Scrape type for PC01829: 2
2026-03-30 08:39:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f5fb589-9951-5f71-991b-a5e438cec510 with identifier: PC01829
2026-03-30 08:39:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f5fb589-9951-5f71-991b-a5e438cec510 with scrape type 2
2026-03-30 08:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f5fb589-9951-5f71-991b-a5e438cec510 with scrape type 2
2026-03-30 08:39:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 0f5fb589-9951-5f71-991b-a5e438cec510, identifier: PC01829
2026-03-30 08:39:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 0f5fb589-9951-5f71-991b-a5e438cec510 with identifier: PC01829
2026-03-30 08:39:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 0f5fb589-9951-5f71-991b-a5e438cec510 with identifier: PC01829
2026-03-30 08:39:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 0f5fb589-9951-5f71-991b-a5e438cec510 with identifier: PC01829 to the API
2026-03-30 08:39:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:39:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:39:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:50:11Z',
'fuel_type': 'diesel',
'id': '0f5fb589-9951-5f71-991b-a5e438cec510',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC01829',
'listing': 'auction',
'make': 'Seat',
'model': 'Cordoba',
'odometer': 133342,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-04-21',
'seller_name': None,
'title': 'Seat Cordoba 1.4 TDI Reference',
'transmission': 'manual',
'trim': 'Reference',
'year': 2008}
2026-03-30 08:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27PC01829%27 HTTP/1.1" 200 None
2026-03-30 08:39:02 [auto1.be] INFO: Saving data for PC01829: {'auction_closing_time': 1774885811.0, 'created_time': 1774686939.100127, 'last_price_update_time': 1774859942.860789}
2026-03-30 08:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='PC01829') HTTP/1.1" 204 0
2026-03-30 08:39:02 [auto1.be] INFO: Found listing with ID: RW32127
2026-03-30 08:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW32127%27 HTTP/1.1" 200 None
2026-03-30 08:39:02 [auto1.be] INFO: Scrape type for RW32127: 2
2026-03-30 08:39:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ebf1fc3-07be-5c12-9255-977e9814527d with identifier: RW32127
2026-03-30 08:39:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ebf1fc3-07be-5c12-9255-977e9814527d with scrape type 2
2026-03-30 08:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ebf1fc3-07be-5c12-9255-977e9814527d with scrape type 2
2026-03-30 08:39:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 9ebf1fc3-07be-5c12-9255-977e9814527d, identifier: RW32127
2026-03-30 08:39:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 9ebf1fc3-07be-5c12-9255-977e9814527d with identifier: RW32127
2026-03-30 08:39:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 9ebf1fc3-07be-5c12-9255-977e9814527d with identifier: RW32127
2026-03-30 08:39:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 9ebf1fc3-07be-5c12-9255-977e9814527d with identifier: RW32127 to the API
2026-03-30 08:39:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:39:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 170,
'expiration_date': '2026-03-30T15:55:44Z',
'fuel_type': 'diesel',
'id': '9ebf1fc3-07be-5c12-9255-977e9814527d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW32127',
'listing': 'auction',
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 436555,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-19',
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 CDI T BlueEfficiency Elegance',
'transmission': 'manual',
'trim': 'T BlueEfficiency Elegance',
'year': 2012}
2026-03-30 08:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RW32127%27 HTTP/1.1" 200 None
2026-03-30 08:39:03 [auto1.be] INFO: Saving data for RW32127: {'auction_closing_time': 1774886144.0, 'created_time': 1774686926.891323, 'last_price_update_time': 1774859943.25431}
2026-03-30 08:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RW32127') HTTP/1.1" 204 0
2026-03-30 08:39:03 [auto1.be] INFO: Found listing with ID: CE27208
2026-03-30 08:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE27208%27 HTTP/1.1" 200 None
2026-03-30 08:39:03 [auto1.be] INFO: Scrape type for CE27208: 2
2026-03-30 08:39:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31345bdc-1875-5eb2-93ff-11d119f18053 with identifier: CE27208
2026-03-30 08:39:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31345bdc-1875-5eb2-93ff-11d119f18053 with scrape type 2
2026-03-30 08:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31345bdc-1875-5eb2-93ff-11d119f18053 with scrape type 2
2026-03-30 08:39:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 31345bdc-1875-5eb2-93ff-11d119f18053, identifier: CE27208
2026-03-30 08:39:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 31345bdc-1875-5eb2-93ff-11d119f18053 with identifier: CE27208
2026-03-30 08:39:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 31345bdc-1875-5eb2-93ff-11d119f18053 with identifier: CE27208
2026-03-30 08:39:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 31345bdc-1875-5eb2-93ff-11d119f18053 with identifier: CE27208 to the API
2026-03-30 08:39:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:39:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:16:01Z',
'fuel_type': 'petrol',
'id': '31345bdc-1875-5eb2-93ff-11d119f18053',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE27208',
'listing': 'auction',
'make': 'Renault',
'model': 'Captur',
'odometer': 8364,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-28',
'seller_name': None,
'title': 'Renault Captur 0.9 Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2019}
2026-03-30 08:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CE27208%27 HTTP/1.1" 200 None
2026-03-30 08:39:03 [auto1.be] INFO: Saving data for CE27208: {'auction_closing_time': 1774883761.0, 'created_time': 1774686941.360472, 'last_price_update_time': 1774859943.684758}
2026-03-30 08:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CE27208') HTTP/1.1" 204 0
2026-03-30 08:39:03 [auto1.be] INFO: Found listing with ID: XG78459
2026-03-30 08:39:03 [auto1.be] INFO: Found listing with ID: CG81228
2026-03-30 08:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG81228%27 HTTP/1.1" 200 None
2026-03-30 08:39:03 [auto1.be] INFO: Scrape type for CG81228: 2
2026-03-30 08:39:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 373d6282-31c7-562e-b795-e7d228f92fa1 with identifier: CG81228
2026-03-30 08:39:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 373d6282-31c7-562e-b795-e7d228f92fa1 with scrape type 2
2026-03-30 08:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 373d6282-31c7-562e-b795-e7d228f92fa1 with scrape type 2
2026-03-30 08:39:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 373d6282-31c7-562e-b795-e7d228f92fa1, identifier: CG81228
2026-03-30 08:39:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 373d6282-31c7-562e-b795-e7d228f92fa1 with identifier: CG81228
2026-03-30 08:39:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 373d6282-31c7-562e-b795-e7d228f92fa1 with identifier: CG81228
2026-03-30 08:39:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 373d6282-31c7-562e-b795-e7d228f92fa1 with identifier: CG81228 to the API
2026-03-30 08:39:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:39:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:39:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 105,
'expiration_date': '2026-03-30T15:23:59Z',
'fuel_type': 'diesel',
'id': '373d6282-31c7-562e-b795-e7d228f92fa1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG81228',
'listing': 'auction',
'make': 'Skoda',
'model': 'Octavia',
'odometer': 257054,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-12-04',
'seller_name': None,
'title': 'Skoda Octavia 1.6 TDI GreenLine',
'transmission': 'manual',
'trim': 'GreenLine',
'year': 2011}
2026-03-30 08:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27CG81228%27 HTTP/1.1" 200 None
2026-03-30 08:39:04 [auto1.be] INFO: Saving data for CG81228: {'auction_closing_time': 1774884239.0, 'created_time': 1774686936.80688, 'last_price_update_time': 1774859944.200964}
2026-03-30 08:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='CG81228') HTTP/1.1" 204 0
2026-03-30 08:39:04 [auto1.be] INFO: Found listing with ID: RC25321
2026-03-30 08:39:04 [auto1.be] INFO: Found listing with ID: YZ86935
2026-03-30 08:39:04 [auto1.be] INFO: Found listing with ID: XB72565
2026-03-30 08:39:04 [auto1.be] INFO: Found listing with ID: WN54122
2026-03-30 08:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN54122%27 HTTP/1.1" 200 None
2026-03-30 08:39:04 [auto1.be] INFO: Scrape type for WN54122: 2
2026-03-30 08:39:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f56cb8fa-524f-5248-8e48-8957f14682fa with identifier: WN54122
2026-03-30 08:39:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f56cb8fa-524f-5248-8e48-8957f14682fa with scrape type 2
2026-03-30 08:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f56cb8fa-524f-5248-8e48-8957f14682fa with scrape type 2
2026-03-30 08:39:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: f56cb8fa-524f-5248-8e48-8957f14682fa, identifier: WN54122
2026-03-30 08:39:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: f56cb8fa-524f-5248-8e48-8957f14682fa with identifier: WN54122
2026-03-30 08:39:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: f56cb8fa-524f-5248-8e48-8957f14682fa with identifier: WN54122
2026-03-30 08:39:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: f56cb8fa-524f-5248-8e48-8957f14682fa with identifier: WN54122 to the API
2026-03-30 08:39:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:39:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:39:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 115,
'expiration_date': '2026-03-30T15:28:36Z',
'fuel_type': 'diesel',
'id': 'f56cb8fa-524f-5248-8e48-8957f14682fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN54122',
'listing': 'auction',
'make': 'Volvo',
'model': 'V50',
'odometer': 295205,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-03-18',
'seller_name': None,
'title': 'Volvo V50 1.6 DRIVe',
'transmission': 'manual',
'trim': '',
'year': 2011}
2026-03-30 08:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WN54122%27 HTTP/1.1" 200 None
2026-03-30 08:39:04 [auto1.be] INFO: Saving data for WN54122: {'auction_closing_time': 1774884516.0, 'created_time': 1774686936.04424, 'last_price_update_time': 1774859944.622157}
2026-03-30 08:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WN54122') HTTP/1.1" 204 0
2026-03-30 08:39:04 [auto1.be] INFO: Found listing with ID: WM28184
2026-03-30 08:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM28184%27 HTTP/1.1" 200 None
2026-03-30 08:39:04 [auto1.be] INFO: Scrape type for WM28184: 2
2026-03-30 08:39:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70e25ca2-9a89-529b-8fd6-fac12f04e25f with identifier: WM28184
2026-03-30 08:39:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70e25ca2-9a89-529b-8fd6-fac12f04e25f with scrape type 2
2026-03-30 08:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70e25ca2-9a89-529b-8fd6-fac12f04e25f with scrape type 2
2026-03-30 08:39:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 70e25ca2-9a89-529b-8fd6-fac12f04e25f, identifier: WM28184
2026-03-30 08:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:39:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 70e25ca2-9a89-529b-8fd6-fac12f04e25f with identifier: WM28184
2026-03-30 08:39:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 70e25ca2-9a89-529b-8fd6-fac12f04e25f with identifier: WM28184
2026-03-30 08:39:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 70e25ca2-9a89-529b-8fd6-fac12f04e25f with identifier: WM28184 to the API
2026-03-30 08:39:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:39:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:39:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:01:25Z',
'fuel_type': 'petrol',
'id': '70e25ca2-9a89-529b-8fd6-fac12f04e25f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM28184',
'listing': 'auction',
'make': 'Renault',
'model': 'Grand Scenic',
'odometer': 201750,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-19',
'seller_name': None,
'title': 'Renault Grand Scenic 1.3 TCe BOSE-Edition',
'transmission': 'manual',
'trim': 'BOSE-Edition',
'year': 2018}
2026-03-30 08:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27WM28184%27 HTTP/1.1" 200 None
2026-03-30 08:39:05 [auto1.be] INFO: Saving data for WM28184: {'auction_closing_time': 1774882885.0, 'created_time': 1774384578.475275, 'last_price_update_time': 1774859945.145299}
2026-03-30 08:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='WM28184') HTTP/1.1" 204 0
2026-03-30 08:39:05 [auto1.be] INFO: Found listing with ID: UA48921
2026-03-30 08:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA48921%27 HTTP/1.1" 200 None
2026-03-30 08:39:05 [auto1.be] INFO: Scrape type for UA48921: 2
2026-03-30 08:39:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2a20b8a-8294-554b-9300-021f075da908 with identifier: UA48921
2026-03-30 08:39:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2a20b8a-8294-554b-9300-021f075da908 with scrape type 2
2026-03-30 08:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2a20b8a-8294-554b-9300-021f075da908 with scrape type 2
2026-03-30 08:39:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b2a20b8a-8294-554b-9300-021f075da908, identifier: UA48921
2026-03-30 08:39:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b2a20b8a-8294-554b-9300-021f075da908 with identifier: UA48921
2026-03-30 08:39:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b2a20b8a-8294-554b-9300-021f075da908 with identifier: UA48921
2026-03-30 08:39:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b2a20b8a-8294-554b-9300-021f075da908 with identifier: UA48921 to the API
2026-03-30 08:39:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:39:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:39:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 2,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:56:58Z',
'fuel_type': 'petrol',
'id': 'b2a20b8a-8294-554b-9300-021f075da908',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA48921',
'listing': 'auction',
'make': 'Smart',
'model': 'fortwo',
'odometer': 76342,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-12-26',
'seller_name': None,
'title': 'Smart fortwo 1.0 Micro Hybrid Drive pulse',
'transmission': 'automatic',
'trim': 'Micro Hybrid Drive pulse',
'year': 2013}
2026-03-30 08:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27UA48921%27 HTTP/1.1" 200 None
2026-03-30 08:39:05 [auto1.be] INFO: Saving data for UA48921: {'auction_closing_time': 1774886218.0, 'created_time': 1774686928.061024, 'last_price_update_time': 1774859945.85711}
2026-03-30 08:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='UA48921') HTTP/1.1" 204 0
2026-03-30 08:39:05 [auto1.be] INFO: Found listing with ID: PV46198
2026-03-30 08:39:05 [auto1.be] INFO: Found listing with ID: LE69336
2026-03-30 08:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE69336%27 HTTP/1.1" 200 None
2026-03-30 08:39:05 [auto1.be] INFO: Scrape type for LE69336: 2
2026-03-30 08:39:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d24c770-d34a-5cfb-9daa-86d53d2b05a9 with identifier: LE69336
2026-03-30 08:39:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d24c770-d34a-5cfb-9daa-86d53d2b05a9 with scrape type 2
2026-03-30 08:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d24c770-d34a-5cfb-9daa-86d53d2b05a9 with scrape type 2
2026-03-30 08:39:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 3d24c770-d34a-5cfb-9daa-86d53d2b05a9, identifier: LE69336
2026-03-30 08:39:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 3d24c770-d34a-5cfb-9daa-86d53d2b05a9 with identifier: LE69336
2026-03-30 08:39:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 3d24c770-d34a-5cfb-9daa-86d53d2b05a9 with identifier: LE69336
2026-03-30 08:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 3d24c770-d34a-5cfb-9daa-86d53d2b05a9 with identifier: LE69336 to the API
2026-03-30 08:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:39:40Z',
'fuel_type': 'diesel',
'id': '3d24c770-d34a-5cfb-9daa-86d53d2b05a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE69336',
'listing': 'auction',
'make': 'Audi',
'model': 'A7 Sportback',
'odometer': 378167,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-07-01',
'seller_name': None,
'title': 'Audi A7 Sportback 3.0 V6 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2012}
2026-03-30 08:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LE69336%27 HTTP/1.1" 200 None
2026-03-30 08:39:06 [auto1.be] INFO: Saving data for LE69336: {'auction_closing_time': 1774885180.0, 'created_time': 1773920168.94634, 'last_price_update_time': 1774859946.268085}
2026-03-30 08:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LE69336') HTTP/1.1" 204 0
2026-03-30 08:39:06 [auto1.be] INFO: Channel: 24h | Page: 38 | totalHits: 1503 | hits on page: 23
2026-03-30 08:39:06 [auto1.be] INFO: Found listing with ID: RY49845
2026-03-30 08:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY49845%27 HTTP/1.1" 200 None
2026-03-30 08:39:06 [auto1.be] INFO: Scrape type for RY49845: 2
2026-03-30 08:39:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 683c5982-2d40-5e4c-8362-4eea5e187da1 with identifier: RY49845
2026-03-30 08:39:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 683c5982-2d40-5e4c-8362-4eea5e187da1 with scrape type 2
2026-03-30 08:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 683c5982-2d40-5e4c-8362-4eea5e187da1 with scrape type 2
2026-03-30 08:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 683c5982-2d40-5e4c-8362-4eea5e187da1, identifier: RY49845
2026-03-30 08:39:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 683c5982-2d40-5e4c-8362-4eea5e187da1 with identifier: RY49845
2026-03-30 08:39:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 683c5982-2d40-5e4c-8362-4eea5e187da1 with identifier: RY49845
2026-03-30 08:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 683c5982-2d40-5e4c-8362-4eea5e187da1 with identifier: RY49845 to the API
2026-03-30 08:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 185,
'expiration_date': '2026-03-30T15:17:55Z',
'fuel_type': 'petrol',
'id': '683c5982-2d40-5e4c-8362-4eea5e187da1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY49845',
'listing': 'auction',
'make': 'BMW',
'model': '4er',
'odometer': 60888,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-11-25',
'seller_name': None,
'title': 'BMW 4er 420i Gran Coupé xDrive M Sport',
'transmission': 'automatic',
'trim': 'xDrive M Sport',
'year': 2018}
2026-03-30 08:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27RY49845%27 HTTP/1.1" 200 None
2026-03-30 08:39:06 [auto1.be] INFO: Saving data for RY49845: {'auction_closing_time': 1774883875.0, 'created_time': 1774686929.340394, 'last_price_update_time': 1774859946.652797}
2026-03-30 08:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='RY49845') HTTP/1.1" 204 0
2026-03-30 08:39:06 [auto1.be] INFO: Found listing with ID: XX22473
2026-03-30 08:39:06 [auto1.be] INFO: Found listing with ID: LK52725
2026-03-30 08:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK52725%27 HTTP/1.1" 200 None
2026-03-30 08:39:06 [auto1.be] INFO: Scrape type for LK52725: 2
2026-03-30 08:39:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c709fee6-adc9-56e0-acc0-7dbae4bf1e83 with identifier: LK52725
2026-03-30 08:39:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c709fee6-adc9-56e0-acc0-7dbae4bf1e83 with scrape type 2
2026-03-30 08:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c709fee6-adc9-56e0-acc0-7dbae4bf1e83 with scrape type 2
2026-03-30 08:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: c709fee6-adc9-56e0-acc0-7dbae4bf1e83, identifier: LK52725
2026-03-30 08:39:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 08:39:06 [auto1.be] INFO: Found listing with ID: ZT87936
2026-03-30 08:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZT87936%27 HTTP/1.1" 200 None
2026-03-30 08:39:06 [auto1.be] INFO: Scrape type for ZT87936: 2
2026-03-30 08:39:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 595b3383-415b-59b6-b010-7045f09ab499 with identifier: ZT87936
2026-03-30 08:39:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 595b3383-415b-59b6-b010-7045f09ab499 with scrape type 2
2026-03-30 08:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 595b3383-415b-59b6-b010-7045f09ab499 with scrape type 2
2026-03-30 08:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 595b3383-415b-59b6-b010-7045f09ab499, identifier: ZT87936
2026-03-30 08:39:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: c709fee6-adc9-56e0-acc0-7dbae4bf1e83 with identifier: LK52725
2026-03-30 08:39:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: c709fee6-adc9-56e0-acc0-7dbae4bf1e83 with identifier: LK52725
2026-03-30 08:39:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: c709fee6-adc9-56e0-acc0-7dbae4bf1e83 with identifier: LK52725 to the API
2026-03-30 08:39:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:39:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:00:02Z',
'fuel_type': 'petrol',
'id': 'c709fee6-adc9-56e0-acc0-7dbae4bf1e83',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK52725',
'listing': 'auction',
'make': 'Opel',
'model': 'Mokka',
'odometer': 71003,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-11-05',
'seller_name': None,
'title': 'Opel Mokka 1.4 Turbo Innovation ecoFlex 4x4',
'transmission': 'manual',
'trim': 'Innovation ecoFlex 4x4',
'year': 2013}
2026-03-30 08:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27LK52725%27 HTTP/1.1" 200 None
2026-03-30 08:39:07 [auto1.be] INFO: Saving data for LK52725: {'auction_closing_time': 1774882802.0, 'created_time': 1774686934.060481, 'last_price_update_time': 1774859947.182628}
2026-03-30 08:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='LK52725') HTTP/1.1" 204 0
2026-03-30 08:39:07 [scrapy.extensions.logstats] INFO: Crawled 122 pages (at 14 pages/min), scraped 240 items (at 20 items/min)
2026-03-30 08:39:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 182MiB
2026-03-30 08:39:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 595b3383-415b-59b6-b010-7045f09ab499 with identifier: ZT87936
2026-03-30 08:39:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 595b3383-415b-59b6-b010-7045f09ab499 with identifier: ZT87936
2026-03-30 08:39:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 595b3383-415b-59b6-b010-7045f09ab499 with identifier: ZT87936 to the API
2026-03-30 08:39:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:39:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 140,
'expiration_date': '2026-03-30T15:18:15Z',
'fuel_type': 'petrol',
'id': '595b3383-415b-59b6-b010-7045f09ab499',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT87936',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 210001,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-27',
'seller_name': None,
'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Highline BlueMotion Tech',
'year': 2014}
2026-03-30 08:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZT87936%27 HTTP/1.1" 200 None
2026-03-30 08:39:07 [auto1.be] INFO: Saving data for ZT87936: {'auction_closing_time': 1774883895.0, 'created_time': 1774686947.18161, 'last_price_update_time': 1774859947.489411}
2026-03-30 08:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZT87936') HTTP/1.1" 204 0
2026-03-30 08:39:07 [auto1.be] INFO: Found listing with ID: TS84713
2026-03-30 08:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS84713%27 HTTP/1.1" 200 None
2026-03-30 08:39:07 [auto1.be] INFO: Scrape type for TS84713: 2
2026-03-30 08:39:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5305e02-626b-571c-9d4c-427af525642d with identifier: TS84713
2026-03-30 08:39:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5305e02-626b-571c-9d4c-427af525642d with scrape type 2
2026-03-30 08:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5305e02-626b-571c-9d4c-427af525642d with scrape type 2
2026-03-30 08:39:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e5305e02-626b-571c-9d4c-427af525642d, identifier: TS84713
2026-03-30 08:39:07 [auto1.be] INFO: Found listing with ID: VZ26828
2026-03-30 08:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ26828%27 HTTP/1.1" 200 None
2026-03-30 08:39:07 [auto1.be] INFO: Scrape type for VZ26828: 2
2026-03-30 08:39:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7854656e-d739-5aba-aa3a-86968c28e4be with identifier: VZ26828
2026-03-30 08:39:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7854656e-d739-5aba-aa3a-86968c28e4be with scrape type 2
2026-03-30 08:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7854656e-d739-5aba-aa3a-86968c28e4be with scrape type 2
2026-03-30 08:39:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 7854656e-d739-5aba-aa3a-86968c28e4be, identifier: VZ26828
2026-03-30 08:39:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e5305e02-626b-571c-9d4c-427af525642d with identifier: TS84713
2026-03-30 08:39:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e5305e02-626b-571c-9d4c-427af525642d with identifier: TS84713
2026-03-30 08:39:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e5305e02-626b-571c-9d4c-427af525642d with identifier: TS84713 to the API
2026-03-30 08:39:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:39:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 68,
'expiration_date': '2026-03-30T15:33:12Z',
'fuel_type': 'petrol',
'id': 'e5305e02-626b-571c-9d4c-427af525642d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS84713',
'listing': 'auction',
'make': 'Toyota',
'model': 'Aygo',
'odometer': 164241,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-08-31',
'seller_name': None,
'title': 'Toyota Aygo 1.0',
'transmission': 'manual',
'trim': '',
'year': 2008}
2026-03-30 08:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27TS84713%27 HTTP/1.1" 200 None
2026-03-30 08:39:08 [auto1.be] INFO: Saving data for TS84713: {'auction_closing_time': 1774884792.0, 'created_time': 1774686953.952962, 'last_price_update_time': 1774859948.021854}
2026-03-30 08:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='TS84713') HTTP/1.1" 204 0
2026-03-30 08:39:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 7854656e-d739-5aba-aa3a-86968c28e4be with identifier: VZ26828
2026-03-30 08:39:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 7854656e-d739-5aba-aa3a-86968c28e4be with identifier: VZ26828
2026-03-30 08:39:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 7854656e-d739-5aba-aa3a-86968c28e4be with identifier: VZ26828 to the API
2026-03-30 08:39:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:39:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:39:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 205,
'expiration_date': '2026-03-30T15:21:48Z',
'fuel_type': 'diesel',
'id': '7854656e-d739-5aba-aa3a-86968c28e4be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ26828',
'listing': 'auction',
'make': 'Volkswagen',
'model': 'T6 Transporter',
'odometer': 250776,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-03-29',
'seller_name': None,
'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten',
'transmission': 'automatic',
'trim': 'Kasten',
'year': 2017}
2026-03-30 08:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27VZ26828%27 HTTP/1.1" 200 None
2026-03-30 08:39:08 [auto1.be] INFO: Saving data for VZ26828: {'auction_closing_time': 1774884108.0, 'created_time': 1774686945.543288, 'last_price_update_time': 1774859948.291113}
2026-03-30 08:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='VZ26828') HTTP/1.1" 204 0
2026-03-30 08:39:08 [auto1.be] INFO: Found listing with ID: HY97997
2026-03-30 08:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY97997%27 HTTP/1.1" 200 None
2026-03-30 08:39:08 [auto1.be] INFO: Scrape type for HY97997: 2
2026-03-30 08:39:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e07c09c-348e-5621-9b4c-da3fc758ab99 with identifier: HY97997
2026-03-30 08:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e07c09c-348e-5621-9b4c-da3fc758ab99 with scrape type 2
2026-03-30 08:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e07c09c-348e-5621-9b4c-da3fc758ab99 with scrape type 2
2026-03-30 08:39:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 4e07c09c-348e-5621-9b4c-da3fc758ab99, identifier: HY97997
2026-03-30 08:39:08 [auto1.be] INFO: Found listing with ID: RU30240
2026-03-30 08:39:08 [auto1.be] INFO: Found listing with ID: KR16689
2026-03-30 08:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KR16689%27 HTTP/1.1" 200 None
2026-03-30 08:39:08 [auto1.be] INFO: Scrape type for KR16689: 2
2026-03-30 08:39:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 964e5527-b132-5e5b-82b9-2780fb02e37f with identifier: KR16689
2026-03-30 08:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 964e5527-b132-5e5b-82b9-2780fb02e37f with scrape type 2
2026-03-30 08:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 964e5527-b132-5e5b-82b9-2780fb02e37f with scrape type 2
2026-03-30 08:39:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 964e5527-b132-5e5b-82b9-2780fb02e37f, identifier: KR16689
2026-03-30 08:39:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 4e07c09c-348e-5621-9b4c-da3fc758ab99 with identifier: HY97997
2026-03-30 08:39:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 4e07c09c-348e-5621-9b4c-da3fc758ab99 with identifier: HY97997
2026-03-30 08:39:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 4e07c09c-348e-5621-9b4c-da3fc758ab99 with identifier: HY97997 to the API
2026-03-30 08:39:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:39:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:39:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:40:51Z',
'fuel_type': 'diesel',
'id': '4e07c09c-348e-5621-9b4c-da3fc758ab99',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY97997',
'listing': 'auction',
'make': 'Peugeot',
'model': '2008',
'odometer': 178955,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-07',
'seller_name': None,
'title': 'Peugeot 2008 1.5 Blue-HDi Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2020}
2026-03-30 08:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27HY97997%27 HTTP/1.1" 200 None
2026-03-30 08:39:08 [auto1.be] INFO: Saving data for HY97997: {'auction_closing_time': 1774885251.0, 'created_time': 1774686938.06072, 'last_price_update_time': 1774859948.783873}
2026-03-30 08:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='HY97997') HTTP/1.1" 204 0
2026-03-30 08:39:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 964e5527-b132-5e5b-82b9-2780fb02e37f with identifier: KR16689
2026-03-30 08:39:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 964e5527-b132-5e5b-82b9-2780fb02e37f with identifier: KR16689
2026-03-30 08:39:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 964e5527-b132-5e5b-82b9-2780fb02e37f with identifier: KR16689 to the API
2026-03-30 08:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 117,
'expiration_date': '2026-03-30T15:53:52Z',
'fuel_type': 'petrol',
'id': '964e5527-b132-5e5b-82b9-2780fb02e37f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR16689',
'listing': 'auction',
'make': 'Nissan',
'model': 'Juke',
'odometer': 62290,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-08-02',
'seller_name': None,
'title': 'Nissan Juke 1.6 Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2012}
2026-03-30 08:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27KR16689%27 HTTP/1.1" 200 None
2026-03-30 08:39:09 [auto1.be] INFO: Saving data for KR16689: {'auction_closing_time': 1774886032.0, 'created_time': 1774686932.349448, 'last_price_update_time': 1774859949.244332}
2026-03-30 08:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='KR16689') HTTP/1.1" 204 0
2026-03-30 08:39:09 [auto1.be] INFO: Found listing with ID: YA99172
2026-03-30 08:39:09 [auto1.be] INFO: Found listing with ID: PD03709
2026-03-30 08:39:09 [auto1.be] INFO: Found listing with ID: ZU52155
2026-03-30 08:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU52155%27 HTTP/1.1" 200 None
2026-03-30 08:39:09 [auto1.be] INFO: Scrape type for ZU52155: 2
2026-03-30 08:39:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2f34d93-eaf8-5527-b8e0-3b3f9b29f198 with identifier: ZU52155
2026-03-30 08:39:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2f34d93-eaf8-5527-b8e0-3b3f9b29f198 with scrape type 2
2026-03-30 08:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2f34d93-eaf8-5527-b8e0-3b3f9b29f198 with scrape type 2
2026-03-30 08:39:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: e2f34d93-eaf8-5527-b8e0-3b3f9b29f198, identifier: ZU52155
2026-03-30 08:39:09 [auto1.be] INFO: Found listing with ID: YV20290
2026-03-30 08:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV20290%27 HTTP/1.1" 200 None
2026-03-30 08:39:09 [auto1.be] INFO: Scrape type for YV20290: 2
2026-03-30 08:39:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dce43ba4-977e-5060-b67e-9faba728d3a9 with identifier: YV20290
2026-03-30 08:39:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dce43ba4-977e-5060-b67e-9faba728d3a9 with scrape type 2
2026-03-30 08:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dce43ba4-977e-5060-b67e-9faba728d3a9 with scrape type 2
2026-03-30 08:39:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: dce43ba4-977e-5060-b67e-9faba728d3a9, identifier: YV20290
2026-03-30 08:39:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: e2f34d93-eaf8-5527-b8e0-3b3f9b29f198 with identifier: ZU52155
2026-03-30 08:39:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: e2f34d93-eaf8-5527-b8e0-3b3f9b29f198 with identifier: ZU52155
2026-03-30 08:39:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: e2f34d93-eaf8-5527-b8e0-3b3f9b29f198 with identifier: ZU52155 to the API
2026-03-30 08:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 143,
'expiration_date': '2026-03-30T15:22:58Z',
'fuel_type': 'diesel',
'id': 'e2f34d93-eaf8-5527-b8e0-3b3f9b29f198',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU52155',
'listing': 'auction',
'make': 'BMW',
'model': 'X3',
'odometer': 184666,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-02-07',
'seller_name': None,
'title': 'BMW X3 xDrive 18d Edition Exclusive',
'transmission': 'manual',
'trim': 'Edition Exclusive',
'year': 2010}
2026-03-30 08:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27ZU52155%27 HTTP/1.1" 200 None
2026-03-30 08:39:09 [auto1.be] INFO: Saving data for ZU52155: {'auction_closing_time': 1774884178.0, 'created_time': 1774039028.863284, 'last_price_update_time': 1774859949.748021}
2026-03-30 08:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='ZU52155') HTTP/1.1" 204 0
2026-03-30 08:39:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: dce43ba4-977e-5060-b67e-9faba728d3a9 with identifier: YV20290
2026-03-30 08:39:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: dce43ba4-977e-5060-b67e-9faba728d3a9 with identifier: YV20290
2026-03-30 08:39:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: dce43ba4-977e-5060-b67e-9faba728d3a9 with identifier: YV20290 to the API
2026-03-30 08:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 131,
'expiration_date': '2026-03-30T15:24:19Z',
'fuel_type': 'diesel',
'id': 'dce43ba4-977e-5060-b67e-9faba728d3a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV20290',
'listing': 'auction',
'make': 'Citroen',
'model': 'C4 Grand Spacetourer',
'odometer': 169718,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-06',
'seller_name': None,
'title': 'Citroen C4 Grand Spacetourer 1.5 Blue-HDi Business +',
'transmission': 'manual',
'trim': 'Business +',
'year': 2019}
2026-03-30 08:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27YV20290%27 HTTP/1.1" 200 None
2026-03-30 08:39:10 [auto1.be] INFO: Saving data for YV20290: {'auction_closing_time': 1774884259.0, 'created_time': 1774686935.285926, 'last_price_update_time': 1774859950.032926}
2026-03-30 08:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='YV20290') HTTP/1.1" 204 0
2026-03-30 08:39:10 [auto1.be] INFO: Found listing with ID: HJ47401
2026-03-30 08:39:10 [auto1.be] INFO: Found listing with ID: FY94559
2026-03-30 08:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY94559%27 HTTP/1.1" 200 None
2026-03-30 08:39:10 [auto1.be] INFO: Scrape type for FY94559: 2
2026-03-30 08:39:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 603692b3-5c67-5f24-ac09-e0b8e7e230f6 with identifier: FY94559
2026-03-30 08:39:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 603692b3-5c67-5f24-ac09-e0b8e7e230f6 with scrape type 2
2026-03-30 08:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 603692b3-5c67-5f24-ac09-e0b8e7e230f6 with scrape type 2
2026-03-30 08:39:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 603692b3-5c67-5f24-ac09-e0b8e7e230f6, identifier: FY94559
2026-03-30 08:39:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 603692b3-5c67-5f24-ac09-e0b8e7e230f6 with identifier: FY94559
2026-03-30 08:39:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 603692b3-5c67-5f24-ac09-e0b8e7e230f6 with identifier: FY94559
2026-03-30 08:39:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 603692b3-5c67-5f24-ac09-e0b8e7e230f6 with identifier: FY94559 to the API
2026-03-30 08:39:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:39:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 70,
'expiration_date': '2026-03-30T15:37:57Z',
'fuel_type': 'petrol',
'id': '603692b3-5c67-5f24-ac09-e0b8e7e230f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY94559',
'listing': 'auction',
'make': 'Renault',
'model': 'Twingo',
'odometer': 86319,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-02-08',
'seller_name': None,
'title': 'Renault Twingo 1.0 SCe Energy Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2017}
2026-03-30 08:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27FY94559%27 HTTP/1.1" 200 None
2026-03-30 08:39:10 [auto1.be] INFO: Saving data for FY94559: {'auction_closing_time': 1774885077.0, 'created_time': 1773953032.544082, 'last_price_update_time': 1774859950.417642}
2026-03-30 08:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='FY94559') HTTP/1.1" 204 0
2026-03-30 08:39:10 [auto1.be] INFO: Found listing with ID: WY04920
2026-03-30 08:39:10 [auto1.be] INFO: Found listing with ID: PG64643
2026-03-30 08:39:10 [auto1.be] INFO: Found listing with ID: GF35922
2026-03-30 08:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27GF35922%27 HTTP/1.1" 200 None
2026-03-30 08:39:10 [auto1.be] INFO: Scrape type for GF35922: 0
2026-03-30 08:39:10 [auto1.be] INFO: Found listing with ID: BR73229
2026-03-30 08:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR73229%27 HTTP/1.1" 200 None
2026-03-30 08:39:10 [auto1.be] INFO: Scrape type for BR73229: 2
2026-03-30 08:39:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbb3668b-8a1a-528d-abd1-d0317422561b with identifier: BR73229
2026-03-30 08:39:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbb3668b-8a1a-528d-abd1-d0317422561b with scrape type 2
2026-03-30 08:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbb3668b-8a1a-528d-abd1-d0317422561b with scrape type 2
2026-03-30 08:39:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: cbb3668b-8a1a-528d-abd1-d0317422561b, identifier: BR73229
2026-03-30 08:39:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: cbb3668b-8a1a-528d-abd1-d0317422561b with identifier: BR73229
2026-03-30 08:39:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: cbb3668b-8a1a-528d-abd1-d0317422561b with identifier: BR73229
2026-03-30 08:39:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: cbb3668b-8a1a-528d-abd1-d0317422561b with identifier: BR73229 to the API
2026-03-30 08:39:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:39:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 150,
'expiration_date': '2026-03-30T15:19:16Z',
'fuel_type': 'diesel',
'id': 'cbb3668b-8a1a-528d-abd1-d0317422561b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR73229',
'listing': 'auction',
'make': 'Audi',
'model': 'Q2',
'odometer': 123260,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-25',
'seller_name': None,
'title': 'Audi Q2 35 TDI',
'transmission': 'automatic',
'trim': '',
'year': 2021}
2026-03-30 08:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BR73229%27 HTTP/1.1" 200 None
2026-03-30 08:39:10 [auto1.be] INFO: Saving data for BR73229: {'auction_closing_time': 1774883956.0, 'created_time': 1774686940.420679, 'last_price_update_time': 1774859950.983296}
2026-03-30 08:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BR73229') HTTP/1.1" 204 0
2026-03-30 08:39:11 [auto1.be] INFO: Found listing with ID: PV20794
2026-03-30 08:39:11 [auto1.be] INFO: Found listing with ID: BB63081
2026-03-30 08:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB63081%27 HTTP/1.1" 200 None
2026-03-30 08:39:11 [auto1.be] INFO: Scrape type for BB63081: 2
2026-03-30 08:39:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee474fd8-a289-5202-9ddb-cc5aac801ba1 with identifier: BB63081
2026-03-30 08:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee474fd8-a289-5202-9ddb-cc5aac801ba1 with scrape type 2
2026-03-30 08:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee474fd8-a289-5202-9ddb-cc5aac801ba1 with scrape type 2
2026-03-30 08:39:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: ee474fd8-a289-5202-9ddb-cc5aac801ba1, identifier: BB63081
2026-03-30 08:39:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: ee474fd8-a289-5202-9ddb-cc5aac801ba1 with identifier: BB63081
2026-03-30 08:39:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: ee474fd8-a289-5202-9ddb-cc5aac801ba1 with identifier: BB63081
2026-03-30 08:39:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: ee474fd8-a289-5202-9ddb-cc5aac801ba1 with identifier: BB63081 to the API
2026-03-30 08:39:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:39:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'engine_horse_power': 160,
'expiration_date': '2026-03-30T15:58:00Z',
'fuel_type': 'diesel',
'id': 'ee474fd8-a289-5202-9ddb-cc5aac801ba1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB63081',
'listing': 'auction',
'make': 'Renault',
'model': 'Talisman',
'odometer': 85505,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-28',
'seller_name': None,
'title': 'Renault Talisman 1.6 dCi Energy Intens',
'transmission': 'automatic',
'trim': 'Intens',
'year': 2017}
2026-03-30 08:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27BB63081%27 HTTP/1.1" 200 None
2026-03-30 08:39:11 [auto1.be] INFO: Saving data for BB63081: {'auction_closing_time': 1774886280.0, 'created_time': 1774686940.089522, 'last_price_update_time': 1774859951.404542}
2026-03-30 08:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='BB63081') HTTP/1.1" 204 0
2026-03-30 08:39:11 [auto1.be] INFO: Found listing with ID: SD89253
2026-03-30 08:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD89253%27 HTTP/1.1" 200 None
2026-03-30 08:39:11 [auto1.be] INFO: Scrape type for SD89253: 2
2026-03-30 08:39:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a5f59a8-f8ff-5e75-a341-3cc401653c6e with identifier: SD89253
2026-03-30 08:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a5f59a8-f8ff-5e75-a341-3cc401653c6e with scrape type 2
2026-03-30 08:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a5f59a8-f8ff-5e75-a341-3cc401653c6e with scrape type 2
2026-03-30 08:39:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: 8a5f59a8-f8ff-5e75-a341-3cc401653c6e, identifier: SD89253
2026-03-30 08:39:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: 8a5f59a8-f8ff-5e75-a341-3cc401653c6e with identifier: SD89253
2026-03-30 08:39:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: 8a5f59a8-f8ff-5e75-a341-3cc401653c6e with identifier: SD89253
2026-03-30 08:39:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: 8a5f59a8-f8ff-5e75-a341-3cc401653c6e with identifier: SD89253 to the API
2026-03-30 08:39:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:39:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 255,
'expiration_date': '2026-03-30T15:30:24Z',
'fuel_type': 'petrol',
'id': '8a5f59a8-f8ff-5e75-a341-3cc401653c6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD89253',
'listing': 'auction',
'make': 'Volvo',
'model': 'XC90',
'odometer': 132264,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-12',
'seller_name': None,
'title': 'Volvo XC90 2.0 T5 Momentum AWD',
'transmission': 'automatic',
'trim': 'Momentum AWD',
'year': 2017}
2026-03-30 08:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27SD89253%27 HTTP/1.1" 200 None
2026-03-30 08:39:11 [auto1.be] INFO: Saving data for SD89253: {'auction_closing_time': 1774884624.0, 'created_time': 1773995750.214786, 'last_price_update_time': 1774859951.895452}
2026-03-30 08:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='SD89253') HTTP/1.1" 204 0
2026-03-30 08:39:11 [auto1.be] INFO: Found listing with ID: SJ57770
2026-03-30 08:39:11 [auto1.be] INFO: Found listing with ID: XR93319
2026-03-30 08:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR93319%27 HTTP/1.1" 200 None
2026-03-30 08:39:11 [auto1.be] INFO: Scrape type for XR93319: 2
2026-03-30 08:39:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b62383b5-6176-5c42-be88-764430464d31 with identifier: XR93319
2026-03-30 08:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b62383b5-6176-5c42-be88-764430464d31 with scrape type 2
2026-03-30 08:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b62383b5-6176-5c42-be88-764430464d31 with scrape type 2
2026-03-30 08:39:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.be, Processed item id: b62383b5-6176-5c42-be88-764430464d31, identifier: XR93319
2026-03-30 08:39:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.be, Translating item: b62383b5-6176-5c42-be88-764430464d31 with identifier: XR93319
2026-03-30 08:39:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.be, Applying rules to item: b62383b5-6176-5c42-be88-764430464d31 with identifier: XR93319
2026-03-30 08:39:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.be, Posting item: b62383b5-6176-5c42-be88-764430464d31 with identifier: XR93319 to the API
2026-03-30 08:39:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 08:39:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 08:39:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'engine_horse_power': 90,
'expiration_date': '2026-03-30T15:34:18Z',
'fuel_type': 'petrol',
'id': 'b62383b5-6176-5c42-be88-764430464d31',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR93319',
'listing': 'auction',
'make': 'Renault',
'model': 'Captur',
'odometer': 53451,
'odometer_reading_unit': 'km',
'origin_country_code': 'BE',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-21',
'seller_name': None,
'title': 'Renault Captur 0.9 Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2016}
2026-03-30 08:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XR93319%27 HTTP/1.1" 200 None
2026-03-30 08:39:12 [auto1.be] INFO: Saving data for XR93319: {'auction_closing_time': 1774884858.0, 'created_time': 1774686934.420746, 'last_price_update_time': 1774859952.309496}
2026-03-30 08:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.be',RowKey='XR93319') HTTP/1.1" 204 0
2026-03-30 08:39:12 [auto1.be] INFO: Found listing with ID: AB98915
2026-03-30 08:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27AB98915%27 HTTP/1.1" 200 None
2026-03-30 08:39:12 [auto1.be] INFO: Scrape type for AB98915: 0
2026-03-30 08:39:12 [auto1.be] INFO: Found listing with ID: AB83336
2026-03-30 08:39:12 [auto1.be] INFO: Found listing with ID: MR34349
2026-03-30 08:39:12 [auto1.be] INFO: Found listing with ID: XL09418
2026-03-30 08:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 08:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.be%27%20and%20RowKey%20eq%20%27XL09418%27 HTTP/1.1" 200 None
2026-03-30 08:39:12 [auto1.be] INFO: Scrape type for XL09418: 0
2026-03-30 08:39:12 [auto1.be] INFO: Found listing with ID: UW48636
2026-03-30 08:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 08:39:13 [auto1.be] INFO: Channel: 24h | Page: 39 | totalHits: 1504 | hits on page: 0
2026-03-30 08:39:13 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 08:39:13 [auto1.be] INFO: auto1.be Batch config: batch 2/2
2026-03-30 08:39:13 [auto1.be] INFO: auto1.be Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 2, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 2, <ScrapeType.BATCH_SKIPPED: 5>: 4}
2026-03-30 08:39:14 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (252 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.be/task_26_2026-03-30T08_35_00.jl
2026-03-30 08:39:14 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 544061,
'downloader/request_count': 297,
'downloader/request_method_count/GET': 256,
'downloader/request_method_count/POST': 41,
'downloader/response_bytes': 60272708,
'downloader/response_count': 297,
'downloader/response_status_count/200': 297,
'dupefilter/filtered': 9,
'elapsed_time_seconds': 247.047348,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 30, 8, 39, 14, 48177, tzinfo=datetime.timezone.utc),
'item_scraped_count': 252,
'log_count/DEBUG': 5226,
'log_count/INFO': 5869,
'log_count/WARNING': 2,
'memusage/max': 191488000,
'memusage/startup': 150204416,
'photo_download_count': 174,
'request_depth_max': 42,
'response_received_count': 123,
'scheduler/dequeued': 297,
'scheduler/dequeued/memory': 297,
'scheduler/enqueued': 297,
'scheduler/enqueued/memory': 297,
'scrape_type/batch_skipped': 777,
'scrape_type/new': 40,
'scrape_type/price_update': 212,
'scrape_type/skipped': 505,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 123,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 4.978274820103667,
'scrapy-zyte-api/mean_response_seconds': 5.012105049527577,
'scrapy-zyte-api/processed': 123,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 123,
'scrapy-zyte-api/request_args/experimental.requestCookies': 122,
'scrapy-zyte-api/request_args/experimental.responseCookies': 123,
'scrapy-zyte-api/request_args/httpRequestBody': 41,
'scrapy-zyte-api/request_args/httpRequestMethod': 41,
'scrapy-zyte-api/request_args/httpResponseBody': 123,
'scrapy-zyte-api/request_args/httpResponseHeaders': 123,
'scrapy-zyte-api/request_args/sessionContext': 123,
'scrapy-zyte-api/request_args/url': 123,
'scrapy-zyte-api/status_codes/200': 123,
'scrapy-zyte-api/success': 123,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'source/items_encountered': 1543,
'source/total_available': 1504,
'start_time': datetime.datetime(2026, 3, 30, 8, 35, 7, 829, tzinfo=datetime.timezone.utc)}
2026-03-30 08:39:14 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 08:39:14 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7febdaf0a310>
2026-03-30 08:39:14 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7febdb04c290>